Releases: lucidrains/local-attention
Releases · lucidrains/local-attention
1.7.1
add ability to configure xpos scale base
1.7.0
add ability to length extrapolate to greater local attention window s…
1.6.0
add ability to rmsnorm queries and keys, from some unpublished techni…
1.5.8
1.5.8
1.5.7
prenorm needed in local mha
1.5.6
expose local multi-head attention, for use in audiolm
1.5.5
fix mask
1.5.4
better naming
1.5.3
further cleanup, only mask out padding values if autopad is turned on…
1.5.2
makeover with einops