1.9.1

Full Changelog: 1.9.0a...1.9.1

1.9.0a

fix pypi

1.9.0

ability to attend to nothing for LocalMHA through gating

1.8.6

allows for turning off exact windowsize

1.8.5

make sure non-causal local attention can also support exact window sizes

1.8.4

fix bug with attention bias, thanks to @ilya16 again

1.8.2

fix when xpos is turned off

1.8.1

fix xpos with new rotary pos embedding applied on bucketed queries an…

1.8.0

add dynamic positional bias

1.7.2

follow @ilya16 suggestion and rotate positions into queries and keys …