Skip to content

Equinox v0.2.2
Compare
Choose a tag to compare
@github-actions github-actions released this 15 Mar 11:25
· 751 commits to main since this release
v0.2.2
3343e84
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Added several new layers:

  • LayerNorm
  • MultiheadAttention
  • ConvTranspose, ConvTranspose1d, ConvTranspose2d, ConvTranspose3d
  • Embedding

(Thanks to @andyehrenberg for implementing much of this, and to @lucidrains for reviewing the implementation of attention.)

Autogenerated release notes as follows:

What's Changed

  • ConvTranspose layers, MultiheadAttention, lookup embeddings, LayerNorm by @andyehrenberg in #34
  • Tidied; simplified; generalised ConvTranspose implementation. by @patrick-kidger in #40
  • Attention, Transposed Convolutions, Embeddings, LayerNorm by @patrick-kidger in #38

Full Changelog: v0.2.1...v0.2.2

Contributors

lucidrains, andyehrenberg, and patrick-kidger
Assets 2
Loading