Skip to content

v3.1.1

Compare
Choose a tag to compare
@tina-z-jia tina-z-jia released this 06 Dec 19:40
· 3 commits to main since this release
8127b99

In this release, we made three changes:

  1. Updated ESM C tokenizer to no longer depend on ESM3. So now you can use ESM C without having to accept the ESM3 license.
  2. Updated the transformer class so it returns hidden states.
  3. Pined transformers version to be <4.47.0 to prevent a tokenizer issue. If you are currently seeing tokenizer issues, try reinstalling the new release.