Skip to content

Commit

Permalink
Update tokenizers requirement from <0.20,>=0.10 to >=0.10,<0.22
Browse files Browse the repository at this point in the history
Updates the requirements on [tokenizers](https://github.com/huggingface/tokenizers) to permit the latest version.
- [Release notes](https://github.com/huggingface/tokenizers/releases)
- [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md)
- [Commits](huggingface/tokenizers@rust-v0.10.0...v0.21.0)

---
updated-dependencies:
- dependency-name: tokenizers
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
  • Loading branch information
dependabot[bot] authored Nov 28, 2024
1 parent 0c2c1ff commit 7cf5011
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ dependencies = [
"system_info",
"tensorboardx",
"torchmetrics >= 0.9, < 2.0",
"tokenizers >= 0.10, < 0.20",
"tokenizers >= 0.10, < 0.22",
"tomli",
"torch >= 2.0, < 2.4",
"transformers >= 4.19.0, < 4.41.0, != 4.23.0, != 4.23.1",
Expand Down

0 comments on commit 7cf5011

Please sign in to comment.