Key Changes
- Engine Updates:
- Added Android support for HuggingFace Tokenizers @naveen521kk in #3531
Enhancements
- [api] Use encoder/decoder for Segment anython2 translator by @frankfliu in #3487
- [api] alternative NDArray should not be closed in NDScope by @frankfliu in #3490
- [api] Adds sam2 model to onnxruntime model zoo by @frankfliu in #3492
- [api] Standardizes CV output format by @frankfliu in #3493
- [api] Visualize sam2 output for Sam2ServingTranslator by @frankfliu in #3494
- [api] Improve Sam2Translator for PyTorch traced model by @frankfliu in #3495
- [android] Update pytorch version to 2.4.0 by @xyang16 in #3474
- [tokenizers] Use tokenizers from rust.io by @xyang16 in #3476
- [rust] Remove unnecessary clone in cublaslt by @xyang16 in #3482
- [api] Makes Sam2 input consistent with other CV model by @frankfliu in #3498
- [api] Adds serving support for some CV models by @frankfliu in #3499
- HuggingFaceTokenizer: add support for Android by @naveen521kk in #3531
- [tokenizer] Updates tokenizer to 0.20.3 by @xyang16 in #3514
- [tokenizer] Updates tokenizer to 0.20.3 in libs.versions.toml by @xyang16 in #3515
- [pytorch] Adds Yolo11 model to model zoo by @xyang16 in #3516
- [pytorch] Updates PyTorch to 2.5.1 by @xyang16 in #3517
- [converter] Trim jit output token_str by @xyang16 in #3527
Bug Fixes
- [PyTorch] Fixes sam2 model version by @frankfliu in #3496
- [api] Fixes QaServingTranslator output format by @frankfliu in #3500
- [djl-convert] Fix huggingface converter by @xyang16 in #3505
Documentation
- [docs] Updates PyTorch engine README for 2.4.0 by @frankfliu in #3472
- Docs: Added a link by @operagxoksana in #3510
- [doc] Add blogposts index to docs by @xyang16 in #3519
- [doc] Add blogposts link to README by @xyang16 in #3520
- add lmi breaking changes document to docs site by @siddvenk in #3529
- Update troubleshooting.md - UnsatisfiedLinkError issue by @ThiloteE in #3512
CI/CD
- [fix][ci] configure aws creds manually to avoid node20 issues on inco… by @siddvenk in #3469
- [ci] Updates gradle to 8.10.1 by @frankfliu in #3470
- [ci] configure aws creds manually to avoid node20 issues for AL2 by @frankfliu in #3471
- [ci] Update tensorrt native build container by @xyang16 in #3477
- [ci] Fixes fasttext native build for nodejs20 issue by @xyang16 in #3478
- [ci] Fixes sentencepiece native build for nodejs20 issue by @xyang16 in #3479
- Increase build version to 0.31.0 by @xyang16 in #3475
- [mxnet] Fixes build error on JDK 22 by @frankfliu in #3485
- [ci] Fixes java 21 compile error by @frankfliu in #3497
- Delete serving publish from DJL repo by @brndysgit in #3501
- Bump com.google.protobuf:protobuf-java from 3.25.4 to 3.25.5 by @dependabot in #3502
- dependency updates for djl by @siddvenk in #3528
- Add CI for the hugging face tokenizers android by @naveen521kk in #3532
- CI: setup cargo-ndk for huggingface tokenizers android builds by @naveen521kk in #3535
- update DJL version to 0.31.0 in docs by @siddvenk in #3534
- Fix a typo in
android/tokenizer-native/build.gradle
by @naveen521kk in #3537 - fix dependency versions in examples/pom.xml by @siddvenk in #3539
- [android] fix djl version for android by @siddvenk in #3526
New Contributors
- @brndysgit made their first contribution in #3501
- @operagxoksana made their first contribution in #3510
- @ThiloteE made their first contribution in #3512
- @naveen521kk made their first contribution in #3531
Full Changelog: v0.30.0...v0.31.0