v0.7.0

asafgardin released this 02 Jan 15:46

· 31 commits to main since this release

v0.7.0 (2024-01-02)

Feature

feat: Init tokenizer from filehandle (#76)
feat: allow creating JurassicTokenizer from model file handle
fix: Add default for model_path and model_file_handle
feat: Add JurassicTokenizer.from_file_path classmethod
fix: remove model_path=None in JurassicTokenizer.from_file_handle
fix: rename _assert_exactly_one to _validate_init and make it not static
refactor: semantics
test: Added tests

Co-authored-by: Asaf Gardin <[email protected]> (dcb73a7)

Assets 2