Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[Unreleased]

[0.1.3] - 2024-05-27

Fixed

ngram bench use counter lib's function rather than the truly used function.

Changed

Use AHash in ngram module

[0.1.2] - 2024-04-29

Changed

Implement ngram counts with a better way (#33)
Rust compute_score function signature changed to use references (#34)
Use rayon to run every prediction-references statistics calculation parallely (#38)
Use ahash for better performance (#39)

[0.1.1] - 2024-04-26

Changed

Upgrade cached version to 0.50.0 Change crate-type to ["cdylib", "rlib"]

[0.1.0] - 2024-04-23

BLEU score calculation with Tokenizer13a as default tokenizer.