Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it about faster and slightly more accurate than lingua-rs? #9

Open
LeMoussel opened this issue May 24, 2023 · 4 comments
Open

Is it about faster and slightly more accurate than lingua-rs? #9

LeMoussel opened this issue May 24, 2023 · 4 comments

Comments

@LeMoussel
Copy link

LeMoussel commented May 24, 2023

Does Whichlang is about faster and slightly more accurate than lingua-rs?

Rem:
it should be noted that lingua-rss supports 75 languages compared to the 16 languages supported by whichlang

@LeMoussel LeMoussel changed the title Is it about and slightly more accurate than lingua-rs? Is it about faster and slightly more accurate than lingua-rs? May 24, 2023
@getreu
Copy link

getreu commented May 28, 2023

whatlang currently supports 68 languages.

@pemistahl
Copy link

Hi, I'm the author of lingua-rs. I've just released a new version of my library together with a detailed accuracy evaluation and performance benchmark.

  1. Yes, Whichlang needs much less processing time than Lingua. My benchmark yields the following results for determining the language of 2,000 sentences in Whichlang's 16 supported languages. Lingua is restricted to the same set of 16 languages.
Single Thread Multiple Threads
Lingua / high accuracy mode 333.31 ms 37.347 ms
Lingua / low accuracy mode 180.54 ms 24.550 ms
Whichlang 2.0458 ms 351.03 µs

  1. No, Whichlang is not more accurate than Lingua. On the contrary, Lingua still is the most accurate language detection library for Rust.

Average Detection Performance

All benchmark results are available here and here.

@LeMoussel
Copy link
Author

@pemistahl How did you limit Lingua to the same set of 16 languages?

@getreu
Copy link

getreu commented Jun 21, 2023

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants