Skip to content

This Python package is used for calculating ROUGE scores and supports over 100 languages by utilizing a multilingual BPE tokenizer. It leverages the mBERT tokenizer and was developed to support our work XL-HeadTags.

Notifications You must be signed in to change notification settings

faisaltareque/Multilingual-Rouge-Scorer

Repository files navigation

Multilingual ROUGE(Rouge_score) Scoring Using BPE Tokenizer

This repo extended from multilingual-rouge.

Setup from Repository

python setup.py bdist_wheel
pip install -e .

Setup from Git

pip install git+https://github.com/faisaltareque/Multilingual-Rouge-Scorer
  • Default usage
from multi_lingual_rouge_score import multi_lingual_rouge
scorer = multi_lingual_rouge.RougeScorer(['rouge1', 'rouge2', 'rougeL'], use_stemmer=True)
scores = scorer.score('The quick brown fox jumps over the lazy dog',
                          'The quick brown dog jumps on the log.')

About

This Python package is used for calculating ROUGE scores and supports over 100 languages by utilizing a multilingual BPE tokenizer. It leverages the mBERT tokenizer and was developed to support our work XL-HeadTags.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages