Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ROC, Precision-Recall curves and thresholds #49

Open
al-yakubovich opened this issue Aug 3, 2020 · 2 comments
Open

ROC, Precision-Recall curves and thresholds #49

al-yakubovich opened this issue Aug 3, 2020 · 2 comments

Comments

@al-yakubovich
Copy link

Thank you for the awesome package! Just one quick question.

I want to calculate ROC curve and Precision-Recall curves so I need to get scores for multiply thresholds. aka relative importance of recall and precision ROUGE scores. Alpha -> 1 favors precision, Alpha -> 0 favors recall.
Is it possible to do with your package?

Thanks.

@pltrdy
Copy link
Owner

pltrdy commented Aug 4, 2020

Sure its possible. You can get recall and precision from this package then calculate whatever you want with it?

Also, the code would only require small update to take this alpha into account, in particular here https://github.com/pltrdy/rouge/blob/master/rouge/rouge_score.py#L292

@mdabedr
Copy link

mdabedr commented May 29, 2022

Thank you for the awesome package! Just one quick question.

I want to calculate ROC curve and Precision-Recall curves so I need to get scores for multiply thresholds. aka relative importance of recall and precision ROUGE scores. Alpha -> 1 favors precision, Alpha -> 0 favors recall. Is it possible to do with your package?

Thanks.

I also interested with this. Any ideas how this would work as precision and recall is defined in terms of classification. I am having a hard time understanding how it would transfer for summaization

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants