Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update AUROC checks for CBPE and realized performance #405

Merged
merged 9 commits into from
Jul 18, 2024
Merged

Conversation

nikml
Copy link
Contributor

@nikml nikml commented Jul 9, 2024

  • All classes need to be present to fit and to calculate realized performance for a chunk.

@nikml nikml requested a review from nnansters as a code owner July 9, 2024 20:40
@nikml nikml self-assigned this Jul 9, 2024
@nikml nikml added the bug Something isn't working label Jul 9, 2024
Copy link

codecov bot commented Jul 18, 2024

Codecov Report

Attention: Patch coverage is 87.50000% with 7 lines in your changes missing coverage. Please review.

Project coverage is 77.18%. Comparing base (b25655a) to head (d353276).
Report is 5 commits behind head on main.

Files Patch % Lines
...e_calculation/metrics/multiclass_classification.py 83.33% 4 Missing ⚠️
...performance_estimation/confidence_based/metrics.py 91.30% 2 Missing ⚠️
...ml/performance_estimation/confidence_based/cbpe.py 75.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #405      +/-   ##
==========================================
+ Coverage   77.00%   77.18%   +0.18%     
==========================================
  Files         108      108              
  Lines        9300     9314      +14     
  Branches     1655     1657       +2     
==========================================
+ Hits         7161     7189      +28     
+ Misses       1677     1664      -13     
+ Partials      462      461       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@nnansters nnansters merged commit a121838 into main Jul 18, 2024
7 of 8 checks passed
@nnansters nnansters deleted the mc_auroc branch July 18, 2024 14:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants