Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add preliminary code for Weighted CP and CoDrug #227

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

siddharthal
Copy link

@siddharthal siddharthal commented Oct 2, 2023

Preliminary code for Weighted Conformal Prediction.

Main changes anticipated: Supported for Weighted Conformal Prediciton for both Classification and Regression.
Reference papers:

Conformal Prediction under Covariate shift: https://arxiv.org/abs/1904.06019
Locally Valid and Discriminative Prediction Intervals for Deep Learning Models: https://arxiv.org/abs/2106.00225
CoDrug: Conformal Drug Property Prediction and Density Estimation under Covariate Shift.

Current status of the PR:

  • includes a base class for general Weighted CP.
  • includes functionality for weighted CP using KDE, as suggested by CoDrug.
  • Includes support for multi-class classification with an example

Anticipated changes:

  • Add support for feature extraction from NN models
  • Add support for LVD
  • Add support for regression
  • Refactoring and organizing of the code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant