v0.4.0

Added

• Added support for new metrics in the Confidence Based Performance Estimator (CBPE). It now estimates roc_auc,
  f1, precision, recall, specificity and accuracy.
• Added support for multiclass classification. This includes
  • Specifying multiclass classification metadata + support in automated metadata extraction (by introducing a
    model_type parameter).
  • Support for all CBPE metrics.
  • Support for realized performance calculation using the PerformanceCalculator.
  • Support for all types of drift detection (model inputs, model output, target distribution).
  • A new synthetic toy dataset.

Changed

• Removed the identifier property from the ModelMetadata class. Joining analysis data and
  analysis target values should be done upfront or index-based.
• Added an exclude_columns parameter to the extract_metadata function. Use it to specify the columns that should
  not be considered as model metadata or features.
• All fit methods now return the fitted object. This allows chaining Calculator/Estimator instantiation
  and fitting into a single line.
• Custom metrics are no longer supported in the PerformanceCalculator. Only the predefined metrics remain supported.
• Big documentation revamp: we've tweaked overall structure, page structure and incorporated lots of feedback.
• Improvements to consistency and readability for the 'hover' visualization in the step plots, including consistent
  color usage, conditional formatting, icon usage etc.
• Improved indication of "realized" and "estimated" performance in all CBPE step plots
  (changes to hover, axes and legends)

Fixed

• Updated homepage in project metadata
• Added missing metadata modification to the quickstart
• Perform some additional check on reference data during preprocessing
• Various documentation suggestions (#58)

v0.3.2

Fixed

• Deal with out-of-time-order data when chunking (thanks for the assist @SoyGema!)
• Fix reversed Y-axis and plot labels in continuous distribution plots

v0.3.1

[skip ci] Updated CHANGELOG.md for 0.3.1

v0.3.0

Added

• Added support for both predicted labels and predicted probabilities in ModelMetadata.
• Support for monitoring model performance metrics using the PerformanceCalculator.
• Support for monitoring target distribution using the TargetDistributionCalculator

Changed

• Plotting will default to using step plots.
• Restructured the nannyml.drift package and subpackages. Breaking changes!
• Metadata completeness check will now fail when there are features of FeatureType.UNKNOWN.
• Chunk date boundaries are now calculated differently for a PeriodBasedChunker, using the
  theoretical period for boundaries as opposed to the observed boundaries within the chunk observations.
• Updated version of the black pre-commit hook due to breaking changes in its click dependency.
• The minimum chunk size will now be provided by each individual calculator / estimator / metric,
  allowing for each of them to warn the end user when chunk sizes are suboptimal.

Fixed

• Restrict version of the scipy dependency to be >=1.7.3, <1.8.0. Planned to be relaxed ASAP.
• Deal with missing values in chunks causing NaN values when concatenating.
• Crash when estimating CBPE without a target column present
• Incorrect label in ModelMetadata printout