v0.10.7

What's Changed

• Upgrade Ray by @chainlink in #104

Full Changelog: v0.10.6...v0.10.7

v0.10.6

What's Changed

• Add input data + predictions to output file by @aittalam in #103

Full Changelog: v0.10.4...v0.10.6

v0.10.5

What's Changed

• Added S3 support for datasets, refactored asset loaders by @aittalam in #99
• New huggingface eval for the summarization use case with rouge, meteor, and bertscore by @aittalam in #100

Full Changelog: v0.10.3...v0.10.4

v0.10.3

What's Changed

• Prometheus tutorial by @aittalam in #97
• Fixed prometheus script for local demo, bumped version by @aittalam in #98

Full Changelog: v0.10.1...v0.10.3

v0.10.1

What's Changed

• Update dataset generation and storage for ragas and prometheus by @sfriedowitz in #94
• Move client inside data generator becuase its not serializable by @sfriedowitz in #95

Full Changelog: v0.9.0...v0.10.1

v0.9.0

What's Changed

• lm buddy ragas draft by @imtihan in #77
• Add prompt template capability to TextDatasetConfig by @sfriedowitz in #90
• New mechanics for handling path types by @sfriedowitz in #91
• Centralize artifact lineage creation on LMBuddy class by @sfriedowitz in #92
• Refactor module layout to separate configs and functionality by @sfriedowitz in #93

New Contributors

• @imtihan made their first contribution in #77

Full Changelog: v0.4.1...v0.9.0

v0.4.1

What's Changed

• Add ability to pass a JSON string directly to CLI by @sfriedowitz in #89

Full Changelog: v0.4.0...v0.4.1

v0.4.0

What's Changed

• Add PyPI docs by @veekaybee in #80
• Added v0 of prometheus lm-buddy entrypoint by @aittalam in #75
• Update lm-eval version and API by @veekaybee in #85
• Reinstate uv for tests by @veekaybee in #86
• Initial LMBuddy class for running jobs by @sfriedowitz in #84
• Change CLI groups to finetune and evaluate by @sfriedowitz in #87
• RD2024-147: Implement LMBuddy class as generic job runner by @sfriedowitz in #88

Full Changelog: v.0.2.8...v0.4.0

v.0.2.8

What's Changed

• Fix up epoch vs epochs in config by @chainlink in #70
• [RD2024-148] bump ray version by @chainlink in #72
• PR check to enforce version bump by @sfriedowitz in #73
• Pinning lm-harness at the git hash by @veekaybee in #76
• Bumping the library version and pinning lm-eval-harness to a PyPI Distribution by @veekaybee in #78

Full Changelog: v0.2.3...v.0.2.8

v0.2.3-rc.1

What's Changed

• Bump protobuf from 3.20.0 to 3.20.2 by @dependabot in #66
• Adding information about evaluating quantized models with GPUs by @veekaybee in #65
• Trigger publishing on releases by @sfriedowitz in #67

New Contributors

• @dependabot made their first contribution in #66

Full Changelog: v0.2.2...v0.2.3-rc.1