Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor llm info #961

Merged
merged 23 commits into from
Dec 21, 2024
Merged

refactor llm info #961

merged 23 commits into from
Dec 21, 2024

Conversation

pelikhan
Copy link
Member

@pelikhan pelikhan commented Dec 19, 2024

Move LLMs inormation to own file


Pull Request Description

Key Changes

  • 🔧 Dependency Updates:

    • Updated several dependencies across package.json files, including @astrojs/starlight, astro, @inquirer/prompts, @huggingface/transformers, and esbuild, among others, to newer versions for improved stability and features.
  • 🆕 Model Aliases Enhancements:

    • Added support for defining and managing model aliases in llms.json and across CLI commands, enabling flexible alias-based model selection for large, small, vision, and reasoning models.
    • Introduced a new info models alias CLI command to display model alias mappings.
  • 🛠️ CLI Improvements:

    • Enhanced CLI commands (run, test, etc.) with additional model provider options and streamlined alias handling.
    • Refactored and modularized code for better maintainability (e.g., replaced modealias.ts with modelalias.ts).
  • 📚 Documentation Updates:

    • Fixed a typo in provider usage (mistalmistral).
    • Expanded schema definitions in llms.json to include aliases and updated documentation to reflect new alias capabilities.
  • 🧩 Feature Additions:

    • Added a new judgeClassify utility in the sample project for task classification based on predefined categories, showcasing advanced prompt usage.
  • ⚙️ Code Refactoring:

    • Consolidated default model configurations into a reusable function (defaultModelConfigurations) for consistency across runtime environments.
    • Improved handling of empty values and undefined properties in utility functions.
  • 🧪 Testing Enhancements:

    • Updated test cases to validate new CLI commands and alias functionality.
  • 🚀 Performance Improvements:

    • Optimized logit bias computation by reducing unnecessary warnings and improving verbosity control.

Summary

This PR introduces significant improvements to dependency management, CLI functionality, and model alias support, while enhancing documentation and testing. These changes streamline workflows, improve maintainability, and provide a more robust developer experience. 🚀

AI-generated content by prd may be incorrect

Copy link

LGTM 🚀

Changes look good! The change from logWarn to logVerbose is appropriate if the verbose logging level is suitable for this scenario. There are no functional issues or concerns noted in the provided diff. The change improves the log level consistency, which can be beneficial for better control and analysis of logs.

AI-generated content by pr-review may be incorrect

Copy link

Investigator report

AI-generated content by gai may be incorrect

@pelikhan pelikhan changed the title Add LLM as judge support refactor llm info Dec 20, 2024
@pelikhan pelikhan merged commit 11a12e7 into main Dec 21, 2024
14 checks passed
@pelikhan pelikhan deleted the judge branch December 21, 2024 07:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant