Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cohere support #145

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Cohere support #145

wants to merge 2 commits into from

Conversation

Avi-Robusta
Copy link
Contributor

To run:

export COHERE_API_KEY=...
poetry run python3 holmes.py ask "what issues does my kubernetes cluster pods have?." --model="cohere/command-r-plus"

It looks like there are some internal issues with some of litellms functions with cohere
right now this just supports model cohere/command-r-plus but other models can be included in the future by updating
get_context_window_size
get_maximum_output_token

export COHERE_API_KEY=...
poetry run python3 holmes.py ask "what issues does my kubernetes cluster pods have?." --model="cohere/command-r-plus" --json-output-file "output.json"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant