Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix for the topic tree issues #11

Merged
merged 6 commits into from
Nov 8, 2024
Merged

Fix for the topic tree issues #11

merged 6 commits into from
Nov 8, 2024

Conversation

lukehinds
Copy link
Contributor

A fair amount of work involved, as I lost the previous code somehow. Some of main changes are repurposing the prompts, retry logic for hallucinations and the introduction of litellm

A fair amount of work involved, as I lost the previous code
somehow. Some of main changes are repurposing the prompts,
retry logic for hallucinations and the introduction of litellm
@lukehinds lukehinds requested a review from yrobla November 6, 2024 20:47
tree_degree=5, # Increase degree for more prompts
tree_depth=4, # Increase depth for more prompts
temperature=0.9, # Higher temperature for more creative variations
model_name="ollama/llama3" # Set the model name here
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

worth having as a constant or an env var that can be configured

model=self.model_name,
max_tokens=1000,
temperature=self.temperature,
base_url="http://localhost:11434",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this should be better configured as a constant/env var that you should be able to modify

Copy link
Contributor

@yrobla yrobla left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

minor comments about how to expose configurable vars

@lukehinds lukehinds merged commit de8e994 into main Nov 8, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants