Skip to content

Commit

Permalink
use 4096 completion tokens as default
Browse files Browse the repository at this point in the history
  • Loading branch information
rishsriv committed Nov 13, 2024
1 parent 8954cb9 commit 98f71b6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion defog_utils/utils_multi_llm.py
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ def map_model_to_chat_fn(model: str) -> Callable:
def chat(
models,
messages,
max_completion_tokens=8192,
max_completion_tokens=4096,
temperature=0.0,
stop=[],
json_mode=False,
Expand Down

0 comments on commit 98f71b6

Please sign in to comment.