You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In ollama, the default context size is 2048, which causes long texts to be unable to track instructions.
one-api has added relevant settings in the request, but they are only effective for non-OpenAI API requests. For example: songquanpeng/one-api#1694
For applications that only support the OpenAI API, this is very inconvenient.
预期结果
It would be great if ollama's native parameter num_ctx could be supported, and ideally, it should be possible to override the existing variable directly in the settings.
The text was updated successfully, but these errors were encountered:
例行检查
问题描述
In ollama, the default context size is 2048, which causes long texts to be unable to track instructions.
one-api has added relevant settings in the request, but they are only effective for non-OpenAI API requests. For example:
songquanpeng/one-api#1694
For applications that only support the OpenAI API, this is very inconvenient.
预期结果
It would be great if ollama's native parameter num_ctx could be supported, and ideally, it should be possible to override the existing variable directly in the settings.
The text was updated successfully, but these errors were encountered: