Replies: 2 comments
-
用oneapi转一层有点麻烦,还需要多起用一个服务 |
Beta Was this translation helpful? Give feedback.
0 replies
-
每个LLM的token不一样 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
功能建议:通过网关整合所有的模型到一个docker镜像里面,通过 参数"model": "XXX"来调用不同的LLM,支持对用户token的管理
Beta Was this translation helpful? Give feedback.
All reactions