New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

使用lora方案进行GLM-4-9B Chat 对话模型微调后，如何在xinference平台中加载？ #660

Open

1 of 2 tasks

xuechaofei opened this issue Nov 26, 2024 · 0 comments

xuechaofei commented Nov 26, 2024

System Info / 系統信息

操作系统centos

Who can help? / 谁可以帮助到您？

No response

Information / 问题信息

The official example scripts / 官方的示例脚本
My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程

使用lora方案进行GLM-4-9B Chat 对话模型微调,已产生checkpoint-3000目录，测试推理均正常。
在xinference平台中加载微调后的模型失败。请问如何才能将结果模型在xinference中运行

Expected behavior / 期待表现

结果模型在xinference中运行

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment