Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG glm4-chat的API请求,不支持流式回复吗 #1766

Open
xiaohuihuige opened this issue Jul 3, 2024 · 8 comments
Open

BUG glm4-chat的API请求,不支持流式回复吗 #1766

xiaohuihuige opened this issue Jul 3, 2024 · 8 comments
Labels
Milestone

Comments

@xiaohuihuige
Copy link
Contributor

glm4-chat的API请求,不支持流式回复吗,用着是一次性回复,能否支持流式,十分感谢

@XprobeBot XprobeBot added this to the v0.12.4 milestone Jul 3, 2024
@qinxuye
Copy link
Contributor

qinxuye commented Jul 3, 2024

哪个引擎?应该是支持流式的。

@xiaohuihuige
Copy link
Contributor Author

哪个引擎?应该是支持流式的。

Transformers

@liaotingyao
Copy link

我用的是dify,直接报错,不支持流式,也不知道怎么禁用流式。。。

@xiaohuihuige
Copy link
Contributor Author

我用的是dify,直接报错,不支持流式,也不知道怎么禁用流式。。。
我也是dify,倒没有报错,0.12.3版本,只是回答的时候是一次性回复的

@liaotingyao
Copy link

我也是0.12.3版本,dify版本是0.6.12-fix1。dify前端报错:An error occurred during streaming。
然后看到别人是可以的:
#1425

@xiaohuihuige
Copy link
Contributor Author

我也是0.12.3版本,dify版本是0.6.12-fix1。dify前端报错:An error occurred during streaming。 然后看到别人是可以的: #1425

我的dify是0.6.111

@xiaohuihuige
Copy link
Contributor Author

glm4-chat在xinference是不支持流式的,看着https请求是一次性回复,不是流式的

@XprobeBot XprobeBot modified the milestones: v0.13.0, v0.13.1 Jul 5, 2024
@XprobeBot XprobeBot modified the milestones: v0.13.1, v0.13.2 Jul 12, 2024
@XprobeBot XprobeBot modified the milestones: v0.13.2, v0.13.4 Jul 26, 2024
Copy link

github-actions bot commented Aug 6, 2024

This issue is stale because it has been open for 7 days with no activity.

@github-actions github-actions bot added the stale label Aug 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants