Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Codestral v0.1 Pytorch Wrong Resource #2588

Closed
1 of 3 tasks
danialcheung opened this issue Nov 26, 2024 · 3 comments · Fixed by #2590
Closed
1 of 3 tasks

Codestral v0.1 Pytorch Wrong Resource #2588

danialcheung opened this issue Nov 26, 2024 · 3 comments · Fixed by #2590
Milestone

Comments

@danialcheung
Copy link
Contributor

System Info / 系統信息

Irrelevant

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?

  • docker / docker
  • pip install / 通过 pip install 安装
  • installation from source / 从源码安装

Version info / 版本信息

1.0.0

The command used to start Xinference / 用以启动 xinference 的命令

xinference-local --host 0.0.0.0 --port 3000

Reproduction / 复现过程

  1. Try running: xinference launch --model-engine ${engine} --model-name codestral-v0.1 --size-in-billions 22 --model-format pytorch --quantization ${quantization}
  2. Get mistral Instruct instead

Expected behavior / 期待表现

To be able to pull from the correct URI

@XprobeBot XprobeBot added this to the v1.x milestone Nov 26, 2024
@qinxuye
Copy link
Contributor

qinxuye commented Nov 26, 2024

Thanks for pointing out, welcome to send a PR to fix it.

@danialcheung
Copy link
Contributor Author

PR sent! #2590

@qinxuye
Copy link
Contributor

qinxuye commented Nov 27, 2024

Thanks, nice work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants