Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

With billion dollars you still don't support Windows and thus we can't use CogVLM V2 on Windows! #4395

Open
FurkanGozukara opened this issue Jul 26, 2024 · 5 comments

Comments

@FurkanGozukara
Copy link

There was a guy publishing pre-compiled wheels on Windows solo but he left

Meanwhile a single person can do it you are not able to!

#2738

THUDM/CogVLM2#169

@FurkanGozukara FurkanGozukara changed the title With billion dollars you still don't support Windows support and thus we can't use CogVLM V2 on Windows! With billion dollars you still don't support Windows and thus we can't use CogVLM V2 on Windows! Jul 26, 2024
@tarunabhdutta
Copy link

tarunabhdutta commented Jul 29, 2024

Running Cogvlm 2 on windows is long overdue. This compatibility is needed asap. I request the developers to kindly look into it

@Rio77Shiina
Copy link

I'm also on the lookout for pre-compiled wheels for Windows and found this great resource by madbuda for Triton: https://huggingface.co/madbuda/triton-windows-builds

It works perfectly with my torch-2.4.0-cu121-cp311 on Windows. Thanks to him for the awesome work.

@FurkanGozukara
Copy link
Author

I'm also on the lookout for pre-compiled wheels for Windows and found this great resource by madbuda for Triton: https://huggingface.co/madbuda/triton-windows-builds

It works perfectly with my torch-2.4.0-cu121-cp311 on Windows. Thanks to him for the awesome work.

Thanks I also have Triton 2.1 pre-compiled wheel but need triton 3 :(

@thojmr
Copy link

thojmr commented Aug 5, 2024

It works perfectly with my torch-2.4.0-cu121-cp311 on Windows. Thanks to him for the awesome work.

Thanks for this. I'm generating almost exactly 25% faster tokens/second now with CogVLM.

@Puiching-Memory
Copy link

I'm also on the lookout for pre-compiled wheels for Windows and found this great resource by madbuda for Triton: https://huggingface.co/madbuda/triton-windows-builds
It works perfectly with my torch-2.4.0-cu121-cp311 on Windows. Thanks to him for the awesome work.

Thanks I also have Triton 2.1 pre-compiled wheel but need triton 3 :(

Hey!
two days ago, I found out that the authors of the repository added version 3.0 of triton, which supports python310-312

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants