-
Notifications
You must be signed in to change notification settings - Fork 30
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
VMFB buffer access test #368
Conversation
used to be #325, which was reverted because it broke CI |
30f2a8e
to
d2128af
Compare
Compared to #325 this has 2 code changes:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should try to get it fixed for windows before merging.
8f77093
to
3d552cb
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for enabling it for Windows too.
This test mimics the kvcache indexing, reading, and writing in open-llama-3b-v2-f16.gguf.
It's a simple test to verify that shortfin can: