New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG]: RAG with KernelMemory - #996

Open

biapar opened this issue Nov 26, 2024 · 0 comments

biapar commented Nov 26, 2024 •

edited

Loading

Description

I've this error: llama_get_logits_ith: invalid logits id 214, reason: no logits
[1] 16721 segmentation fault

Reproduction Steps

I follow this example https://scisharp.github.io/LLamaSharp/0.11.2/Examples/KernelMemorySaveAndLoad/
and use I use this model Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf

Environment & Configuration

Operating system: MacOS Sequoia
.NET runtime version: 8
LLamaSharp version: 0.19
CUDA version (if you are using cuda backend):
CPU & GPU device: Apple M2 MAX

Known Workarounds

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment