not able to reproduce the passkey retrieval accuracy

[zhuconv]

I have directly run instructions for python3 passkey_retrival for Llama 7B but get accuracy all zeros.

[zhuconv]

btw, i also cannot get high passkey retrieval accuracy when finishing the finetuning of llama 7B with length 8192. generally the accuracies are 0.5.

[zhuconv]

my mistake for python3 passkey_retrival for Llama 7B. the results should be right. but the problem of low accuracy for longlora-llama-7b with length 8192 remains.

[micelvrice]

my mistake for python3 passkey_retrival for Llama 7B. the results should be right.

hey, what's your mistake? i get the same result as your show

[micelvrice]

ok i find the mistake too