You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for the great job. I am a little bit confused about eval.py. I understand the data is fetched from eval_data/popqa_longtail_w_gs.jsonl. However, I could not find an inference code to generate the results before doing the metric calculation. Is there any code missing, or am I wrong?
Thanks.
The text was updated successfully, but these errors were encountered:
Thanks for the replying. But it is not what I am looking for. I already got the json file and I want to feed it into CRAG and get the results.
Similar to pred, results, do_retrieve = generate(prompt, evidences, max_new_tokens=args.max_new_tokens,) Self-RAG:
I didn't find such generation function in your eval.py file. Could you tell me where it has been used to generate the results?
Hi authors,
Thanks for the great job. I am a little bit confused about eval.py. I understand the data is fetched from
eval_data/popqa_longtail_w_gs.jsonl
. However, I could not find an inference code to generate the results before doing the metric calculation. Is there any code missing, or am I wrong?Thanks.
The text was updated successfully, but these errors were encountered: