Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About the details of the experiment #16

Open
aJupyter opened this issue Jun 29, 2024 · 2 comments
Open

About the details of the experiment #16

aJupyter opened this issue Jun 29, 2024 · 2 comments

Comments

@aJupyter
Copy link

Can you tell me if the ambiguous, correct, and incorrect in the ref subfolder inside the data folder in the repository are the results from the #Knowledge Preparation step, and the --upper_threshold in the inference script (run_crag_inference.sh) is 0.592 --lower_threshold 0.995 are the ones used in the main experiment of the thesis?

@HuskyInSalt
Copy link
Owner

Hi, @aJupyter ! As the empirical hyperparameters, they are different according to the benchmarks, you can refer to the experiment details that lie in the appendix of our paper for more information.

@aJupyter
Copy link
Author

aJupyter commented Jul 4, 2024

Thank you for your reply, I would also like to ask from which article the prompt used in the repository comes from? Is it consistent with self-rag?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants