Create a basic set of tools to retrieve paper information and measure its reproducibility.
To create the virtual environment from the environment.yml file, run the following commands:
conda env create -f environment.yml
conda activate RR-measurePut the API key in a file named config.yaml in the parent directory ../config.yaml of this GitHub repo. The content of the file should be like this:
elsevier_api:
api_key: your_api_key_here- 2024-10-01: Project started
- 2024-11-01: Dataset v0.1 created
- 2024-11-15: Dataset v1.0 created (10k+ papers from 2019-2024 created)
The data-sharing license is still pending, but our goal is to release the data alongside the associated preprint for this project.
API for searching paper information
API for retrieving paper information
- Try to Start It! The Challenge of Reusing Code in Robotics Research
- Get in Researchers; We're Measuring Reproducibility": A Reproducibility Study of Machine Learning Papers in Tier 1 Security Conferences.
It's a project developed under the instruction of materials from Wu et al. (2024). Views here are my own and do not represent the views of any organization.
- C. Wu, B. Ghosh, Z. Zheng, and I. Martínez, “Reproducibility in transportation research: a hands-on tutorial.” IEEE International Conference on Intelligent Transportation Systems (ITSC), 2024. Online. Available: https://www.rerite.org/itsc24-rr-tutorial/
git pull --rebase origin main
git add .
git commit -m "message"
git push origin main