Feature/a2c benchmarks

[michele-milesi]

Summary

Describe the purpose of the pull request, including:

• Fix benchmark configs
• Update benchmark for the new version
• Add A2C benchmarks
• Replace round() with int() in replay ratio

Type of Change

Please select the one relevant option below:

• New feature (non-breaking change that adds functionality)

Checklist

Please confirm that the following tasks have been completed:

• I have tested my changes locally and they work as expected. (Please describe the tests you performed.)
• I have added unit tests for my changes, or updated existing tests if necessary.
• I have updated the documentation, if applicable.
• I have installed pre-commit and run locally for my code changes.