Skip to content

Release BigCodeBench v0.1.6

Compare
Choose a tag to compare
@terryyz terryyz released this 26 Jun 21:39
· 265 commits to main since this release

New features;

  • The RAM setup is now adjustable via specific arguments.
  • Parallel ground truth checking is supported. Potentially failed checks are skipped during execution. A warning will be issued if the ground truth pass rate falls below 0.95.