How to Benchmark Jan 2015

The aim of this page is to execute a particular benchmark run. You must use ZKL to use this tool. This benchmark will take 1 to 2 hours to complete. You should not touch your computer during this time because any other use could cause uneven load during the benchmark.

Download this repository https://github.com/ZeroK-RTS/Benchmarks to ..\Documents\My Games\Spring\Benchmarks. To do this:

• Click "Download ZIP" (near the bottom right of the page).
• Unzip the downloaded file to ..\Documents\My Games\Spring.
• Rename the folder in "Benchmarks-master" to "Benchmarks" (found in ..\Documents\My Games\Spring).

If you have already downloaded this repository delete your old version and download it again.

Your folder tree should now contain the path ..\Documents\My Games\Spring\Benchmarks\Configs. (If you have Git then you can checkout the repository and it is assumed that you are advanced enough to figure out how to get the correct path.)

Open ZKL, click the Settings tab and then click the Benchmarker button. This window allows you to run the benchmarks. If the "Tests (mutators) to use" box is empty you've messed up.

Now we will setup the benchmarks to run. Here is what to do:

• In the "Tests (mutators) to use" box tick "caiFight.sdd".
• Select "12cai_no_plop" from the "Start script" dropdown list.
• Select "ZKL_default" from the "Config" dropdown list.
• Enter "98.0.1-353-gcae510f" into the "Engine" text box.
• Click "Add test case" 4 times.
• Enter "91.0" into the "Engine" text box.
• Click "Add test case" 4 times.
• Enter "98.0.1-360-g0fc313a" into the "Engine" text box.
• Click "Add test case" 4 times.
• Enter "98.0.1-353-gcae510f" into the "Engine" text box.
• Click "Add test case" 4 times.
• Enter "91.0" into the "Engine" text box.
• Click "Add test case" 4 times.
• Enter "98.0.1-360-g0fc313a" into the "Engine" text box.
• Click "Add test case" 4 times.

There should now be 24 lines in the "Test cases to compare" box. Click "Start" to begin the benchmarks.

Leave your computer alone for an hour or two while you wait for the benchmarks to complete. When they complete a notification will appear with the text:

"Test batch run complete, please open the graph and datasheet by pressing buttons on the left."

Click "OK" and then click "Open datasheet" to view the results. Now submit your results to the central benchmarking spreadsheet and add some information about your computer. To do this:

• Click this link https://docs.google.com/spreadsheets/d/1IVUfzZssk33qVlQEXGUINXSZbAthbryvqOZglM8ONwI/edit?usp=sharing
• Click the + in the bottom left to add a sheet.
• Right click on the new sheet and rename it to something relevant (probably your player name).
• Copy the results from the "Open datasheet" spreadsheet into the google docs sheet that you just created.
• Enter some useful information below your data. This should include processor, graphics, RAM and operating system.
• Add an account link in case you have interesting results and need to be contacted.

Post in the thread if you have issues. Spring may hang during "Loading Skirmish AIs" on the first run of an engine, if this happens force Spring to close and the benchmark will continue without that entry.