Skip to content

Latest commit

 

History

History
239 lines (216 loc) · 20.2 KB

03-round1-results.md

File metadata and controls

239 lines (216 loc) · 20.2 KB

Previous post | Next post

Results of Round 1

First of all, we are sorry for the delay. We received as many as 186 solutions, and because the size of a full tournament grows quadratically with the number of participants, the testing took longer than we had expected. Thank you for the amazing participation, as well as for your patience.

All participating solutions are now published in the submissions directory. There, solution.js is the script we tested, and the src directory contains the contents of the sources archive, if the participant attached one. Only the last solution from each participant is published and tested.

The names of the participants (or nicknames for those who prefer that) will be published along with the results of the finals. Until then, we only display submission IDs here. You can find your submission ID in the email you received after submitting your solution.

Seeds

As promised, we took the first tweet that @SpringerTV has written after the submission deadline, and put it into the previously published script the seed sequence. The script with the tweet inserted, that produces 500 seeds for round 1 and 500 seeds for the finals, is now published as seeds.js.

The first 500 odd-numbered seeds have been used for round 1. You can find them in round1.txt.

The first 500 even-numbered seeds are now being used for the finals. They are published as finals.txt.

Statistics

Testing every ordered pair of distinct solutions out of the pool of 186 makes 34,410 sessions per seed. For 500 seeds, this resulted in 17,205,000 sessions. Each solution was tested in 185,000 sessions.

13,868,284 sessions (80.6%) resulted in an agreement. The average payout was 5.8728 per session, or 7.2858 per agreement.

626,779 sessions (3.64%) were aborted for various reasons (invalid offers, exceptions, timeouts).

Raw logs

The full logs of all 17,205,000 sessions of round 1 are published as an archive (2.1 GB). A session's log is stored in the archive as S/A-B.json, where S is the seed, A is the solution ID of the first participant, and B is the solution ID of the second participant.

You can use haggle.js --replay=LOG.json to “replay” a session log as human-readable text.

Finals

According to the rules we published earlier, no more than 50 solutions are going to participate in the finals. This time, no copies of example.js were among the participating solutions, but because in the preliminary testing that script achieved an average score of 5.29, it's obvious that it wouldn't have been anywhere near the top 50 in round 1.

Therefore, the top 50 solutions from the table below are going to compete in the finals. They will be run pairwise on additional 500 seeds. Together with the sessions they already had with each other in round 1, 1000 seeds will decide the final standings among the finalists.

The final results will be published on August 20, 2018.

Scores

Legend:

  • S: Total score (this is what the competition is about)
  • S/N: Average score per session
  • A: Number of sessions where an agreement has been reached
  • A/N: Number of agreements as a percentage of the number of sessions
  • S/A: Average score per session where an agreement has been reached
  • X: Number of sessions aborted by the solution (exceptions, incorrect output)
# ID S S/N A A/N S/A X
1 5b64926eadb0280402fd77b4 1242729 6.7175 168160 90.90% 7.39 0
2 5b62eddaadb0280402fd7766 1241689 6.7118 161960 87.55% 7.67 0
3 5b60c8b3adb0280402fd7746 1232693 6.6632 168807 91.25% 7.30 0
4 5b6194d9adb0280402fd774d 1228286 6.6394 163729 88.50% 7.50 0
5 5b5f34a0adb0280402fd7704 1222043 6.6056 156877 84.80% 7.79 0
6 5b6194f3adb0280402fd774e 1221842 6.6046 167159 90.36% 7.31 0
7 5b6194a3adb0280402fd774c 1220300 6.5962 164244 88.78% 7.43 0
8 5b6061cdadb0280402fd773e 1217623 6.5817 155087 83.83% 7.85 0
9 5b622468adb0280402fd775c 1216153 6.5738 162361 87.76% 7.49 0
10 5b64ebedadb0280402fd77f5 1215855 6.5722 172233 93.10% 7.06 0
11 5b64e876adb0280402fd77ed 1215650 6.5711 156973 84.85% 7.74 0
12 5b5f56d9adb0280402fd771b 1213074 6.5572 170422 92.12% 7.12 0
13 5b640864adb0280402fd777d 1212846 6.5559 173505 93.79% 6.99 0
14 5b64909cadb0280402fd77b0 1212082 6.5518 159784 86.37% 7.59 0
15 5b60e006adb0280402fd7749 1209533 6.5380 164366 88.85% 7.36 0
16 5b644603adb0280402fd7781 1207516 6.5271 171379 92.64% 7.05 0
17 5b64e7f2adb0280402fd77ea 1207365 6.5263 164451 88.89% 7.34 0
18 5b63b9efadb0280402fd7779 1206329 6.5207 153901 83.19% 7.84 0
19 5b61aac7adb0280402fd774f 1204758 6.5122 158147 85.48% 7.62 0
20 5b61b487adb0280402fd7751 1204244 6.5094 161781 87.45% 7.44 0
21 5b64e9e0adb0280402fd77f0 1202516 6.5001 166923 90.23% 7.20 0
21 5b64cb2dadb0280402fd77d8 1202516 6.5001 155516 84.06% 7.73 0
23 5b6449d4adb0280402fd7789 1202350 6.4992 160446 86.73% 7.49 0
24 5b61f95fadb0280402fd7754 1201136 6.4926 164419 88.88% 7.31 0
25 5b646019adb0280402fd779c 1199999 6.4865 164806 89.08% 7.28 0
26 5b64eb06adb0280402fd77f3 1198648 6.4792 161866 87.50% 7.41 0
27 5b64e7baadb0280402fd77e8 1197826 6.4747 160990 87.02% 7.44 0
28 5b605be4adb0280402fd773b 1197098 6.4708 157071 84.90% 7.62 0
29 5b64e225adb0280402fd77e6 1196140 6.4656 164667 89.01% 7.26 0
30 5b59906f28c8422305e8e9c8 1195917 6.4644 158787 85.83% 7.53 0
31 5b646257adb0280402fd779e 1194327 6.4558 169730 91.75% 7.04 0
32 5b5f7b9dadb0280402fd7725 1192591 6.4464 162956 88.08% 7.32 0
33 5b622c6aadb0280402fd775e 1192359 6.4452 157732 85.26% 7.56 0
34 5b6493acadb0280402fd77b7 1190609 6.4357 159763 86.36% 7.45 0
35 5b64eaabadb0280402fd77f2 1188520 6.4244 158991 85.94% 7.48 0
36 5b64575dadb0280402fd7794 1188155 6.4225 158872 85.88% 7.48 0
37 5b5fb68eadb0280402fd772a 1187351 6.4181 166959 90.25% 7.11 4630
38 5b5f31dbadb0280402fd7700 1184252 6.4014 163096 88.16% 7.26 0
39 5b64e9c6adb0280402fd77ef 1183945 6.3997 155673 84.15% 7.61 0
40 5b64ba5badb0280402fd77cd 1183798 6.3989 157075 84.91% 7.54 0
41 5b64ec4fadb0280402fd77f7 1182447 6.3916 153710 83.09% 7.69 0
42 5b5f3ddaadb0280402fd770d 1182173 6.3901 152178 82.26% 7.77 0
43 5b632514adb0280402fd776f 1181898 6.3886 156761 84.74% 7.54 0
44 5b606e98adb0280402fd7740 1181089 6.3843 170155 91.98% 6.94 273
45 5b64ec01adb0280402fd77f6 1180880 6.3831 153380 82.91% 7.70 0
46 5b649223adb0280402fd77b3 1178540 6.3705 154386 83.45% 7.63 0
47 5b63bb43adb0280402fd777a 1178251 6.3689 165301 89.35% 7.13 0
48 5b62f0c6adb0280402fd7767 1178162 6.3684 174960 94.57% 6.73 0
49 5b5f61ccadb0280402fd771c 1177895 6.3670 163667 88.47% 7.20 0
50 5b64acd3adb0280402fd77c4 1177722 6.3661 161319 87.20% 7.30 0
51 5b649339adb0280402fd77b5 1177398 6.3643 152701 82.54% 7.71 0
52 5b6205d9adb0280402fd7756 1177345 6.3640 172260 93.11% 6.83 0
53 5b62f937adb0280402fd776a 1175879 6.3561 156326 84.50% 7.52 0
54 5b635a9eadb0280402fd7774 1175500 6.3541 167153 90.35% 7.03 5
55 5b620112adb0280402fd7755 1174931 6.3510 165356 89.38% 7.11 0
56 5b609808adb0280402fd7743 1174282 6.3475 169619 91.69% 6.92 0
57 5b64c121adb0280402fd77d4 1173430 6.3429 161429 87.26% 7.27 0
58 5b64b128adb0280402fd77c8 1172056 6.3354 159060 85.98% 7.37 0
59 5b64cbc4adb0280402fd77db 1172051 6.3354 169435 91.59% 6.92 0
60 5b645fcfadb0280402fd779b 1171860 6.3344 169417 91.58% 6.92 0
61 5b5f36f6adb0280402fd7707 1171148 6.3305 158764 85.82% 7.38 0
62 5b5f368eadb0280402fd7705 1171071 6.3301 151128 81.69% 7.75 0
63 5b648f06adb0280402fd77af 1169587 6.3221 159406 86.17% 7.34 0
64 5b64d6a6adb0280402fd77df 1168919 6.3185 159294 86.10% 7.34 0
65 5b5f3334adb0280402fd7701 1168882 6.3183 153660 83.06% 7.61 17
66 5b645263adb0280402fd7790 1168491 6.3162 174827 94.50% 6.68 0
67 5b60066badb0280402fd7730 1167646 6.3116 153285 82.86% 7.62 0
68 5b646d65adb0280402fd77a1 1167609 6.3114 158502 85.68% 7.37 0
69 5b605f98adb0280402fd773c 1165335 6.2991 153299 82.86% 7.60 0
70 5b644b20adb0280402fd778a 1164697 6.2957 162387 87.78% 7.17 0
71 5b64e93badb0280402fd77ee 1162737 6.2851 152222 82.28% 7.64 0
72 5b64da77adb0280402fd77e1 1161902 6.2806 158772 85.82% 7.32 0
73 5b5f535fadb0280402fd771a 1161529 6.2785 167699 90.65% 6.93 0
74 5b5f783dadb0280402fd7724 1160215 6.2714 161206 87.14% 7.20 0
75 5b5f48a3adb0280402fd7714 1159033 6.2650 173637 93.86% 6.68 0
76 5b64ea06adb0280402fd77f1 1158476 6.2620 174139 94.13% 6.65 0
77 5b64d77cadb0280402fd77e0 1158424 6.2618 160602 86.81% 7.21 0
78 5b5f3a75adb0280402fd7708 1157288 6.2556 152569 82.47% 7.59 0
79 5b64a625adb0280402fd77c1 1156074 6.2490 166383 89.94% 6.95 0
80 5b64466dadb0280402fd7785 1156044 6.2489 168411 91.03% 6.86 0
81 5b647497adb0280402fd77a5 1154194 6.2389 145050 78.41% 7.96 0
82 5b649b2eadb0280402fd77ba 1152820 6.2315 158599 85.73% 7.27 0
83 5b63728aadb0280402fd7777 1148881 6.2102 159210 86.06% 7.22 0
84 5b60c2aeadb0280402fd7745 1148472 6.2080 162252 87.70% 7.08 0
85 5b64828fadb0280402fd77aa 1148350 6.2073 152330 82.34% 7.54 0
86 5b5f319badb0280402fd76fd 1147845 6.2046 167767 90.68% 6.84 0
87 5b646e67adb0280402fd77a2 1145924 6.1942 157670 85.23% 7.27 0
88 5b60d89dadb0280402fd7748 1144334 6.1856 160030 86.50% 7.15 0
89 5b644963adb0280402fd7788 1144157 6.1846 146680 79.29% 7.80 16
90 5b648504adb0280402fd77ab 1143273 6.1799 170092 91.94% 6.72 0
91 5b6495abadb0280402fd77b9 1139958 6.1619 160199 86.59% 7.12 0
92 5b649b72adb0280402fd77bb 1139859 6.1614 154886 83.72% 7.36 0
93 5b647889adb0280402fd77a7 1136690 6.1443 142316 76.93% 7.99 0
94 5b6493ebadb0280402fd77b8 1136008 6.1406 152490 82.43% 7.45 122
95 5b5f7000adb0280402fd7721 1135678 6.1388 138134 74.67% 8.22 0
96 5b64800cadb0280402fd77a9 1134302 6.1314 157296 85.02% 7.21 0
97 5b61b994adb0280402fd7752 1133800 6.1286 169210 91.46% 6.70 0
98 5b64582fadb0280402fd7795 1132839 6.1235 160600 86.81% 7.05 0
99 5b602781adb0280402fd7738 1131947 6.1186 138402 74.81% 8.18 0
100 5b6312cfadb0280402fd776d 1130084 6.1086 141971 76.74% 7.96 0
101 5b64eb6dadb0280402fd77f4 1129117 6.1033 143072 77.34% 7.89 0
102 5b5f31b6adb0280402fd76fe 1128923 6.1023 138257 74.73% 8.17 0
103 5b64935badb0280402fd77b6 1125786 6.0853 153657 83.06% 7.33 0
104 5b5f2d45adb0280402fd76f7 1125722 6.0850 144804 78.27% 7.77 0
105 5b5f7d33adb0280402fd7726 1125451 6.0835 153232 82.83% 7.34 0
106 5b5f6de7adb0280402fd7720 1125027 6.0812 176607 95.46% 6.37 0
107 5b5f4f0cadb0280402fd7716 1124888 6.0805 176175 95.23% 6.39 0
108 5b615af3adb0280402fd774a 1124228 6.0769 148565 80.31% 7.57 0
109 5b60aa52adb0280402fd7744 1124011 6.0757 149386 80.75% 7.52 0
110 5b645609adb0280402fd7792 1122985 6.0702 181532 98.13% 6.19 0
111 5b61f2c2adb0280402fd7753 1122402 6.0670 143796 77.73% 7.81 0
112 5b64a2e3adb0280402fd77c0 1120801 6.0584 162029 87.58% 6.92 0
113 5b64bddfadb0280402fd77cf 1119910 6.0536 144932 78.34% 7.73 0
114 5b5f36b1adb0280402fd7706 1119589 6.0518 160207 86.60% 6.99 0
115 5b637fdfadb0280402fd7778 1115764 6.0312 150246 81.21% 7.43 0
116 5b607d5eadb0280402fd7741 1115717 6.0309 147281 79.61% 7.58 0
117 5b648891adb0280402fd77ad 1115071 6.0274 174592 94.37% 6.39 0
118 5b5f4185adb0280402fd770f 1113934 6.0213 146593 79.24% 7.60 0
119 5b5f2dd5adb0280402fd76f9 1112158 6.0117 136831 73.96% 8.13 0
120 5b5fcebaadb0280402fd772c 1112061 6.0111 136434 73.75% 8.15 0
121 5b64c0f5adb0280402fd77d3 1111146 6.0062 170454 92.14% 6.52 0
122 5b6016a7adb0280402fd7737 1108742 5.9932 155886 84.26% 7.11 0
123 5b64ec78adb0280402fd77f8 1107358 5.9857 155870 84.25% 7.10 1446
124 5b6214c7adb0280402fd7757 1106655 5.9819 152046 82.19% 7.28 0
125 5b648ef2adb0280402fd77ae 1102864 5.9614 141448 76.46% 7.80 0
126 5b644656adb0280402fd7782 1101407 5.9536 154763 83.66% 7.12 34
127 5b64ba6aadb0280402fd77ce 1098566 5.9382 149625 80.88% 7.34 0
128 5b630ae9adb0280402fd776c 1097870 5.9344 137883 74.53% 7.96 0
129 5b605fe8adb0280402fd773d 1095701 5.9227 153262 82.84% 7.15 0
130 5b5f5017adb0280402fd7717 1093110 5.9087 173814 93.95% 6.29 0
131 5b60d05dadb0280402fd7747 1091374 5.8993 126675 68.47% 8.62 0
132 5b5f2d3eadb0280402fd76f6 1085887 5.8697 152689 82.53% 7.11 8488
133 5b64b9a8adb0280402fd77cc 1084489 5.8621 178883 96.69% 6.06 0
134 5b64b8cfadb0280402fd77cb 1082286 5.8502 140595 76.00% 7.70 0
135 5b6368e3adb0280402fd7776 1079983 5.8377 164047 88.67% 6.58 0
136 5b5f86acadb0280402fd7729 1078046 5.8273 139978 75.66% 7.70 0
137 5b64910fadb0280402fd77b1 1074088 5.8059 137436 74.29% 7.82 0
138 5b64c086adb0280402fd77d2 1073602 5.8033 132592 71.67% 8.10 0
139 5b634809adb0280402fd7771 1071717 5.7931 144122 77.90% 7.44 0
140 5b649190adb0280402fd77b2 1068352 5.7749 135775 73.39% 7.87 0
141 5b6459b7adb0280402fd7798 1067409 5.7698 141710 76.60% 7.53 0
142 5b647a53adb0280402fd77a8 1063341 5.7478 140598 76.00% 7.56 0
143 5b6456e6adb0280402fd7793 1062601 5.7438 129435 69.96% 8.21 0
144 5b645d41adb0280402fd779a 1054358 5.6992 129245 69.86% 8.16 0
145 5b645b9cadb0280402fd7799 1045647 5.6521 138340 74.78% 7.56 0
146 5b634872adb0280402fd7772 1045429 5.6510 132729 71.75% 7.88 0
147 5b64aab6adb0280402fd77c3 1045086 5.6491 148990 80.54% 7.01 0
148 5b6458adadb0280402fd7797 1044890 5.6481 124719 67.42% 8.38 0
149 5b64cbc2adb0280402fd77da 1044541 5.6462 137603 74.38% 7.59 0
150 5b6038abadb0280402fd773a 1043975 5.6431 172455 93.22% 6.05 0
151 5b644660adb0280402fd7784 1043214 5.6390 125105 67.62% 8.34 0
152 5b64e05aadb0280402fd77e5 1040107 5.6222 172006 92.98% 6.05 0
153 5b64588eadb0280402fd7796 1039128 5.6169 132073 71.39% 7.87 0
154 5b5f3c6eadb0280402fd7709 1035270 5.5961 136774 73.93% 7.57 0
155 5b645609adb0280402fd7791 1018337 5.5045 181812 98.28% 5.60 0
156 5b6061dbadb0280402fd773f 1006254 5.4392 119932 64.83% 8.39 0
157 5b644737adb0280402fd7787 990692 5.3551 163090 88.16% 6.07 0
158 5b64505cadb0280402fd778d 985762 5.3284 139369 75.33% 7.07 0
159 5b64465fadb0280402fd7783 984195 5.3200 181472 98.09% 5.42 0
160 5b621541adb0280402fd7758 981510 5.3055 129531 70.02% 7.58 0
161 5b5ba4dd28c8422305e8ea44 977419 5.2833 122326 66.12% 7.99 0
162 5b64c75aadb0280402fd77d6 959900 5.1886 116630 63.04% 8.23 0
163 5b644bd0adb0280402fd778b 959515 5.1866 106831 57.75% 8.98 364
164 5b64a253adb0280402fd77bf 953917 5.1563 153238 82.83% 6.23 8
165 5b6010ccadb0280402fd7735 953713 5.1552 176549 95.43% 5.40 0
166 5b6356daadb0280402fd7773 948100 5.1249 165353 89.38% 5.73 0
167 5b62ec7badb0280402fd7765 939662 5.0793 108042 58.40% 8.70 0
168 5b64a04eadb0280402fd77bc 930869 5.0317 137444 74.29% 6.77 2462
169 5b64afbbadb0280402fd77c7 921645 4.9819 158768 85.82% 5.80 0
170 5b5fd9dfadb0280402fd772d 920335 4.9748 160984 87.02% 5.72 6033
171 5b642a80adb0280402fd777e 905546 4.8948 102427 55.37% 8.84 0
172 5b64aebbadb0280402fd77c6 901665 4.8739 99526 53.80% 9.06 0
173 5b64767cadb0280402fd77a6 848228 4.5850 93249 50.40% 9.10 0
174 5b64c00badb0280402fd77d0 840401 4.5427 127536 68.94% 6.59 8321
175 5b64a95cadb0280402fd77c2 836861 4.5236 94376 51.01% 8.87 0
176 5b5f4a5badb0280402fd7715 833259 4.5041 86866 46.95% 9.59 0
177 5b5f2f46adb0280402fd76fb 818451 4.4241 129428 69.96% 6.32 0
178 5b5f5315adb0280402fd7719 791037 4.2759 82345 44.51% 9.61 0
179 5b646255adb0280402fd779d 746529 4.0353 100860 54.52% 7.40 59432
180 5b6446adadb0280402fd7786 720138 3.8926 153560 83.01% 4.69 0
181 5b5f722fadb0280402fd7722 639048 3.4543 139696 75.51% 4.57 0
182 5b633aeaadb0280402fd7770 503494 2.7216 56723 30.66% 8.88 0
183 5b618a29adb0280402fd774b 326159 1.7630 38342 20.73% 8.51 0
184 5b645177adb0280402fd778f 113192 0.6118 13185 7.13% 8.58 170626
185 5b647124adb0280402fd77a3 35169 0.1901 3612 1.95% 9.74 180128
186 5b64722eadb0280402fd77a4 0 0.0000 0 0.00% n/a 184374