Code: Select all
Kiudee
ZZ-tune default
CPuct 1.350 2.147
FpuValue 0.228 0.443
PolicyTemperature 1.497 1.607
CPuctFactor 3.468 2.147
CPuctBase 20253 18368
and
In the last plot (Compute_CPuct), we see that the ZZ-tune is quite neutral in the region of 30 000 nodes per move (npm), gaining in importance with larger npm or TC. If I understood it, the gain from ZZ-tune, especially to larger npm (TC), is unclear. I have three matches: at about 20k npm, 100k npm and 400k npm using the last T70 net 703810 in self-play. I am using unbalanced openings and computing the correct pentanomial error margins, which are much smaller here than the naive trinomial ones shown in Cutechess-Cli. Computing the Normalized Elo too, which shows the scaling of the possible gain at different time controls or npm. The GPU is RTX 2070. The results of the three matches are here:
Code: Select all
20 000 nodes per move
Score of T70_ZZ vs T70_Kiudee: 79 - 74 - 247 [0.506] 400
... T70_ZZ playing White: 75 - 8 - 117 [0.667] 200
... T70_ZZ playing Black: 4 - 66 - 130 [0.345] 200
... White vs Black: 141 - 12 - 247 [0.661] 400
Elo difference: 4.3 +/- 21.1, LOS: 65.7 %, DrawRatio: 61.8 %
Finished match
4.3 +/- 8.5
Normalized Elo: 0.025 +/- 0.050
Low nmp, inconclusive
Code: Select all
100 000 nodes per move
Score of T70_ZZ vs T70_Kiudee: 74 - 50 - 276 [0.530] 400
... T70_ZZ playing White: 69 - 2 - 129 [0.667] 200
... T70_ZZ playing Black: 5 - 48 - 147 [0.393] 200
... White vs Black: 117 - 7 - 276 [0.637] 400
Elo difference: 20.9 +/- 18.9, LOS: 98.4 %, DrawRatio: 69.0 %
Finished match
20.9 +/- 8.04
Normalized Elo: 0.130 +/- 0.050
Large npm, conclusive
Code: Select all
400 000 nodes per move
Score of T70_ZZ vs T70_Kiudee: 23 - 13 - 64 [0.550] 100
... T70_ZZ playing White: 23 - 0 - 27 [0.730] 50
... T70_ZZ playing Black: 0 - 13 - 37 [0.370] 50
... White vs Black: 36 - 0 - 64 [0.680] 100
Elo difference: 34.9 +/- 41.1, LOS: 94.9 %, DrawRatio: 64.0 %
Finished match
34.9 +/- 14.9
Normalized Elo: 0.236 +/- 0.100
Very large npm, conclusive