Testers already performed some first relevant tests, so I will post the scaling issue with Houdini 6 more for fun:Laskos wrote:I maybe didn't express myself properly. I try to see the scaling with time control, although the number of games will be insufficient for higher time controls. The first test was at 15''+ 0.15'', and Houdini lost, although by not that significant margin. The second test was at 60''+ 0.6'', and Houdini won, also with not that significant margin. The combined result is that on this time control span, the scaling is better for Houdini fairly significantly. 240''+ 2.4'' is probably the maximum I can get as time control with my CPU resources and time. We have to wait for FGRL results of Andreas.Lyudmil Tsvetkov wrote:oops, SF still leading by 400.5/800, a full clearly distinguished half a point, so my first thoughts SF will still outperform H might be true, though all this might be very well just statistical noise.
15''+ 0.15'':
Code: Select all
Games Completed = 400 of 400 (Avg game length = 46.830 sec)
Settings = RR/64MB/15000ms+150ms/M 600cp for 3 moves, D 120 moves/EPD:C:\LittleBlitzer\2moves_v1.epd(32000)
Time = 2709 sec elapsed, 0 sec remaining
1. Houdini 6 Pro x64-pext 191.0/400 90-108-202 (L: m=1 t=0 i=0 a=107) (D: r=137 i=25 f=8 s=4 a=28) (tpm=361.3 d=16.24 nps=1865876)
2. Stockfish 170917 64 BMI2 209.0/400 108-90-202 (L: m=0 t=0 i=0 a=90) (D: r=137 i=25 f=8 s=4 a=28) (tpm=357.2 d=18.05 nps=1547259)Code: Select all
Games Completed = 400 of 400 (Avg game length = 186.268 sec)
Settings = RR/64MB/60000ms+600ms/M 600cp for 3 moves, D 120 moves/EPD:C:\LittleBlitzer\2moves_v1.epd(32000)
Time = 10739 sec elapsed, 0 sec remaining
1. Houdini 6 Pro x64-pext 208.5/400 86-69-245 (L: m=0 t=0 i=0 a=69) (D: r=169 i=39 f=8 s=6 a=23) (tpm=1411.2 d=20.03 nps=1955285)
2. Stockfish 170917 64 BMI2 191.5/400 69-86-245 (L: m=0 t=0 i=0 a=86) (D: r=169 i=39 f=8 s=6 a=23) (tpm=1404.1 d=22.57 nps=1623147)Code: Select all
Games Completed = 400 of 400 (Avg game length = 739.790 sec)
Settings = RR/64MB/240000ms+2400ms/M 600cp for 3 moves, D 100 moves/EPD:C:\LittleBlitzer\2moves_v1.epd(32000)
Time = 42721 sec elapsed, 0 sec remaining
1. Houdini 6 Pro x64-pext 209.0/400 78-60-262 (L: m=0 t=0 i=0 a=60) (D: r=159 i=34 f=2 s=4 a=63) (tpm=5602.5 d=23.33 nps=1939138)
2. Stockfish 170917 64 BMI2 191.0/400 60-78-262 (L: m=0 t=0 i=0 a=78) (D: r=159 i=34 f=2 s=4 a=63) (tpm=5517.4 d=26.89 nps=1605486)To see the scaling, due to increasing draw rate, one has to use "Normalized ELO":
Code: Select all
Time Control Normalized ELO Standard Deviation
===========================================================
15''+ 0.15'' -0.064 0.05
60''+ 0.60'' +0.069 0.05
240''+ 2.40'' +0.077 0.05
===========================================================
[/img]