Houdini 4, Stockfish-DD, Komodo-TCEC: EGTBs on and off

[RJN]

40 moves in 5 minutes, repeating
Round Robin
Hash=512
Ponder off
No Book
All Tablebases on SSD
Syzgy bases are 6-piece, Gaviota 5-piece.
Threads=2, no Hyperthreading.
All are 64 bit SSE4.2 engines

Results so far:

EloStat Start Elo=0

401 games

12/8/2013 9:17:50 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_4_Pro_x64B-Syzygy : 63 59 59 81 59.9 % -7 40.7 %
2 Houdini_4_Pro_x64B-Gaviota : 28 54 53 80 54.4 % -2 51.2 %
3 Stockfish-DD-64-PA_Gaviota : 20 52 52 80 53.1 % -2 53.8 %
4 Stockfish_DD_64_modern : 20 52 52 80 53.1 % -2 53.8 %
5 Komodo-TCEC-64bit : 12 58 58 80 51.9 % -1 43.8 %
6 Komodo6-64bit : 4 51 51 80 50.6 % -1 56.2 %
7 Houdini_4_Pro_x64B-None : -4 54 54 80 49.4 % 0 51.2 %
8 Houdini_3_Pro_x64-Gaviota : -27 54 54 81 45.7 % 3 49.4 %
9 Stockfish_DD_Syzygy_13112921 : -28 49 49 80 45.6 % 3 58.8 %
10 Houdini_3_Pro-None : -88 61 62 80 36.2 % 10 37.5 %

[Ryan Benitez]

There is also a robbo bases version of Stockfish call ComStock.
http://ippolit.wikispaces.com/file/deta ... 8b.tar.bz2
It might be interesting to compare with the others.

[Graham Banks]

There is also a robbo bases version of Stockfish call ComStock.
http://ippolit.wikispaces.com/file/deta ... 8b.tar.bz2
It might be interesting to compare with the others.

Does it comply with the GPL?

[Ryan Benitez]

There is also a robbo bases version of Stockfish call ComStock.
http://ippolit.wikispaces.com/file/deta ... 8b.tar.bz2
It might be interesting to compare with the others.

Does it comply with the GPL?

Yes

[RJN]

Hi Ryan

With 10 engines competing, and about 50 games per day on average in a Round Robin tournament, it will take me some time to get the error bars down. Maybe in the future I can add ComStock.

[RJN]

476 games

12/10/2013 2:05:46 AM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_4_Pro_x64B-Syzygy : 64 52 51 95 60.0 % -6 46.3 %
2 Houdini_4_Pro_x64B-Gaviota : 24 47 47 95 53.7 % -2 54.7 %
3 Komodo-TCEC-64bit : 16 51 50 95 52.6 % -3 48.4 %
4 Stockfish-DD-64-PA_Gaviota : 14 46 45 95 52.1 % -1 57.9 %
5 Stockfish_DD_64_modern : 10 46 46 95 51.6 % -1 56.8 %
6 Komodo6-64bit : 6 44 44 95 51.1 % -1 60.0 %
7 Houdini_4_Pro_x64B-None : -3 47 47 96 49.5 % 0 55.2 %
8 Stockfish_DD_Syzygy_13112921 : -19 45 46 95 46.8 % 3 57.9 %
9 Houdini_3_Pro_x64-Gaviota : -26 47 48 96 45.8 % 3 54.2 %
10 Houdini_3_Pro-None : -85 52 53 95 36.8 % 9 44.2 %

[RJN]

PGN link:

https://www.sugarsync.com/pf/D0094094_75971673_786554

555 games

12/11/2013 6:43:38 AM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_4_Pro_x64B-Syzygy : 43 46 46 111 56.8 % -4 50.5 %
2 Houdini_4_Pro_x64B-Gaviota : 23 42 42 111 53.6 % -2 58.6 %
3 Stockfish-DD-64-PA_Gaviota : 15 41 40 111 52.3 % -1 61.3 %
4 Stockfish_DD_64_modern : 14 44 44 111 52.3 % -2 54.1 %
5 Komodo-TCEC-64bit : 11 45 45 111 51.8 % -1 51.4 %
6 Stockfish_DD_Syzygy_13112921 : -2 41 41 111 49.5 % 1 59.5 %
7 Komodo6-64bit : -3 41 41 111 49.5 % -0 59.5 %
8 Houdini_4_Pro_x64B-None : -6 44 44 111 49.1 % 0 55.0 %
9 Houdini_3_Pro_x64-Gaviota : -22 43 43 111 46.4 % 3 56.8 %
10 Houdini_3_Pro-None : -72 47 48 111 38.7 % 8 46.8 %

[RJN]

Komodo-TCEC has been updated, but I had not see any instances of the "FEN Castling Bug" with Arena 3.0 (maybe also since there is no book being used). Komodo-TCEC results from before the update have been retained.

PGN link:

https://www.sugarsync.com/pf/D0094094_75971673_790576

668 games

12/12/2013 10:04:18 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_4_Pro_x64B-Syzygy : 45 41 41 134 57.1 % -5 51.5 %
2 Stockfish_DD_64_modern : 19 39 39 134 53.0 % -2 56.7 %
3 Houdini_4_Pro_x64B-Gaviota : 17 38 38 133 52.6 % -1 58.6 %
4 Komodo-TCEC-64bit : 16 41 41 133 52.6 % -2 52.6 %
5 Stockfish-DD-64-PA_Gaviota : 8 37 37 133 51.1 % -0 60.2 %
6 Houdini_4_Pro_x64B-None : -0 38 38 134 50.0 % -0 58.2 %
7 Stockfish_DD_Syzygy_13112921 : -2 38 38 134 49.6 % 0 59.0 %
8 Komodo6-64bit : -7 38 38 134 48.9 % 1 59.0 %
9 Houdini_3_Pro_x64-Gaviota : -21 38 38 134 46.6 % 2 59.0 %
10 Houdini_3_Pro-None : -74 42 42 133 38.3 % 8 49.6 %

[RJN]

815 games

12/15/2013 1:13:04 AM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_4_Pro_x64B-Syzygy : 47 37 37 163 57.4 % -5 52.1 %
2 Komodo-TCEC-64bit : 16 37 36 163 52.5 % -2 53.4 %
3 Stockfish_DD_64_modern : 14 35 35 163 52.1 % -1 56.4 %
4 Houdini_4_Pro_x64B-Gaviota : 14 34 34 163 52.1 % -1 60.1 %
5 Houdini_4_Pro_x64B-None : 13 35 35 163 52.1 % -2 57.7 %
6 Stockfish-DD-64-PA_Gaviota : 4 34 34 163 50.6 % -0 60.7 %
7 Stockfish_DD_Syzygy_13112921 : 0 34 34 163 50.0 % 0 59.5 %
8 Komodo6-64bit : -4 35 35 163 49.4 % 0 58.3 %
9 Houdini_3_Pro_x64-Gaviota : -27 34 34 163 45.7 % 3 59.5 %
10 Houdini_3_Pro-None : -76 37 37 163 38.0 % 9 51.5 %

[RJN]

Configuration note: Houdini Contempt and Komodo DrawScore has been at 0 for all engines during this tournament, since the start.

PGN link:

https://www.sugarsync.com/pf/D0094094_75971673_709565

900 games

12/16/2013 5:29:42 AM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_4_Pro_x64B-Syzygy : 44 35 34 180 56.9 % -5 53.9 %
2 Houdini_4_Pro_x64B-Gaviota : 16 32 31 180 52.5 % -2 61.7 %
3 Stockfish_DD_64_modern : 12 32 32 180 51.9 % -1 59.4 %
4 Stockfish_DD_Syzygy_13112921 : 11 33 33 180 51.7 % -1 58.9 %
5 Komodo-TCEC-64bit : 11 35 35 180 51.7 % -1 52.2 %
6 Houdini_4_Pro_x64B-None : 9 33 33 180 51.4 % -1 57.2 %
7 Stockfish-DD-64-PA_Gaviota : 4 32 32 180 50.6 % -0 60.0 %
8 Komodo6-64bit : -3 33 33 180 49.4 % 0 57.8 %
9 Houdini_3_Pro_x64-Gaviota : -28 32 32 180 45.6 % 3 60.0 %
10 Houdini_3_Pro-None : -74 34 35 180 38.3 % 8 53.3 %