8 engine, 8CPU, octo roundrobin 40/40 tournament

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Post by Graham Banks »

jdart wrote:What kind of book is the "Barracuda 2015 book?"

--Jon
It's a fair book. I use the ChessGUI version of it in my testing.
gbanksnz at gmail.com
Dan Cooper
Posts: 184
Joined: Sun Nov 01, 2015 3:15 am

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Post by Dan Cooper »

Standings after round 28 of 56.

Code: Select all

 RANK   ENGINE                                    GAMES  POINTS   1    2    3    4    5    6    7    8    
-----------------------------------------------------------------------------------------------------------
   1.   KOMODO 9.3 64-BIT                           28    19.0    **** ==== ==== ==11 1=11 =1=1 1==1 =1== 
   2.   STOCKFISH 070915 64 BMI2                    28    17.0    ==== **** ==== ==== ==1= ==== =11= 1=11 
   3.   STOCKFISH 051215 64 BMI2                    28    16.5    ==== ==== **** ==== ==== 1=1= =11= 1=== 
   4.   HOUDINI 4 PRO X64                           28    14.0    ==00 ==== ==== **** ==== ==== ==== 1==1 
   5.   ANDSCACS 0.84                               28    13.0    0=00 ==0= ==== ==== **** ==== 01=1 ===1 
   6.   GULL 3 X64                                  28    12.0    =0=0 ==== 0=0= ==== ==== **** =01= ==== 
   7.   PROTECTOR 1.9.0                             28    11.0    0==0 =00= =00= ==== 10=0 =10= **** ===1 
   8.   NIRVANACHESS 2.2                            28     9.5    =0== 0=00 0=== 0==0 ===0 ==== ===0 **** 

Total games = 112

   # PLAYER                      : RATING    POINTS  PLAYED    (%)
   1 Komodo 9.3 64-bit           : 3118.5      19.0      28   67.9%
   2 Stockfish 070915 64 BMI2    : 3069.6      17.0      28   60.7%
   3 Stockfish 051215 64 BMI2    : 3057.8      16.5      28   58.9%
   4 Houdini 4 Pro x64           : 3000.0      14.0      28   50.0%
   5 Andscacs 0.84               : 2977.0      13.0      28   46.4%
   6 Gull 3 x64                  : 2953.9      12.0      28   42.9%
   7 Protector 1.9.0             : 2930.4      11.0      28   39.3%
   8 Nirvanachess 2.2            : 2894.1       9.5      28   33.9%
Dan Cooper
Posts: 184
Joined: Sun Nov 01, 2015 3:15 am

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Post by Dan Cooper »

At the halfway point and Komodo has a 2 point lead over the next closest engine. Stockfish-YBW has a tiny lead over Stockfish-Lazy for the #2 spot. Houdini with contempt 0 seems much less of a punching bag to K and SF. Andscacs continues its impressive showing and may be a breakout surprise for TCEC season 9.
fenchel
Posts: 36
Joined: Thu Dec 04, 2014 6:01 am

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Post by fenchel »

Very interesting of you to include not only SF-YBW, but in particular an older version; that means we know there is a reasonable single-core ELO gap between the two SFs playing, so one would expect/hope there is a distinct showing between the two SF versions even with the massive error bars.

Especially if the newer SF loses some games it will be interesting to pore over the PGN (I look forward to your post on fishcooking...)
Dan Cooper
Posts: 184
Joined: Sun Nov 01, 2015 3:15 am

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Post by Dan Cooper »

Standings after round 35 of 56.

Code: Select all

 RANK   ENGINE                                    GAMES  POINTS   1     2     3     4     5     6     7     8     
-------------------------------------------------------------------------------------------------------------------
   1.   KOMODO 9.3 64-BIT                           35    24.0    ***** ===== ====1 ==111 1=11= =1=1= 1==11 =1=== 
   2.   STOCKFISH 051215 64 BMI2                    35    22.0    ===== ***** ===== ====1 ====1 1=1=1 =11== 1===1 
   3.   STOCKFISH 070915 64 BMI2                    35    21.5    ====0 ===== ***** ====1 ==1=1 ===== =11=1 1=11= 
   4.   HOUDINI 4 PRO X64                           35    16.5    ==000 ====0 ====0 ***** ===== ===== ===== 1==11 
   5.   ANDSCACS 0.84                               35    15.0    0=00= ====0 ==0=0 ===== ***** ===== 01=10 ===1= 
   6.   GULL 3 X64                                  35    15.0    =0=0= 0=0=0 ===== ===== ===== ***** =01== ===== 
   7.   PROTECTOR 1.9.0                             35    14.0    0==00 =00== =00=0 ===== 10=01 =10== ***** ===1= 
   8.   NIRVANACHESS 2.2                            35    12.0    =0=== 0===0 0=00= 0==00 ===0= ===== ===0= ***** 

Total games = 140

   # PLAYER                      : RATING    POINTS  PLAYED    (%)
   1 Komodo 9.3 64-bit           : 3142.7      24.0      35   68.6%
   2 Stockfish 051215 64 BMI2    : 3102.9      22.0      35   62.9%
   3 Stockfish 070915 64 BMI2    : 3093.3      21.5      35   61.4%
   4 Houdini 4 Pro x64           : 3000.0      16.5      35   47.1%
   5 Andscacs 0.84               : 2976.4      15.0      35   42.9%
   6 Gull 3 x64                  : 2972.4      15.0      35   42.9%
   7 Protector 1.9.0             : 2953.5      14.0      35   40.0%
   8 Nirvanachess 2.2            : 2914.6      12.0      35   34.3%

White advantage = 20.64
Dan Cooper
Posts: 184
Joined: Sun Nov 01, 2015 3:15 am

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Post by Dan Cooper »

Standings after round 42 of 56.

Code: Select all

 RANK   ENGINE                                    GAMES  POINTS   1      2      3      4      5      6      7      8      
---------------------------------------------------------------------------------------------------------------------------
   1.   KOMODO 9.3 64-BIT                           42    29.0    ****** ====== ====10 ==111= 1=11=1 1==111 =1=1=1 =1===1 
   2.   STOCKFISH 051215 64 BMI2                    42    27.0    ====== ****** ====== ====11 ====1= =11=== 1=1=11 1===11 
   3.   STOCKFISH 070915 64 BMI2                    42    26.0    ====01 ====== ****** ====10 ==1=11 =11=11 ====== 1=11== 
   4.   HOUDINI 4 PRO X64                           42    19.5    ==000= ====00 ====01 ****** ====== =====0 ====== 1==11= 
   5.   ANDSCACS 0.84                               42    18.0    0=00=0 ====0= ==0=00 ====== ****** 01=10= ====== ===1=1 
   6.   PROTECTOR 1.9.0                             42    17.5    0==000 =00=== =00=00 =====1 10=01= ****** =10==1 ===1== 
   7.   GULL 3 X64                                  42    17.0    =0=0=0 0=0=00 ====== ====== ====== =01==0 ****** ====== 
   8.   NIRVANACHESS 2.2                            42    14.0    =0===0 0===00 0=00== 0==00= ===0=0 ===0== ====== ****** 

Total games = 168


   # PLAYER                      : RATING    POINTS  PLAYED    (%)
   1 Komodo 9.3 64-bit           : 3151.6      29.0      42   69.0%
   2 Stockfish 051215 64 BMI2    : 3117.9      27.0      42   64.3%
   3 Stockfish 070915 64 BMI2    : 3101.6      26.0      42   61.9%
   4 Houdini 4 Pro x64           : 3000.0      19.5      42   46.4%
   5 Andscacs 0.84               : 2976.6      18.0      42   42.9%
   6 Protector 1.9.0             : 2968.8      17.5      42   41.7%
   7 Gull 3 x64                  : 2960.9      17.0      42   40.5%
   8 Nirvanachess 2.2            : 2912.1      14.0      42   33.3%
Dan Cooper
Posts: 184
Joined: Sun Nov 01, 2015 3:15 am

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Post by Dan Cooper »

Standings after round 49 of 56.

Code: Select all

 RANK   ENGINE                                    GAMES  POINTS   1       2       3       4       5       6       7       8       
-----------------------------------------------------------------------------------------------------------------------------------
   1.   KOMODO 9.3 64-BIT                           49    33.0    ******* ======= ====10= ==111== 1=11=1= 1==111= =1=1=11 =1===1= 
   2.   STOCKFISH 051215 64 BMI2                    49    31.0    ======= ******* ======= ====11= ====1== =11==== 1=1=111 1===11= 
   3.   STOCKFISH 070915 64 BMI2                    49    30.5    ====01= ======= ******* ====10= ==1=111 =11=111 ======= 1=11=== 
   4.   HOUDINI 4 PRO X64                           49    24.0    ==000== ====00= ====01= ******* ======1 =====0= ======= 1==11=1 
   5.   ANDSCACS 0.84                               49    20.5    0=00=0= ====0== ==0=000 ======0 ******* 01=10== ======= ===1=1= 
   6.   PROTECTOR 1.9.0                             49    20.5    0==000= =00==== =00=000 =====1= 10=01== ******* =10==1= ===1=== 
   7.   GULL 3 X64                                  49    19.0    =0=0=00 0=0=000 ======= ======= ======= =01==0= ******* ======0 
   8.   NIRVANACHESS 2.2                            49    17.5    =0===0= 0===00= 0=00=== 0==00=0 ===0=0= ===0=== ======1 ******* 

Total games = 196


   # PLAYER                      : RATING    POINTS  PLAYED    (%)
   1 Komodo 9.3 64-bit           : 3121.8      33.0      49   67.3%
   2 Stockfish 051215 64 BMI2    : 3093.6      31.0      49   63.3%
   3 Stockfish 070915 64 BMI2    : 3086.7      30.5      49   62.2%
   4 Houdini 4 Pro x64           : 3000.0      24.0      49   49.0%
   5 Andscacs 0.84               : 2956.0      20.5      49   41.8%
   6 Protector 1.9.0             : 2953.8      20.5      49   41.8%
   7 Gull 3 x64                  : 2933.5      19.0      49   38.8%
   8 Nirvanachess 2.2            : 2912.7      17.5      49   35.7%

Dan Cooper
Posts: 184
Joined: Sun Nov 01, 2015 3:15 am

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Post by Dan Cooper »

88% done and K 9.3 continues to maintain a 2 point lead over the Stockfishes. No real separation between SF-YBW and SF-Lazy.

The next version of this will start around January. I would like to add some contempt to Stockfish, as I feel that should help it some against some of the other engines.
Dan Cooper
Posts: 184
Joined: Sun Nov 01, 2015 3:15 am

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Post by Dan Cooper »

K defended a very tough game against SF-Lazy. I went to bed thinking SF was going to win and I woke up surprised to see a draw. I haven't had much time to go through the game, but I didn't see any game 22 style catastrophes.

[pgn]
[Event "Top 8 Round Robin 2015"]
[Site "ChessGUI"]
[Date "2015.12.25"]
[Round "47.4"]
[White "Komodo 9.3 64-bit"]
[Black "Stockfish 051215 64 BMI2"]
[Result "1/2-1/2"]
[PlyCount "170"]
[EventDate "2015.??.??"]
[TimeControl "40/2400:40/2400:40/2400"]

{Intel(R) Core(TM) i7-5960X CPU @ 4.50 GHz} 1. d4 {0/1 0s} d5 {0/1 0s} 2. c4 {
0/1 0s} c6 {0/1 0s} 3. Nc3 {0/1 0s} Nf6 {0/1 0s} 4. e3 {0/1 0s} Bf5 {0/1 0s} 5.
cxd5 {0/1 0s} cxd5 {0/1 0s} 6. Qb3 {0/1 0s} Nc6 {0/1 0s} 7. Qxb7 {0/1 0s} Bd7 {
0/1 0s} 8. Qb3 {0/1 0s} Rb8 {0/1 0s} 9. Qd1 {35/27 38s} e5 {-10/30 1:17m} 10.
dxe5 {33/28 48s} Nxe5 {-9/26 28s} 11. a3 {134 29/28} Bd6 {78 11/29} 12. f4 {
93 16/30} Ng6 {15/25 6s} 13. Nf3 {61 0/30} O-O {71 4/29} 14. Be2 {92 0/32} Re8
{133 15/31} 15. Nd4 {-7/28 58s} Bc5 {37/24 11s} 16. O-O {-8/29 52s} Nh4 {
83 32/29} 17. Nc2 {-25/30 1:34m} Nf5 {205 39/28} 18. Bf3 {-10/30 45s} Rc8 {
132 22/30} 19. Bxd5 {-15/27 2:1m} Qc7 {28/28 50s} 20. Kh1 {-37/27 1:38m} Nxd5 {
25/27 7s} 21. Qxd5 {-41/30 1:46m} Be6 {41/29 58s} 22. Qf3 {-39/27 40s} Bc4 {
139 58/29} 23. Rf2 {-48/31 2:13m} Bb3 {49/29 53s} 24. h3 {-40/30 38s} h5 {
79 53/31} 25. Kh2 {-41/31 1:19m} h4 {52/27 8s} 26. Nb4 {-35/29 22s} Qd7 {
60 49/34} 27. Rd2 {-34/31 1:44m} Qe6 {52/33 29s} 28. Rf2 {-43/30 35s} f6 {
144 46/33} 29. Qg4 {-37/34 1:20m} Bb6 {51/35 42s} 30. Nc2 {-37/33 41s} Rcd8 {
102 48/33} 31. a4 {-30/31 46s} a5 {44/34 41s} 32. Qh5 {-37/33 1:38m} Re7 {
44/35 43s} 33. Qg4 {-44/32 53s} Bc5 {67 44/35} 34. Qh5 {-38/31 34s} Qc8 {
44/34 18s} 35. Qg4 {-42/31 38s} Ree8 {44/34 52s} 36. Qh5 {-43/32 37s} Ba7 {
98 44/33} 37. Qg4 {-34/30 42s} Bb6 {225 44/34} 38. Re2 {-44/29 53s} Ng3 {
79 48/32} 39. Rf2 {-60/33 1:9m} Qxg4 {99 77/34} 40. hxg4 {-68/32 42s} Bxc2 {
63 75/33} 41. Rxc2 {-72/33 38s} Nf1+ {84/27 11s} 42. Kh3 {-64/34 49s} Bxe3 {
130 91/33} 43. Re2 {-72/34 56s} Rd3 {91/32 7s} 44. Bxe3 {-68/34 33s} Nxe3 {
97 87/36} 45. Rg1 {-82/35 1:22m} Nd5+ {85/36 50s} 46. Kxh4 {-75/33 40s} Ne7 {
102 93/38} 47. g5 {-81/35 1:28m} Kf7 {88/37 19s} 48. f5 {-75/33 55s} Nxf5+ {
83 96/38} 49. Kg4 {-86/32 30s} Ne3+ {91/36 7s} 50. Kg3 {-97/34 2:33m} f5 {
91/39 46s} 51. Kf2 {-89/33 31s} Kg6 {67 95/38} 52. Rc1 {-113/33 2:18m} f4 {
209 134/30} 53. Nb1 {-124/33 1:51m} Red8 {244 149/32} 54. Na3 {-133/32 1:25m}
R8d4 {150/27 5s} 55. Rc6+ {-122/31 34s} Kh5 {141/34 51s} 56. Nc2 {-123/33 34s}
Ng4+ {149/30 5s} 57. Kf1 {-122/32 25s} Rxa4 {77 148/30} 58. Rc7 {-125/33 1:8m}
Rd1+ {141/26 5s} 59. Re1 {-97/30 25s} Rd5 {72 122/32} 60. g6 {-95/32 1:7m} Ra2
{108/27 5s} 61. Rxg7 {-89/30 34s} Rxb2 {108 105/32} 62. Rc7 {-88/31 23s} Kxg6 {
100/29 15s} 63. Ree7 {-88/31 42s} Ne5 {93/32 54s} 64. Ke2 {-84/31 59s} Ra2 {
65 93/33} 65. Re8 {-73/31 1:8m} Kg5 {65 93/33} 66. Rec8 {-72/31 31s} Rd4 {
77 73/30} 67. Ke1 {-66/31 1:22m} Rd6 {63/30 49s} 68. Kf1 {-54/32 1:15m} Kg6 {
138 55/30} 69. Rg8+ {-45/33 43s} Kf5 {113 48/33} 70. Rc5 {-44/33 1:0m} Ke4 {
37/30 32s} 71. Re8 {-37/31 52s} Rd5 {37/28 4s} 72. Rcc8 {-35/31 44s} a4 {
125 43/28} 73. Ne1 {-16/29 40s} Ke3 {60 39/28} 74. Rc6 {0/30 39s} Ra1 {12/26
20s} 75. Rc2 {0/34 25s} Ke4 {7/26 25s} 76. Ke2 {0/34 36s} Kf5 {16/28 55s} 77.
Rf8+ {0/35 35s} Kg6 {13/27 20s} 78. Nf3 {0/36 46s} Nd3 {0/28 17s} 79. Rg8+ {
61 0/36} Kf7 {0/30 20s} 80. Rgc8 {86 0/40} a3 {0/33 31s} 81. R8c7+ {85 0/39}
Kf8 {60 0/38} 82. Rc8+ {69 0/44} Ke7 {0/43 51s} 83. R8c7+ {81 0/44} Kf8 {
108 0/44} 84. Rc8+ {209 0/55} Ke7 {134 0/50} 85. R8c7+ {148 0/57} Kd8 {GUI
adjudication} 1/2-1/2
[/pgn]
Dan Cooper
Posts: 184
Joined: Sun Nov 01, 2015 3:15 am

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Post by Dan Cooper »

Final Standings

Code: Select all

 RANK   ENGINE                                    GAMES  POINTS   1        2        3        4        5        6        7        8        
-------------------------------------------------------------------------------------------------------------------------------------------
   1.   KOMODO 9.3 64-BIT  C10                      56    37.5    ******** ======== ====10== ==111==1 1==111== 1=11=1== =1=1=11= =1===1=1 
   2.   STOCKFISH 051215 64 BMI2                    56    35.5    ======== ******** ======== ====11== =11====1 ====1=== 1=1=1111 1===11== 
   3.   STOCKFISH 070915 64 BMI2                    56    35.5    ====01== ======== ******** ====10== =11=111= ==1=1111 =======1 1=11===1 
   4.   HOUDINI 4 PRO X64                           56    27.5    ==000==0 ====00== ====01== ******** =====0== ======11 ======== 1==11=1= 
   5.   PROTECTOR 1.9.0                             56    24.0    0==000== =00====0 =00=000= =====1== ******** 10=01=== =10==1== ===1===1 
   6.   ANDSCACS 0.84                               56    23.0    0=00=0== ====0=== ==0=0000 ======00 01=10=== ******** ======== ===1=1== 
   7.   GULL 3 X64                                  56    22.0    =0=0=00= 0=0=0000 =======0 ======== =01==0== ======== ******** ======01 
   8.   NIRVANACHESS 2.2                            56    19.0    =0===0=0 0===00== 0=00===0 0==00=0= ===0===0 ===0=0== ======10 ******** 

Total games = 224
Initial 8CPU 40/40 Rating List

Code: Select all


   # PLAYER                      : RATING    POINTS  PLAYED    (%)
   1 Komodo 9.3 64-bit C10          : 3118.4      37.5      56   67.0%
   2 Stockfish 070915 64 BMI2    : 3093.7      35.5      56   63.4%
   3 Stockfish 051215 64 BMI2    : 3093.7      35.5      56   63.4%
   4 Houdini 4 Pro x64           : 3000.0      27.5      56   49.1%
   5 Protector 1.9.0             : 2959.5      24.0      56   42.9%
   6 Andscacs 0.84               : 2947.8      23.0      56   41.1%
   7 Gull 3 x64                  : 2935.9      22.0      56   39.3%
   8 Nirvanachess 2.2            : 2899.5      19.0      56   33.9%

Games
https://www.dropbox.com/s/ruxaq66vj0exi ... n.pgn?dl=0
Last edited by Dan Cooper on Tue Dec 29, 2015 8:55 pm, edited 2 times in total.