TalkChess.com

Computer Chess Club
https://talkchess.com/

8 engine, 8CPU, octo roundrobin 40/40 tournament

https://talkchess.com/viewtopic.php?t=58590

Page 2 of 3

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Posted: Wed Dec 16, 2015 7:56 pm
by Graham Banks
jdart wrote:What kind of book is the "Barracuda 2015 book?"

--Jon
It's a fair book. I use the ChessGUI version of it in my testing.

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Posted: Sat Dec 19, 2015 1:41 am
by Dan Cooper
Standings after round 28 of 56.

Code: Select all

 RANK   ENGINE                                    GAMES  POINTS   1    2    3    4    5    6    7    8    
-----------------------------------------------------------------------------------------------------------
   1.   KOMODO 9.3 64-BIT                           28    19.0    **** ==== ==== ==11 1=11 =1=1 1==1 =1== 
   2.   STOCKFISH 070915 64 BMI2                    28    17.0    ==== **** ==== ==== ==1= ==== =11= 1=11 
   3.   STOCKFISH 051215 64 BMI2                    28    16.5    ==== ==== **** ==== ==== 1=1= =11= 1=== 
   4.   HOUDINI 4 PRO X64                           28    14.0    ==00 ==== ==== **** ==== ==== ==== 1==1 
   5.   ANDSCACS 0.84                               28    13.0    0=00 ==0= ==== ==== **** ==== 01=1 ===1 
   6.   GULL 3 X64                                  28    12.0    =0=0 ==== 0=0= ==== ==== **** =01= ==== 
   7.   PROTECTOR 1.9.0                             28    11.0    0==0 =00= =00= ==== 10=0 =10= **** ===1 
   8.   NIRVANACHESS 2.2                            28     9.5    =0== 0=00 0=== 0==0 ===0 ==== ===0 **** 

Total games = 112

   # PLAYER                      : RATING    POINTS  PLAYED    (%)
   1 Komodo 9.3 64-bit           : 3118.5      19.0      28   67.9%
   2 Stockfish 070915 64 BMI2    : 3069.6      17.0      28   60.7%
   3 Stockfish 051215 64 BMI2    : 3057.8      16.5      28   58.9%
   4 Houdini 4 Pro x64           : 3000.0      14.0      28   50.0%
   5 Andscacs 0.84               : 2977.0      13.0      28   46.4%
   6 Gull 3 x64                  : 2953.9      12.0      28   42.9%
   7 Protector 1.9.0             : 2930.4      11.0      28   39.3%
   8 Nirvanachess 2.2            : 2894.1       9.5      28   33.9%

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Posted: Sat Dec 19, 2015 1:45 am
by Dan Cooper
At the halfway point and Komodo has a 2 point lead over the next closest engine. Stockfish-YBW has a tiny lead over Stockfish-Lazy for the #2 spot. Houdini with contempt 0 seems much less of a punching bag to K and SF. Andscacs continues its impressive showing and may be a breakout surprise for TCEC season 9.

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Posted: Sat Dec 19, 2015 4:15 am
by fenchel
Very interesting of you to include not only SF-YBW, but in particular an older version; that means we know there is a reasonable single-core ELO gap between the two SFs playing, so one would expect/hope there is a distinct showing between the two SF versions even with the massive error bars.

Especially if the newer SF loses some games it will be interesting to pore over the PGN (I look forward to your post on fishcooking...)

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Posted: Mon Dec 21, 2015 11:38 pm
by Dan Cooper
Standings after round 35 of 56.

Code: Select all

 RANK   ENGINE                                    GAMES  POINTS   1     2     3     4     5     6     7     8     
-------------------------------------------------------------------------------------------------------------------
   1.   KOMODO 9.3 64-BIT                           35    24.0    ***** ===== ====1 ==111 1=11= =1=1= 1==11 =1=== 
   2.   STOCKFISH 051215 64 BMI2                    35    22.0    ===== ***** ===== ====1 ====1 1=1=1 =11== 1===1 
   3.   STOCKFISH 070915 64 BMI2                    35    21.5    ====0 ===== ***** ====1 ==1=1 ===== =11=1 1=11= 
   4.   HOUDINI 4 PRO X64                           35    16.5    ==000 ====0 ====0 ***** ===== ===== ===== 1==11 
   5.   ANDSCACS 0.84                               35    15.0    0=00= ====0 ==0=0 ===== ***** ===== 01=10 ===1= 
   6.   GULL 3 X64                                  35    15.0    =0=0= 0=0=0 ===== ===== ===== ***** =01== ===== 
   7.   PROTECTOR 1.9.0                             35    14.0    0==00 =00== =00=0 ===== 10=01 =10== ***** ===1= 
   8.   NIRVANACHESS 2.2                            35    12.0    =0=== 0===0 0=00= 0==00 ===0= ===== ===0= ***** 

Total games = 140

   # PLAYER                      : RATING    POINTS  PLAYED    (%)
   1 Komodo 9.3 64-bit           : 3142.7      24.0      35   68.6%
   2 Stockfish 051215 64 BMI2    : 3102.9      22.0      35   62.9%
   3 Stockfish 070915 64 BMI2    : 3093.3      21.5      35   61.4%
   4 Houdini 4 Pro x64           : 3000.0      16.5      35   47.1%
   5 Andscacs 0.84               : 2976.4      15.0      35   42.9%
   6 Gull 3 x64                  : 2972.4      15.0      35   42.9%
   7 Protector 1.9.0             : 2953.5      14.0      35   40.0%
   8 Nirvanachess 2.2            : 2914.6      12.0      35   34.3%

White advantage = 20.64

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Posted: Thu Dec 24, 2015 12:34 pm
by Dan Cooper
Standings after round 42 of 56.

Code: Select all

 RANK   ENGINE                                    GAMES  POINTS   1      2      3      4      5      6      7      8      
---------------------------------------------------------------------------------------------------------------------------
   1.   KOMODO 9.3 64-BIT                           42    29.0    ****** ====== ====10 ==111= 1=11=1 1==111 =1=1=1 =1===1 
   2.   STOCKFISH 051215 64 BMI2                    42    27.0    ====== ****** ====== ====11 ====1= =11=== 1=1=11 1===11 
   3.   STOCKFISH 070915 64 BMI2                    42    26.0    ====01 ====== ****** ====10 ==1=11 =11=11 ====== 1=11== 
   4.   HOUDINI 4 PRO X64                           42    19.5    ==000= ====00 ====01 ****** ====== =====0 ====== 1==11= 
   5.   ANDSCACS 0.84                               42    18.0    0=00=0 ====0= ==0=00 ====== ****** 01=10= ====== ===1=1 
   6.   PROTECTOR 1.9.0                             42    17.5    0==000 =00=== =00=00 =====1 10=01= ****** =10==1 ===1== 
   7.   GULL 3 X64                                  42    17.0    =0=0=0 0=0=00 ====== ====== ====== =01==0 ****** ====== 
   8.   NIRVANACHESS 2.2                            42    14.0    =0===0 0===00 0=00== 0==00= ===0=0 ===0== ====== ****** 

Total games = 168


   # PLAYER                      : RATING    POINTS  PLAYED    (%)
   1 Komodo 9.3 64-bit           : 3151.6      29.0      42   69.0%
   2 Stockfish 051215 64 BMI2    : 3117.9      27.0      42   64.3%
   3 Stockfish 070915 64 BMI2    : 3101.6      26.0      42   61.9%
   4 Houdini 4 Pro x64           : 3000.0      19.5      42   46.4%
   5 Andscacs 0.84               : 2976.6      18.0      42   42.9%
   6 Protector 1.9.0             : 2968.8      17.5      42   41.7%
   7 Gull 3 x64                  : 2960.9      17.0      42   40.5%
   8 Nirvanachess 2.2            : 2912.1      14.0      42   33.3%

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Posted: Sun Dec 27, 2015 2:27 am
by Dan Cooper
Standings after round 49 of 56.

Code: Select all

 RANK   ENGINE                                    GAMES  POINTS   1       2       3       4       5       6       7       8       
-----------------------------------------------------------------------------------------------------------------------------------
   1.   KOMODO 9.3 64-BIT                           49    33.0    ******* ======= ====10= ==111== 1=11=1= 1==111= =1=1=11 =1===1= 
   2.   STOCKFISH 051215 64 BMI2                    49    31.0    ======= ******* ======= ====11= ====1== =11==== 1=1=111 1===11= 
   3.   STOCKFISH 070915 64 BMI2                    49    30.5    ====01= ======= ******* ====10= ==1=111 =11=111 ======= 1=11=== 
   4.   HOUDINI 4 PRO X64                           49    24.0    ==000== ====00= ====01= ******* ======1 =====0= ======= 1==11=1 
   5.   ANDSCACS 0.84                               49    20.5    0=00=0= ====0== ==0=000 ======0 ******* 01=10== ======= ===1=1= 
   6.   PROTECTOR 1.9.0                             49    20.5    0==000= =00==== =00=000 =====1= 10=01== ******* =10==1= ===1=== 
   7.   GULL 3 X64                                  49    19.0    =0=0=00 0=0=000 ======= ======= ======= =01==0= ******* ======0 
   8.   NIRVANACHESS 2.2                            49    17.5    =0===0= 0===00= 0=00=== 0==00=0 ===0=0= ===0=== ======1 ******* 

Total games = 196


   # PLAYER                      : RATING    POINTS  PLAYED    (%)
   1 Komodo 9.3 64-bit           : 3121.8      33.0      49   67.3%
   2 Stockfish 051215 64 BMI2    : 3093.6      31.0      49   63.3%
   3 Stockfish 070915 64 BMI2    : 3086.7      30.5      49   62.2%
   4 Houdini 4 Pro x64           : 3000.0      24.0      49   49.0%
   5 Andscacs 0.84               : 2956.0      20.5      49   41.8%
   6 Protector 1.9.0             : 2953.8      20.5      49   41.8%
   7 Gull 3 x64                  : 2933.5      19.0      49   38.8%
   8 Nirvanachess 2.2            : 2912.7      17.5      49   35.7%

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Posted: Sun Dec 27, 2015 2:28 am
by Dan Cooper
88% done and K 9.3 continues to maintain a 2 point lead over the Stockfishes. No real separation between SF-YBW and SF-Lazy.

The next version of this will start around January. I would like to add some contempt to Stockfish, as I feel that should help it some against some of the other engines.

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Posted: Sun Dec 27, 2015 2:37 am
by Dan Cooper
K defended a very tough game against SF-Lazy. I went to bed thinking SF was going to win and I woke up surprised to see a draw. I haven't had much time to go through the game, but I didn't see any game 22 style catastrophes.

[pgn]
[Event "Top 8 Round Robin 2015"]
[Site "ChessGUI"]
[Date "2015.12.25"]
[Round "47.4"]
[White "Komodo 9.3 64-bit"]
[Black "Stockfish 051215 64 BMI2"]
[Result "1/2-1/2"]
[PlyCount "170"]
[EventDate "2015.??.??"]
[TimeControl "40/2400:40/2400:40/2400"]

{Intel(R) Core(TM) i7-5960X CPU @ 4.50 GHz} 1. d4 {0/1 0s} d5 {0/1 0s} 2. c4 {
0/1 0s} c6 {0/1 0s} 3. Nc3 {0/1 0s} Nf6 {0/1 0s} 4. e3 {0/1 0s} Bf5 {0/1 0s} 5.
cxd5 {0/1 0s} cxd5 {0/1 0s} 6. Qb3 {0/1 0s} Nc6 {0/1 0s} 7. Qxb7 {0/1 0s} Bd7 {
0/1 0s} 8. Qb3 {0/1 0s} Rb8 {0/1 0s} 9. Qd1 {35/27 38s} e5 {-10/30 1:17m} 10.
dxe5 {33/28 48s} Nxe5 {-9/26 28s} 11. a3 {134 29/28} Bd6 {78 11/29} 12. f4 {
93 16/30} Ng6 {15/25 6s} 13. Nf3 {61 0/30} O-O {71 4/29} 14. Be2 {92 0/32} Re8
{133 15/31} 15. Nd4 {-7/28 58s} Bc5 {37/24 11s} 16. O-O {-8/29 52s} Nh4 {
83 32/29} 17. Nc2 {-25/30 1:34m} Nf5 {205 39/28} 18. Bf3 {-10/30 45s} Rc8 {
132 22/30} 19. Bxd5 {-15/27 2:1m} Qc7 {28/28 50s} 20. Kh1 {-37/27 1:38m} Nxd5 {
25/27 7s} 21. Qxd5 {-41/30 1:46m} Be6 {41/29 58s} 22. Qf3 {-39/27 40s} Bc4 {
139 58/29} 23. Rf2 {-48/31 2:13m} Bb3 {49/29 53s} 24. h3 {-40/30 38s} h5 {
79 53/31} 25. Kh2 {-41/31 1:19m} h4 {52/27 8s} 26. Nb4 {-35/29 22s} Qd7 {
60 49/34} 27. Rd2 {-34/31 1:44m} Qe6 {52/33 29s} 28. Rf2 {-43/30 35s} f6 {
144 46/33} 29. Qg4 {-37/34 1:20m} Bb6 {51/35 42s} 30. Nc2 {-37/33 41s} Rcd8 {
102 48/33} 31. a4 {-30/31 46s} a5 {44/34 41s} 32. Qh5 {-37/33 1:38m} Re7 {
44/35 43s} 33. Qg4 {-44/32 53s} Bc5 {67 44/35} 34. Qh5 {-38/31 34s} Qc8 {
44/34 18s} 35. Qg4 {-42/31 38s} Ree8 {44/34 52s} 36. Qh5 {-43/32 37s} Ba7 {
98 44/33} 37. Qg4 {-34/30 42s} Bb6 {225 44/34} 38. Re2 {-44/29 53s} Ng3 {
79 48/32} 39. Rf2 {-60/33 1:9m} Qxg4 {99 77/34} 40. hxg4 {-68/32 42s} Bxc2 {
63 75/33} 41. Rxc2 {-72/33 38s} Nf1+ {84/27 11s} 42. Kh3 {-64/34 49s} Bxe3 {
130 91/33} 43. Re2 {-72/34 56s} Rd3 {91/32 7s} 44. Bxe3 {-68/34 33s} Nxe3 {
97 87/36} 45. Rg1 {-82/35 1:22m} Nd5+ {85/36 50s} 46. Kxh4 {-75/33 40s} Ne7 {
102 93/38} 47. g5 {-81/35 1:28m} Kf7 {88/37 19s} 48. f5 {-75/33 55s} Nxf5+ {
83 96/38} 49. Kg4 {-86/32 30s} Ne3+ {91/36 7s} 50. Kg3 {-97/34 2:33m} f5 {
91/39 46s} 51. Kf2 {-89/33 31s} Kg6 {67 95/38} 52. Rc1 {-113/33 2:18m} f4 {
209 134/30} 53. Nb1 {-124/33 1:51m} Red8 {244 149/32} 54. Na3 {-133/32 1:25m}
R8d4 {150/27 5s} 55. Rc6+ {-122/31 34s} Kh5 {141/34 51s} 56. Nc2 {-123/33 34s}
Ng4+ {149/30 5s} 57. Kf1 {-122/32 25s} Rxa4 {77 148/30} 58. Rc7 {-125/33 1:8m}
Rd1+ {141/26 5s} 59. Re1 {-97/30 25s} Rd5 {72 122/32} 60. g6 {-95/32 1:7m} Ra2
{108/27 5s} 61. Rxg7 {-89/30 34s} Rxb2 {108 105/32} 62. Rc7 {-88/31 23s} Kxg6 {
100/29 15s} 63. Ree7 {-88/31 42s} Ne5 {93/32 54s} 64. Ke2 {-84/31 59s} Ra2 {
65 93/33} 65. Re8 {-73/31 1:8m} Kg5 {65 93/33} 66. Rec8 {-72/31 31s} Rd4 {
77 73/30} 67. Ke1 {-66/31 1:22m} Rd6 {63/30 49s} 68. Kf1 {-54/32 1:15m} Kg6 {
138 55/30} 69. Rg8+ {-45/33 43s} Kf5 {113 48/33} 70. Rc5 {-44/33 1:0m} Ke4 {
37/30 32s} 71. Re8 {-37/31 52s} Rd5 {37/28 4s} 72. Rcc8 {-35/31 44s} a4 {
125 43/28} 73. Ne1 {-16/29 40s} Ke3 {60 39/28} 74. Rc6 {0/30 39s} Ra1 {12/26
20s} 75. Rc2 {0/34 25s} Ke4 {7/26 25s} 76. Ke2 {0/34 36s} Kf5 {16/28 55s} 77.
Rf8+ {0/35 35s} Kg6 {13/27 20s} 78. Nf3 {0/36 46s} Nd3 {0/28 17s} 79. Rg8+ {
61 0/36} Kf7 {0/30 20s} 80. Rgc8 {86 0/40} a3 {0/33 31s} 81. R8c7+ {85 0/39}
Kf8 {60 0/38} 82. Rc8+ {69 0/44} Ke7 {0/43 51s} 83. R8c7+ {81 0/44} Kf8 {
108 0/44} 84. Rc8+ {209 0/55} Ke7 {134 0/50} 85. R8c7+ {148 0/57} Kd8 {GUI
adjudication} 1/2-1/2
[/pgn]

Re: 8 engine, 8CPU, octo roundrobin 40/40 tournament

Posted: Tue Dec 29, 2015 8:48 pm
by Dan Cooper
Final Standings

Code: Select all

 RANK   ENGINE                                    GAMES  POINTS   1        2        3        4        5        6        7        8        
-------------------------------------------------------------------------------------------------------------------------------------------
   1.   KOMODO 9.3 64-BIT  C10                      56    37.5    ******** ======== ====10== ==111==1 1==111== 1=11=1== =1=1=11= =1===1=1 
   2.   STOCKFISH 051215 64 BMI2                    56    35.5    ======== ******** ======== ====11== =11====1 ====1=== 1=1=1111 1===11== 
   3.   STOCKFISH 070915 64 BMI2                    56    35.5    ====01== ======== ******** ====10== =11=111= ==1=1111 =======1 1=11===1 
   4.   HOUDINI 4 PRO X64                           56    27.5    ==000==0 ====00== ====01== ******** =====0== ======11 ======== 1==11=1= 
   5.   PROTECTOR 1.9.0                             56    24.0    0==000== =00====0 =00=000= =====1== ******** 10=01=== =10==1== ===1===1 
   6.   ANDSCACS 0.84                               56    23.0    0=00=0== ====0=== ==0=0000 ======00 01=10=== ******** ======== ===1=1== 
   7.   GULL 3 X64                                  56    22.0    =0=0=00= 0=0=0000 =======0 ======== =01==0== ======== ******** ======01 
   8.   NIRVANACHESS 2.2                            56    19.0    =0===0=0 0===00== 0=00===0 0==00=0= ===0===0 ===0=0== ======10 ******** 

Total games = 224
Initial 8CPU 40/40 Rating List

Code: Select all


   # PLAYER                      : RATING    POINTS  PLAYED    (%)
   1 Komodo 9.3 64-bit C10          : 3118.4      37.5      56   67.0%
   2 Stockfish 070915 64 BMI2    : 3093.7      35.5      56   63.4%
   3 Stockfish 051215 64 BMI2    : 3093.7      35.5      56   63.4%
   4 Houdini 4 Pro x64           : 3000.0      27.5      56   49.1%
   5 Protector 1.9.0             : 2959.5      24.0      56   42.9%
   6 Andscacs 0.84               : 2947.8      23.0      56   41.1%
   7 Gull 3 x64                  : 2935.9      22.0      56   39.3%
   8 Nirvanachess 2.2            : 2899.5      19.0      56   33.9%
Games
https://www.dropbox.com/s/ruxaq66vj0exi ... n.pgn?dl=0
All times are UTC+02:00
Page 2 of 3

Powered by phpBB® Forum Software © phpBB Limited