Stockfish 8 - Stockfish 7: 400 games

[Jouni]

Code: Select all

Games Completed = 400 of 400 (Avg game length = 162.580 sec)
Settings = Gauntlet/256MB/60000ms+600ms/M 450cp for 4 moves, D 100 moves/EPD:salc.epd(500)

Time = 16712 sec elapsed, 0 sec remaining
 1.  Stockfish 7 64 BMI2      	147.0/400	32-138-230  	(L: m=0 t=0 i=0 a=138) (D: r=162 i=23 f=3 s=0 a=42)	(tpm=1520.2 d=22.10 nps=2237096)
 2.  Stockfish 8 64 BMI2      	253.0/400	138-32-230  	(L: m=0 t=0 i=0 a=32) (D: r=162 i=23 f=3 s=0 a=42)	(tpm=1476.2 d=24.27 nps=2027731)

+94 ELO. Note, that SF8 has 2 plies more depth with less time and nps. If Houdini beats this monster in TCEC final I am really surprised .

[fastgm]

TC = 20" + 0.2"

Code: Select all

Games Completed = 8000 of 8000 (Avg game length = 57.524 sec)
Settings = Gauntlet/64MB/20000ms+200ms/M 650cp for 5 moves, D 100 moves/PGN:C:\LittleBlitzer-2.75\8moves_v3.pgn(32000)
Time = 15100 sec elapsed, 0 sec remaining

 1.  Stockfish 8 64 POPCNT    	4968.0/8000	2460-524-5016	(L: m=0 t=0 i=0 a=524)  (D: r=3535 i=460 f=60 s=55 a=906)	(tpm=491.6 d=18.40 nps=859554)
 2.  Stockfish 7 64 POPCNT    	3032.0/8000	524-2460-5016	(L: m=4 t=0 i=0 a=2456) (D: r=3535 i=460 f=60 s=55 a=906)	(tpm=494.7 d=16.77 nps=921139)


    Program                  Elo    +   -   Games   Score   Av.Op.  Draws
 --------------------------------------------------------------------------
  1 Stockfish 8 64 POPCNT  : 3043   5   5   8000    62.1 %   2957   62.7 %
  2 Stockfish 7 64 POPCNT  : 2957   5   5   8000    37.9 %   3043   62.7 %


Av.Op. Elo = 3000

Result     : 4968.0/8000 (+2460,=5016,-524)
Perf.      : 62.1 %
Margins    :
 68 %      : (+  0.3,-  0.3 %) -> [ 61.8, 62.4 %]
 95 %      : (+  0.6,-  0.6 %) -> [ 61.5, 62.7 %]
 99.7 %    : (+  0.9,-  0.9 %) -> [ 61.2, 63.0 %]

Elo        : 3086
Margins    :
 68 %      : (+  2,-  2) -> [3083,3088]
 95 %      : (+  5,-  5) -> [3081,3090]
 99.7 %    : (+  7,-  7) -> [3079,3093]


Games        :   8000 (finished)

White Wins   :   1778 (22.2 %)
Black Wins   :   1206 (15.1 %)
Draws        :   5016 (62.7 %)

White Perf.  : 53.6 %
Black Perf.  : 46.4 %

[JJJ]

86 elo at 20 sec + 200 ms. Probably a little less at 60 sec + 600 ms and more.

[PaulieD]

1500 GAME GAUNTLET
i3 380M | 2 @ 2.53 | Win7 x64 | 6 GB Ram | Gui~ CuteChess GUI 0.9.4
Draw Adjudication~120 / 40 / 2 | Resign~3 / 4.8 | Cores~1 | HT~On
Book~TopGM_2move.pgn | Hash~8MB | Concurrency~3
Ponder~No | TB's~No | Elo~Ordo 1.2.6 | Time~20" + .2"

Stockfish 8 +94 Elo over Stockfish 7

Code: Select all

   # PLAYER         :  RATING  ERROR  PLAYED    W    D    L   (%)  D(%)
   1 Stockfish 8    :    3285     10    1500  705  553  242  65.4  36.9
   2 Komodo 10.1    :    3203     20     500  102  182  216  38.6  36.4
   3 Stockfish 7    :    3191     20     500   57  256  187  37.0  51.2
   4 Houdini 4      :    3120     22     500   83  115  302  28.1  23.0

[fastgm]

TC = 100" + 1"

Code: Select all

Games Completed = 8000 of 8000 (Avg game length = 279.416 sec)
Settings = Gauntlet/128MB/100000ms+1000ms/M 650cp for 5 moves, D 100 moves/PGN:C:\LittleBlitzer-2.75\8moves_v3.pgn(32000)
Time = 72544 sec elapsed, 0 sec remaining

 1.  Stockfish 8 64 POPCNT    	4976.5/8000	2260-307-5433  	(L: m=0 t=0 i=0 a=307)	 (D: r=3819 i=464 f=89 s=60 a=1001)	(tpm=2392.4 d=23.38 nps=882775)
 2.  Stockfish 7 64 POPCNT    	3023.5/8000	307-2260-5433  	(L: m=2 t=0 i=0 a=2258)	(D: r=3819 i=464 f=89 s=60 a=1001)	(tpm=2400.1 d=21.28 nps=941192)


    Program                  Elo    +   -   Games   Score   Av.Op.  Draws
 --------------------------------------------------------------------------
  1 Stockfish 8 64 POPCNT  : 3043   4   4   8000    62.2 %   2957   67.9 %
  2 Stockfish 7 64 POPCNT  : 2957   4   4   8000    37.8 %   3043   67.9 %


Av.Op. Elo = 3000

Result     : 4976.5/8000 (+2260,=5433,-307)
Perf.      : 62.2 %
Margins    :
 68 %      : (+  0.3,-  0.3 %) -> [ 61.9, 62.5 %]
 95 %      : (+  0.6,-  0.6 %) -> [ 61.6, 62.8 %]
 99.7 %    : (+  0.9,-  0.8 %) -> [ 61.4, 63.1 %]

Elo        : 3087
Margins    :
 68 %      : (+  2,-  2) -> [3084,3089]
 95 %      : (+  4,-  4) -> [3082,3091]
 99.7 %    : (+  6,-  6) -> [3080,3093]


Games        :   8000 (finished)

White Wins   :   1617 (20.2 %)
Black Wins   :    950 (11.9 %)
Draws        :   5433 (67.9 %)

White Perf.  : 54.2 %
Black Perf.  : 45.8 %

[Look]

Code: Select all

Games Completed = 400 of 400 (Avg game length = 162.580 sec)
Settings = Gauntlet/256MB/60000ms+600ms/M 450cp for 4 moves, D 100 moves/EPD:salc.epd(500)

Time = 16712 sec elapsed, 0 sec remaining
 1.  Stockfish 7 64 BMI2      	147.0/400	32-138-230  	(L: m=0 t=0 i=0 a=138) (D: r=162 i=23 f=3 s=0 a=42)	(tpm=1520.2 d=22.10 nps=2237096)
 2.  Stockfish 8 64 BMI2      	253.0/400	138-32-230  	(L: m=0 t=0 i=0 a=32) (D: r=162 i=23 f=3 s=0 a=42)	(tpm=1476.2 d=24.27 nps=2027731)

+94 ELO. Note, that SF8 has 2 plies more depth with less time and nps. If Houdini beats this monster in TCEC final I am really surprised .

Can you provide the PGN file ?

[CheckersGuy]

If that +80-90 elo is actually accurate than Stockfish is now a Monster. Houdini wll have a very hard time unless Houdart did improve Houdart by 80 elo Points as well.

[Jouni]

Andreas: which CPU is so slow nps=859554!?

[fastgm]

Andreas: which CPU is so slow nps=859554!?

Dual AMD Opteron 6376, 32 Cores/Threads

[Dr.Wael Deeb]

If that +80-90 elo is actually accurate than Stockfish is now a Monster. Houdini wll have a very hard time unless Houdart did improve Houdart by 80 elo Points as well.

And even then if won't be enough ....
Dr.D