Stockfish 8 - Stockfish 7: 400 games

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
Jouni
Posts: 1958
Joined: Wed Mar 08, 2006 7:15 pm

Stockfish 8 - Stockfish 7: 400 games

Post by Jouni » Wed Nov 02, 2016 12:29 pm

Code: Select all

Games Completed = 400 of 400 (Avg game length = 162.580 sec)
Settings = Gauntlet/256MB/60000ms+600ms/M 450cp for 4 moves, D 100 moves/EPD:salc.epd(500)

Time = 16712 sec elapsed, 0 sec remaining
 1.  Stockfish 7 64 BMI2      	147.0/400	32-138-230  	(L: m=0 t=0 i=0 a=138) (D: r=162 i=23 f=3 s=0 a=42)	(tpm=1520.2 d=22.10 nps=2237096)
 2.  Stockfish 8 64 BMI2      	253.0/400	138-32-230  	(L: m=0 t=0 i=0 a=32) (D: r=162 i=23 f=3 s=0 a=42)	(tpm=1476.2 d=24.27 nps=2027731)
+94 ELO. Note, that SF8 has 2 plies more depth with less time and nps. If Houdini beats this monster in TCEC final I am really surprised :!: .
Jouni

fastgm
Posts: 402
Joined: Mon Aug 19, 2013 4:57 pm
Contact:

Stockfish 8 - Stockfish 7: 8000 games

Post by fastgm » Wed Nov 02, 2016 11:03 pm

TC = 20" + 0.2"

Code: Select all

Games Completed = 8000 of 8000 (Avg game length = 57.524 sec)
Settings = Gauntlet/64MB/20000ms+200ms/M 650cp for 5 moves, D 100 moves/PGN:C:\LittleBlitzer-2.75\8moves_v3.pgn(32000)
Time = 15100 sec elapsed, 0 sec remaining

 1.  Stockfish 8 64 POPCNT    	4968.0/8000	2460-524-5016	(L: m=0 t=0 i=0 a=524)  (D: r=3535 i=460 f=60 s=55 a=906)	(tpm=491.6 d=18.40 nps=859554)
 2.  Stockfish 7 64 POPCNT    	3032.0/8000	524-2460-5016	(L: m=4 t=0 i=0 a=2456) (D: r=3535 i=460 f=60 s=55 a=906)	(tpm=494.7 d=16.77 nps=921139)


    Program                  Elo    +   -   Games   Score   Av.Op.  Draws
 --------------------------------------------------------------------------
  1 Stockfish 8 64 POPCNT  : 3043   5   5   8000    62.1 %   2957   62.7 %
  2 Stockfish 7 64 POPCNT  : 2957   5   5   8000    37.9 %   3043   62.7 %


Av.Op. Elo = 3000

Result     : 4968.0/8000 (+2460,=5016,-524)
Perf.      : 62.1 %
Margins    :
 68 %      : (+  0.3,-  0.3 %) -> [ 61.8, 62.4 %]
 95 %      : (+  0.6,-  0.6 %) -> [ 61.5, 62.7 %]
 99.7 %    : (+  0.9,-  0.9 %) -> [ 61.2, 63.0 %]

Elo        : 3086
Margins    :
 68 %      : (+  2,-  2) -> [3083,3088]
 95 %      : (+  5,-  5) -> [3081,3090]
 99.7 %    : (+  7,-  7) -> [3079,3093]


Games        :   8000 (finished)

White Wins   :   1778 (22.2 %)
Black Wins   :   1206 (15.1 %)
Draws        :   5016 (62.7 %)

White Perf.  : 53.6 %
Black Perf.  : 46.4 %

JJJ
Posts: 1285
Joined: Sat Apr 19, 2014 11:47 am

Re: Stockfish 8 - Stockfish 7: 8000 games

Post by JJJ » Thu Nov 03, 2016 7:47 am

86 elo at 20 sec + 200 ms. Probably a little less at 60 sec + 600 ms and more.

PaulieD
Posts: 205
Joined: Tue Jun 25, 2013 6:19 pm

Re: Stockfish 8 - Stockfish 7: 8000 games

Post by PaulieD » Thu Nov 03, 2016 12:52 pm

1500 GAME GAUNTLET
i3 380M | 2 @ 2.53 | Win7 x64 | 6 GB Ram | Gui~ CuteChess GUI 0.9.4
Draw Adjudication~120 / 40 / 2 | Resign~3 / 4.8 | Cores~1 | HT~On
Book~TopGM_2move.pgn | Hash~8MB | Concurrency~3
Ponder~No | TB's~No | Elo~Ordo 1.2.6 | Time~20" + .2"

Stockfish 8 +94 Elo over Stockfish 7

Code: Select all

   # PLAYER         :  RATING  ERROR  PLAYED    W    D    L   (%)  D(%)
   1 Stockfish 8    :    3285     10    1500  705  553  242  65.4  36.9
   2 Komodo 10.1    :    3203     20     500  102  182  216  38.6  36.4
   3 Stockfish 7    :    3191     20     500   57  256  187  37.0  51.2
   4 Houdini 4      :    3120     22     500   83  115  302  28.1  23.0

fastgm
Posts: 402
Joined: Mon Aug 19, 2013 4:57 pm
Contact:

Stockfish 8 - Stockfish 7: 8000 games - TC = 100" + 1&q

Post by fastgm » Thu Nov 03, 2016 7:00 pm

TC = 100" + 1"

Code: Select all

Games Completed = 8000 of 8000 (Avg game length = 279.416 sec)
Settings = Gauntlet/128MB/100000ms+1000ms/M 650cp for 5 moves, D 100 moves/PGN:C:\LittleBlitzer-2.75\8moves_v3.pgn(32000)
Time = 72544 sec elapsed, 0 sec remaining

 1.  Stockfish 8 64 POPCNT    	4976.5/8000	2260-307-5433  	(L: m=0 t=0 i=0 a=307)	 (D: r=3819 i=464 f=89 s=60 a=1001)	(tpm=2392.4 d=23.38 nps=882775)
 2.  Stockfish 7 64 POPCNT    	3023.5/8000	307-2260-5433  	(L: m=2 t=0 i=0 a=2258)	(D: r=3819 i=464 f=89 s=60 a=1001)	(tpm=2400.1 d=21.28 nps=941192)


    Program                  Elo    +   -   Games   Score   Av.Op.  Draws
 --------------------------------------------------------------------------
  1 Stockfish 8 64 POPCNT  : 3043   4   4   8000    62.2 %   2957   67.9 %
  2 Stockfish 7 64 POPCNT  : 2957   4   4   8000    37.8 %   3043   67.9 %


Av.Op. Elo = 3000

Result     : 4976.5/8000 (+2260,=5433,-307)
Perf.      : 62.2 %
Margins    :
 68 %      : (+  0.3,-  0.3 %) -> [ 61.9, 62.5 %]
 95 %      : (+  0.6,-  0.6 %) -> [ 61.6, 62.8 %]
 99.7 %    : (+  0.9,-  0.8 %) -> [ 61.4, 63.1 %]

Elo        : 3087
Margins    :
 68 %      : (+  2,-  2) -> [3084,3089]
 95 %      : (+  4,-  4) -> [3082,3091]
 99.7 %    : (+  6,-  6) -> [3080,3093]


Games        :   8000 (finished)

White Wins   :   1617 (20.2 %)
Black Wins   :    950 (11.9 %)
Draws        :   5433 (67.9 %)

White Perf.  : 54.2 %
Black Perf.  : 45.8 %

Look
Posts: 202
Joined: Thu Jun 05, 2014 12:14 pm
Location: Iran
Full name: Mehdi Amini
Contact:

Re: Stockfish 8 - Stockfish 7: 400 games

Post by Look » Fri Nov 04, 2016 4:32 am

Jouni wrote:

Code: Select all

Games Completed = 400 of 400 (Avg game length = 162.580 sec)
Settings = Gauntlet/256MB/60000ms+600ms/M 450cp for 4 moves, D 100 moves/EPD:salc.epd(500)

Time = 16712 sec elapsed, 0 sec remaining
 1.  Stockfish 7 64 BMI2      	147.0/400	32-138-230  	(L: m=0 t=0 i=0 a=138) (D: r=162 i=23 f=3 s=0 a=42)	(tpm=1520.2 d=22.10 nps=2237096)
 2.  Stockfish 8 64 BMI2      	253.0/400	138-32-230  	(L: m=0 t=0 i=0 a=32) (D: r=162 i=23 f=3 s=0 a=42)	(tpm=1476.2 d=24.27 nps=2027731)
+94 ELO. Note, that SF8 has 2 plies more depth with less time and nps. If Houdini beats this monster in TCEC final I am really surprised :!: .
Can you provide the PGN file ?

CheckersGuy
Posts: 273
Joined: Wed Aug 24, 2016 7:49 pm

Re: Stockfish 8 - Stockfish 7: 400 games

Post by CheckersGuy » Sat Nov 05, 2016 11:05 am

If that +80-90 elo is actually accurate than Stockfish is now a Monster. Houdini wll have a very hard time unless Houdart did improve Houdart by 80 elo Points as well.

Jouni
Posts: 1958
Joined: Wed Mar 08, 2006 7:15 pm

Re: Stockfish 8 - Stockfish 7: 400 games

Post by Jouni » Sat Nov 05, 2016 11:10 am

Andreas: which CPU is so slow nps=859554!?
Jouni

fastgm
Posts: 402
Joined: Mon Aug 19, 2013 4:57 pm
Contact:

Re: Stockfish 8 - Stockfish 7: 400 games

Post by fastgm » Sat Nov 05, 2016 12:42 pm

Andreas: which CPU is so slow nps=859554!?
Dual AMD Opteron 6376, 32 Cores/Threads

User avatar
Dr.Wael Deeb
Posts: 9635
Joined: Wed Mar 08, 2006 7:44 pm
Location: Amman,Jordan

Re: Stockfish 8 - Stockfish 7: 400 games

Post by Dr.Wael Deeb » Sat Nov 05, 2016 5:31 pm

CheckersGuy wrote:If that +80-90 elo is actually accurate than Stockfish is now a Monster. Houdini wll have a very hard time unless Houdart did improve Houdart by 80 elo Points as well.
And even then if won't be enough ....
Dr.D
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….

Post Reply