SF 171212 vs Komodo 11.2.2 - TCEC 10 Superfinal openings

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

SF 171212 vs Komodo 11.2.2 - TCEC 10 Superfinal openings

Post by fastgm »

50 openings from the TCEC 10 Superfinal, Stockfish 171212 vs Komodo 11.2.2, Contempt=0, 1 thread
Dual Intel Xeon X5670 @ 2.93 GHz, Cutechess-Cli, no adjudication rules
Each 100 games with doubling time control.

All games: http://www.fastgm.de/schach/SF171212-T1 ... erfinal.7z

Code: Select all

Depth     : Average search depth
Time      : Total time engine used
Moves     : Total moves engine played
Average   : Average time per move in centi-seconds


Time in seconds

TC = 120" + 1.2"

    Program                Elo    +   -   Games   Score   Av.Op.  Draws       Depth       Time   Games     Moves  Average
 ------------------------------------------------------------------------    ---------------------------------------------
  1 Stockfish 171212 T1  : 3039   50  49   100    61.0 %   2961   48.0 %      27.59    5:32:48     100      8176    2.44
  2 Komodo 11.2.2 T1     : 2961   49  50   100    39.0 %   3039   48.0 %      22.54    5:36:09     100      8162    2.47

Individual statistics:

1 Stockfish 171212 T1  : 3039  100 (+ 37,= 48,- 15), 61.0 %
2 Komodo 11.2.2 T1     : 2961  100 (+ 15,= 48,- 37), 39.0 %

-------------------------------------------------------------------------------------------------------------------------

TC = 240" + 2.4"

    Program                Elo    +   -   Games   Score   Av.Op.  Draws       Depth       Time   Games     Moves  Average
 ------------------------------------------------------------------------    ---------------------------------------------
  1 Stockfish 171212 T1  : 3048   47  46   100    63.5 %   2952   53.0 %      28.67   10:35:59     100      7510    5.08
  2 Komodo 11.2.2 T1     : 2952   46  47   100    36.5 %   3048   53.0 %      23.58   10:50:13     100      7495    5.21

Individual statistics:

1 Stockfish 171212 T1  : 3048  100 (+ 37,= 53,- 10), 63.5 %
2 Komodo 11.2.2 T1     : 2952  100 (+ 10,= 53,- 37), 36.5 %

-------------------------------------------------------------------------------------------------------------------------

TC = 480" + 4.8"

    Program                Elo    +   -   Games   Score   Av.Op.  Draws       Depth       Time   Games     Moves  Average
 ------------------------------------------------------------------------    ---------------------------------------------
  1 Stockfish 171212 T1  : 3039   41  39   100    61.0 %   2961   64.0 %      32.33   21:21:00     100      7732     9.94
  2 Komodo 11.2.2 T1     : 2961   39  41   100    39.0 %   3039   64.0 %      26.26   21:53:13     100      7719    10.21

Individual statistics:
 
1 Stockfish 171212 T1  : 3039  100 (+ 29,= 64,-  7), 61.0 %
2 Komodo 11.2.2 T1     : 2961  100 (+  7,= 64,- 29), 39.0 %

-------------------------------------------------------------------------------------------------------------------------

TC = 960" + 9.6"

    Program                Elo    +   -   Games   Score   Av.Op.  Draws       Depth       Time   Games     Moves  Average
 ------------------------------------------------------------------------    ---------------------------------------------
  1 Stockfish 171212 T1  : 3043   40  37   100    62.0 %   2957   66.0 %      34.82   43:50:08     100      8034    19.64
  2 Komodo 11.2.2 T1     : 2957   37  40   100    38.0 %   3043   66.0 %      28.24   44:42:27     100      8018    20.07

Individual statistics:

1 Stockfish 171212 T1  : 3043  100 (+ 29,= 66,-  5), 62.0 %
2 Komodo 11.2.2 T1     : 2957  100 (+  5,= 66,- 29), 38.0 %

-------------------------------------------------------------------------------------------------------------------------

TC = 1920" + 19.2"

    Program                Elo    +   -   Games   Score   Av.Op.  Draws       Depth       Time   Games     Moves  Average
 ------------------------------------------------------------------------    ---------------------------------------------
  1 Stockfish 171212 T1  : 3028   42  41   100    58.0 %   2972   62.0 %      37.34   89:33:14     100      8366    38.54
  2 Komodo 11.2.2 T1     : 2972   41  42   100    42.0 %   3028   62.0 %      29.81   91:00:16     100      8359    39.19

Individual statistics:

1 Stockfish 171212 T1  : 3028  100 (+ 27,= 62,- 11), 58.0 %
2 Komodo 11.2.2 T1     : 2972  100 (+ 11,= 62,- 27), 42.0 %

-------------------------------------------------------------------------------------------------------------------------

TC = 3840" + 38.4"

    Program                Elo    +   -   Games   Score   Av.Op.  Draws       Depth       Time   Games     Moves  Average
 ------------------------------------------------------------------------    ---------------------------------------------
  1 Stockfish 171212 T1  : 3035   34  29   100    60.0 %   2965   76.0 %      39.86  177:19:00     100      8172    78.11
  2 Komodo 11.2.2 T1     : 2965   29  34   100    40.0 %   3035   76.0 %      33.12  178:11:51     100      8164    78.58

Individual statistics:

1 Stockfish 171212 T1  : 3035  100 (+ 22,= 76,-  2), 60.0 %
2 Komodo 11.2.2 T1     : 2965  100 (+  2,= 76,- 22), 40.0 %

-------------------------------------------------------------------------------------------------------------------------

TC = 7680" + 76.8"

    Program                Elo    +   -   Games   Score   Av.Op.  Draws       Depth       Time   Games     Moves  Average
 ------------------------------------------------------------------------    ---------------------------------------------
  1 Stockfish 171212 T1  : 3003   39  39   100    51.0 %   2997   68.0 %      41.26  368:44:04     100      8567   154.95
  2 Komodo 11.2.2 T1     : 2997   39  39   100    49.0 %   3003   68.0 %      34.42  367:09:36     100      8561   154.40

Individual statistics:

1 Stockfish 171212 T1  : 3003  100 (+ 17,= 68,- 15), 51.0 %
2 Komodo 11.2.2 T1     : 2997  100 (+ 15,= 68,- 17), 49.0 %

-------------------------------------------------------------------------------------------------------------------------

TC = 15360" + 153.6"

    Program                Elo    +   -   Games   Score   Av.Op.  Draws       Depth       Time   Games     Moves  Average
 ------------------------------------------------------------------------    ---------------------------------------------
  1 Stockfish 171212 T1  : 3033   33  27   100    59.5 %   2967   79.0 %      44.43  733:33:24     100      8698   303.61
  2 Komodo 11.2.2 T1     : 2967   27  33   100    40.5 %   3033   79.0 %      37.32  729:44:54     100      8680   302.66

Individual statistics:

1 Stockfish 171212 T1  : 3033  100 (+ 20,= 79,-  1), 59.5 %
2 Komodo 11.2.2 T1     : 2967  100 (+  1,= 79,- 20), 40.5 %
.
Top
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: SF 171212 vs Komodo 11.2.2 - TCEC 10 Superfinal openings

Post by JJJ »

Seems more time doesn't help much anymore against Stockfish now !
Top
sovaz1997
Posts: 292
Joined: Sun Nov 13, 2016 10:37 am

Re: SF 171212 vs Komodo 11.2.2 - TCEC 10 Superfinal openings

Post by sovaz1997 »

How did you get such interesting statistics?
Thanks for this test!
Top
Modern Times
Posts: 3756
Joined: Thu Jun 07, 2012 11:02 pm

Re: SF 171212 vs Komodo 11.2.2 - TCEC 10 Superfinal openings

Post by Modern Times »

JJJ wrote:Seems more time doesn't help much anymore against Stockfish now !
No but I wonder if more cores does.
Top
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Re: SF 171212 vs Komodo 11.2.2 - TCEC 10 Superfinal openings

Post by fastgm »

With Protools from Ed Schroeder you can create such statistics.
http://rebel13.nl/misc/protools16a.html

Put your pgn in the pgn subfolder, press F1 and select Match Stats
Top
Leo
Posts: 1104
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: SF 171212 vs Komodo 11.2.2 - TCEC 10 Superfinal openings

Post by Leo »

Thanks for the contest. Did you really only use 1 core?
Advanced Micro Devices fan.
Top
Leo
Posts: 1104
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: SF 171212 vs Komodo 11.2.2 - TCEC 10 Superfinal openings

Post by Leo »

Modern Times wrote:
JJJ wrote:Seems more time doesn't help much anymore against Stockfish now !
No but I wonder if more cores does.
I would think it would.
Advanced Micro Devices fan.
Top
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Re: SF 171212 vs Komodo 11.2.2 - TCEC 10 Superfinal openings

Post by fastgm »

Yes, 1 core, 11 parallel games, no HT, 1 core free for OS activities.
Top
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Re: SF 171212 vs Komodo 11.2.2 - TCEC 10 Superfinal openings

Post by fastgm »

Here an additional tc on another machine and 5-men Syzygy Tablebases.

50 openings from the TCEC 10 Superfinal, Stockfish 171212 vs Komodo 11.2.2, Contempt=0, 1 thread
Dual Intel Xeon E5-2670 @ 2.6 GHz, Cutechess-Cli, adjudication rules, 5-men Syzygy Tablebases
100 games, 30720 sec + 307.2 sec ~ 8.5 hrs + 5 min

All games: http://www.fastgm.de/schach/SF171212-T1 ... +307.2.pgn

Code: Select all

    Program                Elo    +   -   Games   Score   Av.Op.  Draws       Depth        Time   Games     Moves  Average
------------------------------------------------------------------------    ----------------------------------------------
  1 Stockfish 171212 T1  : 3010   38  37   100    53.0 %   2990   70.0 %      45.63  1160:31:16     100      6225   671.14
  2 Komodo 11.2.2 T1     : 2990   37  38   100    47.0 %   3010   70.0 %      37.98  1199:15:04     100      6225   693.54


  Result     : 53.0/100 (+18,=70,-12)
  Perf.      : 53.0 %
  Margins    :
   68 %      : (+  2.7,-  2.7 %) -> [ 50.3, 55.7 %]
   95 %      : (+  5.4,-  5.3 %) -> [ 47.7, 58.4 %]
   99.7 %    : (+  8.1,-  8.0 %) -> [ 45.0, 61.1 %]

  Elo        : 3021
  Margins    :
   68 %      : (+ 19,- 19) -> [3002,3040]
   95 %      : (+ 38,- 37) -> [2984,3059]
   99.7 %    : (+ 58,- 56) -> [2965,3079]

  Games        :    100 (finished)

  White Wins   :     23 (23.0 %)
  Black Wins   :      7 ( 7.0 %)
  Draws        :     70 (70.0 %)

  White Perf.  : 58.0 %
  Black Perf.  : 42.0 %


  Individual statistics:

  1 Stockfish 171212 T1  : 3010  100 (+ 18,= 70,- 12), 53.0 %
  2 Komodo 11.2.2 T1     : 2990  100 (+ 12,= 70,- 18), 47.0 %
.
Top

Return to “Computer Chess Club: Tournaments and Matches”