CCRL 40/40, 40/4 and FRC lists updated (28th June 2015)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 45330
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/40, 40/4 and FRC lists updated (28th June 2015)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

40/40 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable)

53rd Amateur Division 5 Tournament (continuing 16001)
53rd Amateur Division 6 Tournament (continuing 16053)
The Centaur And The Outcast Tournament (continuing 16002)
Andscacs 0.81 64-bit Gauntlet (continuing 16063)
Komodo 9.1 64-bit Gauntlet (continuing 16064)
Protector 1.8.0 64-bit Gauntlet II (continuing 16065)
Nemeton 1.2 Gauntlet (continuing 16073)
Hakkapeliitta 3.0 64-bit Gauntlet (starting Monday 16074)
EXchess 7.71b 64-bit Gauntlet (finishing Monday 16075)
Pawny 1.1 64-bit Gauntlet (continuing 16076)
EXchess 7.71b 64-bit 4CPU Gauntlet (continuing 16083)
The Andorran Enforcer 4CPU Tournament (finishing Wednesday 16084)
Sting SF 5 64-bit 4CPU Gauntlet (being run by Nathanael - paused)
Komodo 9.1 64-bit 4CPU Gauntlet (being run by Nathanael)
Komodo 9.1 64-bit 4CPU Matches (being run by Charles)
Assorted 1CPU Tournaments (being run by Charles)

40/4 testing this week that I'm aware of will include:

Komodo 9.1 64-bit
gbanksnz at gmail.com
Top
lkaufman
Posts: 6284
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: CCRL 40/40, 40/4 and FRC lists updated (28th June 2015)

Post by lkaufman »

So the three ratings you have so far show +62, -3, and +19 for Komodo 9.1 over Komodo 9 (9.01 or 9.02 would be the same as Komodo 9 the way you test). This averages +26. The plus 19 result was a much smaller sample than the other two, but giving it less weight would just raise the average gain. Plus 26 is well above our estimate, so we are quite happy with this result!
Komodo rules!
Top
Norm Pollock
Posts: 1080
Joined: Thu Mar 09, 2006 4:15 pm
Location: Long Island, NY, USA

Re: CCRL 40/40, 40/4 and FRC lists updated (28th June 2015)

Post by Norm Pollock »

Here is a look back at the CCRL 40/40 results over the years between Komodo and Stockfish. (Note that each pairing is listed twice, once with each player listed first. And results reflect how the first player did against the other player. Also, these are total results including results playing both colors.):

Code: Select all

                                                      Games  :  Win  : Draw  : Loss

Komodo 1.0 32-bit  :  Stockfish 1.6.3 32-bit             34  :   4+  :  20=  :  10-
Komodo 1.0 32-bit  :  Stockfish 1.7.1 32-bit             34  :   2+  :  20=  :  12-

Komodo 1.0 64-bit  :  Stockfish 1.6.3 64-bit             73  :   6+  :  45=  :  22-
Komodo 1.0 64-bit  :  Stockfish 1.6.3 64-bit 4CPU        32  :   1+  :  14=  :  17-
Komodo 1.0 64-bit  :  Stockfish 1.6s 64-bit              38  :   8+  :  18=  :  12-
Komodo 1.0 64-bit  :  Stockfish 1.7.1 64-bit             57  :   7+  :  28=  :  22-
Komodo 1.0 64-bit  :  Stockfish 1.7.1 64-bit 4CPU        50  :   2+  :  14=  :  34-

Komodo 1.2 32-bit  :  Stockfish 1.7.1 32-bit             36  :   8+  :  17=  :  11-
Komodo 1.2 32-bit  :  Stockfish 1.8 32-bit               38  :   1+  :  25=  :  12-
Komodo 1.2 32-bit  :  Stockfish 1.9.1 32-bit             43  :   5+  :  17=  :  21-

Komodo 1.2 64-bit  :  Stockfish 1.7.1 64-bit             40  :   9+  :  15=  :  16-
Komodo 1.2 64-bit  :  Stockfish 1.7.1 64-bit 4CPU        33  :   2+  :  12=  :  19-
Komodo 1.2 64-bit  :  Stockfish 1.8 64-bit               31  :   2+  :  15=  :  14-
Komodo 1.2 64-bit  :  Stockfish 1.8 64-bit 4CPU          53  :   2+  :  24=  :  27-

Komodo 1.3 32-bit  :  Stockfish 1.9.1 32-bit             33  :   4+  :  20=  :   9-
Komodo 1.3 32-bit  :  Stockfish 2.0.1 32-bit             46  :   4+  :  26=  :  16-
Komodo 1.3 32-bit  :  Stockfish 2.1.1 32-bit             36  :   7+  :  17=  :  12-

Komodo 1.3 64-bit  :  Stockfish 1.9.1 64-bit             44  :   8+  :  22=  :  14-
Komodo 1.3 64-bit  :  Stockfish 2.0.1 64-bit             20  :   3+  :  12=  :   5-
Komodo 1.3 64-bit  :  Stockfish 2.1.1 64-bit             44  :   4+  :  22=  :  18-

Komodo 2.01 64-bit  :  Stockfish 1.9.1 64-bit            15  :   6+  :   7=  :   2-
Komodo 2.01 64-bit  :  Stockfish 2.0.1 64-bit            16  :   2+  :  10=  :   4-
Komodo 2.01 64-bit  :  Stockfish 2.1.1 64-bit            64  :  14+  :  33=  :  17-

Komodo 2.03 32-bit  :  Stockfish 2.1.1 32-bit            41  :   7+  :  19=  :  15-

Komodo 2.03 64-bit  :  Stockfish 1.9.1 64-bit            16  :   4+  :  10=  :   2-
Komodo 2.03 64-bit  :  Stockfish 2.0.1 64-bit            15  :   3+  :   8=  :   4-
Komodo 2.03 64-bit  :  Stockfish 2.1.1 64-bit            28  :   5+  :  16=  :   7-

Komodo 3 32-bit  :  Stockfish 2.1.1 32-bit               54  :  15+  :  24=  :  15-
Komodo 3 32-bit  :  Stockfish 2.2.2 32-bit               30  :   5+  :  17=  :   8-

Komodo 3 64-bit  :  Stockfish 2.1.1 64-bit              158  :  46+  :  75=  :  37-
Komodo 3 64-bit  :  Stockfish 3 64-bit                   30  :   8+  :  18=  :   4-

Komodo 4 32-bit  :  Stockfish 2.1.1 32-bit               30  :   7+  :  20=  :   3-
Komodo 4 32-bit  :  Stockfish 2.2.2 32-bit               49  :  10+  :  27=  :  12-

Komodo 4 64-bit  :  Stockfish 2.1.1 64-bit              120  :  36+  :  68=  :  16-
Komodo 4 64-bit  :  Stockfish 2.2 64-bit                 26  :   8+  :  13=  :   5-
Komodo 4 64-bit  :  Stockfish 2.2.2 64-bit               35  :  12+  :  17=  :   6-
Komodo 4 64-bit  :  Stockfish 2.2.2 64-bit 4CPU          56  :   4+  :  39=  :  13-

Komodo 5 32-bit  :  Stockfish 2.2.2 32-bit               32  :   4+  :  21=  :   7-
Komodo 5 32-bit  :  Stockfish 2.3.1 32-bit               64  :  14+  :  41=  :   9-

Komodo 5 64-bit  :  Stockfish 2.2.2 64-bit               73  :  21+  :  43=  :   9-
Komodo 5 64-bit  :  Stockfish 2.2.2 64-bit 4CPU          42  :   5+  :  19=  :  18-
Komodo 5 64-bit  :  Stockfish 2.3.1 64-bit               48  :  15+  :  26=  :   7-
Komodo 5 64-bit  :  Stockfish 2.3.1 64-bit 4CPU          16  :   3+  :   9=  :   4-
Komodo 5 64-bit  :  Stockfish DD 64-bit                   9  :   1+  :   7=  :   1-

Komodo 5.1 64-bit  :  Stockfish 3 64-bit                 30  :   9+  :  15=  :   6-
Komodo 5.1 64-bit  :  Stockfish 4 64-bit                 30  :   2+  :  21=  :   7-
Komodo 5.1 64-bit  :  Stockfish 5 64-bit                  3  :   0+  :   2=  :   1-

Komodo 5.1 64-bit 4CPU  :  Stockfish 3 64-bit 4CPU      113  :  27+  :  74=  :  12-
Komodo 5.1 64-bit 4CPU  :  Stockfish 4 64-bit 4CPU       60  :  12+  :  32=  :  16-

Komodo 6 64-bit  :  Stockfish 4 64-bit                   32  :   6+  :  24=  :   2-
Komodo 6 64-bit  :  Stockfish DD 64-bit                  83  :  14+  :  45=  :  24-

Komodo 6 64-bit 4CPU  :  Stockfish 4 64-bit 4CPU        109  :  19+  :  79=  :  11-
Komodo 6 64-bit 4CPU  :  Stockfish DD 64-bit 4CPU        34  :   3+  :  23=  :   8-

Komodo 7a 64-bit  :  Stockfish 5 64-bit                  76  :  16+  :  42=  :  18-
Komodo 7a 64-bit  :  Stockfish DD 64-bit                 30  :   7+  :  16=  :   7-

Komodo 7a 64-bit 4CPU  :  Stockfish 5 64-bit 4CPU       130  :   9+  :  89=  :  32-
Komodo 7a 64-bit 4CPU  :  Stockfish DD 64-bit 4CPU       82  :  10+  :  54=  :  18-

Komodo 8 64-bit  :  Stockfish 5 64-bit                   50  :   8+  :  37=  :   5-
Komodo 8 64-bit  :  Stockfish 6 64-bit                   39  :   4+  :  25=  :  10-

Komodo 8 64-bit 4CPU  :  Stockfish 5 64-bit 4CPU        104  :  20+  :  75=  :   9-
Komodo 8 64-bit 4CPU  :  Stockfish 6 64-bit 4CPU         92  :   6+  :  66=  :  20-

Komodo 9 64-bit  :  Stockfish 6 64-bit                   74  :  12+  :  42=  :  20-

Komodo 9 64-bit 4CPU  :  Stockfish 6 64-bit 4CPU         92  :  17+  :  64=  :  11-

Komodo 9.1 64-bit  :  Stockfish 6 64-bit                 88  :  12+  :  64=  :  12-

Komodo 9.1 64-bit 4CPU  :  Stockfish 6 64-bit 4CPU       61  :  11+  :  42=  :   8-

Komodo CCT 64-bit  :  Stockfish 3 64-bit                142  :  41+  :  68=  :  33-
Komodo CCT 64-bit  :  Stockfish 3 64-bit 4CPU            30  :   6+  :  16=  :   8-
Komodo CCT 64-bit  :  Stockfish 4 64-bit                 30  :  11+  :  17=  :   2-

Komodo TCEC 64-bit  :  Stockfish 4 64-bit                10  :   1+  :   9=  :   0-
Komodo TCEC 64-bit  :  Stockfish DD 64-bit               90  :  15+  :  56=  :  19-

Komodo TCEC 64-bit 4CPU  :  Stockfish DD 64-bit 4CPU    104  :  12+  :  69=  :  23-

Stockfish 1.6.3 32-bit  :  Komodo 1.0 32-bit             34  :  10+  :  20=  :   4-

Stockfish 1.6.3 64-bit  :  Komodo 1.0 64-bit             73  :  22+  :  45=  :   6-

Stockfish 1.6.3 64-bit 4CPU  :  Komodo 1.0 64-bit        32  :  17+  :  14=  :   1-

Stockfish 1.6s 64-bit  :  Komodo 1.0 64-bit              38  :  12+  :  18=  :   8-

Stockfish 1.7.1 32-bit  :  Komodo 1.0 32-bit             34  :  12+  :  20=  :   2-
Stockfish 1.7.1 32-bit  :  Komodo 1.2 32-bit             36  :  11+  :  17=  :   8-

Stockfish 1.7.1 64-bit  :  Komodo 1.0 64-bit             57  :  22+  :  28=  :   7-
Stockfish 1.7.1 64-bit  :  Komodo 1.2 64-bit             40  :  16+  :  15=  :   9-

Stockfish 1.7.1 64-bit 4CPU  :  Komodo 1.0 64-bit        50  :  34+  :  14=  :   2-
Stockfish 1.7.1 64-bit 4CPU  :  Komodo 1.2 64-bit        33  :  19+  :  12=  :   2-

Stockfish 1.8 32-bit  :  Komodo 1.2 32-bit               38  :  12+  :  25=  :   1-

Stockfish 1.8 64-bit  :  Komodo 1.2 64-bit               31  :  14+  :  15=  :   2-

Stockfish 1.8 64-bit 4CPU  :  Komodo 1.2 64-bit          53  :  27+  :  24=  :   2-

Stockfish 1.9.1 32-bit  :  Komodo 1.2 32-bit             43  :  21+  :  17=  :   5-
Stockfish 1.9.1 32-bit  :  Komodo 1.3 32-bit             33  :   9+  :  20=  :   4-

Stockfish 1.9.1 64-bit  :  Komodo 1.3 64-bit             44  :  14+  :  22=  :   8-
Stockfish 1.9.1 64-bit  :  Komodo 2.01 64-bit            15  :   2+  :   7=  :   6-
Stockfish 1.9.1 64-bit  :  Komodo 2.03 64-bit            16  :   2+  :  10=  :   4-

Stockfish 2.0.1 32-bit  :  Komodo 1.3 32-bit             46  :  16+  :  26=  :   4-

Stockfish 2.0.1 64-bit  :  Komodo 1.3 64-bit             20  :   5+  :  12=  :   3-
Stockfish 2.0.1 64-bit  :  Komodo 2.01 64-bit            16  :   4+  :  10=  :   2-
Stockfish 2.0.1 64-bit  :  Komodo 2.03 64-bit            15  :   4+  :   8=  :   3-

Stockfish 2.1.1 32-bit  :  Komodo 1.3 32-bit             36  :  12+  :  17=  :   7-
Stockfish 2.1.1 32-bit  :  Komodo 2.03 32-bit            41  :  15+  :  19=  :   7-
Stockfish 2.1.1 32-bit  :  Komodo 3 32-bit               54  :  15+  :  24=  :  15-
Stockfish 2.1.1 32-bit  :  Komodo 4 32-bit               30  :   3+  :  20=  :   7-

Stockfish 2.1.1 64-bit  :  Komodo 1.3 64-bit             44  :  18+  :  22=  :   4-
Stockfish 2.1.1 64-bit  :  Komodo 2.01 64-bit            64  :  17+  :  33=  :  14-
Stockfish 2.1.1 64-bit  :  Komodo 2.03 64-bit            28  :   7+  :  16=  :   5-
Stockfish 2.1.1 64-bit  :  Komodo 3 64-bit              158  :  37+  :  75=  :  46-
Stockfish 2.1.1 64-bit  :  Komodo 4 64-bit              120  :  16+  :  68=  :  36-

Stockfish 2.2 64-bit  :  Komodo 4 64-bit                 26  :   5+  :  13=  :   8-

Stockfish 2.2.2 32-bit  :  Komodo 3 32-bit               30  :   8+  :  17=  :   5-
Stockfish 2.2.2 32-bit  :  Komodo 4 32-bit               49  :  12+  :  27=  :  10-
Stockfish 2.2.2 32-bit  :  Komodo 5 32-bit               32  :   7+  :  21=  :   4-

Stockfish 2.2.2 64-bit  :  Komodo 4 64-bit               35  :   6+  :  17=  :  12-
Stockfish 2.2.2 64-bit  :  Komodo 5 64-bit               73  :   9+  :  43=  :  21-

Stockfish 2.2.2 64-bit 4CPU  :  Komodo 4 64-bit          56  :  13+  :  39=  :   4-
Stockfish 2.2.2 64-bit 4CPU  :  Komodo 5 64-bit          42  :  18+  :  19=  :   5-

Stockfish 2.3.1 32-bit  :  Komodo 5 32-bit               64  :   9+  :  41=  :  14-

Stockfish 2.3.1 64-bit  :  Komodo 5 64-bit               48  :   7+  :  26=  :  15-

Stockfish 2.3.1 64-bit 4CPU  :  Komodo 5 64-bit          16  :   4+  :   9=  :   3-

Stockfish 3 64-bit  :  Komodo 3 64-bit                   30  :   4+  :  18=  :   8-
Stockfish 3 64-bit  :  Komodo 5.1 64-bit                 30  :   6+  :  15=  :   9-
Stockfish 3 64-bit  :  Komodo CCT 64-bit                142  :  33+  :  68=  :  41-

Stockfish 3 64-bit 4CPU  :  Komodo 5.1 64-bit 4CPU      113  :  12+  :  74=  :  27-
Stockfish 3 64-bit 4CPU  :  Komodo CCT 64-bit            30  :   8+  :  16=  :   6-

Stockfish 4 64-bit  :  Komodo 5.1 64-bit                 30  :   7+  :  21=  :   2-
Stockfish 4 64-bit  :  Komodo 6 64-bit                   32  :   2+  :  24=  :   6-
Stockfish 4 64-bit  :  Komodo CCT 64-bit                 30  :   2+  :  17=  :  11-
Stockfish 4 64-bit  :  Komodo TCEC 64-bit                10  :   0+  :   9=  :   1-

Stockfish 4 64-bit 4CPU  :  Komodo 5.1 64-bit 4CPU       60  :  16+  :  32=  :  12-
Stockfish 4 64-bit 4CPU  :  Komodo 6 64-bit 4CPU        109  :  11+  :  79=  :  19-

Stockfish 5 64-bit  :  Komodo 5.1 64-bit                  3  :   1+  :   2=  :   0-
Stockfish 5 64-bit  :  Komodo 7a 64-bit                  76  :  18+  :  42=  :  16-
Stockfish 5 64-bit  :  Komodo 8 64-bit                   50  :   5+  :  37=  :   8-

Stockfish 5 64-bit 4CPU  :  Komodo 7a 64-bit 4CPU       130  :  32+  :  89=  :   9-
Stockfish 5 64-bit 4CPU  :  Komodo 8 64-bit 4CPU        104  :   9+  :  75=  :  20-

Stockfish 6 64-bit  :  Komodo 8 64-bit                   39  :  10+  :  25=  :   4-
Stockfish 6 64-bit  :  Komodo 9 64-bit                   74  :  20+  :  42=  :  12-
Stockfish 6 64-bit  :  Komodo 9.1 64-bit                 88  :  12+  :  64=  :  12-

Stockfish 6 64-bit 4CPU  :  Komodo 8 64-bit 4CPU         92  :  20+  :  66=  :   6-
Stockfish 6 64-bit 4CPU  :  Komodo 9 64-bit 4CPU         92  :  11+  :  64=  :  17-
Stockfish 6 64-bit 4CPU  :  Komodo 9.1 64-bit 4CPU       61  :   8+  :  42=  :  11-

Stockfish DD 64-bit  :  Komodo 5 64-bit                   9  :   1+  :   7=  :   1-
Stockfish DD 64-bit  :  Komodo 6 64-bit                  83  :  24+  :  45=  :  14-
Stockfish DD 64-bit  :  Komodo 7a 64-bit                 30  :   7+  :  16=  :   7-
Stockfish DD 64-bit  :  Komodo TCEC 64-bit               90  :  19+  :  56=  :  15-

Stockfish DD 64-bit 4CPU  :  Komodo 6 64-bit 4CPU        34  :   8+  :  23=  :   3-
Stockfish DD 64-bit 4CPU  :  Komodo 7a 64-bit 4CPU       82  :  18+  :  54=  :  10-
Stockfish DD 64-bit 4CPU  :  Komodo TCEC 64-bit 4CPU    104  :  23+  :  69=  :  12-
Top
Modern Times
Posts: 3807
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (28th June 2015)

Post by Modern Times »

Looking at the gap to Stockfish 6:

Blitz

On 1CPU - Komodo 9.1 is 4 Elo ahead of Stockfish 6

On 4CPU - Komodo 9.1 is 8 Elo behind Stockfish 6


4040

On 1CPU - Komodo 9.1 is 2 Elo behind Stockfish 6

On 4CPU - Komodo 9.1 is 32 Elo ahead of Stockfish 6

Many more games needed on 4040.
Top

Return to “Computer Chess Club: Tournaments and Matches”