CCRL 40/40, 40/4 and FRC lists updated (22nd August 2015)

[Graham Banks]

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

40/40 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable)

54th Amateur Division 5 Tournament (continuing 16053)
54th Amateur Division 6 Tournament (continuing 16002)
Two Heroes Tournament (finishing Tuesday 16001)
New Tournament (starting Tuesday 16001)
Greko 12.9 64-bit Gauntlet (continuing 16064)
GnuCheese 1.00 64-bit Gauntlet (continuing 16065)
Pedone 1.2 64-bit Gauntlet (continuing 16066)
Arasan 18.0 64-bit Gauntlet (continuing 16073)
Andscacs 0.82 64-bit Gauntlet (continuing 16074)
Arminius 2015-08-06 64-bit Gauntlet (continuing 16076)
Pedone 1.2 64-bit 4CPU Gauntlet (continuing 16083)
The Fish And The Snake 4CPU Tournament (finishing Friday 16084)
New Tournament 4CPU (starting Friday 16084)
Komodo 9.2 64-bit 4CPU Gauntlet (being run by Nathanael)
Assorted 4CPU Matches (being run by Charles)
Assorted 1CPU Tournaments (being run by Charles)

40/40 testing this week that I'm aware of will include

Komodo 9.2 64-bit
Komodo 9.2 64-bit 4CPU
Schooner 1.4.1 64-bit

FRC testing this week that I'm aware of will include

Komodo 9.2 64-bit

[Modern Times]

I have published interim chess960 results for Komodo 9.2. A stunning +70 Elo improvement over Komodo 9 and more than 20 Elo clear of Stockfish 6.

http://www.computerchess.org.uk/ccrl/40 ... _pure.html

There was no doubt that Komodo 9 significantly underperformed at chess960 for whatever reason, so that certainly is a factor in the big gain. We won't see this big increase in standard chess. Anyway, the changes that were made in 9.2 have made a big difference for chess960.

[Modern Times]

I have published interim chess960 results for Komodo 9.2. A stunning +70 Elo improvement over Komodo 9 and more than 20 Elo clear of Stockfish 6.

That was after about 900 games. 350 more games have been added, 1,250 in total now, and Komodo 9.2 now shows a +62 Elo gain, and +18 Elo clear of Stockfish 6 on the pure list.

The large gain reflects that fact that Komodo 9 underperformed at chess960 for some reason. So what we are seeing here is a correction of that situation, and puts Komodo with 9.2 much more where we would expect it to be in relation to Stockfish 6. I'm not sure what Larry and Mark did to Komodo 9.2 to fix it's chess960 performance, and maybe they don't either....

http://www.computerchess.org.uk/ccrl/40 ... _pure.html

Testing of Stockfish 20 Aug 2015 is also now underway, so we will see where the two stand at the same point in their development.

[Modern Times]

The chess960 ratings list has now been updated to include Stockfish 200815. So Komodo and Stockfish are about in synch now in terms of release dates.

http://www.computerchess.org.uk/ccrl/40 ... _pure.html

Stockfish leads the ratings list once again.


Looking at the pure list cross-table and the performances against each opponent relative to the overall rating, it seems that weaker opponents hurt Stockfish's rating more than they do Komodo's. Perhaps that is the new Komodo contempt in action, or else just within the error margins.

Stockfish vs Critter -18 Elo performance (Komodo vs Critter -8 Elo perf.)
Stockfish vs Fire -20 Elo performance (Komodo vs Fire -1 Elo perf.)
Stockfish vs Rybka -19 Elo performance (Komodo vs Rybka -3 Elo perf.)

[Vinvin]

+34 points for Stockfish 200815 over Stockfish 6 !

The chess960 ratings list has now been updated to include Stockfish 200815. So Komodo and Stockfish are about in synch now in terms of release dates.

http://www.computerchess.org.uk/ccrl/40 ... _pure.html

Stockfish leads the ratings list once again.


Looking at the pure list cross-table and the performances against each opponent relative to the overall rating, it seems that weaker opponents hurt Stockfish's rating more than they do Komodo's. Perhaps that is the new Komodo contempt in action, or else just within the error margins.

Stockfish vs Critter -18 Elo performance (Komodo vs Critter -8 Elo perf.)
Stockfish vs Fire -20 Elo performance (Komodo vs Fire -1 Elo perf.)
Stockfish vs Rybka -19 Elo performance (Komodo vs Rybka -3 Elo perf.)

[Modern Times]

+34 points for Stockfish 200815 over Stockfish 6 !

Not so surprising ? There is about a 7-8 month gap between the two ?