CCRL 40/40 lists updated (7th July 2012)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 44760
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/40 lists updated (7th July 2012)

Post by Graham Banks »

Please note that we are no longer using our "live" links. Clicking on those old links (in most cases) should redirect you to the ones given below.

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are updated separately to each other. The 40/40 and 40/4 lists are updated once every two weeks and alternately to each other. The FRC list is updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code. The download databases by month or ECO code are only updated monthly, but the total games database in its entirety is always available.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.
gbanksnz at gmail.com
Uri Blass
Posts: 10912
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: CCRL 40/40 lists updated (7th July 2012)

Post by Uri Blass »

Interesting that komodo4 does not seem to scale better than Houdini1.5

40/4 rating list

Houdini 1.5a 64-bit 3165 +11 −11 68.7% −141.6 31.0% 3147
Komodo 4 64-bit 3127 +11 −10 60.4% −81.5 36.4% 3584

40/40 rating list

Houdini 1.5a 64-bit 3156 +17 −17 64.1% −93.3 42.4% 1169
Komodo 4 64-bit 3118 +12 −11 57.9% −53.5 47.9% 2413

The elo gap is not smaller with more time.

Interesting also that Rybka3 is leading the 32 bits programs in the blitz list(because many 32 bit programs are missing)

http://computerchess.org.uk/ccrl/404/cg ... ons_only=1