CCRL rating lists updated (9th July 2011)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 45075
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL rating lists updated (9th July 2011)

Post by Graham Banks »

The purpose of our rating lists is provide engine authors and enthusiasts with a general comparison of engine strength. We also provide other data that could be of interest.
For various reasons, there may be some engines that do not appear on our lists, therefore it is useful to look at other rating lists as well as ours.
The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. However, where there is controversy surrounding an engine in our lists, we have indicated this.
We test chess engines for our own enjoyment and receive no payment for doing so.


The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040.live/ (40/40)
http://www.computerchess.org.uk/ccrl/404.live/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are often updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code, but you will need to remove the .live from the links if you wish to access these (for example http://computerchess.org.uk/ccrl/4040 ). The download databases by month or ECO code are only updated monthly, but the total games database in its entirety is always available.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.
gbanksnz at gmail.com
Engin
Posts: 1001
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: CCRL rating lists updated (9th July 2011)

Post by Engin »

This is what i expected so long time before, now i like the ratinglist very much, because there are no more doubled engines and we can better compare each one to the others on the rating place :)
JVMerlino
Posts: 1407
Joined: Wed Mar 08, 2006 10:15 pm
Location: San Francisco, California

Re: CCRL rating lists updated (9th July 2011)

Post by JVMerlino »

Engin wrote:This is what i expected so long time before, now i like the ratinglist very much, because there are no more doubled engines and we can better compare each one to the others on the rating place :)
Engin,

Just in case you were not aware, CCRL has many variants of their rating list. All tested versions of all engines is available in the "Complete List". The "Index" list is the default one that contains no duplicates and all engines have been tested for a minimum of 200 games. And the "Pure List" contains only engines that have played a minimum of 200 games against other engines that have also played a minimum of 200 games, which is why it contains about 50 engines less than the "Index" list.

jm

p.s. Graham, please correct me if any of the above is wrong.