CCRL rating lists updated (1st April 2011)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 44557
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL rating lists updated (1st April 2011)

Post by Graham Banks »

The purpose of our rating lists is provide engine authors and enthusiasts with a general comparison of engine strength. We also provide other data that could be of interest.
For various reasons, there may be some engines that do not appear on our lists, therefore it is useful to look at other rating lists as well as ours.
The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. However, where there is controversy surrounding an engine in our lists, we have indicated this.
We test chess engines for our own enjoyment and receive no payment for doing so.


The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040.live/ (40/40)
http://www.computerchess.org.uk/ccrl/404.live/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are often updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code, but you will need to remove the .live from the links if you wish to access these (for example http://computerchess.org.uk/ccrl/4040 ). The download databases by month or ECO code are only updated monthly, but the total games database in its entirety is always available.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

Thanks to all testers who contributed to this update.
gbanksnz at gmail.com
UncombedCoconut
Posts: 319
Joined: Fri Dec 18, 2009 11:40 am
Location: Naperville, IL

Re: CCRL rating lists updated (1st April 2011)

Post by UncombedCoconut »

Hi Graham,
Some engines on the list have no results available for their latest SMP versions. I've noticed Onno on the 40/40, and Crafty and Houdini on the 40/4. Does anyone have a complete list of such engines? Are there any active testers with quads who might be able to cover these gaps?
Thanks

P.S. Thanks in advance to whoever tells me this is a conspiracy to preserve Rybka's dominance. :P
User avatar
Graham Banks
Posts: 44557
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL rating lists updated (1st April 2011)

Post by Graham Banks »

UncombedCoconut wrote:Hi Graham,
Some engines on the list have no results available for their latest SMP versions. I've noticed Onno on the 40/40, and Crafty and Houdini on the 40/4. Does anyone have a complete list of such engines? Are there any active testers with quads who might be able to cover these gaps?
Thanks

P.S. Thanks in advance to whoever tells me this is a conspiracy to preserve Rybka's dominance. :P
Hi Justin,

unfortunately we only seem to have two testers currently contributing to 40/40 4CPU testing.

Personally, I'd like to have a few more testers who'd be interested in doing 40/40 4CPU testing in particular join the group to help out, but having had a bad experience in the past, the other members are quite wary when it comes to admitting new testers.

Any prospective new tester would need to be approved by the existing testers initially. They would have to use their real name and provide the group with contact details so that one of us could call to have a precursory chat. This tends to put many people off.

Cheers,
Graham.
gbanksnz at gmail.com
UncombedCoconut
Posts: 319
Joined: Fri Dec 18, 2009 11:40 am
Location: Naperville, IL

Re: CCRL rating lists updated (1st April 2011)

Post by UncombedCoconut »

Thanks for the answer. If I had the hardware, I'd try to give you guys help instead of criticism.
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: CCRL rating lists updated (1st April 2011)

Post by Adam Hair »

UncombedCoconut wrote:Hi Graham,
Some engines on the list have no results available for their latest SMP versions. I've noticed Onno on the 40/40, and Crafty and Houdini on the 40/4. Does anyone have a complete list of such engines? Are there any active testers with quads who might be able to cover these gaps?
Thanks

P.S. Thanks in advance to whoever tells me this is a conspiracy to preserve Rybka's dominance. :P
The Committee Committed to keep Rybka in the Lead
Yep, that is who we are. :)

Like Graham said, we are low on manpower and processor power at the
moment.