CCRL update (29th May 2010)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Shaun
Posts: 323
Joined: Wed Mar 08, 2006 9:55 pm
Location: Brighton - UK

CCRL update (29th May 2010)

Post by Shaun »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://www.computerchess.org.uk/ccrl/4040.live/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers are Graham Banks, Ray Banks, Shaun Brewer, Aser Huerga, Kirill Kryukov, Dom Leste, Denis Mendoza, Cody Rowland, Wassim Saeed, Gabor Szots and Martin Thoresen.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code.
ELO ratings are now saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

For any testers interested in joining our group, please read our homepage before applying.
User avatar
Leto
Posts: 2071
Joined: Thu May 04, 2006 3:40 am
Location: Dune

Re: CCRL update (29th May 2010)

Post by Leto »

Interesting, only +26 elo improvement for Rybka 4 x64 4CPU according to the CCRL 40/4 list after 550 games. I suspect the CEGT 40/4 list will show a bigger improvement tomorrow. My own testing of 300 games had it at around 50 elo for the x64 4CPU version, and Gerhard's testing for the same version had it at around 60 elo after 200 games.

However CCRL allows Rybka vs Rybka while CEGT does not, which might explain the difference. My own private testing of Rybka 4 x64 4CPU vs Rybka 3 x64 4CPU had Rybka 4 performing only +28 elo after 50 games, which is close to the +21 elo performance CCRL 40/4 got in that matchup.