CCRL rating lists updated (15th January 2010)

[Graham Banks]

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040.live/ (40/40)
http://www.computerchess.org.uk/ccrl/404.live/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot).



Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers are Graham Banks, Shaun Brewer, Aser Huerga, Kirill Kryukov, Dom Leste, Denis Mendoza, Cody Rowland, Wassim Saeed, Charles Smith and Gabor Szots.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code (not from the live links though - remove the .live).
ELO ratings are now saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

For any testers interested in joining our group, please read our homepage before applying.

[Carlos777]

Interesting info as usual Graham.

I wonder why CCRL shows so little interest in testing StockFish 1.6 at 40/40 so far. Or maybe you forgot to update the list?

Regards,
Carlos

[Graham Banks]

Interesting info as usual Graham.

I wonder why CCRL shows so little interest in testing StockFish 1.6 at 40/40 so far. Or maybe you forgot to update the list?

Regards,
Carlos

In which category Carlos?
64-bit, 32-bit, 4CPU, 2CPU, 1CPU?

Cheers,
Graham.

[Carlos777]

I can't see any here:

http://computerchess.org.uk/ccrl/4040.live/

Only SF 1.5.1 results. I hope I have not offended you in any way. It was not my intention btw.

Best,
Carlos

[gerold]

I can't see any here:

http://computerchess.org.uk/ccrl/4040.live/

Only SF 1.5.1 results. I hope I have not offended you in any way. It was not my intention btw.

Best,
Carlos

I don't know what is the latest version is. However it is improving
daily and diff versions come out quite often.

Best,
Gerold.

[Graham Banks]

I can't see any here:

http://computerchess.org.uk/ccrl/4040.live/

Only SF 1.5.1 results. I hope I have not offended you in any way. It was not my intention btw.

Best,
Carlos

Hi Carlos,

Of course you haven't offended me. It was a fair enough question.
Stockfish 1.6.2 is being tested, but the 64-bit 4CPU version doesn't yet have enough games to appear in the default best versions list.
However, if you click on any of the specific categories listed, you'll certainly see the results to date.

Cheers,
Graham.

[Carlos777]

Ok. I am looking at the Complete list and yes, you are right Graham. There are many versions of SF1.6 w32, x64 with 1, 2 and 4 cpu tested.

This version is the one being tested more:

Stockfish 1.6.2 32-bit 3024 +31 −31 62.5% −76.7 48.6% 319

I don't want to start a war here because I like both testing groups , but my point was that CEGT has tested SF 1.6 more and faster, I am not sure why is that, maybe they have more resources. I mean SF 1.6 was released on Xmas.

CEGT:

4 Stockfish 1.6 x64 4CPU 3127 16 16 1022 64.8% 3021 42.1%
8 Stockfish 1.6 x64 2CPU 3065 20 20 650 58.2% 3008 45.8%
14 Stockfish 1.6 x64 1CPU 3034 20 20 634 58.6% 2974 43.7%

OTOH, one thing that I like of CCRL is the way you sort the results by OS (w32, x64) and number of CPUs. This is very useful information.

Thank you guys for your hard work (CCRL and CEGT.)

Kind regards,
Carlos

[Shaun]

Just to highlight

Stockfish 1.6 & 1.6s version comparisons at the 40/4 time control.

Results

Shaun

[Shaun]

Interesting info as usual Graham.

I wonder why CCRL shows so little interest in testing StockFish 1.6 at 40/40 so far. Or maybe you forgot to update the list?

Regards,
Carlos

Hi Carlos.

there will be a lot more Stockfish 1.6 games in the next 40/40 update

Shaun

[Graham Banks]

CEGT has tested SF 1.6 more and faster, I am not sure why is that, maybe they have more resources. I mean SF 1.6 was released on Xmas.

I think it's mainly because you can run twice as many games using a 40/20 time control.
Also, I think you'll find we tend to spread our resources over testing a wider range of engines.
These comments are not intended as a criticism of CEGT. They do a great job.

Cheers,
Graham.