CCRL rating lists updated (5th November 2010)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 44209
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL rating lists updated (5th November 2010)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040.live/ (40/40)
http://www.computerchess.org.uk/ccrl/404.live/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

For any testers interested in joining our group, please read our homepage before applying.
gbanksnz at gmail.com
Ferdy
Posts: 4846
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: CCRL rating lists updated (5th November 2010)

Post by Ferdy »

Graham Banks wrote:The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040.live/ (40/40)
http://www.computerchess.org.uk/ccrl/404.live/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

For any testers interested in joining our group, please read our homepage before applying.
Hi Graham, any chance for the CCRL creating new section of rating list, I would suggest a time control of sub-minute something like 40 moves in 20 sec - use single processor version of the engine. This list can be a good reference to estimate engines rating quickly.

I have also observed that the games played at this level is very interesting, something that a human can understand why engines moves like this like that. Have you seen Stockfish blundered like a human? :) . You may use cutechess-cli as interface for this. To save tourney time, you can even set the interface to run 4 pairs of games (ponder off) if you have a computer with 4 processors.
Engin
Posts: 1000
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: CCRL rating lists updated (5th November 2010)

Post by Engin »

Hi Graham,

good thx, but the engine versions are only actual on the top, other engine version are very old, that is not acceptable to compare, would be nice if some engines will be upgrade or need from some engines more games to playing, no ?
Engin
Posts: 1000
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: CCRL rating lists updated (5th November 2010)

Post by Engin »

i know that Ray plays with Tornado 4.1 his FRC tournament, but i dont meaning that, on the 40/40 is a very old Tornado 3.21a still present, and on top 20 engines are become 4 cpu that give them more distance to the other engines without more CPUS
Frank Quisinsky
Posts: 6930
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: CCRL rating lists updated (5th November 2010)

Post by Frank Quisinsky »

Hi Engin,

after the first 96 SWCR games +70 for Tornado 4.1 :-)
Not enough games but your engine is still running ...

Go Tornado go ... :-)

Very nice tourney, after the first 500 games in my still running SWCR tourney only one game lost on time ... from Stockfish 1.9.1 JA x64.

No work for myself and I can visit the games in my free time.

Best
Frank
Engin
Posts: 1000
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: CCRL rating lists updated (5th November 2010)

Post by Engin »

even in 4.1 i found some bugs again, it has a search bug with futility pruning, and its have a bug if is in doubled check, that generates false king evasions ....fixed in current 4.25 version, from now generates Tornado only legal moves that is i found even faster then to generating pseudo legal moves and then testing if is legal or not.
Frank Quisinsky
Posts: 6930
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: CCRL rating lists updated (5th November 2010)

Post by Frank Quisinsky »

Hi Engine,

in this case "we need it" ... great infos from yourself.
Good that you don't lost your interest and you develops your great engine!

Now years after ...
More and more will find it and use your work because you have an own good resuls from your long time developement. That's what engine fans like. Not an engine which started from 0 ELO with 3.000 ELO.

Believe me!
Most will see that and will like such engines or better will like such a work you do!

Enough for today ...
Late now in Germany!

Best
Frank
User avatar
Graham Banks
Posts: 44209
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL rating lists updated (5th November 2010)

Post by Graham Banks »

Engin wrote:i know that Ray plays with Tornado 4.1 his FRC tournament, but i dont meaning that, on the 40/40 is a very old Tornado 3.21a still present, and on top 20 engines are become 4 cpu that give them more distance to the other engines without more CPUS
An engine needs at least 200 games before it establishes itself in our lists.
It's hard to keep up at 40/40 when new versions are released regularly. I'm still finishing Tornado 3.6.7 games as well as running Tornado 4.1 games.
Not complaining, but just explaining. :)

Cheers,
Graham.
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 44209
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL rating lists updated (5th November 2010)

Post by Graham Banks »

Ferdy wrote:Hi Graham, any chance for the CCRL creating new section of rating list, I would suggest a time control of sub-minute something like 40 moves in 20 sec - use single processor version of the engine. This list can be a good reference to estimate engines rating quickly.

I have also observed that the games played at this level is very interesting, something that a human can understand why engines moves like this like that. Have you seen Stockfish blundered like a human? :) . You may use cutechess-cli as interface for this. To save tourney time, you can even set the interface to run 4 pairs of games (ponder off) if you have a computer with 4 processors.
Hi Ferdinand,

originally we started trying to maintain three lists (40/4, 40/10 from memory and 40/40).
Three lists were too difficult to maintain. Even two lists are currently difficult to maintain, because the recession has had an impact on some of our testers.

Cheers,
Graham.
gbanksnz at gmail.com
User avatar
Aser Huerga
Posts: 812
Joined: Tue Jun 16, 2009 10:09 am
Location: Spain

Re: CCRL rating lists updated (5th November 2010)

Post by Aser Huerga »

Graham Banks wrote:
Engin wrote:i know that Ray plays with Tornado 4.1 his FRC tournament, but i dont meaning that, on the 40/40 is a very old Tornado 3.21a still present, and on top 20 engines are become 4 cpu that give them more distance to the other engines without more CPUS
An engine needs at least 200 games before it establishes itself in our lists.
It's hard to keep up at 40/40 when new versions are released regularly. I'm still finishing Tornado 3.6.7 games as well as running Tornado 4.1 games.
Not complaining, but just explaining. :)

Cheers,
Graham.
I'm running new Tornado 4.0 gauntlets right now (you can see the first results here: http://talkchess.com/forum/viewtopic.ph ... 220#375220). In a few days over 200 40/40 games will be available.

Regards.