CCRL rating lists updated (7th January 2011)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 44571
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL rating lists updated (7th January 2011)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040.live/ (40/40)
http://www.computerchess.org.uk/ccrl/404.live/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

Thanks to all testers who contributed to this update.
For any testers interested in joining our group, please read our homepage before applying. At present we'd be interested in hearing from anybody who'd be prepared to do 4CPU testing.
gbanksnz at gmail.com
Jouni
Posts: 3646
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: CCRL rating lists updated (7th January 2011)

Post by Jouni »

Interesting:

Stockfish 1.8 64-bit 3235 +19 −19 69.5% −152.0 25.1% 1100
Stockfish 2.0.1 64-bit 3234 +22 −21 66.7% −129.0 27.4% 800

Jouni
Uri Blass
Posts: 10882
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: CCRL rating lists updated (7th January 2011)

Post by Uri Blass »

Stockfish is still not better than Rybka3 in normal chess based on the 40/4 list(the error is still too high to be sure but Rybka3 has better rating)

Rybka 3 64-bit 4CPU 3260 +10 −10 77.5% −204.4 30.9% 5021 85.3%
Stockfish 2.0.1 64-bit 4CPU 3248 +21 −21 70.6% −139.5 40.1% 798
Jouni
Posts: 3646
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: CCRL rating lists updated (7th January 2011)

Post by Jouni »

Addition: this was FRC chess!

Stockfish 1.8 64-bit 3235 +19 −19 69.5% −152.0 25.1% 1100
Stockfish 2.0.1 64-bit 3234 +22 −21 66.7% −129.0 27.4%

Jouni
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: CCRL rating lists updated (7th January 2011)

Post by Sedat Canbaz »

Hello dear Graham !

Many Thanks for your update,efforts...and for using Perfect opening books
>40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).
I have a question:

I just wonder about CCRL 40/4 or CEGT 40/4 adapted time controls ?!

Which adjusted time control is used (the testes who are owner of latest new processors-Intel Core i7 920,AMD Phenom II X6 1090T...) ?

As far as i know,the latest new processors are approx. 5 times faster than AMD64 X2 4600+

And in this case of using a such faster hardwares,its will be very hard to adapt 40 moves in 4 minutes repeating adjusted to the AMD64 X2 4600+
Note:even 40 moves in 1 minutes will not be equal

Greetings,
Sedat
User avatar
Graham Banks
Posts: 44571
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL rating lists updated (7th January 2011)

Post by Graham Banks »

Sedat Canbaz wrote:...........I just wonder about CCRL 40/4 or CEGT 40/4 adapted time controls ?!

Which adjusted time control is used (the testes who are owner of latest new processors-Intel Core i7 920,AMD Phenom II X6 1090T...) ?

As far as i know,the latest new processors are approx. 5 times faster than AMD64 X2 4600+

And in this case of using a such faster hardwares,its will be very hard to adapt 40 moves in 4 minutes repeating adjusted to the AMD64 X2 4600+
Note:even 40 moves in 1 minutes will not be equal

Greetings,
Sedat
Hi Sedat,

that's a good question.
I'm not sure that any of our blitz testers currently have hardware that would pose this problem, but I'll find out for you what the solution would be if they did.
My simple answer would be to use such fast hardware for CCRL 40/40 testing.

Cheers,
Graham.

PS - your Perfect books are right up there amongst the best for our testing, so please keep up your efforts in this regard. :D
gbanksnz at gmail.com
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: CCRL rating lists updated (7th January 2011)

Post by Sedat Canbaz »

Graham Banks wrote:
Sedat Canbaz wrote:...........I just wonder about CCRL 40/4 or CEGT 40/4 adapted time controls ?!

Which adjusted time control is used (the testes who are owner of latest new processors-Intel Core i7 920,AMD Phenom II X6 1090T...) ?

As far as i know,the latest new processors are approx. 5 times faster than AMD64 X2 4600+

And in this case of using a such faster hardwares,its will be very hard to adapt 40 moves in 4 minutes repeating adjusted to the AMD64 X2 4600+
Note:even 40 moves in 1 minutes will not be equal

Greetings,
Sedat
Hi Sedat,

that's a good question.
I'm not sure that any of our blitz testers currently have hardware that would pose this problem, but I'll find out for you what the solution would be if they did.
My simple answer would be to use such fast hardware for CCRL 40/40 testing.

Cheers,
Graham.

Hello Graham,
PS - your Perfect books are right up there amongst the best for our testing, so please keep up your efforts in this regard.
Thanks a lot for your kind words..

Yes...during latest 4-5 years was ok,but as you know the latest processors
are much faster and i hope CCRL/CEGT Team will solve this problem

Best,
Sedat
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: CCRL rating lists updated (7th January 2011)

Post by Adam Hair »

Sedat Canbaz wrote:
Graham Banks wrote:
Sedat Canbaz wrote:...........I just wonder about CCRL 40/4 or CEGT 40/4 adapted time controls ?!

Which adjusted time control is used (the testes who are owner of latest new processors-Intel Core i7 920,AMD Phenom II X6 1090T...) ?

As far as i know,the latest new processors are approx. 5 times faster than AMD64 X2 4600+

And in this case of using a such faster hardwares,its will be very hard to adapt 40 moves in 4 minutes repeating adjusted to the AMD64 X2 4600+
Note:even 40 moves in 1 minutes will not be equal

Greetings,
Sedat
Hi Sedat,

that's a good question.
I'm not sure that any of our blitz testers currently have hardware that would pose this problem, but I'll find out for you what the solution would be if they did.
My simple answer would be to use such fast hardware for CCRL 40/40 testing.

Cheers,
Graham.

Hello Graham,
PS - your Perfect books are right up there amongst the best for our testing, so please keep up your efforts in this regard.
Thanks a lot for your kind words..

Yes...during latest 4-5 years was ok,but as you know the latest processors
are much faster and i hope CCRL/CEGT Team will solve this problem

Best,
Sedat
Hi Sedat,

So far, none of us who do the 40/4 testing have the newest processors.
That will be a dilemma for us at some point. I don't know when we will
have to face that dilemma; none of us seem ready to upgrade our
computers.

However, though it may sound strange to say so, if necessary we could
under-clock to in order to match the CCRL standard.

Adam