CCRL rating lists updated (17th December 2011)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 44573
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL rating lists updated (17th December 2011)

Post by Graham Banks »

The purpose of our rating lists is provide engine authors and enthusiasts with a general comparison of engine strength. We also provide other data that could be of interest.
For various reasons, there may be some engines that do not appear on our lists, therefore it is useful to look at other rating lists as well as ours.
The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. However, where there is controversy surrounding an engine in our lists, we have indicated this.
We test chess engines for our own enjoyment and receive no payment for doing so.


The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040.live/ (40/40)
http://www.computerchess.org.uk/ccrl/404.live/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are often updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code, but you will need to remove the .live from the links if you wish to access these (for example http://computerchess.org.uk/ccrl/4040 ). The download databases by month or ECO code are only updated monthly, but the total games database in its entirety is always available.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.


40/40 games submitted this week
Abrok 5.0 -> 14
Alaric 0702b -> 2
Alaric 707 -> 24
Alex 1.96 -> 6
Alex 2.14a 32-bit -> 28
Alfil 11 -> 33
Alfil 8.1.1 -> 24
Amy 0.87b -> 14
Amyan 1.72 -> 24
Arasan 11.4 32-bit -> 2
Arasan 13.4 32-bit -> 43
Ares 1.004 -> 22
Atak 6.2 -> 4
Averno 0.81 -> 14
BSC 3.9+ 32-bit -> 8
Bagatur 1.2b 32-bit -> 2
Bearded N44.2 -> 2
Betsabe II 1.08c -> 26
Betsabe II 1.09c -> 8
BigLion 2.23w -> 8
BikJump 1.8 -> 4
Bison 9.6 -> 2
Bobcat 2.75 32-bit -> 9
Booot 4.10.1 -> 2
Booot 4.13.0 -> 4
Booot 5.1.0 -> 14
Bright 0.4a -> 2
Bright 0.5c -> 29
Brutus 6.0 -> 4
Brutus 8.05 32-bit -> 19
Bubble 1.5 -> 8
CM10th Xperience -> 6
Cheng3 1.06 32-bit -> 48
Chess Tiger 2007 -> 8
ChessKiss 1.3a -> 78
Chessmaster 11 -> 11
Chiron 1.1 32-bit -> 37
Clueless 1.4 -> 8
Colossus 2008b -> 26
Counter 0.8 -> 2
Counter 1.2 -> 22
Crafty 22.4 32-bit -> 4
Crafty 23.1 32-bit -> 6
Critter 1.2 32-bit -> 14
CuckooChess 1.12 -> 61
Cyrano 0.6b17 -> 9
DanaSah 4.66 -> 29
Deep Junior 12.5 32-bit 1CPU -> 7
Deep Sjeng c't 2010 -> 14
Delphil 2.3 -> 2
Delphil 2.8 -> 38
Deuterium 11.01.28.159 -> 27
Dirty 0.99z -> 2
Dirty 25Aug2011 32-bit -> 9
Dirty 6J-22 -> 2
Dorky 4.3 32-bit -> 28
DoubleCheck 2.1 32-bit -> 8
E.T. Chess 13.01.08 -> 2
EveAnn 1.66 -> 12
FireFly 2.5.13 32-bit -> 2
Francesca MAD 0.19 -> 40
Fritz 13 -> 95
GChess IV 0.2.0 -> 8
Gandalf 6 -> 9
GarboChess 3.0 32-bit -> 22
GarboChess 3.0 64-bit -> 24
Gaviota 0.84 32-bit -> 35
Gaviota 0.84 64-bit -> 48
Ghost 2.0.1 -> 14
Glass 1.8 32-bit -> 51
Glass 1.8 64-bit -> 216
Godel 2.05 32-bit -> 93
GreKo 5.2.5 -> 4
GreKo 6.30 -> 2
Green Light Chess 3.01.2.2 -> 16
Gull 1.0a 32-bit -> 15
Gull 1.2 32-bit -> 24
Gull 1.2 64-bit -> 32
Hamsters 0.0.6 -> 6
Hannibal 1.1 32-bit -> 24
Heracles 0.6.16 -> 8
Hermann 1.9 -> 2
Hermann 2.8 32-bit -> 22
Hiarcs 13.2 -> 7
Hiarcs 13.2 4CPU -> 224
Houdini 2.0 64-bit 4CPU -> 52
Houdini 2.0c 32-bit -> 231
Hussar 0.4 -> 16
Ifrit j2.9 -> 4
Ifrit j4.3 -> 8
Ifrit m1.5 -> 40
Jazz 501 32-bit -> 2
Komodo 3 32-bit -> 14
Ktulu 8 -> 8
Kurt 271009 -> 6
LittleThought 1.04 32-bit -> 2
LoopList 6.00 -> 2
Marvin 1.3.0 -> 8
MatMoi 7.15.0 -> 8
Matheus 2.3 -> 8
Mediocre 0.4 -> 28
Monarch 1.7 -> 8
Monik 2.2.3 32-bit -> 8
Movei 00.8.438 -> 2
Murka 2.0 32-bit -> 64
N2 0.4 32-bit -> 22
NanoSzachy 3.1 -> 2
NanoSzachy 3.9 -> 38
Naum 4.2 32-bit -> 14
Naum 4.2 64-bit 4CPU -> 32
Neurosis 2.3 -> 2
Onno 1.2.70 64-bit 4CPU -> 32
Patzer 3.80 -> 14
Pawny 0.3.1 32-bit -> 51
Petir 4.999999 -> 16
Philou 2.7.0 -> 2
Philou 3.60 -> 67
Plisk 0.2.7d 32-bit -> 14
Popochin 2.9 -> 2
ProDeo 1.74 -> 284
Protector 1.4.0 32-bit -> 55
Protector 1.4.0 64-bit -> 29
Protector 1.4.0 64-bit 4CPU -> 32
Protej 0.5.7 -> 8
Pupsi2 0.08 -> 16
Quazar 0.3 32-bit -> 55
RedQueen 1.0.0 32-bit -> 20
RedQueen 1.0.0 64-bit -> 24
Reger 0.09 -> 8
Rodin 4.0 -> 47
Rotor 0.6 -> 19
Rybka 2.3.2a 32-bit -> 14
Rybka 4.1 32-bit -> 14
Rybka 4.1 64-bit 4CPU -> 52
SOS 5.1 -> 40
Schola 1.1.0 -> 8
Scorpio 1.91 -> 2
Scorpio 2.0 -> 4
Shredder 12 32-bit OA Off -> 8
Shredder 12 32-bit OA On -> 6
Simplex 0.9.8 32-bit -> 34
Sjakk 1.1.8 -> 14
Slibo 0.5.1 -> 16
Sloppy 0.2.3 64-bit -> 48
Slow Chess Blitz WV2.1 -> 24
Smash 1.0.3 -> 8
Spark 1.0 32-bit -> 26
Spark 1.0 64-bit 4CPU -> 32
Spike 1.2 Turin -> 2
Spike 1.4 Leiden -> 13
Stockfish 2.1.1 32-bit -> 14
TJchess 1.01 -> 14
Tao 5.6 -> 16
Thinker 5.4C Inert 64-bit 4CPU -> 32
Thinker 5.4D Inert 32-bit -> 14
Thor's Hammer 2.28 32-bit -> 14
Toga II 1.4.1SE 4CPU -> 32
Tornado 3.42a 32-bit -> 2
Tornado 4.82 32-bit -> 6
Tornado 4.87 32-bit -> 11
Typhoon 1.00-348 -> 2
Tytan 9.32 -> 14
Ufim 8.02 -> 24
Umko 1.2 32-bit -> 2
Warrior 1.0.3 -> 8
Waxman 2008 -> 2
Waxman 2010 -> 14
WildCat 8 -> 24
iCE 0.1 -> 2
iCE 0.2 -> 14


40/4 games submitted this week
Alaric 707 -> 32
Alfil 11 MT 2CPU -> 446
Bobcat 2.75 64-bit 2CPU -> 32
Brutus 8.05 64-bit 2CPU -> 32
Chess Tiger 2007.1 -> 32
Colossus 2008b -> 32
Critter 1.2 64-bit 4CPU -> 57
Critter 1.2 64-bit 6CPU -> 583
CyberPagno 2.1 -> 32
Deep Junior 12.5 64-bit 4CPU -> 50
Deep Shredder 12 64-bit OA On 4CPU -> 58
Deep Sjeng 3.0 64-bit 4CPU -> 50
Deep Sjeng WC2008 64-bit 4CPU -> 50
Delfi 5.4 -> 32
Deuterium 10.01.27.213 -> 32
Dirty 24Apr2011 64-bit -> 32
E.T. Chess 13.01.08 -> 32
EveAnn 1.66 -> 32
Firefly 2.5.8 64-bit -> 32
Fritz 13 -> 1696
Gaviota 0.84 64-bit -> 32
Hamsters 0.7.1 2CPU -> 31
Hiarcs 13.1 4CPU -> 50
Hiarcs 13.2 4CPU -> 49
Houdini 1.5a 64-bit 4CPU -> 72
Houdini 2.0 64-bit 4CPU -> 50
Houdini 2.0c 64-bit 6CPU -> 546
Komodo 3 64-bit -> 413
Lime 66 -> 32
Mediocre 0.4 -> 160
Movei 00.8.438 (10 10 10) -> 32
Naum 4.2 64-bit 4CPU -> 50
OBender 3.2.x -> 32
Onno 1.2.70 64-bit 4CPU -> 50
Pharaon 3.5.1 2CPU -> 32
Protector 1.4.0 64-bit 4CPU -> 50
Rybka 4.1 64-bit 4CPU -> 455
Rybka 4.1 64-bit 6CPU -> 511
Spark 1.0 64-bit 4CPU -> 50
Spike 1.4 Leiden 4CPU -> 50
Stockfish 2.1.1 64-bit 4CPU -> 456
Stockfish 2.1.1 64-bit 6CPU -> 514
Thinker 5.4c Inert 64-bit 4CPU -> 50
Toga II 1.4 beta5c 4CPU -> 50
WildCat 8 -> 31
Zappa Mexico II 64-bit 4CPU -> 50
gbanksnz at gmail.com
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: CCRL rating lists updated (17th December 2011)

Post by kranium »

Graham Banks wrote: We test chess engines for our own enjoyment and receive no payment for doing so.[/i]
yeah, right..
c'mon Graham, be straight here..

you guys receive commercial engines for free, and have for many years...
or is George S. a liar?

that ends up totaling to many hundreds (i.e. thousands) of dollars...
that most CC users must pay for the same engines.
sure smells like financial compensation (payment) to me!

it's no wonder you are so biased and un-inclusive in your engine rating lists.

please give us a break with this incessant spin/nonsense you're spewing...

PS-
Larry K.- I googled it...

from Wikipedia:
"Consumer Reports does not print outside advertising, accept free product samples, or permit the commercial use of its reviews for selling products. Its publisher states that this policy allows the magazine to "maintain our independence and impartiality... [so that] CU has no agenda other than the interests of consumers."
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: CCRL rating lists updated (17th December 2011)

Post by kranium »

lkaufman wrote: I doubt very much that Consumer Reports has to pay for the cars they test (I could be wrong though), or in general that testing organizations have to pay for the products they test. That is just common sense.
Well I guess our definitions of 'common sense' differ...
because it sure seems like a major conflict of interest to me.
Last edited by kranium on Sun Dec 18, 2011 1:24 am, edited 1 time in total.
User avatar
Graham Banks
Posts: 44573
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL rating lists updated (17th December 2011)

Post by Graham Banks »

kranium wrote:
Graham Banks wrote: We test chess engines for our own enjoyment and receive no payment for doing so.[/i]
yeah, right..
c'mon Graham, be straight here..

you guys receive commercial engines for free, and have for many years...
or is George S. a liar?

that ends up totaling to many hundreds (i.e. thousands) of dollars...
that most CC users must pay for the same engines.
sure smells like financial compensation (payment) to me!

it's no wonder you are so biased and un-inclusive in your engine rating lists.

please give us a break with this incessant spin/nonsense you're spewing...

PS-
Larry K.- I googled it...

from Wikipedia:
"Consumer Reports does not print outside advertising, accept free product samples, or permit the commercial use of its reviews for selling products. Its publisher states that this policy allows the magazine to "maintain our independence and impartiality... [so that] CU has no agenda other than the interests of consumers."
http://www.talkchess.com/forum/viewtopi ... 09&t=41131

You're like a broken record Norm. Get over it and have a nice Christmas/New Year. :)

And please don't misrepresent the facts - there are only a tiny number of commercial engines that we are provided free copies of and this did not happen until we'd established ourselves.

Regardless, I don't really care what you think about it anyway. :wink:
gbanksnz at gmail.com
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: CCRL rating lists updated (17th December 2011)

Post by kranium »

Graham Banks wrote: And please don't misrepresent the facts - there are only a tiny number of commercial engines that we are provided free copies of and this did not happen until we'd established ourselves.
am i misrepresenting the facts?
did I say it was a 'huge number' or that it happened before you were established?

go ahead spin it as you see fit...damage control, etc.
but it is what it is...
no matter how much you'd like to...you simply can't change that.
geots wrote: 7. "As a tester he has befriended me, and he is laughing all the way to the bank." This one is really off the charts. Have no idea how you reach this conclusion. Competent testers are not a rarity. And he never asked me to do any private beta testing for him. I do not think that you realize that every beta, following beta, version, upgraded version with an "a", "c", "n", whatever- before he went commercial- I have each and every one of them. Then after he went commercial- I have every beta, every version he sold, and every update to every version. If he wrote it, I have it. And from the first free beta to the last commercial version he has put out- it has cost me NADA- i.e., not one dime have I spent. It was all given to me free.
So if he is laughing at me- I missed the joke and the punch line.
gts