CCRL rating lists updated (10th September 2011)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 44557
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL rating lists updated (10th September 2011)

Post by Graham Banks »

The purpose of our rating lists is provide engine authors and enthusiasts with a general comparison of engine strength. We also provide other data that could be of interest.
For various reasons, there may be some engines that do not appear on our lists, therefore it is useful to look at other rating lists as well as ours.
The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. However, where there is controversy surrounding an engine in our lists, we have indicated this.
We test chess engines for our own enjoyment and receive no payment for doing so.


The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040.live/ (40/40)
http://www.computerchess.org.uk/ccrl/404.live/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are often updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code, but you will need to remove the .live from the links if you wish to access these (for example http://computerchess.org.uk/ccrl/4040 ). The download databases by month or ECO code are only updated monthly, but the total games database in its entirety is always available.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.


40/40 games this week (sorted by number of games):
Houdini 2.0 64-bit -> 410
Komodo 3 64-bit -> 326
Spark 1.0 64-bit 4CPU -> 224
DoubleCheck 1.3.1 64-bit -> 210
Komodo 3 32-bit -> 196
Naum 4.2 64-bit -> 144
Arasan 13.0 64-bit -> 120
GreKo 8.2 32-bit -> 115
Rybka 4.1 64-bit -> 90
Critter 1.2 64-bit -> 88
Dirty 25Aug2011 32-bit -> 78
Deep Sjeng c't 2010 -> 74
EveAnn 1.66 -> 66
Stockfish 2.1.1 64-bit -> 66
Chesley r323 -> 56
Betsabe II 1.08 -> 52
Gull 1.2 64-bit -> 48
Shredder 12 64-bit OA On -> 46
Ice 0.2 -> 40
Spike 1.4 Leiden -> 39
Bagatur 1.1.3 -> 36
Zappa Mexico II 64-bit 4CPU -> 32
Deep Shredder 12 64-bit OA On 4CPU -> 32
Critter 1.2 64-bit 4CPU -> 32
Rybka 4.1 64-bit 4CPU -> 32
Stockfish 2.1.1 64-bit 4CPU -> 32
Protector 1.4.0 64-bit 4CPU -> 32
Amyan 1.72 -> 32
Houdini 1.5a 64-bit 4CPU -> 32
ECE 11.01 -> 29
Booot 5.1.0 -> 28
Rodin 4.0 -> 26
Cheng3 1.04 32-bit -> 26
Pawny 0.2.2 32-bit -> 25
KnockOut 0.7.1 -> 25
Colossus 2008b -> 24
Sloppy 0.2.3 64-bit -> 24
Spark 1.0 32-bit -> 24
Alaric 707 -> 24
Hiarcs 13.2 -> 24
Shredder 12 32-bit OA On -> 24
Protector 1.4.0 32-bit -> 24
Pharaon 3.5.1 -> 24
Naum 4.2 32-bit -> 23
Gull 1.2 32-bit -> 22
Deep Junior 12.5 32-bit 1CPU -> 22
Houdini 1.5a 32-bit -> 22
Rybka 4.1 32-bit -> 22
Stockfish 2.1.1 32-bit -> 22
Critter 1.2 32-bit -> 22
Thinker 5.4D Inert 32-bit -> 22
Hannibal 1.1 32-bit -> 22
Alex 2.14a 32-bit -> 21
BikJump 2.01 -> 21
Prophet 2.0 -> 21
KMTChess 1.2.1 64-bit -> 21
Matheus 2.3 -> 21
Mustang 4.97 -> 21
Monarch 1.7 -> 21
ChessMind 0.82 -> 21
NagaSkaki 5.12 -> 21
TJchess 1.01 -> 20
LittleThought 1.052 32-bit -> 20
Hussar 0.4 -> 20
DanaSah 4.66 -> 20
Pupsi2 0.08 -> 20
NanoSzachy 3.8 -> 20
Counter 1.2 -> 20
Delphil 2.8 -> 20
Atlas 3.14b 32-bit -> 19
Umko 1.2 32-bit -> 18
Gull 1.1 64-bit -> 16
Houdini 1.5a 64-bit -> 16
Protector 1.4.0 64-bit -> 16
ChessKiss 1.3 -> 16
Zappa Mexico II 64-bit -> 16
Spark 1.0 64-bit -> 16
Butcher 1.61 32-bit -> 15
Sungorus 1.4 32-bit -> 15
Ghost 2.0.1 -> 15
Ares 1.004 -> 15
Chaturanga 2.4.3 -> 15
Simplex 0.9.7 32-bit -> 15
Eeyore 1.52 -> 15
Myrddin 0.85 32-bit -> 14
Glass 1.7 32-bit -> 14
Dorky 4.3 32-bit -> 14
Plisk 0.2.7d 32-bit -> 14
Waxman 2010 -> 14
Jazz 444 32-bit -> 14
DoubleCheck 1.4 32-bit -> 14
Fritz 12 -> 14
Arasan 13.1 32-bit -> 13
Toga II 3.1.2SE -> 12
Onno 1.2.70 32-bit -> 12
Bright 0.5c -> 12
Philou 3.60 -> 12
Rybka 2.3.2a 32-bit -> 12
Zappa Mexico II 32-bit -> 12
Jonny 4.00 -> 12
Shredder 12 32-bit OA Off -> 10
Gaviota 0.83 32-bit -> 8
OliThink 5.3.0 -> 8
RattateChess 1.0 Nosferatu -> 8
Xpdnt 091007 -> 8
Atak 6.8 -> 8
AliChess 4.25 -> 8
Dolphin 1.0 -> 8
Adam 3.3 -> 8
N2 0.4 32-bit -> 8
Sjakk 1.1.8 -> 8
Gull 1.0a 32-bit -> 8
Brutus 8.05 32-bit -> 8
Beowulf 2.4a 32-bit -> 8
Rotor 0.6 -> 8
Hermann 2.8 32-bit -> 8
GarboChess 3.0 32-bit -> 8
CuckooChess 1.11 -> 8
Brutus 5.4 -> 6
Rotor 0.1a -> 6
Crafty 20.14 32-bit -> 6
Spike 1.2 Turin -> 6
Ktulu 9 -> 6
Brutus 7.02b -> 6
Naum 1.91 32-bit -> 6
Naraku 1.31 -> 6
CuckooChess 1.09 -> 6
Hannibal 1.0a 32-bit -> 6
Bright 0.3a -> 6
AnMon 5.60 -> 6
Twisted Logic 20100131x 32-bit -> 6
Scorpio 1.7 -> 6
Neurosis 2.3 -> 6
Tornado 2.1.41a -> 6
Bison 9.6 -> 6
Amundsen 0.65.1 -> 6
Alaric 0702b -> 6
Cheese 1.2 -> 6
Twisted Logic 0.085 -> 6
CM10th Default -> 5
Deuterium 11.01.28.159 -> 5
Hiarcs 9 -> 5
Simplex 0.9.3 32-bit -> 5
Slow Chess Blitz WV2 -> 5
FireFly 2.5.12 -> 4
Glass 0.1.0c -> 4
Carballo 0.5 32-bit -> 4
Bearded 06_29_02 -> 4
KMTChess 1.2.1 32-bit -> 4
Frenzee Dec07 -> 4
LoopList 6.00 -> 4
Kurt 0.9.2 32-bit -> 4
Ifrit j4.3 32-bit -> 4
NanoSzachy 3.1 -> 2
Counter 0.8 -> 2
Arasan 9.2 -> 2
Hermann 1.9 -> 2
Pupsi2 0.06 -> 2
Abrok 5.0 -> 2
DanaSah 2.85 -> 2
Sage 2.2a -> 2
Alex 2.09 -> 2
LittleThought 1.00 32-bit -> 2
Twisted Logic 20070915 -> 1


40/4 games this week(sorted by number of games):
Uralochka 1.1b -> 1184
BugChess2 1.9 64-bit -> 1051
Komodo 3 64-bit -> 1021
Storm 0.6 -> 917
Needle 0.531 -> 819
Ares 1.004 -> 710
Frenzee 3.5.19 64-bit -> 604
Houdini 2.0 64-bit 4CPU -> 445
Embracer 1.12 -> 306
DChess 1.0.2 -> 95
Elf 1.3.0 -> 94
Laurifer 1.0 -> 92
Mizar 3.0 -> 91
PolarChess 1.3 -> 88
Grizzly 1.40.1b -> 75
Deep Shredder 12 64-bit OA On 4CPU -> 73
Naum 4.2 64-bit 4CPU -> 73
Spike 1.4 Leiden 4CPU -> 73
Rybka 4.1 64-bit 4CPU -> 73
Rybka 4 64-bit 4CPU -> 72
Zappa Mexico II 64-bit 4CPU -> 72
Toga II 1.4 beta5c 4CPU -> 72
Spark 1.0 64-bit 4CPU -> 72
Deep Junior 12.5 64-bit 4CPU -> 72
Critter 1.2 64-bit 4CPU -> 72
Hiarcs 13.2 4CPU -> 72
Onno 1.2.70 64-bit 4CPU -> 72
Deep Sjeng WC2008 64-bit 4CPU -> 72
Hiarcs 13.1 4CPU -> 72
Stockfish 2.1.1 64-bit 4CPU -> 72
Deep Sjeng 3.0 64-bit 4CPU -> 72
Thinker 5.4c Inert 64-bit 4CPU -> 72
Protector 1.4.0 64-bit 4CPU -> 72
Houdini 1.5a 64-bit 4CPU -> 71
KnightX 1.92 -> 66
Beaches 2.32 -> 66
Bison 9.11 64-bit -> 64
Rybka 2.3.2a 64-bit -> 64
Predateur 2.1 64-bit -> 64
Piranha 0.5 -> 64
Daydreamer 1.75 64-bit -> 64
Spike 1.4 Leiden -> 64
Protector 1.4.0 64-bit -> 64
Umko 0.9 64-bit -> 64
Delfi 5.4 -> 64
Scorpio 2.7 64-bit -> 64
Toga II 1.4.1SE -> 64
Tornado 4.40 64-bit -> 64
Twisted Logic 20090922 64-bit -> 64
Jonny 4.00 -> 64
Naum 2.0 32-bit -> 63
Thinker 5.4c Inert 64-bit -> 63
Aldebaran 0.7.0 -> 63
Slow Chess Blitz WV2.1 -> 63
WildCat 8 -> 63
Spark 1.0 64-bit -> 63
Chronos 1.9.9 64-bit -> 63
Bace 0.45 -> 63
ALChess 1.5b -> 62
Dabbaba 2.62 -> 62
Purple Haze 2.0 -> 62
Soldat 0.25b -> 62
Roce 0.0390 -> 62
MiniMardi 1.3 -> 62
Zotron 4.4.6 -> 61
Cecir 3.5 -> 61
Simontacchi 1.81 -> 61
Tscp 1.81 -> 60
Robin 0.983 -> 59
CyberPagno 2.1 -> 57
SEE 0.6.9 -> 57
Alarm 0.93.1 -> 55
Ant 2006-F -> 54
Stockfish 2.0.1 64-bit 4CPU -> 49
Adamant 1.7 -> 40
Genesis 2.0 -> 34
Clarabit 1.00 64-bit -> 34
Atlas 2.20 -> 34
Scidlet 3.61 x64 JA -> 34
Ghost 0.14 -> 34
InmiChess3.06N -> 34
Chispa 4.0.3 -> 34
GK 0.90 64-bit -> 34
Sunsetter 10.3 64-bit -> 34
Madeleine 0.2 -> 34
Nesik 0.7.0 alpha -> 34
Bodo 0.2b -> 34
Anechka 0.08 -> 34
WJChess 1.64 -> 34
Parrot 070722 -> 34
EXchess 5.01b 64-bit -> 34
Matheus 2.3 -> 34
Eeyore 1.48 -> 34
Fortress 1.62 -> 34
Natwarlal 0.14 -> 34
Monarch 1.7 -> 34
Alf 1.09 -> 34
Ayito 0.2.994 -> 34
Averno 0.81 -> 34
Latista (Sinobyl) 1.5 -> 34
Matilde 2008 64-bit -> 34
Dorky 3.48 -> 34
Esc 1.16 -> 33
Zeus 1.29 -> 33
Wing 2.0a -> 33
E.T. Chess 13.01.08 -> 32
Bearded 06-29 -> 32
Der Bringer 1.9 -> 32
Leila 0.53h -> 32
Colossus 2008b -> 32
Hannibal 1.1 64-bit -> 32
Booot 5.1.0 -> 32
Movei 00.8.438 (10 10 10) -> 32
Alaric 707 -> 32
Sage 3.53 -> 32
Matacz 1.4 -> 32
Chezzz 1.0.3 -> 32
Popochin 3.2 -> 32
Bright 0.5c -> 32
Gosu 0.16 -> 32
Alfil 8.1.1 Optimized -> 32
Gull 1.0a 64-bit -> 32
Loop 13.6 (Loop 2007) 64-bit -> 32
Cyrano 06b17 64-bit -> 32
Crafty 23.4 64-bit -> 32
Cerebro 3.03d -> 32
MSCP 1.44 -> 32
Surprise 4.3b13 -> 32
Frenzee Feb08 64-bit -> 32
Amy 0.8.7b DC -> 31
Uragano 3D 0.87 -> 31
N2 0.4 64-bit -> 31
SnailChess 4.013 -> 31
Crazy Bishop 0052 -> 31
Belzebub 0.67 -> 31
NanoSzachy 3.8 -> 31
Zappa Mexico II 64-bit -> 31
Comet B68 -> 31
Pharaon 3.5.1 -> 31
Horizon 4.4 -> 31
Djinn 0.925x -> 31
SpiderChess 070603 -> 30
Warrior 1.0.3 -> 30
Cilian 4.14 -> 29
Clueless V1.4 -> 29
Morphy 3.22 -> 29
Amateur 2.82 -> 26
Beowulf 2.4a 32-bit -> 26
Armageddon 2.308 -> 23
Bestia 0.90 -> 20
gbanksnz at gmail.com
lkaufman
Posts: 6257
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: CCRL rating lists updated (10th September 2011)

Post by lkaufman »

What percentage (roughly) of your tests on Komodo 3 were run on machines that could use the sse version, and if they could use it did they always do so? It seems to make a bigger difference on Komodo than on other programs.

Thanks.
Jouni
Posts: 3645
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: CCRL rating lists updated (10th September 2011)

Post by Jouni »

In both standard chess lists Houdini 2 is below 1.5a after 500 games :o

Jouni
User avatar
Graham Banks
Posts: 44557
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL rating lists updated (10th September 2011)

Post by Graham Banks »

lkaufman wrote:What percentage (roughly) of your tests on Komodo 3 were run on machines that could use the sse version, and if they could use it did they always do so? It seems to make a bigger difference on Komodo than on other programs.

Thanks.
I ran all of the 32-bit games for the 40/40 list. Two gauntlets were run on the Q6600 and the other gauntlet on the i5.
As for the 64-bit games on the 40/40 list, I'd need to find out for you.

Graham.
Last edited by Graham Banks on Sun Sep 11, 2011 9:18 pm, edited 2 times in total.
gbanksnz at gmail.com
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: CCRL rating lists updated (10th September 2011)

Post by Adam Hair »

lkaufman wrote:What percentage (roughly) of your tests on Komodo 3 were run on machines that could use the sse version, and if they could use it did they always do so? It seems to make a bigger difference on Komodo than on other programs.

Thanks.
Hi Larry,

I will have to ask around to give you full details. The 40/4 games I submitted for Komodo 3 were non-sse.

Adam
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: CCRL rating lists updated (10th September 2011)

Post by Adam Hair »

Graham Banks wrote:
lkaufman wrote:What percentage (roughly) of your tests on Komodo 3 were run on machines that could use the sse version, and if they could use it did they always do so? It seems to make a bigger difference on Komodo than on other programs.

Thanks.
I ran all of the 32-bit games for the 40/40 list. Two gauntlets were run on the Q6600 and the other gauntlet on the i5.
As for the 64-bit games on the 40/40 list, I'd need to find out for you.

Graham.
It appears the only 32-bit version of Komodo available is non-sse.
User avatar
Graham Banks
Posts: 44557
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL rating lists updated (10th September 2011)

Post by Graham Banks »

Adam Hair wrote:
lkaufman wrote:What percentage (roughly) of your tests on Komodo 3 were run on machines that could use the sse version, and if they could use it did they always do so? It seems to make a bigger difference on Komodo than on other programs.

Thanks.
Hi Larry,

I will have to ask around to give you full details. The 40/4 games I submitted for Komodo 3 were non-sse.

Adam
The 660 40/40 x64 games are:
388 SSE
272 Non-SSE
gbanksnz at gmail.com
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Re: CCRL rating lists updated (10th September 2011)

Post by IWB »

Hi Graham,
Graham Banks wrote:
The 660 40/40 x64 games are:
388 SSE
272 Non-SSE
I dont think that mixing engine versions which are definately different is the right way for a rating list! What about other engines?

Houdini
Komodo 388/272
Rybka
Critter
Umko
...

And how do you control that all engines which are available in SSE and NONSSE get the same ratio of games?

I know that the difference is bigger, but thinking this to the logical end you could combine 32 and 64 bit versions as well.

Bye
Ingo