CCRL 40/40 lists updated (27th April 2013)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 45252
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/40 lists updated (27th April 2013)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are updated separately to each other. The 40/40 and 40/4 lists are updated once every two weeks and alternately to each other. The FRC list is updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine or ECO code. The total games database in its entirety is always available.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.


Games submitted for this update
Protector 1.5.0 64-bit -> 117
BlackMamba 1.2c 64-bit -> 110
Gull R375 64-bit 4CPU -> 97
DeepSaros 3.3b 64-bit -> 62
Dirty 20Apr2013 64-bit -> 62
Houdini 3 Tactical 64-bit -> 61
Komodo 5 64-bit -> 61
Capivara LK 0.09a01a 64-bit -> 55
BlackMamba 1.4 64-bit -> 50
Vajolet 1.62.1 -> 49
Critter 1.6a 64-bit -> 46
Hannibal 1.3 64-bit -> 44
Rybka 4.1 64-bit -> 42
Hiarcs 14 -> 42
Nemo 1.0.1 64-bit -> 40
Crafty 23.4 64-bit 4CPU -> 40
Quazar 0.4 64-bit -> 39
Deep Junior 13.3 64-bit 1CPU -> 38
Mediocre 0.5 -> 37
TJchess 1.1 64-bit -> 37
EveAnn 1.71a -> 37
Rybka 4.1 64-bit 4CPU -> 37
Sting SF 2 64-bit -> 37
Houdini 3 64-bit 4CPU -> 37
Jazz 721 64-bit -> 36
IvanHoe 9.46h 64-bit -> 36
Sjakk 2.0 64-bit -> 36
Strelka 5.5 64-bit -> 36
Stockfish 2.3.1 64-bit -> 36
RomiChess P3L 64-bit -> 35
NirvanaChess 1.0 -> 35
Butcher 1.64 64-bit -> 35
OliThink 5.3.2 64-bit -> 35
ECE 12.01 -> 35
Waxman 2011 -> 35
Bagatur 1.3a 64-bit -> 35
Myrddin 0.86 64-bit -> 35
Betsabe II 1.30 64-bit -> 35
Ifrit m1.8 64-bit -> 34
Murka 2.0 64-bit -> 32
Pupsi2 0.09 -> 32
Alex 2.14a 64-bit -> 32
Delphil 2.9g 64-bit -> 32
iCE 0.3 -> 32
Predateur 2.2.1 64-bit -> 32
Cheese 1.4 64-bit -> 32
Shredder 12 64-bit OA Off -> 32
Hermann 2.8 64-bit -> 32
Pawny 0.3.1 64-bit -> 32
Chiron 1.5 64-bit -> 32
Rodin 5.1 -> 32
Dorky 4.3 64-bit -> 32
Thinker 5.4D Inert 64-bit -> 31
Gull R375 64-bit -> 31
Ziggurat 0.18 64-bit -> 30
Vitruvius 1.11C 64-bit -> 28
Naum 4.2 64-bit -> 28
RobboLito 0.21Q 64-bit -> 27
Carballo 0.4 32-bit -> 22
Critter 1.6a 64-bit 4CPU -> 21
Stockfish 2.3.1 64-bit 4CPU -> 21
DoubleCheck 1.0 64-bit -> 20
Gaviota 0.86 64-bit 4CPU -> 18
EXchess 7.03b 64-bit 4CPU -> 18
Tigran 2.3 64-bit -> 18
Octochess r4984 64-bit 4CPU -> 18
Bouquet 1.6 64-bit -> 18
Scorpio 2.7.5 64-bit 4CPU -> 18
Deep Junior 13.3 64-bit 4CPU -> 17
Naum 4.2 64-bit 4CPU -> 16
Hiarcs 14 4CPU -> 16
Vitruvius 1.11C 64-bit 4CPU -> 16
Booot 5.1.0 -> 14
Stockfish 2.2.2 64-bit -> 12
Gull II b2 64-bit -> 9
Chiron 1.1a 64-bit -> 9
Alfil 13.1 64-bit 4CPU -> 8
Zappa Mexico II 64-bit 4CPU -> 8
Spark 1.0 64-bit 4CPU -> 8
Scorpio 2.7.5 64-bit -> 8
MinkoChess 1.3 64-bit 4CPU -> 8
Jonny 4.00 4CPU -> 8
Bouquet 1.5 64-bit -> 8
Tornado 4.88 64-bit 4CPU -> 8
Crafty 23.5 64-bit 4CPU -> 8
Onno 1.2.70 64-bit 4CPU -> 8
Thinker 5.4D Inert 64-bit 4CPU -> 8
Deep Sjeng WC2008 64-bit 4CPU -> 8
BugChess2 1.9 64-bit 4CPU -> 8
Texel 1.01 64-bit -> 8
Bright 0.5c 4CPU -> 8
Nebula 2.0 64-bit 4CPU -> 8
Toga II 3.0 4CPU -> 8
Loop 13.6 (Loop 2007) 64-bit 4CPU -> 8
Arasan 15.3 64-bit 4CPU -> 8
ChessKiss 1.7 64-bit -> 8
Rhetoric Lite -> 7
ProChess 1.02AD -> 7
Critter 0.60 64-bit -> 6
EXchess 7.03b 64-bit -> 6
Rodent 1.0 64-bit -> 6
FireFly 2.6.0 64-bit -> 6
Glaurung 2.1 64-bit -> 6
Shallow 1.0 64-bit -> 6
ProDeo 1.85 -> 6
Jabba 13032012 -> 6
RedQueen 1.1.3 64-bit -> 6
Arasan 15.4 64-bit -> 6
BigLion 2.23x -> 5
Cupcake 1.1a -> 5
Dabbaba 7.49 -> 5
Gibbon 2.57a 64-bit -> 5
Soldat III 0.172 -> 5
MadChess 1.2 -> 5
Rotor 0.1a -> 4
Zeus 1.28 -> 4
GreKo 5.9 -> 4
FireFly 2.5.13 64-bit -> 2
Plisk 0.2.6 64-bit -> 2
Quazar 0.2 64-bit -> 2
Ifrit m1.6 32-bit -> 2
RomiChess P3L 32-bit -> 2
Popochin 2.9 -> 2
gbanksnz at gmail.com
tpetzke
Posts: 686
Joined: Thu Mar 03, 2011 4:57 pm
Location: Germany

Re: CCRL 40/40 lists updated (27th April 2013)

Post by tpetzke »

Hi Graham,

is it possible that the 40/40 list is missing games ?

On March 10 I'm sure that iCE was listed with 420 games as

#118 2474 +29 -29 420

Now it only has 368 games which include new games from D5 that weren't there March 10 already.

Not that it really matters, I just noticed.

Thomas...
User avatar
Graham Banks
Posts: 45252
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/40 lists updated (27th April 2013)

Post by Graham Banks »

tpetzke wrote:Hi Graham,

is it possible that the 40/40 list is missing games ?

On March 10 I'm sure that iCE was listed with 420 games as

#118 2474 +29 -29 420

Now it only has 368 games which include new games from D5 that weren't there March 10 already.

Not that it really matters, I just noticed.

Thomas...
Shouldn't be missing games. I'll ask Ray to check.
gbanksnz at gmail.com
Modern Times
Posts: 3800
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/40 lists updated (27th April 2013)

Post by Modern Times »

It is not missing any games.
tpetzke
Posts: 686
Joined: Thu Mar 03, 2011 4:57 pm
Location: Germany

Re: CCRL 40/40 lists updated (27th April 2013)

Post by tpetzke »

Of course it is your list and so no one from outside can say it misses something.

The 60 games more or less don't change anything anyway for iCE.

Thomas...
User avatar
Evert
Posts: 2929
Joined: Sat Jan 22, 2011 12:42 am
Location: NL

Re: CCRL 40/40 lists updated (27th April 2013)

Post by Evert »

Perhaps it played against opponents that have been removed from the active list? Jazz 640 used to be included (but not listed, due to too few games), but was replaced with 721 and no longer appears. Presumably its games were removed too, which would show up in the number of games played by its opponents.
Modern Times
Posts: 3800
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/40 lists updated (27th April 2013)

Post by Modern Times »

Yes, if we removed some engines, and they had played iCE, then of course that would be one reason.
Modern Times
Posts: 3800
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/40 lists updated (27th April 2013)

Post by Modern Times »

Evert wrote:Perhaps it played against opponents that have been removed from the active list? Jazz 640 used to be included (but not listed, due to too few games), but was replaced with 721 and no longer appears. Presumably its games were removed too, which would show up in the number of games played by its opponents.
I can confirm that this is the case. iCE 0.3 has "lost" 150+ games overall because the opponents in those games were removed from the list. We tend to remove engines when a new version is released quickly, and the older version does not have many games. This affects the opponent engines too of course.
tpetzke
Posts: 686
Joined: Thu Mar 03, 2011 4:57 pm
Location: Germany

Re: CCRL 40/40 lists updated (27th April 2013)

Post by tpetzke »

Thanks, so at least I'm not seeing ghosts. If this starts with 42 already this would really worry me :-)

Thomas...
Modern Times
Posts: 3800
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/40 lists updated (27th April 2013)

Post by Modern Times »

I think iCE 0.3 was a little unlucky, normally there is not such a big effect on another single engine when we remove engines.

I'm sure Graham will play lots more games to get the number back up again :)