CCRL 40/40 lists updated (16th March 2013)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 45235
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/40 lists updated (16th March 2013)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are updated separately to each other. The 40/40 and 40/4 lists are updated once every two weeks and alternately to each other. The FRC list is updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code. The download databases by month or ECO code are only updated monthly, but the total games database in its entirety is always available.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.


Games submitted for this update
Hannibal 1.3 32-bit -> 353
RobboLito 0.21Q 32-bit -> 215
Chiron 1.5 64-bit 4CPU -> 158
Deep Junior 13.3 64-bit 1CPU -> 148
Protector 1.5.0 32-bit -> 145
Gull R375 64-bit -> 97
Hannibal 1.3 64-bit -> 81
Hannibal 1.3 64-bit 4CPU -> 76
Strelka 5.5 64-bit -> 76
Gull II 64-bit -> 58
Sting SF 2 64-bit -> 53
Stockfish 2.3.1 64-bit -> 53
Critter 1.6a 64-bit -> 53
IvanHoe 9.46h 64-bit -> 52
Octochess r4984 64-bit 4CPU -> 50
FireFly 2.6.0 64-bit 4CPU -> 50
Alfil 13.1 64-bit 4CPU -> 49
Jonny 4.00 4CPU -> 49
Delphil 2.9g 64-bit 4CPU -> 49
Pharaon 3.5.1 4CPU -> 49
RedQueen 1.1.3 64-bit 4CPU -> 49
Nebula 1.5 64-bit 4CPU -> 49
BugChess2 1.9 64-bit 4CPU -> 49
Fritz 13 -> 49
Arasan 15.2 64-bit 4CPU -> 49
Komodo 5 64-bit -> 47
Hiarcs 14 -> 46
Protector 1.5.0 64-bit -> 42
BlackMamba 1.2c 64-bit -> 42
RobboLito 0.21Q 64-bit -> 41
Bouquet 1.6 64-bit -> 41
Houdini 3 32-bit -> 38
Cupcake 1.1a -> 36
Naum 4.2 64-bit 4CPU -> 36
Soldat III 0.172 -> 36
Hiarcs 14 4CPU -> 36
Critter 1.6a 64-bit 4CPU -> 35
Dabbaba 7.49 -> 35
RobboLito 0.21Q 64-bit 4CPU -> 35
Stockfish 2.3.1 64-bit 4CPU -> 35
Vitruvius 1.11C 64-bit 4CPU -> 34
MatMoi 7.15.0 -> 33
Arasan 15.1 64-bit -> 33
Warrior 1.0.3 -> 33
IvanHoe 9.46h 64-bit 4CPU -> 33
Protector 1.5.0 64-bit 4CPU -> 33
Rybka 4.1 64-bit 4CPU -> 33
GChess IV 0.2.0 -> 33
Jabba 13032012 -> 33
Ziggurat 0.18 64-bit -> 33
Reger 0.09 -> 33
Bison 9.11 64-bit -> 32
Bouquet 1.6 64-bit 4CPU -> 32
Shredder 12 32-bit OA On -> 32
BeRoChess 1.00 32-bit -> 32
Sting SF 2 64-bit 4CPU -> 32
Gull R375 64-bit 4CPU -> 32
Shredder 12 32-bit OA Off -> 32
DeepSaros 3.3b 64-bit -> 31
Deep Junior 13.3 32-bit 1CPU -> 30
MinkoChess 1.3 64-bit -> 30
Stockfish 2.2.2 32-bit -> 30
Naum 4.2 32-bit -> 30
Rybka 4.1 32-bit -> 30
Vitruvius 1.11C 32-bit -> 30
ProDeo 1.83c -> 30
Critter 1.4 32-bit -> 30
DanaSah 5.00 -> 28
Chronos 1.9.9 64-bit -> 28
Chiron 1.5 32-bit -> 28
Vitruvius 1.11C 64-bit -> 26
Rybka 4.1 64-bit -> 26
Naum 4.2 64-bit -> 26
GreKo 10.0 64-bit -> 24
Dirty 5Sep2012 64-bit -> 24
Atlas 3.25 64-bit -> 24
Ufim 8.02 -> 24
Trace 1.37a -> 24
SOS 5.1 -> 24
Houdini 3 64-bit 4CPU -> 24
Green Light Chess 3.01.2.2 -> 23
Glass 2.0 64-bit -> 23
Alfil 13.1 64-bit -> 23
Delphil 2.9g 64-bit -> 23
AnMon 5.75 -> 23
Nebula 1.5 64-bit -> 23
N2 0.4 64-bit -> 23
Sloppy 0.2.3 64-bit -> 23
Petir 4.999999 -> 23
Djinn 0.979 64-bit -> 23
DiscoCheck 4.0.3 64-bit -> 22
EXchess 6.71b 64-bit -> 22
Critter 1.6a 32-bit -> 20
Crafty 23.5 64-bit -> 20
Stockfish 2.3.1 32-bit -> 19
Gaviota 0.86 64-bit -> 19
IvanHoe 9.46h 32-bit -> 18
BlackMamba 1.2c 32-bit -> 18
Sting SF 2 32-bit -> 18
Komodo 3 32-bit -> 18
DeepSaros 2.3j 32-bit -> 18
Strelka 5.5 32-bit -> 16
Bobcat 3.25 64-bit -> 16
Komodo 5 32-bit -> 16
Quazar 0.4 32-bit -> 16
Philou 3.7.1 64-bit -> 16
Delfi 5.4 -> 16
Rybka 2.3.2a 32-bit -> 16
Spike 1.4 Leiden -> 15
RedQueen 1.1.3 64-bit -> 15
Deep Sjeng c't 2010 -> 14
Bouquet 1.5 32-bit -> 14
DeepSaros 3.0 32-bit -> 14
Gull II 32-bit -> 12
Quazar 0.4 64-bit -> 12
EXchess 7.01b 64-bit -> 12
Bouquet 1.6 32-bit -> 12
Scorpio 2.7.5 64-bit -> 11
BugChess2 1.9 64-bit -> 11
Texel 1.01 64-bit -> 11
BlackMamba 1.2b 64-bit -> 11
Nemo 1.0.1 64-bit -> 11
Frenzee 3.5.19 64-bit -> 11
Toga Returns 1.1 -> 11
Tornado 4.88 64-bit -> 11
Spike 1.4 Leiden 4CPU -> 10
Houdini 1.5a 32-bit -> 10
Deep Junior 13.3 64-bit 4CPU -> 10
Chess Tiger 2007.1 -> 8
Ktulu 9 -> 8
Daydreamer 1.75 64-bit -> 8
Cheng3 1.07 64-bit -> 8
Hannibal 1.0a 32-bit -> 6
CM10th Default -> 4
Capivara LK 0.09a01a 64-bit -> 4
Quazar 0.3b 32-bit -> 4
FireFly 2.6.0 64-bit -> 4
Butcher 1.64 64-bit -> 4
Gibbon 2.57a 64-bit -> 4
Ktulu 7.1 -> 4
Alfil 11 -> 4
Shallow 1.0 64-bit -> 4
Waxman 2011 -> 4
Tucano 1.04 -> 4
Scorpio 2.1 32-bit -> 4
ProChess 1.02AD -> 4
Octochess r4984 64-bit -> 4
ChessKiss 1.7 64-bit -> 4
Vajolet 1.62.1 -> 3
Crafty 22.8 32-bit -> 2
gbanksnz at gmail.com
laoliveirajr
Posts: 138
Joined: Tue Sep 25, 2012 11:39 pm
Location: Brasilia DF Brazil

Re: CCRL 40/40 lists updated (16th March 2013)

Post by laoliveirajr »

Graham,
Thank you for all you have done.

We continue with Capivara LK 0.09a01a being the official version for tournaments, I had decided that in the first few tests.

In the my following tests, which I chose 3 of 4 engine versions to test showed different results. (see Capivara Test Page: vivaxadrez.wikispaces.com/TestandoEngines ).

The differences between b01a, b02a, b01b and b02b are relatively significant for me, in the conceptual point of view, had only a small difference in the results.

Yesterday I compiled 4 more versions of the Capivara LK 0.09, still unpublished: b01a, b02a, b01b and b02b.

A Capivara has two different search functions, one calculates the positions of the point of view of the Capivara, another calculates the point of view of the opponent.

I made a small change, this time removing the pruning of the function that computes the opponent's side, so the engine will prune considering only the values of Capivara.

The next change I intend to do, will be the Capivara with concurrent processing.
The splits will be made by the function that computes the opponent's side, so a function throws the threads, and the other will do the pruning.


Thanks
Lourenço
laoliveirajr
Posts: 138
Joined: Tue Sep 25, 2012 11:39 pm
Location: Brasilia DF Brazil

Correcting ... (underlined text)

Post by laoliveirajr »

Correcting ... (Underlined text)


Graham,
Thank you for all you have done.

We continue with Capivara LK 0.09a01a being the official version for tournaments, I had decided that in the first few tests.

In the my following tests, which I chose 3 of 4 engine versions to test showed different results. (see Capivara Test Page: vivaxadrez.wikispaces.com/TestandoEngines ).

The differences between a01a, a02a, a01b and a02b are relatively significant for me, in the conceptual point of view, had only a small difference in the results.

Yesterday I compiled 4 more versions of the Capivara LK 0.09, still unpublished: b01a, b02a, b01b and b02b.

A Capivara has two different search functions, one calculates the positions of the point of view of the Capivara, another calculates the point of view of the opponent.

I made a small change, this time removing the pruning of the function that computes the opponent's side, so the engine will prune considering only the values of Capivara.

The next change I intend to do, will be the Capivara with concurrent processing.
The splits will be made by the function that computes the opponent's side, so a function throws the threads, and the other will do the pruning.


Thanks
Lourenço.
User avatar
Graham Banks
Posts: 45235
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Correcting ... (underlined text)

Post by Graham Banks »

laoliveirajr wrote:We continue with Capivara LK 0.09a01a being the official version for tournaments, I had decided that in the first few tests.
Thanks. I'll set up a gauntlet to try and get this version established for you.

Your thanks of course should go to the whole group of testers. I'm just one of several. :)

Graham.
gbanksnz at gmail.com
Alibaba
Posts: 1218
Joined: Mon May 25, 2009 12:16 am

Re: Correcting ... (underlined text)

Post by Alibaba »

Hi Graham,

where can i find the 8CPU Engines in your lists?
Do you have a separate list for 8 CPU?

Regards
Andi
User avatar
Graham Banks
Posts: 45235
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Correcting ... (underlined text)

Post by Graham Banks »

Alibaba wrote:Hi Graham,

where can i find the 8CPU Engines in your lists?
Do you have a separate list for 8 CPU?

Regards
Andi
Hi Andi,

we don't have an 8CPU list, but I know that Vincent might have put together one at some stage, including all the games from 8 core tournaments that I've run.

Graham.
gbanksnz at gmail.com
Vinvin
Posts: 5312
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Correcting ... (underlined text)

Post by Vinvin »

Graham Banks wrote:
Alibaba wrote:Hi Graham,

where can i find the 8CPU Engines in your lists?
Do you have a separate list for 8 CPU?

Regards
Andi
Hi Andi,

we don't have an 8CPU list, but I know that Vincent might have put together one at some stage, including all the games from 8 core tournaments that I've run.

Graham.
That reminds me something ... I ding in my folders and I found a file with 744 games inside. 4 events : Ponziani Swiss 8CPU, Revving Up The V8s (8 cores), Super Tournament 8CPU and The Champions 2012 8CPU. But there's some strange things, some names suppose only 1CPU used, what do you thing about this (1 or 8 CPUs) ?
[Event "Revving Up The V8s (8 cores)"]
[Site "Auckland"]
[Date "2012.07.12"]
[Round "8"]
[White "HIARCS 13.2 MP"]
[Black "cyclone xTreme Rage"]
[Result "1/2-1/2"]
And more names like this :

[White "Arasan 14.0.1"]
[White "Arminius 2012-06-28"]
[White "Bouquet _1.3 x64"]
[White "cyclone xTreme Rage"]
[White "Deep Fritz 13"]
[White "DeepSaros ver.3.2"]
[White "Delphil 2.9e"]
[White "HIARCS 13.2 MP"]
[White "IvanHoe 9.46b x64"]
[White "RedQueen 1.1.1"]
[White "Spike 1.4"]
[White "Stockfish 2.2.2 JA"]

And, there was engines playing with 4CPUs, wasn't they ?
User avatar
Graham Banks
Posts: 45235
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Correcting ... (underlined text)

Post by Graham Banks »

Vinvin wrote:That reminds me something ... I ding in my folders and I found a file with 744 games inside. 4 events : Ponziani Swiss 8CPU, Revving Up The V8s (8 cores), Super Tournament 8CPU and The Champions 2012 8CPU. But there's some strange things, some names suppose only 1CPU used, what do you thing about this (1 or 8 CPUs) ?
In 8 core tourneys, all engines that could play with multi-cpu used 8 cores.
Likewise in 4 core tourneys, all engines that are multi-cpu used 4 cores.

From memory, the only 1 core engines used were Komodo, Strelka, Quazar, Nemo, Booot and Texel.
gbanksnz at gmail.com