CCRL update (22nd February 2008)

[Graham Banks]

The February 22nd update of the CCRL Rating Lists and Statistics is now available for viewing at:
http://www.computerchess.org.uk/ccrl/4040/

The list gets updated periodically during the week and these updates can be viewed here:
http://www.computerchess.org.uk/ccrl/4040.live/
Please be aware that no game downloads are available from this live link.

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our standard testing is at 40 moves in 40 minutes repeating while our current blitz testing is at both 40 moves in 4 minutes repeating and 40 moves in 12 minutes repeating, all adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers in our team are:
Graham Banks, Ray Banks, Shaun Brewer, Kirill Kryukov, Dom Leste, Tom Logan, Andreas Schwartmann, Charles Smith, George Speight, Chris Taylor, Chuck Wilson, Gabor Szots and Martin Thoresen.


40/40 Notes

There are currently 105,618 games in our 40/40 database.

Many engines on our list have few games and in many cases their ratings are likely to fluctuate (markedly for some) until a lot more games are played. Therefore no conclusions should be drawn about their strength yet.
To illustrate this point, when an engine has 200 games played, the error margin is still approximately +-40 ELO, after 500 games +-25 ELO, after 1000 games +-17 ELO and even after 2000 games there is a +-13 ELO error margin!
This of course highlights the importance of looking at other rating lists that are also available in order to draw comparisons and get a more accurate overall picture.


4CPU 64-bit Engines

Rybka 2.3.2a remains the strongest engine by over 50+ ELO.

Zappa Mexico II and Naum 3 now have over 200 games, with Zappa currently holding second spot. Of course, more games are still required.

Deep Shredder 11 lies 40 points further back, ahead of Deep Fritz 10.1.

Toga II 1.4 beta5c is the strongest free engine, heading off Hiarcs 11.2, Loop M1-T and Glaurung 2.0.1.

Other well tested engines in order of rating are Deep Junior 10, Bright 0.2c, Deep Sjeng 2.7 and Scorpio 2.0.


2CPU Engines

With the emphasis of our multi-cpu testing on 4CPU as opposed to 2CPU, there are gaps in this category and some of the engines also require further games.
However, the order of strength is almost identical to the 4CPU list with regard to the engines that have been well tested.
Our resources can only be spread so far unfortunately and further testers of 2CPU engines would be useful.

Naum 3 and Zappa Mexico II are currently being tested in this category.


Single CPU Engines

No real changes here during the week.

Rybka 2.3.2a has an impressive 120+ ELO lead over Fritz 11, Shredder 11 and Zappa Mexico II.
We are in the early stages of testing Naum 3, so no accurate conclusions can yet be drawn. It could well end up as the second strongest single cpu engine based on what we've seen so far.

Toga II 3.1.2SE is only 20 ELO further back, currently clearly ahead of Loop 13.6, Fruit 2.3.1 and Hiarcs 11.2.

Not too far behind, Deep Sjeng 2.7, Spike 1.2 Turin and Glaurung 2.0.1are very closely grouped.

Junior 10.1 is sandwiched on its own between the group just mentioned above it and the group of engines below that includes Ktulu 8.0, Chess Tiger 2007.1, SmarThink 1.00 and Bright 0.2c.

Chessmaster 11, Booot 4.14.0, Movei 00.8.438 (10 10 10), Scorpio 2.0 and Alaric 707 comprise the next group of engines ahead of Frenzee Dec07, SlowChess Blitz WV2.1, E.T Chess 13.01.08, Delfi 5.2, Ruffian 2.1.0, WildCat 7 and Gandalf 6.

We are also in the early stages of testing Frenzee Feb08, Sloppy 0.2.0 and Alfil 8.1.1 amongst others.


Free Single CPU Engines

Toga II 3.1.2SE has overtaken Rybka 1.0 as the top free engine.

Fruit 2.3.1 comes in third ahead of Spike 1.2 Turin and Glaurung 2.0.1.

Naum 2.0 and Bright 0.2c are 40+ ELO further back.

Booot 4.14.0, Movei 00.8.438 (10 10 10), Scorpio 2.0, Alaric 707 and Frenzee Dec07 come in next, ahead of SlowChess Blitz WV2.1, E.T Chess 13.01.08, Delfi 5.2, Zappa 1.1 and WildCat 7.
How much of an improvement Frenzee Feb08 is has yet to be established.

We test a very extensive range of amateur engines (currently ranging down to the 2000 ELO level) through a range of tournaments, all of which can be followed in our public forum.
Our aim is of course to ensure that all engines lower on our lists get 200+ games.


Blitz Notes

Shaun has been on vacation, so there has been no update this week. One could well follow soon though, so keep checking through the live link given below.

There are currently 247,235 games in our 40/4 database.

The 40/4 update is usually done separately to our 40/40 update.
The latest ratings can be found at one of the following links:
http://computerchess.org.uk/ccrl/404/
http://computerchess.org.uk/ccrl/404.live/

An enormous amount of work goes into the blitz list and it is well worth a visit.

Of special interest to some will be the best free 1CPU engines list which is being constructed through a systematic testing approach as mentioned here:
http://www.talkchess.com/forum/viewtopic.php?t=19206


FRC Notes

There are currently 26,200 games in the FRC 40/4 database.

Ray tests only those engines that can play FRC through the Shredder Classic GUI.
If engine authors have a new and stable version of their engine that will run under this GUI, they should contact Ray if they wish to see it tested.

Shredder 11 is the top available FRC engine (remembering of course that Rybka 2.3.2 FRC has remained private).
Naum 3 has second spot ahead of Hiarcs 11.1 and Loop 10.32f (we've not tested Hiarcs 11.2 while this version of Loop was the latest that plays FRC).

For FRC the best list to look at is the pure list.
http://www.computerchess.org.uk/ccrl/404FRC/


Stats/Presentation Notes

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

A list of games played this week per engine can be found in the update thread in the CCRL public forum.

All games are available for download by engine, by month or by ECO code.
ELO ratings are now saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

[Terry McCracken]

Graham what's your take on Toga II 1.4.1SE running on a single core?

Terry

[Graham Banks]

Graham what's your take on Toga II 1.4.1SE running on a single core?

Terry

Hi Terry,

I haven't tested Toga II 1.4.1SE personally, so can't comment.
However, Toga II 1.4.2SE is currently in testing, so can't be too far away.

Regards, Graham.

[Terry McCracken]

Graham what's your take on Toga II 1.4.1SE running on a single core?

Terry

Hi Terry,

I haven't tested Toga II 1.4.1SE personally, so can't comment.
However, Toga II 1.4.2SE is currently in testing, so can't be too far away.

Regards, Graham.

Really? Where can I download it?

Thanks...

Terry

[Dr.Wael Deeb]

Graham what's your take on Toga II 1.4.1SE running on a single core?

Terry

Hi Terry,

I haven't tested Toga II 1.4.1SE personally, so can't comment.
However, Toga II 1.4.2SE is currently in testing, so can't be too far away.

Regards, Graham.

Really? Where can I download it?

Thanks...

Terry

It's still private Terry,will be released soon AFAIK....

[Vinvin]

...However, Toga II 1.4.2SE is currently in testing, so can't be too far away.

Who is the autor ? Thomas Gaksch or someone else ?

Thanks,
Vincent

[Ovyron]

Who is the autor ?

There are so many co-authors that it's difficult to keep up, but Chris Formula says that the full credits should go to Fabien/Thomas.

[Graham Banks]

...However, Toga II 1.4.2SE is currently in testing, so can't be too far away.

Who is the autor ? Thomas Gaksch or someone else ?

Thanks,
Vincent

Toga II 1.4.2SE is still being privately tested for Chris Formula.

Regards, Graham.