CCRL update (20th June 2008)

[Graham Banks]

The June 20th update of the CCRL Rating Lists and Statistics is now available for viewing at:
http://www.computerchess.org.uk/ccrl/4040/

The list usually gets updated midweek and can be viewed here:
http://www.computerchess.org.uk/ccrl/4040.live/
However, no game downloads are available from the live link.

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our standard testing is at 40 moves in 40 minutes repeating and our blitz testing is at 40 moves in 4 minutes repeating, both adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers are:
Graham Banks, Ray Banks, Shaun Brewer, Kirill Kryukov, Tom Logan, Andreas Schwartmann, Charles Smith, George Speight, Gabor Szots and Chuck Wilson.
This week, we've had the pleasure of welcoming Arnaud Loheac into our team.


40/40 Notes

During the early stages of testing, an engine's rating can often fluctuate a lot.
One should also look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.


4CPU 64-bit Engines

Rybka 2.3.2a has a 55 elo lead over the very evenly matched pair of Naum 3.1 and Zappa Mexico II.

There is a similar gap back to Deep Shredder 11 and Toga II 1.4.1SE, both slightly ahead of Hiarcs 12, Deep Fritz 10.1 and Glaurung 2.1
There seems very little difference between Hiarcs 12 Sharpen PV On, Hiarcs 12 Default and Hiarcs Paderborn 2007.

Loop M1-T and Bright 0.3a come in next, holding a clear advantage over Deep Junior 10 and Deep Sjeng 2.7 and Scorpio 2.0.


2CPU Engines

With the emphasis of our multi-cpu testing on 4CPU as opposed to 2CPU, there are gaps in this list and some of the engines also require further games.
We would welcome applications from further testers prepared to focus on 2CPU, so that we could present a more worthwhile rating list in this category.
However, in all honesty, the relative ratings of the engines in this category are pretty much the same as in the 4CPU list.


Single CPU Engines

Rybka 2.3.2a is the strongest engine in this category by a significant margin. It is scary to think how much higher the upcoming Rybka 3 will raise the bar!

A 30 elo spread covers the group of engines vying for second spot - Naum 3.1, Deep Shredder 11 1CPU, Fritz 11, Zappa Mexico II and Toga II 1.4.1SE.

Hiarcs 12 bridges the gap back to Loop 13.6, Fruit 2.3.1 and Glaurung 2.1.
It seems to make little difference to Hiarcs 12 whether the Sharpen PV setting is used or not.

Deep Sjeng 2.7, Spike 1.2 Turin, Bright 0.3a, Junior 10 and Thinker 5.1e Passive are the next closely grouped bunch of engines.


Free Single CPU Engines

Toga II 1.4.1SE tops this list ahead of Rybka 1.0.

Fruit 2.3.1 is 50 elo back in third, but could well be overtaken by Glaurung 2.1.

Spike 1.2 Turin, Bright 0.3a and Thinker 5.1e Passive are the next group of engines, with a comfortable margin over Naum 2.0 and Frenzee Feb08.

Movei 00.8.438 (10 10 10), Booot 4.14.0, Alaric 707 and Scorpio 2.0 come in next, ahead of E.T Chess 13.01.08, SlowChess Blitz WV2.1, Delfi 5.2, Zappa 1.1, WildCat 8 and Pro Deo 1.6b.

We test a very extensive range of amateur engines (currently ranging down to the 2000 elo level) through a range of tournaments, all of which can be followed in our public forum.
Our aim is to for all of these engines to have a rating based on 200+ games.


Blitz Notes

An enormous amount of work goes into the blitz list and it is well worth a visit.

The latest ratings can be found at one of the following links:
http://computerchess.org.uk/ccrl/404/
http://computerchess.org.uk/ccrl/404.live/

Of special interest to some will be the best free 1CPU engines list which is being constructed through a systematic testing approach as mentioned here:
http://kirr.homeunix.org/chess/discussi ... f=7&t=3271


FRC Notes

Ray tests only those engines that can play FRC through the Shredder Classic GUI.
If engine authors have a new and stable version of their engine that will run under this GUI, they should contact Ray if they wish to see it tested.

The top engine, Rybka 2.3.2z3 has remained private, therefore the best available FRC engines are the evenly matched Shredder 11 and Naum 3.1.

Hermann 2.3 was tested during the week and has achieved a 67 elo gain over the previous version.
We are hoping to test a new private version of Bright soon. Watch this space!

For FRC the best list to look at is the pure list.
http://www.computerchess.org.uk/ccrl/404FRC/


Stats/Presentation Notes

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

A list of games played this week per engine can be found in the update thread in the CCRL public forum.

All games are available for download by engine, by month or by ECO code.
ELO ratings are now saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.