CCRL update (17th October 2008)

[Graham Banks]

The latest updates of the CCRL Rating Lists and Statistics are available for viewing at:
http://www.computerchess.org.uk/ccrl/4040/ (40/40)
http://computerchess.org.uk/ccrl/404/ (40/4)
The live link to the 40/4 list given below is currently the most up to date for that list.

The lists sometimes get updated during the week and these updates can be viewed here:
http://www.computerchess.org.uk/ccrl/4040.live/ (40/40)
http://computerchess.org.uk/ccrl/404.live/ (40/4)
However, no game downloads are available from these live links.

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers are:
Graham Banks, Ray Banks, Shaun Brewer, Kirill Kryukov, Dom Leste, Tom Logan, Wassim Saeed, Andreas Schwartmann, Charles Smith, George Speight and Gabor Szots.
Currently inactive testers are:
Sarah Bird, Chris Taylor, Martin Thoresen and Chuck Wilson.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to also look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.


40/40 Notes

4CPU 64-bit Engines

Rybka 3 remains close to 150 elo clear at the top.
Naum 3.1 and Zappa Mexico II in second and third spots are very similar in strength to each other.
There is a 50+ elo gap back to Deep Shredder 11, Deep Sjeng 3.0, Bright 0.4a (private), Hiarcs 12 and Toga II 1.4.1SE. These engines have an edge over Deep Fritz 10.1 which in turn has an advantage over Glaurung 2.1.
Loop M1-T and Thinker 5.2l Passive are further back.

The relative ratings of the 2CPU engines that have been well tested are pretty much the same as their 4CPU counterparts.


Single CPU Engines

Rybka 3 is 190 elo ahead of other engines in this category. Although more games are still needed, it looks apparent that the default settings are better than both the dynamic and human settings.
Naum 3.1 lies in second spot, narrowly ahead of the equally matched Fritz 11 and Zappa Mexico II.
Again there is a small margin back to the next group which comprises Shredder 11, Deep Sjeng 3.0 and Toga II 1.4.1SE.
Hiarcs 12 bridges the gap between the previous group mentioned and the group below that includes Bright 0.4a (private), Fruit 2.3.1, Loop 13.6, Glaurung 2.1, Cyclone 1.0 and Thinker 5.1e Passive.


Free Single CPU Engines

Rybka 2.2 heads the field with a 50+ elo gap back to Toga II 1.4.1SE.
There is a similar gap back to Fruit 2.3.1, Glaurung 2.1, Cyclone 1.0 and Thinker 5.2e Passive. This group holds a definite edge over Spike 1.2 Turin and Bright 0.3a.

CCRL tests a wide range of amateur engines (defined as free and having never gone commercial), ranging right down to the 1900 elo level. The intention is to get well over 200 games for each of these engines. We see it is a way of supporting and hopefully motivating these engine authors with their efforts.

Recently released engines that seem to have made good improvement are Twisted Logic, Hamsters, Cyrano, DanaSah, Rotor, Pupsi and NanoSzachy.


Blitz Notes

An enormous amount of work goes into the blitz list and with almost 350,000 games in the database, it is well worth a visit.

Of special interest to some will be the best free 1CPU engines list which is being constructed through a systematic testing approach as mentioned here:
http://kirill-kryukov.com/chess/discuss ... f=7&t=3271


FRC Notes

Ray tests only those engines that can play FRC through the Shredder Classic GUI.
If engine authors have a new and stable version of their engine that will run under this GUI, they should contact Ray if they wish to see it tested.

Rybka 3 has a massive 200 elo lead over the closely grouped Shredder 11, Naum 3.1 and Deep Sjeng 3.0.
Hiarcs Paderborn 2007 in fifth spot is well ahead of Fruit 051103 and Loop 10.32f (the most recent Loop version that could play FRC).

For FRC the best list to look at is the pure list.
http://www.computerchess.org.uk/ccrl/404FRC/


Stats/Presentation Notes

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code.
ELO ratings are now saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

[Norm Pollock]

Hi Graham,

Among this week's new games is this Amy v Amy.

-Norm

Code: Select all

[Event "CCRL 40/40"]
[Site "CCRL"]
[Date "2008.10.15"]
[Round "144.1.346"]
[White "Amy 0.87b"]
[Black "Amy 0.87b"]
[Result "1-0"]
[ECO "A16"]
[Opening "English"]
[Variation "Anglo-Gruenfeld, Smyslov defense"]
[PlyCount "96"]

1. c4 Nf6 2. Nc3 d5 3. cxd5 Nxd5 4. g3 g6 5. Bg2 Nxc3 6. bxc3 Bg7 7. Rb1 Nd7 8.
Nf3 Nb6 9. Qc2 c5 10. O-O c4 11. d4 cxd3 12. exd3 Bf5 13. Nd4 Bxd4 14. cxd4 Qd7
15. Bh6 Bh3 16. Bxh3 Qxh3 17. Qc1 Rc8 18. Qd2 Kd8 19. Rfe1 Re8 20. Rb5 Rc6 21.
Be3 Qd7 22. Qa5 Rf6 23. Rc1 Rc6 24. Rbb1 Qc7 25. d5 Nd7 26. Qxa7 Ra6 27. Qd4
Ne5 28. Rxc7 Nf3+ 29. Kg2 Nxd4 30. Rcxb7 Nf5 31. Bc5 Nd6 32. Bxd6 exd6 33. Rb8+
Ke7 34. Re1+ Kf6 35. Rexe8 Ra5 36. Re3 Rxd5 37. Rf3+ Ke6 38. Rb7 f6 39. Re3+
Kf5 40. Rxh7 Rd4 41. h3 Kg5 42. f4+ Rxf4 43. gxf4+ Kxf4 44. Rhe7 d5 45. Rf3+
Kg5 46. h4+ Kg4 47. Rxf6 g5 48. Rg7 Kxh4 1-0

[Zach Wegner]

Good to see ZCT finally making into the official list with 201 games. Thanks for testing guys!

[Graham Banks]

Good to see ZCT finally making into the official list with 201 games. Thanks for testing guys!

You're welcome Zach. Thanks for your efforts with ZCT.

[Graham Banks]

Hi Graham,

Among this week's new games is this Amy v Amy.

-Norm

Code: Select all

[Event "CCRL 40/40"]
[Site "CCRL"]
[Date "2008.10.15"]
[Round "144.1.346"]
[White "Amy 0.87b"]
[Black "Amy 0.87b"]
[Result "1-0"]
[ECO "A16"]
[Opening "English"]
[Variation "Anglo-Gruenfeld, Smyslov defense"]
[PlyCount "96"]

1. c4 Nf6 2. Nc3 d5 3. cxd5 Nxd5 4. g3 g6 5. Bg2 Nxc3 6. bxc3 Bg7 7. Rb1 Nd7 8.
Nf3 Nb6 9. Qc2 c5 10. O-O c4 11. d4 cxd3 12. exd3 Bf5 13. Nd4 Bxd4 14. cxd4 Qd7
15. Bh6 Bh3 16. Bxh3 Qxh3 17. Qc1 Rc8 18. Qd2 Kd8 19. Rfe1 Re8 20. Rb5 Rc6 21.
Be3 Qd7 22. Qa5 Rf6 23. Rc1 Rc6 24. Rbb1 Qc7 25. d5 Nd7 26. Qxa7 Ra6 27. Qd4
Ne5 28. Rxc7 Nf3+ 29. Kg2 Nxd4 30. Rcxb7 Nf5 31. Bc5 Nd6 32. Bxd6 exd6 33. Rb8+
Ke7 34. Re1+ Kf6 35. Rexe8 Ra5 36. Re3 Rxd5 37. Rf3+ Ke6 38. Rb7 f6 39. Re3+
Kf5 40. Rxh7 Rd4 41. h3 Kg5 42. f4+ Rxf4 43. gxf4+ Kxf4 44. Rhe7 d5 45. Rf3+
Kg5 46. h4+ Kg4 47. Rxf6 g5 48. Rg7 Kxh4 1-0

Thanks Norm. It's great to have people point out errors and I mean that sincerely.
This game will of course be removed.

Cheers, Graham.