CCRL update (26th May 2007)

[Graham Banks]

The May 26th update of the CCRL Rating Lists and Statistics is now available for viewing at:
http://www.computerchess.org.uk/ccrl/4040/

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our standard testing is at 40 moves in 40 minutes repeating while our current blitz testing is at both 40 moves in 4 minutes repeating and 40 moves in 12 minutes repeating, all adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers in our team are:
Graham Banks, Ray Banks, Shaun Brewer, Kirill Kryukov, Dom Leste, Tom Logan, Andreas Schwartmann, Charles Smith, George Speight, Chris Taylor, Chuck Wilson, Gabor Szots and Martin Thoresen.

We remain on the lookout for more testers to help, so please contact one of us if you're interested.
You do not need to own any commercial engines as amateurs are also a big part of our testing.
An extra tester who could carry out 2CPU 64-bit and 32-bit testing at 40/40 time control would be a valuable asset to our team.


40/40 Notes

There was a net gain of only 489 games added to our 40/40 database this week, making a total of 59,864 games.
This was due to our removing several older versions of engines that had a small number of games. Unless we intend to give older versions 200+ games, there is no point including them.
As we have made such culls to our list reasonably regularly, it means we have 2000+ games no longer included in the main database.
All games except Arena pgn (which Kirill is working on) are now checked with "pgn extract" so that faulty games are removed.
A big thanks to all testers as usual.


Many engines on our list have few games and in many cases their ratings are likely to fluctuate (markedly for some) until a lot more games are played. Therefore no conclusions should be drawn about their strength yet.
To illustrate this point, when an engine has 200 games played, the error margin is still approximately +/-40 ELO, after 500 games +-25 ELO, after 1000 games +-17 ELO and even after 2000 games there is a +-13 ELO error margin!
This of course highlights the importance of looking at other rating lists that are also available in order to draw comparisons and get a more accurate overall picture.

We are not testing Rybka 2.3 at 40/40, preferring to wait for the bugfixed Rybka 2.3.2 to be released.
Glaurung 2 epsilon/2 and Strelka 1.0b still have too few games to be listed below.


4CPU Engines
3106 - Rybka 2.2 64-bit 4CPU
3046 - Zap!Chess Zanzibar 64-bit 4CPU
2980 - Hiarcs 11.1 4CPU
2956 - Naum 2.1 64-bit 4CPU
2941 - Loop 13.6 64-bit 4CPU
2928 - Deep Shredder 10 64-bit 4CPU
2924 - Deep Fritz 10 4CPU
2922 - Deep Junior 10 4CPU
2862 - Glaurung 1.2.1 64-bit 4CPU


2CPU Engines
3082 - Rybka 2.1 64-bit 2CPU
3051 - Rybka 2.2 64-bit 2CPU
3031 - Zap!Chess Zanzibar 64-bit 2CPU (only 108 games)
2953 - Deep Fritz 10 2CPU (only 94 games)
2943 - Hiarcs 11.1 2CPU
2927 - LoopMP 12.32 2CPU
2923 - Loop 13.6 64-bit 2CPU
2912 - Naum 2.1 64-bit 2CPU
2899 - Deep Junior 10 2CPU
2893 - Deep Shredder 10 64-bit 2CPU
2817 - Glaurung 1.2.1 Avalanche 64-bit 2CPU
2790 - Scorpio 1.9 32-bit 2CPU (Scorpio 1.91 untested)
2742 - Deep Frenzee 3.0 64-bit 2CPU (only 56 games)
2735 - Pharaon 3.5.1 32-bit 2CPU


Single CPU Engines
2998 - Rybka 2.2 64-bit
2911 - Loop 13.6 32-bit (only 109 games and 64-bit untested)
2910 - Hiarcs 11.1
2905 - Zap!Chess Zanzibar 64-bit
2877 - Fritz 10
2871 - Shredder 10
2861 - Toga II 1.2.1a (not testing Toga II 1.3x4 yet due to egbb access bug)
2851 - Spike 1.2 Turin
2846 - Junior 10
2846 - Naum 2.1 32-bit (64-bit untested)
2839 - Fruit 2.2.1
2835 - Deep Sjeng 2.5 1CPU (only 125 games)
2831 - Junior 10.1
2803 - Ktulu 8.0
2797 - SmarThink 1.00 64-bit (only 85 games)
2794 - Glaurung 1.2.1 Beren 64-bit (only 90 games)
2793 - Chess Tiger 2007.1
2776 - Alaric 704 (only 98 games)
2776 - Scorpio 1.84
2768 - Glaurung 1.2.1 64-bit
2766 - CM9000 Enforcer
2762 - CM10th Xperience
2755 - Scorpio 1.91
2741 - Slow Chess Blitz WV2.1
2736 - Delfi 5.1
2734 - CM10th Default
2731 - Petir 4.39
2731 - Ruffian 2.1.0
2725 - Pro Deo 1.2
2725 - WildCat 7
2723 - Gandalf 6
2707 - Pharaon 3.5.1


CCRL Amateur Championship (32-bit 1CPU):
4th Season Division 1 - Spike claimed the crown. The Baron, Movei and Pseudo were relegated.

4th Season Division 2 - after 26 of the 30 rounds, Alaric, Little Goliath, Pharaon and Ufim are vying for the three promotion spots. Amateur, Matacz and Gaia currently occupy the three relegation slots.

4th Season Division 3 - Patzer, AnMon and Djinn gained promotion while Thor's Hammer, Arion and Typhoon were relegated.

4th Season Division 4 - Diablo, Aice and BugChess gained promotion while Deuterium, Ayito and BBChess were relegated.

4th Season Division 5 - will start after the higher divisions are completed. The final field will be posted once a Qualifier has been run for the final two spots.

Qualifier - after 4 of the 30 rounds, Latista, Buzz and Flux hold an early lead over Mediocre, Counter and Prophet.


We have a number of tournaments in progress and most of these can be followed in our public forum.


Blitz Notes

The 40/4 is updated separately to 40/40 with the latest update able to be viewed here:
http://computerchess.org.uk/ccrl/404.live/

Multi-CPU Engines (both 4CPU and 2CPU)
3078 - Rybka 2.3.1 64-bit 2CPU
3021 - Zap!Chess Zanzibar 64-bit 4CPU
2993 - Hiarcs 11.1 4CPU
2945 - Deep Shredder 10 64-bit 4CPU
2943 - Deep Fritz 10 4CPU
2937 - Naum 2.1 64-bit 4CPU
2924 - LoopMP 12.32 2CPU
2916 - Deep Junior 10 4CPU
2904 - Loop 13.6 64-bit 2CPU
2859 - Glaurung 1.2.1 32-bit 4CPU
2753 - Pharaon 3.5.1 2CPU
2740 - Deep Sjeng 2.5 2CPU (only 55 games)
2735 - Deep Frenzee 3.0 64-bit 2CPU
2723 - Scorpio 1.81 2CPU (Scorpio 1.91 2CPU untested)
2713 - Crafty 20.14 2CPU (Crafty 21.5 CPU untested)
2390- Little Thought 0.98 64-bit 2CPU (later version untested)


Single CPU Engines
3025 - Rybka 2.2 64-bit
2992 - Rybka 2.3.1 32-bit
2915 - Hiarcs 11.1
2909 - Loop 10.32f
2870 - Toga II 1.3x4
2866 - Fritz 10
2865 - Loop 13.6 32-bit (only 116 games)
2855 - Shredder 10
2853 - Naum 2.1 64-bit
2850 - Fruit 2.2.1
2847 - Zap!Chess Zanzibar 32-bit (64-bit untested)
2841 - Junior 10
2827 - Spike 1.2 Turin
2826 - Junior 10.1
2825 - Chess Tiger 2007.1
2821 - Ktulu 8.0
2797 - Strelka 1.0b (only 128 games)
2760 - CM10th Paralyse
2760 - Deep Sjeng 2.5 1CPU
2758 - Glaurung 1.2.1 32-bit (higher than 64-bit!)
2952 - Scorpio 1.9
2750 - Scorpio 1.91
2747 - SmarThink 1.00 32-bit (only 116 games, 64-bit untested)
2739 - Bright 0.1d
2721 - Delfi 5.1
2719 - Pro Deo 1.2
2817 - CM10th Default
2714 - Alaric 704
2712 - Slow Chess Blitz WV2.1
2702 - Gandalf 6
2701 - Frenzee 3.0 64-bit (only 69 games)
2700 - Pharaon 3.5.1
2699 - WildCat 7


FRC Notes

Ray tests only those engines that can play FRC through the Shredder Classic GUI.
Deep Sjeng 2.5 1CPU has now been added to the rating list.
For FRC the best list to look at is the pure list, and the ratings there are:

2917 - Hiarcs 11.1
2902 - Shredder 10
2887 - Loop 10.32f
2856 - Spike 1.2 Turin
2852 - Fruit 2.2.1
2815 - Naum 2.1
2769 - Glaurung 1.2.1
2752 - Deep Sjeng 2.5 1CPU
2673 - Pharaon 3.5.1
2624 - Ufim 8.02
2607 - Movei 0.08.383
2484 - Hermann 1.9
2399 - Aice 0.99.2
2376 - Ayito 0.2.994
2370 - Hamsters 0.2


Stats/Presentation Notes

The LOS stats to the right hand side of each rating list are "likelihood of superiority" stats. They tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are also available for download through the link given at the top of this post. They can be downloaded by engine or by month.
ELO ratings are now saved in all game databases for those engines that have 150 games or more.

A list of games played this week per engine can be found in the update thread in the CCRL public forum, accessible through the link given at the top of this post.