CCRL update (19th May 2007)

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL update (19th May 2007)

Post by Graham Banks »

The May 19th update of the CCRL Rating Lists and Statistics is now available for viewing at:
http://www.computerchess.org.uk/ccrl/4040/

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our standard testing is at 40 moves in 40 minutes repeating while our current blitz testing is at both 40 moves in 4 minutes repeating and 40 moves in 12 minutes repeating, all adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers in our team are:
Graham Banks, Ray Banks, Shaun Brewer, Kirill Kryukov, Dom Leste, Tom Logan, Andreas Schwartmann, Charles Smith, George Speight, Chris Taylor, Chuck Wilson, Gabor Szots and Martin Thoresen.

We remain on the lookout for more testers to help, so please contact one of us if you're interested.
You do not need to own any commercial engines as amateurs are also a big part of our testing.
An extra tester who could carry out 2CPU 64-bit and 32-bit testing at 40/40 time control would be a valuable asset to our team.


40/40 Notes

926 games were added to our 40/40 database this week, making a total of 59,375 games.
A big thanks to all testers as usual.

Many engines on our list have few games and in many cases their ratings are likely to fluctuate (markedly for some) until a lot more games are played. Therefore no conclusions should be drawn about their strength yet.
To illustrate this point, when an engine has 200 games played, the error margin is still approximately +/-40 ELO, after 500 games +-25 ELO, after 1000 games +-17 ELO and even after 2000 games there is a +-13 ELO error margin!
This of course highlights the importance of looking at other rating lists that are also available in order to draw comparisons and get a more accurate overall picture.

We are not testing Rybka 2.3 at 40/40, preferring to wait for the bugfixed Rybka 2.3.2 to be released.


4CPU Engines
3105 - Rybka 2.2 64-bit 4CPU
3044 - Zap!Chess Zanzibar 64-bit 4CPU
2979 - Hiarcs 11.1 4CPU
2954 - Naum 2.1 64-bit 4CPU
2942 - Loop 13.6 64-bit 4CPU
2927 - Deep Shredder 10 64-bit 4CPU
2924 - Deep Fritz 10 4CPU
2922 - Deep Junior 10 4CPU
2861 - Glaurung 1.2.1 64-bit 4CPU


2CPU Engines
3084 - Rybka 2.1 64-bit 2CPU
3052 - Rybka 2.2 64-bit 2CPU
3032 - Zap!Chess Zanzibar 64-bit 2CPU (only 78 games so far though)
2945 - Hiarcs 11.1 2CPU
2935 - Loop 13.6 64-bit 2CPU
2926 - Deep Fritz 10 2CPU (only 64 games so far though)
2914 - Naum 2.1 64-bit 2CPU
2899 - Deep Junior 10 2CPU
2894 - Deep Shredder 10 64-bit 2CPU
2818 - Glaurung 1.2.1 Avalanche 64-bit 2CPU
2792 - Scorpio 1.9 32-bit 2CPU (Scorpio 1.91 not tested yet)
2742 - Deep Frenzee 3.0 64-bit 2CPU (only 56 games so far though)
2736 - Pharaon 3.5.1 32-bit 2CPU


Single CPU Engines
2999 - Rybka 2.2 64-bit
2923 - Loop 13.6 32-bit (only 67 games and 64-bit not tested yet)
2910 - Hiarcs 11.1
2905 - Zap!Chess Zanzibar 64-bit
2880 - Fritz 10
2871 - Shredder 10
2861 - Toga II 1.2.1a (not testing Toga II 1.3x4 yet due to egbb access bug)
2850 - Spike 1.2 Turin
2845 - Junior 10
2844 - Naum 2.1 32-bit (64-bit not tested)
2843 - Deep Sjeng 2.5 1CPU (only 89 games)
2840 - Fruit 2.2.1
2823 - Junior 10.1
2802 - Ktulu 8.0
2797 - SmarThink 1.00 64-bit (only 85 games)
2790 - Chess Tiger 2007
2784 - Glaurung 1.2.1 Beren 64-bit (only 60 games)
2779 - Chess Tiger 2007.1
2775 - Scorpio 1.84
2774 - Alaric 704 (only 77 games)
2768 - Glaurung 1.2.1 64-bit (testing of epsilon/2 just started)
2763 - CM9000 Enforcer
2762 - CM10th Xperience
2758 - Scorpio 1.91
2742 - Slow Chess Blitz WV2.1
2734 - CM10th Default
2732 - Delfi 5.1
2731 - Ruffian 2.1.0
2725 - Pro Deo 1.2
2725 - WildCat 7
2723 - Gandalf 6
2719 - Petir 4.39 (only 60 games)
2707 - Pharaon 3.5.1


CCRL Amateur Championship (32-bit 1CPU):
4th Season Division 1 - Spike claimed the crown. The Baron, Movei and Pseudo were relegated.

4th Season Division 2 - after 20 of the 30 rounds, Little Goliath, Ufim, Pharaon and Alaric are vying for the three promotion spots. Amateur, Gaia and Matacz currently occupy the three relegation slots.

4th Season Division 3 - Patzer, AnMon and Djinn gained promotion while Thor's Hammer, Arion and Typhoon were relegated.

4th Season Division 4 - after 25 of the 30 rounds. Diablo, Aice and BugChess have made a break from the field. It's a real dogfight at the other end with BBChess, GreKo, Ayito and NanoSzachy all in danger of relegation.

4th Season Division 5 - will start after the higher divisions are completed. The final field will be posted once a Qualifier has been run for the final two spots. The Qualifier starts this weekend with the contestants listed in our public forum.


We have a number of tournaments in progress and most of these can be followed in our public forum.


Blitz Notes

The 40/4 is updated separately to 40/40 with the latest update able to be viewed here:
http://computerchess.org.uk/ccrl/404.live/

Multi-CPU Engines (both 4CPU and 2CPU)
3079 - Rybka 2.3.1 64-bit 2CPU
3022 - Zap!Chess Zanzibar 64-bit 4CPU
2994 - Hiarcs 11.1 4CPU
2946 - Deep Shredder 10 64-bit 4CPU
2944 - Deep Fritz 10 4CPU
2938 - Naum 2.1 64-bit 4CPU
2925 - LoopMP 12.32 2CPU
2916 - Deep Junior 10 4CPU
2902 - Loop 13.6 64-bit 2CPU
2860 - Glaurung 1.2.1 32-bit 4CPU
2755 - Pharaon 3.5.1 2CPU
2736 - Deep Frenzee 3.0 64-bit 2CPU


Single CPU Engines
3026 - Rybka 2.2 64-bit
2995 - Rybka 2.3.1 32-bit
2915 - Hiarcs 11.1
2909 - Loop 10.32f (only 21 games for Loop 13.6)
2871 - Toga II 1.3x4
2868 - Fritz 10
2855 - Shredder 10
2854 - Naum 2.1 64-bit
2850 - Fruit 2.2.1
2848 - Zap!Chess Zanzibar
2842 - Junior 10
2829 - Chess Tiger 2007.1
2828 - Spike 1.2 Turin
2827 - Strelka 1.0b (only 64 games)
2821 - Ktulu 8.0
2819 - Junior 10.1
2809- Gambit Fruit 1.0b4
2761 - CM10th Paralyse
2761 - Deep Sjeng 2.5 1CPU
2757 - Glaurung 1.2.1 32-bit (higher than 64-bit!)
2751 - Scorpio 1.91
2748 - SmarThink 1.00 32-bit (only 116 games, 64-bit untested)
2740 - Bright 0.1d
2723 - Delfi 5.1
2818 - CM10th Default
2718 - Pro Deo 1.2
2715 - Alaric 704
2713 - Slow Chess Blitz WV2.1
2702 - Frenzee 3.0 64-bit (only 69 games)
2702 - Gandalf 6
2701 - Pharaon 3.5.1
2699 - WildCat 7


FRC Notes

Ray tests only those engines that can play FRC through the Shredder Classic GUI.
For FRC the best list to look at is the pure list, and the ratings there are:

2921 - Hiarcs 11.1
2905 - Shredder 10
2893 - Loop 10.32f
2859 - Spike 1.2 Turin
2858 - Fruit 2.2.1
2811 - Naum 2.1
2781 - Glaurung 1.2.1
2673 - Pharaon 3.5.1
2619 - Ufim 8.02
2607 - Movei 0.08.383
2478 - Hermann 1.9
2390 - Aice 0.99.2
2363 - Hamsters 0.2
2362 - Ayito 0.2.994


Stats/Presentation Notes

The LOS stats to the right hand side of each rating list are "likelihood of superiority" stats. They tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are also available for download through the link given at the top of this post. They can be downloaded by engine or by month.
ELO ratings are now saved in all game databases for those engines that have 150 games or more.

A list of games played this week per engine can be found in the update thread in the CCRL public forum, accessible through the link given at the top of this post.