CCRL update (26th September 2008)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 45333
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL update (26th September 2008)

Post by Graham Banks »

The latest updates of the CCRL Rating Lists and Statistics are available for viewing at:
http://www.computerchess.org.uk/ccrl/4040/ (40/40)
http://computerchess.org.uk/ccrl/404/ (40/4)
The live link to the 40/4 list given below is currently the most up to date for that list.

The lists sometimes get updated during the week and these updates can be viewed here:
http://www.computerchess.org.uk/ccrl/4040.live/ (40/40)
http://computerchess.org.uk/ccrl/404.live/ (40/4)
However, no game downloads are available from these live links.

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers are:
Graham Banks, Ray Banks, Shaun Brewer, Kirill Kryukov, Dom Leste, Tom Logan, Andreas Schwartmann, Charles Smith, George Speight, Gabor Szots and Martin Thoresen.
Currently inactive team members are:
Sarah Bird, Chris Taylor and Chuck Wilson.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to also look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.


40/40 Notes


4CPU 64-bit Engines

With 700+ games now under its belt, Rybka 3 remains close to 150 elo clear at the top.
Naum 3.1 and Zappa Mexico II in second and third spots are very similar in strength to each other.
There is a 55 elo gap back to Deep Shredder 11, Toga II 1.4.1SE, Deep Sjeng 3.0 and Hiarcs 12. These four engines have an edge over Deep Fritz 10.1 which in turn has an advantage over Glaurung 2.1 and the still private Bright 0.3d.
Loop M1-T is further back.

The relative ratings of the 2CPU engines that have been well tested are pretty much the same as their 4CPU counterparts.


Single CPU Engines

Rybka 3 has a 200 elo lead over other engines in this category.
Naum 3.1 lies in second spot, narrowly ahead of the tightly bunched Fritz 11, Zappa Mexico II, Deep Sjeng 3.0, Shredder 11 and Toga II 1.4.1SE.
Hiarcs 12 is further back with a clear advantage over Fruit 2.3.1, Loop 13.6, Bright 0.3d (private) and Glaurung 2.1. Thinker 5.2e Passive is also likely to end up amongst this group of engines.


Free Single CPU Engines

Rybka 2.2 heads the field with a 50+ elo gap back to Toga II 1.4.1SE.
There is a similar gap back to Thinker 5.2e Passive, Glaurung 2.1, Fruit 2.3.1 and Cyclone 1.0. This group holds a definite edge over Spike 1.2 Turin and Bright 0.3a.

CCRL tests a wide range of amateur engines (defined as free and having never gone commercial), ranging right down to the 1900 elo level. The intention is to get well over 200 games for each of these engines. We see it is a way of supporting and hopefully motivating these engine authors with their efforts.


Blitz Notes

An enormous amount of work goes into the blitz list and with over 300,000 games in the database, it is well worth a visit.

Of special interest to some will be the best free 1CPU engines list which is being constructed through a systematic testing approach as mentioned here:
http://kirr.homeunix.org/chess/discussi ... f=7&t=3271


FRC Notes

Ray tests only those engines that can play FRC through the Shredder Classic GUI.
If engine authors have a new and stable version of their engine that will run under this GUI, they should contact Ray if they wish to see it tested.

Rybka 3 has a massive 200 elo lead over the closely grouped Shredder 11, Naum 3.1 and Deep Sjeng 3.0.
Hiarcs Paderborn 2007 in fifth spot is well ahead of Fruit 051103 and Loop 10.32f (the most recent Loop version that could play FRC).

For FRC the best list to look at is the pure list.
http://www.computerchess.org.uk/ccrl/404FRC/


Stats/Presentation Notes

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code.
ELO ratings are now saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.
gbanksnz at gmail.com
Tony Thomas

Re: CCRL update (26th September 2008)

Post by Tony Thomas »

Deep Sjeng seemed to have made it way to the top...About time I say..
User avatar
Graham Banks
Posts: 45333
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL update (26th September 2008)

Post by Graham Banks »

Tony Thomas wrote:Deep Sjeng seemed to have made it way to the top...About time I say..
Gian-Carlo is certainly making giant strides with Sjeng. Long may it continue! 8-)
gbanksnz at gmail.com
Tony Thomas

Re: CCRL update (26th September 2008)

Post by Tony Thomas »

Graham Banks wrote:
Tony Thomas wrote:Deep Sjeng seemed to have made it way to the top...About time I say..
Gian-Carlo is certainly making giant strides with Sjeng. Long may it continue! 8-)
Since we dont have an Sjeng forum, we should start a Sjeng Fanboi forum.. Are you up for the challenge? :wink: And a Naum lovers forum as well..for some reason Naum sounds to me like the name of a very tasty nut, like Macademia, or Pistachio..www.Naumnut.com regards..
swami
Posts: 6664
Joined: Thu Mar 09, 2006 4:21 am

Re: CCRL update (26th September 2008)

Post by swami »

Tony Thomas wrote:
Graham Banks wrote:
Tony Thomas wrote:Deep Sjeng seemed to have made it way to the top...About time I say..
Gian-Carlo is certainly making giant strides with Sjeng. Long may it continue! 8-)
Since we dont have an Sjeng forum, we should start a Sjeng Fanboi forum.. Are you up for the challenge? :wink: And a Naum lovers forum as well..for some reason Naum sounds to me like the name of a very tasty nut, like Macademia, or Pistachio..www.Naumnut.com regards..
Forum for every single engine is maybe good or may not be for the authors, but it definitely is not good for all the computer chess people like us, It's not too good for us to visit every single comp chess page, CCC is enough IMO, It's the authors who should do something to create the forum, since this is not the full time job for them and just a hobby, i don't see what the purpose of such a forum would be for them. Ofcourse we can create a forum if we have bandwidth...
User avatar
Graham Banks
Posts: 45333
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL update (26th September 2008)

Post by Graham Banks »

swami wrote:
Tony Thomas wrote:
Graham Banks wrote:
Tony Thomas wrote:Deep Sjeng seemed to have made it way to the top...About time I say..
Gian-Carlo is certainly making giant strides with Sjeng. Long may it continue! 8-)
Since we dont have an Sjeng forum, we should start a Sjeng Fanboi forum.. Are you up for the challenge? :wink: And a Naum lovers forum as well..for some reason Naum sounds to me like the name of a very tasty nut, like Macademia, or Pistachio..www.Naumnut.com regards..
Forum for every single engine is maybe good or may not be for the authors, but it definitely is not good for all the computer chess people like us, It's not too good for us to visit every single comp chess page, CCC is enough IMO, It's the authors who should do something to create the forum, since this is not the full time job for them and just a hobby, i don't see what the purpose of such a forum would be for them. Ofcourse we can create a forum if we have bandwidth...
I believe that Tony's comment was tongue in cheek. :P
gbanksnz at gmail.com
swami
Posts: 6664
Joined: Thu Mar 09, 2006 4:21 am

Re: CCRL update (26th September 2008)

Post by swami »

Graham Banks wrote:
swami wrote:
Tony Thomas wrote:
Graham Banks wrote:
Tony Thomas wrote:Deep Sjeng seemed to have made it way to the top...About time I say..
Gian-Carlo is certainly making giant strides with Sjeng. Long may it continue! 8-)
Since we dont have an Sjeng forum, we should start a Sjeng Fanboi forum.. Are you up for the challenge? :wink: And a Naum lovers forum as well..for some reason Naum sounds to me like the name of a very tasty nut, like Macademia, or Pistachio..www.Naumnut.com regards..
Forum for every single engine is maybe good or may not be for the authors, but it definitely is not good for all the computer chess people like us, It's not too good for us to visit every single comp chess page, CCC is enough IMO, It's the authors who should do something to create the forum, since this is not the full time job for them and just a hobby, i don't see what the purpose of such a forum would be for them. Ofcourse we can create a forum if we have bandwidth...
Tony's comment was tongue in cheek. :P
Well, I dont find that too funny, atleast it is a non-goat humour, so an indication that Tony is surely on the right track switching back to delicious non-goat humour younger Tony days . :wink:
Tony Thomas

Re: CCRL update (26th September 2008)

Post by Tony Thomas »

Graham Banks wrote:
swami wrote:
Tony Thomas wrote:
Graham Banks wrote:
Tony Thomas wrote:Deep Sjeng seemed to have made it way to the top...About time I say..
Gian-Carlo is certainly making giant strides with Sjeng. Long may it continue! 8-)
Since we dont have an Sjeng forum, we should start a Sjeng Fanboi forum.. Are you up for the challenge? :wink: And a Naum lovers forum as well..for some reason Naum sounds to me like the name of a very tasty nut, like Macademia, or Pistachio..www.Naumnut.com regards..
Forum for every single engine is maybe good or may not be for the authors, but it definitely is not good for all the computer chess people like us, It's not too good for us to visit every single comp chess page, CCC is enough IMO, It's the authors who should do something to create the forum, since this is not the full time job for them and just a hobby, i don't see what the purpose of such a forum would be for them. Ofcourse we can create a forum if we have bandwidth...
I believe that Tony's comment was tongue in cheek. :P

Bang! You are absolutely right..We shall call that forum the Forum for Washed Masses.. :P And here is an idea for an announcement on the top of the page...
To Prospective New members

New members are expected to take daily showers unlesss prior authorization is received from the administrator.

Also do not attach pictures of you taking showers unless its of an absolutely knock out female.

Failure to follow the above rules mean that your account might not get activated.

Regards (Naum nut in behalf of all the other Naum Nutters)