CEGT 40/20 update (May 20th 2007)

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Werner
Posts: 2871
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

CEGT 40/20 update (May 20th 2007)

Post by Werner »

Hi all :),

Our newest rating list 40/20 is now online. All links at the end of the posting as usual.

While watching ICT Leiden - here some news from CEGT:

Strelka 1.0 Beta did make another 400 games and has now a rating of 2761 (+20) and a place near Ktulu 8 in our list.

But the new Glaurung 2-Epsilon/2 engine is the surprise of this week. After more than 500 games we have a stable rating of 2731 - these are 60 Elos more than Glaurung 1.2.1 1CPU! As you can see: Glaurung is also doing a good job in Leiden.

We started the tests with 3 new engines: Alaric 7.04, Chiron 0.87 and Colossus2007a. All of them do not have enough games for a stable rating but they all seem to be better than previous versions. Chiron 0.87 is a private version and next week we will see if Ubaldo could really catch Delphi 5.1 :)

Deep Sjeng 2.5 2CPU reached now 2730 Elos. As I could read in the chat in Leiden version 2.6 is playing. Perhaps we get an update soon??

Our 4CPU engines now have around 200 games and we have nearly the same order as CCRL (Zap!ChessZanzibar, Hiarcs11.1, Naum2.1, Zap!ChessPaderborn, DeepShredder10.1, Loop13.6, DeepFritz10).

And not to forget: Hiarcs 11.1 1CPU is now our second engine with a better rating than Rybka 1.0 beta!

A big thanks to all testers as usual.

Links:
All-Versions: http://www.husvankempen.de/nunn/40_40%2 ... liste.html
Best-Versions: http://www.husvankempen.de/nunn/40_40%2 ... liste.html
Blitz: http://www.husvankempen.de/nunn/blitz.htm (also with Best-Versions and All-Versions lists)
40/120: http://www.husvankempen.de/nunn/40_120_ ... liste.html
Replay-Zone: http://www.husvankempen.de/nunn/Replay/replay.htm
Elo comparison 40/120 and 40/20: http://www.husvankempen.de/nunn/Replay/ ... arison.htm
Testers with picture and Hardware: http://www.husvankempen.de/nunn/testers/testers.htm

Werner Schüle
CEGT-Team
Tony Thomas

Re: CEGT 40/20 update (May 20th 2007)

Post by Tony Thomas »

Werner wrote:
Deep Sjeng 2.5 2CPU reached now 2730 Elos. As I could read in the chat in Leiden version 2.6 is playing. Perhaps we get an update soon??

And not to forget: Hiarcs 11.1 1CPU is now our second engine with a better rating than Rybka 1.0 beta!

A big thanks to all testers as usual.



Werner Schüle
CEGT-Team
I also hope that we get a 100 point stronger update. It is good to know that Hiarcs has finally caught up with one of the Rybka versions after 5 or so releases, a hearty congratulations to them from me.
Spock

Re: CEGT 40/20 update (May 20th 2007)

Post by Spock »

Hi Werner,

I'll be following your quad testing with interest. Great to see. For dual engines you use twice the hash size than for single CPU engines. What policy have you settled on for your quad engines ?
Harvey Williamson

Re: CEGT 40/20 update (May 20th 2007)

Post by Harvey Williamson »

Spock wrote:Hi Werner,

I'll be following your quad testing with interest. Great to see. For dual engines you use twice the hash size than for single CPU engines. What policy have you settled on for your quad engines ?
sadly another group that tests engines+hash rather than engines.
Harvey Williamson

Re: CEGT 40/20 update (May 20th 2007)

Post by Harvey Williamson »

Tony Thomas wrote:
Werner wrote:
Deep Sjeng 2.5 2CPU reached now 2730 Elos. As I could read in the chat in Leiden version 2.6 is playing. Perhaps we get an update soon??

And not to forget: Hiarcs 11.1 1CPU is now our second engine with a better rating than Rybka 1.0 beta!

A big thanks to all testers as usual.



Werner Schüle
CEGT-Team
I also hope that we get a 100 point stronger update. It is good to know that Hiarcs has finally caught up with one of the Rybka versions after 5 or so releases, a hearty congratulations to them from me.
Thanks Tony! and thanks to CEGT for their continued testing efforts.
Spock

Re: CEGT 40/20 update (May 20th 2007)

Post by Spock »

Harvey Williamson wrote:
Tony Thomas wrote:
Werner wrote:
Deep Sjeng 2.5 2CPU reached now 2730 Elos. As I could read in the chat in Leiden version 2.6 is playing. Perhaps we get an update soon??

And not to forget: Hiarcs 11.1 1CPU is now our second engine with a better rating than Rybka 1.0 beta!

A big thanks to all testers as usual.



Werner Schüle
CEGT-Team
I also hope that we get a 100 point stronger update. It is good to know that Hiarcs has finally caught up with one of the Rybka versions after 5 or so releases, a hearty congratulations to them from me.
Thanks Tony! and thanks to CEGT for their continued testing efforts.
Am I missing something ? I see:

2851 Rybka 1.0 Beta x64
2827 Hiarcs 11.1 1CPU

Quite possible, it's been a busy couple of weeks for me....
Harvey Williamson

Re: CEGT 40/20 update (May 20th 2007)

Post by Harvey Williamson »

Spock wrote:
Harvey Williamson wrote:
Tony Thomas wrote:
Werner wrote:
Deep Sjeng 2.5 2CPU reached now 2730 Elos. As I could read in the chat in Leiden version 2.6 is playing. Perhaps we get an update soon??

And not to forget: Hiarcs 11.1 1CPU is now our second engine with a better rating than Rybka 1.0 beta!

A big thanks to all testers as usual.



Werner Schüle
CEGT-Team
I also hope that we get a 100 point stronger update. It is good to know that Hiarcs has finally caught up with one of the Rybka versions after 5 or so releases, a hearty congratulations to them from me.
Thanks Tony! and thanks to CEGT for their continued testing efforts.
Am I missing something ? I see:

2851 Rybka 1.0 Beta x64
2827 Hiarcs 11.1 1CPU

Quite possible, it's been a busy couple of weeks for me....
I suggest you ask Werner not me.
Uri Blass
Posts: 10281
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: CEGT 40/20 update (May 20th 2007)

Post by Uri Blass »

Spock wrote:
Harvey Williamson wrote:
Tony Thomas wrote:
Werner wrote:
Deep Sjeng 2.5 2CPU reached now 2730 Elos. As I could read in the chat in Leiden version 2.6 is playing. Perhaps we get an update soon??

And not to forget: Hiarcs 11.1 1CPU is now our second engine with a better rating than Rybka 1.0 beta!

A big thanks to all testers as usual.



Werner Schüle
CEGT-Team
I also hope that we get a 100 point stronger update. It is good to know that Hiarcs has finally caught up with one of the Rybka versions after 5 or so releases, a hearty congratulations to them from me.
Thanks Tony! and thanks to CEGT for their continued testing efforts.
Am I missing something ? I see:

2851 Rybka 1.0 Beta x64
2827 Hiarcs 11.1 1CPU

Quite possible, it's been a busy couple of weeks for me....
Yes
one of the rybka versions does not mean the 64 bit version

I see the following in the ccrl 40/40 list

Hiarcs 11.1 2910 +24 −24 60.2% −67.8 41.3% 543
Rybka 1.0 32-bit 2882 +16 −16 60.7% −71.9 40.4% 1270
Hiarcs 11 2875 +28 −28 55.1% −31.4 42.4% 389

I see the following in the cegt 40/20 list

43 Hiarcs 11.1 1CPU 2827 27 27 402 56.6 % 2781 37.6 %
44 Rybka 1.0 Beta w32 2822 8 8 4714 65.7 % 2709 32.7 %
51 Hiarcs 11 1CPU 2805 16 16 1080 55.6 % 2766 37.9 %


Uri
Spock

Re: CEGT 40/20 update (May 20th 2007)

Post by Spock »

OK, understood - Hiarcs has caught the 32-bit version of Rybka 1.0 beta :)
Shaun
Posts: 322
Joined: Wed Mar 08, 2006 9:55 pm
Location: Brighton - UK

Re: CEGT 40/20 update (May 20th 2007)

Post by Shaun »

Harvey Williamson wrote:
Spock wrote:Hi Werner,

I'll be following your quad testing with interest. Great to see. For dual engines you use twice the hash size than for single CPU engines. What policy have you settled on for your quad engines ?
sadly another group that tests engines+hash rather than engines.
Hi Harvey,

I thought we cleared this up?

As long as enought hash is allocated for a single cpu version giving more will not help (and for some engines hinder) - where as with say 4 cpus the hash will be used quicker so more is required.

Yes one could run 1 CPU 1GB hash v 4 CPUs 1GB hash but the extra hash for the single CPU version is not going to help - at least we extrapolated that for the 40/40 ccrl time control from the hundreds of games I ran at 40/4?

Shaun.

P.S. Are we going to see a H11.2 soon looking forward to testing it.