CEGT 40/120 Quad testing started

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Heinz Van Kempen

CEGT 40/120 Quad testing started

Post by Heinz Van Kempen »

Hi all :) ,

additionally to the CEGT 40/120 dual core and single tests the CEGT 40/120 Quad testing is now started. The engines will be included in the CEGT 40/120 rating list with 2 CPU and single versions until we have enough games for maybe an additional separate list.

For the start we take:

Rybka 2.3.2a 64-bit
Naum 2.2 64-bit
Zappa Mexiko 64-bit

After those we will include more engine versions one by one. New engine versions like the announced Deep Shredder 11 will come first.

Each engine will play a 50 games match against all others like before. All engines receive 1536 MB hash. Book will be Harry Schnapp´s 8moves. It is planned to match 4 CPU engines against other 4 CPU engines only.

Results will be posted in the CEGT Forum regularly and also in Rybka and Hiarcs Forum (if those engines are involved in matches) and in German fora.

Testers owning a Quad machine are welcome to contribute, also if they are not CEGT testers up to now.
Tony Thomas

Re: CEGT 40/120 Quad testing started

Post by Tony Thomas »

You have done it again, your new Quad 40/120 when it is available will be the best collection of highest quality computer games to date.
Heinz Van Kempen

Re: CEGT 40/120 Quad testing started

Post by Heinz Van Kempen »

Hi Tony :) ,

yes this will be high level games.

A small correction. Hash will be 1024 MB for those engines using a scheme 64, 128, etc.
User avatar
Graham Banks
Posts: 44611
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CEGT 40/120 Quad testing started

Post by Graham Banks »

Heinz Van Kempen wrote:Hi all :) ,

additionally to the CEGT 40/120 dual core and single tests the CEGT 40/120 Quad testing is now started. The engines will be included in the CEGT 40/120 rating list with 2 CPU and single versions until we have enough games for maybe an additional separate list.

For the start we take:

Rybka 2.3.2a 64-bit
Naum 2.2 64-bit
Zappa Mexiko 64-bit

After those we will include more engine versions one by one. New engine versions like the announced Deep Shredder 11 will come first.

Each engine will play a 50 games match against all others like before. All engines receive 1536 MB hash. Book will be Harry Schnapp´s 8moves. It is planned to match 4 CPU engines against other 4 CPU engines only.

Results will be posted in the CEGT Forum regularly and also in Rybka and Hiarcs Forum (if those engines are involved in matches) and in German fora.

Testers owning a Quad machine are welcome to contribute, also if they are not CEGT testers up to now.
Hello Heinz,

I'll be following your testing with interest. I hope you'll post the results here for us too.

Keep up the good work.

Regards, Graham.
gbanksnz at gmail.com
Spock

Re: CEGT 40/120 Quad testing started

Post by Spock »

Tony Thomas wrote:You have done it again, your new Quad 40/120 when it is available will be the best collection of highest quality computer games to date.
Of course Sedat has been doing 40/120 testing on Quad Hardware QX6700 for a while now

http://www.sedatchess.com/scct_40120_all.html

However the volume is not that high, so the CEGT games will be a welcome addition. The more the better :wink:
Uri Blass
Posts: 10892
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: CEGT 40/120 Quad testing started

Post by Uri Blass »

Heinz Van Kempen wrote:Hi Tony :) ,

yes this will be high level games.

A small correction. Hash will be 1024 MB for those engines using a scheme 64, 128, etc.
If the list is only of 4 cpu I have no objecions to it but if you plan to include in the same list 2 cpu and 4 cpu then I prefer to see the same hash for both(otherwise we are not going to know how much advantage in rating is because of more processors and how much advantage is because of hash).

I assume that all engines earn from more hash and it is possible that some fast searcher with 2 cpu earn more from 1024 mbytes hash relative to slow searcher with 4 cpu.

Uri
Heinz Van Kempen

Re: CEGT 40/120 Quad testing started

Post by Heinz Van Kempen »

Hi Uri :) ,

2 CPU engines got 1024 MB before, so this will not change and you will get equal conditions here. I would like to give 2048 MB to all, but this is not possible with 4 GB RAM on each machine.

On further thought I guess that we need also some matches 4 CPU against 2 CPU to avoid different pools of matches with no connections to calculate a decent rating list. If so only the best 2 CPU versions will be chosen for this matches.

What amount of games will concern, it will last some time to have many like in the beginning of CEGT 40/120 one and a half year ago. Anyway we will prefer fewer engines with many games to many engines with few games for better statistical accuracy.
Spock

Re: CEGT 40/120 Quad testing started

Post by Spock »

Heinz Van Kempen wrote: What amount of games will concern, it will last some time to have many like in the beginning of CEGT 40/120 one and a half year ago. Anyway we will prefer fewer engines with many games to many engines with few games for better statistical accuracy.
Yes, I agree with this 100%.

I am curious as to the actual hardware being used and the actual time control ? Can you confirm ?

Keep up the good work :)
ArmyBridge

Re: CEGT 40/120 Quad testing started

Post by ArmyBridge »

Hi, it sound great!! :D
It wolud be nice if you test each engine with own book to , since the Rybka-zappa match I'm still wonder which's the real diference between both engines. so if we take both test ,under generic book and own book we can bring some conclusions, Deep Junior wolud be stronger in own book than generic book, don´t you think so?. Thanks to all CEGT team :!:
Regards
Uri Blass
Posts: 10892
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: CEGT 40/120 Quad testing started

Post by Uri Blass »

ArmyBridge wrote:Hi, it sound great!! :D
It wolud be nice if you test each engine with own book to , since the Rybka-zappa match I'm still wonder which's the real diference between both engines. so if we take both test ,under generic book and own book we can bring some conclusions, Deep Junior wolud be stronger in own book than generic book, don´t you think so?. Thanks to all CEGT team :!:
Regards
testing with own book is not interesting for me

Note that zappa 2 cpu scored 42% against rybka 2 cpu in cegt and considering the fact that zappa earns more from more processors results of 5.5:4.5 for zappa with 8 cpu is not something that you can consider to be a big surprise with generic books.

Uri