Zappa Mexico (8 cpu) vs Top free UCI engine

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Daniel Charles

Zappa Mexico (8 cpu) vs Top free UCI engine

Post by Daniel Charles »

Engine testing condition

New Zappa Mexico 8 cpu vs 10 top free UCI engines
CPU 2 Xeon 5365 (8 x 3Ghz)
Time 4 Mn 2s
128 Mo , 512 MO for Zappa Mexico 8 cpu, 512 Mo For Glarung (4 cpu)
Egtb 3,4,5
Book perfect9.ctg
Gauntlet 10 games vs 10 Top free UCI engines
Total Games 100
score 74.5 %

Image

Zappa Mexico is Very impressive on 8 CPU (just look at the match RybkaSMP vs Zappa Mexico!!)

That s why I decide to test it on my 2Xeon 5365 (8CPU 3ghz)

Zappa was able to score 74.5 % vs 10 top Free uci Engine!!! (and this is just The 32 bits version)

It managed to score positive record vs all opponent (only Strelka draw it, I was alittle bit surprise )

Toga,Strelka and Glaurung SMP (it was on 4 CPU) did very well vs Zappa Mexico (A top 2 commercial engine )

This is the first Time I saw a Top Commercial engine other than Rybka that could beat easily the top 10 free UCI engine ...

It was a big surprise to see Zappa Mexico score 80 % vs Free Rybka 1.0 (A top 3 free engine , maybe the best free engine).
It gave a chess lesson to others free UCI engine (95 % vs Pharaon !!! 80 % vs Fruit 2.3.1, 80% vs Spike 1.2 ...)
revengeska

Re: Zappa Mexico (8 cpu) vs Top free UCI engine

Post by revengeska »

Daniel Charles wrote:Engine testing condition

New Zappa Mexico 8 cpu vs 10 top free UCI engines
CPU 2 Xeon 5365 (8 x 3Ghz)
Time 4 Mn 2s
128 Mo , 512 MO for Zappa Mexico 8 cpu, 512 Mo For Glarung (4 cpu)
Egtb 3,4,5
Book perfect9.ctg
Gauntlet 10 games vs 10 Top free UCI engines
Total Games 100
score 74.5 %

Image

Zappa Mexico is Very impressive on 8 CPU (just look at the match RybkaSMP vs Zappa Mexico!!)

That s why I decide to test it on my 2Xeon 5365 (8CPU 3ghz)

Zappa was able to score 74.5 % vs 10 top Free uci Engine!!! (and this is just The 32 bits version)

It managed to score positive record vs all opponent (only Strelka draw it, I was alittle bit surprise )

Toga,Strelka and Glaurung SMP (it was on 4 CPU) did very well vs Zappa Mexico (A top 2 commercial engine )

This is the first Time I saw a Top Commercial engine other than Rybka that could beat easily the top 10 free UCI engine ...

It was a big surprise to see Zappa Mexico score 80 % vs Free Rybka 1.0 (A top 3 free engine , maybe the best free engine).
It gave a chess lesson to others free UCI engine (95 % vs Pharaon !!! 80 % vs Fruit 2.3.1, 80% vs Spike 1.2 ...)
Hi Charles,

I'm absolutely convinced that Toga II 1.3.1 would fare better than 1.2.1par. On a single cpu Pentium 4, I ran a 32 game match with Toga II 1.3.1 vs Zappa Mexico, Toga won quite convincingly with a score of +14-7=11.
Daniel Charles

Re: Zappa Mexico (8 cpu) vs Top free UCI engine

Post by Daniel Charles »

probably Toga has his chance in a match 1 cpu vs 1 cpu.

However Antony Cozzie is a specialist for SMP Chess engine ... And looks like that with 8 CPU , Zappa Mexico scale very well and is simply in the top 2 commercial engine on big hardware ...

It managed to score an impressive 74.5% vs very strong Free UCI engine

I just want to say wahouuuu .... :D
Vinvin
Posts: 5301
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Zappa Mexico (8 cpu) vs Top free UCI engine

Post by Vinvin »

Could you estimate the speed up nodes/sec on 1 CPU vs nodes/sec 8 CPUs on your machine, please ?

I'm a bit deceived with zappa 8 cpus (50% against strelka 1cpu ???).

Anthony should work more to improve Zappa 1 cpu then he could get +100 elo on all CPU configuration :-)
revengeska

Re: Zappa Mexico (8 cpu) vs Top free UCI engine

Post by revengeska »

Daniel Charles wrote:probably Toga has his chance in a match 1 cpu vs 1 cpu.

However Antony Cozzie is a specialist for SMP Chess engine ... And looks like that with 8 CPU , Zappa Mexico scale very well and is simply in the top 2 commercial engine on big hardware ...

It managed to score an impressive 74.5% vs very strong Free UCI engine

I just want to say wahouuuu .... :D
This is true, however, I just don't see the point of pitting it against weaker, older versions of programs. At least use the latest free versions, it would give a more accurate depiction.
Tony Thomas

Re: Zappa Mexico (8 cpu) vs Top free UCI engine

Post by Tony Thomas »

revengeska wrote:
Daniel Charles wrote:probably Toga has his chance in a match 1 cpu vs 1 cpu.

However Antony Cozzie is a specialist for SMP Chess engine ... And looks like that with 8 CPU , Zappa Mexico scale very well and is simply in the top 2 commercial engine on big hardware ...

It managed to score an impressive 74.5% vs very strong Free UCI engine

I just want to say wahouuuu .... :D
This is true, however, I just don't see the point of pitting it against weaker, older versions of programs. At least use the latest free versions, it would give a more accurate depiction.
You talk as if there is a 100 point difference between 1.2.1 and 1.3.1.
Nid Hogge

Re: Zappa Mexico (8 cpu) vs Top free UCI engine

Post by Nid Hogge »

Nice test, But I don't think it's fair putting 8 core monster versus 1 core engines. (AFAIK only glaurung and maybe naum supports MP). So this test doesnt prove much becuase of the hardware differences. A surprisingly good result for Glaurung. I don't know why people still tet Strelka wasting time on it after its validated as a clone already.

Zappa on monster hardware is a beast no doubt about that. when these machines become more affordable its going to be interesting to play games with such high level and speeds.

Thanks,
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: Zappa Mexico (8 cpu) vs Top free UCI engine

Post by Sedat Canbaz »

Daniel Charles wrote:Engine testing condition

New Zappa Mexico 8 cpu vs 10 top free UCI engines
CPU 2 Xeon 5365 (8 x 3Ghz)
Time 4 Mn 2s
128 Mo , 512 MO for Zappa Mexico 8 cpu, 512 Mo For Glarung (4 cpu)
Egtb 3,4,5
Book perfect9.ctg
Gauntlet 10 games vs 10 Top free UCI engines
Total Games 100
score 74.5 %

Image

Zappa Mexico is Very impressive on 8 CPU (just look at the match RybkaSMP vs Zappa Mexico!!)

That s why I decide to test it on my 2Xeon 5365 (8CPU 3ghz)

Zappa was able to score 74.5 % vs 10 top Free uci Engine!!! (and this is just The 32 bits version)

It managed to score positive record vs all opponent (only Strelka draw it, I was alittle bit surprise )

Toga,Strelka and Glaurung SMP (it was on 4 CPU) did very well vs Zappa Mexico (A top 2 commercial engine )

This is the first Time I saw a Top Commercial engine other than Rybka that could beat easily the top 10 free UCI engine ...

It was a big surprise to see Zappa Mexico score 80 % vs Free Rybka 1.0 (A top 3 free engine , maybe the best free engine).
It gave a chess lesson to others free UCI engine (95 % vs Pharaon !!! 80 % vs Fruit 2.3.1, 80% vs Spike 1.2 ...)

Hello Daniel,

Congratulations for your new hardware''CPU 2 Xeon 5365 (8 x 3Ghz)''
I wonder which smp engines do not support 8 threads ?!

A such information will be very useful !

Thanks,
Sedat
Daniel Charles

Re: Zappa Mexico (8 cpu) vs Top free UCI engine

Post by Daniel Charles »

Hello Sedat

Thanks for your neutral books .ctg .
I still test eng vs eng 80% with some of your neutral book :D

Good question about chess engine that could support fully and scale well with 8 cpu ...

For sure Zappa Mexico and Rybka SMP (they were running both on 8 cpu at Mexico )

for commercial engines I could not answer , because I don t have a lot.
Zappa was on my very short list to buy ... Like Rybka 3 will be ... beside that I don t plan to buy a lot of commercial engines .

However I will test free UCI/WB engine SMP like Scorpio,Glaurung,Deep Patzer, Crafty, Smash SMP ... we will see if they are doing better on 8 T ...
and which one scale better from 1 to 8 T

Thanks

Daniel
revengeska

Re: Zappa Mexico (8 cpu) vs Top free UCI engine

Post by revengeska »

Tony Thomas wrote:
revengeska wrote:
Daniel Charles wrote:probably Toga has his chance in a match 1 cpu vs 1 cpu.

However Antony Cozzie is a specialist for SMP Chess engine ... And looks like that with 8 CPU , Zappa Mexico scale very well and is simply in the top 2 commercial engine on big hardware ...

It managed to score an impressive 74.5% vs very strong Free UCI engine

I just want to say wahouuuu .... :D
This is true, however, I just don't see the point of pitting it against weaker, older versions of programs. At least use the latest free versions, it would give a more accurate depiction.
You talk as if there is a 100 point difference between 1.2.1 and 1.3.1.
If not a 100 point difference, then pretty massive, 50 elo minimum. 1.3.1 gets better results, bar none. We might as well put Rybka 1.2 in a match vs Zappa Mexico to see which engine is better.