Naum SMP 2.2 (8cpu) Test

[Daniel Charles]

Xeon 5365 (8 X 3 Ghz)
512 Mo for SMP engines , 128 Mo for Single CPU
Fritz GUI
Perfec9.ctg
Gauntlets
Time 3 m + 2s (=> 5 mn)
200 games



after 9 rounds

Naum 2.2 with 8 cpu was very surprising !!!!

Naum 2.2 SMP 8T is ahead of Zappa mexico in their close match


Fruit 2.3.3J is doing very good if we consider that Fruit is not SMP.
Last time i tested Fruit 2.3.3J beta and It did beat all free uci engines (except Strelka )

Glaurung is still running on 4 CPU for this version I m testing, I will wait the release with 8 Cpu to run a gauntlet with Glaurung 8 cpu.

Naum SMP 2.2 is doing better than I expected, all the match are not finish yet , however It is winning vs all top free UCI engine...

Scorpio and Crafty are doing bad , probably because they don t play at Full level with wb2uci and I didn t know if they play with 8 or 4 cpu or even if they play with SMP (I will test them with Arena GUI or Winboard GUI, where they should do better)


Daniel

[Daniel Charles]

final score 142/200
71 %

Naum was ahead at half way vs Zappa Mexico (commercial), but at the end Zappa came back and won the match 11/20

Fruit 2.3.3J did very well even if it lost. This is probably a stronger version than 2.3.1 at least vs others engine

It would be interesting to test Glaurung on 8 cpu , because for this test , I was still running Glaurung with 4 CPU .I notice with the Glaurung benchmark that Glaurung 8 cpu is around X 1.5 ( or 50% ) faster than on 4 CPU for the Kn/s

I was surprise to see Naum SMP 8T won 15-5 vs Rybka 1.0 (The best Free UCI engine for the last 2 years )

Free Chess engine did what they could but at the end Naum SMP was simply too strong...even for strelka

On CEGT and CCRL rating , the difference between Naum 2.2 Single CPU and Naum 4 CPU is more than 100 elo. It is probably over 120 elo between the version 1 cpu and 8 CPU !!!


it would be interesting to read your comments about Naum 2.2 SMP on 8 CPU.

Daniel

[naum]

Thanks for the very interesting test Daniel.
Impressive result by Fruit. It might be a nemesis opponent.
Is this version of Fruit available for download (I guess not yet)? I need strong sparring partners.
How many CPUs were used by Scorpio,Arasan and Crafty?
Based on the results, I am pretty sure 8CPU version is stronger then 4CPU.

Regards,
Alex

[Daniel Charles]

Dear Alex

Fruit 2.3.3 J Beta is not available for Download ... It could change soon , like This one Looks Like very strong .

Arasan was running for sure on 8 CPU from the UCI option,
However for Scorpio and Crafty It was more obscur and like I wrotte I didn t know if throught the wb2uci they play with 4 or 8 cpu or with only 1 cpu ... I wrotte 4 cores for Scorpio on the log files (butt don t know if it works), same thing for Crafty put 8 but don t know if it works too

I forgot for this gauntlet to include Deep Pharaon (4 cpu), I got some good test with Deep pharaon ...


I think that for Naum 2.2 single CPU : Rybka 1.0, Fruit 2.3.1, Toga, Strelka, Sipke,Glaurung should be worthy and strong sparring partners.

However for Naum 2.2 SMP 4 or 8 cpu should be test more seriously vs strong sparring partners smp like Rybka SMP ,Zappa Mexico, Hiars SMP ...

This is an evidence that with SMP support Naum 2.2 is among the top 3-5 strongest Chess engines

Thanks

Daniel

[Tony Thomas]

Dear Alex

Fruit 2.3.3 J Beta is not available for Download ... It could change soon , like This one Looks Like very strong .

Arasan was running for sure on 8 CPU from the UCI option,
However for Scorpio and Crafty It was more obscur and like I wrotte I didn t know if throught the wb2uci they play with 4 or 8 cpu or with only 1 cpu ... I wrotte 4 cores for Scorpio on the log files (butt don t know if it works), same thing for Crafty put 8 but don t know if it works too

I forgot for this gauntlet to include Deep Pharaon (4 cpu), I got some good test with Deep pharaon ...


I think that for Naum 2.2 single CPU : Rybka 1.0, Fruit 2.3.1, Toga, Strelka, Sipke,Glaurung should be worthy and strong sparring partners.

However for Naum 2.2 SMP 4 or 8 cpu should be test more seriously vs strong sparring partners smp like Rybka SMP ,Zappa Mexico, Hiars SMP ...

This is an evidence that with SMP support Naum 2.2 is among the top 3-5 strongest Chess engines

Thanks

Daniel

I thought that even if you use Wb to UCI the programm used instructions from its config file. In the case of Scorpio did you change MT to 8?

Code: Select all

ht 128
pht 8
eht 8
mt  8
resign              1200
egbb_path           E:\egbb\
egbb_cache_size     
multi_personality   opn mid end

Same goes for crafty, you have to adjust the numbers inside the RC file.

[Daniel Charles]

I don t know if it worked with Scorpio

This is my wb2uci files for scorpio

Name=Scorpio 2.0 W2U
Author=Daniel Shawul, Ethiopie
Filename=Wb2Uci.exe


[OPTIONS]
Program=scorpio.exe
Terminatehard=true

;Logfile=true

#turn logging on and off
log on

#hashtable size in mb
ht 512

#evaluation hash table size in mb
eht 16

#pawn hashtable size in mb
pht 1

#number of processors
mt 8

#resign value in centipawns
resign 600

#path to egbb
egbb_path C:\egbbs

[Daniel Charles]

nodes = 11837745 <89 qnodes> time = 6.58s nps = 1798229

this is Scorpio Output ...
I don t know how much is the nps for 1 CPU

Here it show nps = 1798229 or 1798 Kn/s

I don t know if this si good or bad .

If anyone could check Scorpio the nps with scorpio 1 CPU

Thanks

Daniel

[Daniel Shawul]

Hi Daniel
The compiled scorpio that you have can use maximum of 4 cpus.
I did not think that many people would test scorpio on 8 cpus so that is why I set to 4. You can see in the log file of scorpio that the number of processors it is using is 4. That is probably the case for crafty too.
can you send me the log files of scorpio?

thanks for the games
Daniel

[Daniel Charles]

========== scorpio.ini =======
log on
ht 10
eht 5
pht 1
mt 8
resign 600
egbb_path f:/egbb/
egbb_cache_size 16
egbb_load_type 1
multi_personality opn mid end
==============================
ht 524288 X 32
eht 524288 X 16
pht 65536 X 16
processors [4]
========== opn ===============

[Daniel Shawul]

Code: Select all

processors [4] 
========== opn ===============

This means scorpio is using 4 cpus even though mt is set to 8.
I will recompile it for 8 cpus and send it to you.