Similarity Detector Available

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Jim Logan
Posts: 74
Joined: Thu Mar 09, 2006 4:14 am
Location: Nevada, USA

Re: Similarity Detector Available

Post by Jim Logan »

Don wrote:The similar.exe is designed to run on 64 bit windows and is actually a tcl script wrapped up with a tcl runtime using tclkit technology.
Any chance of getting a 32 bit version? Some of us still lag behind.
perejaslav
Posts: 240
Joined: Sat Mar 18, 2006 4:01 am
Location: Cold

Re: Similarity Detector Available

Post by perejaslav »

BTW The most «non-clone engine» is Spark!
You just look at this!

------ spark-1.0 (time: 100 ms) ------
12.80 IvanHoe 9.48b x64 (time: 100 ms)
12.25 Rybka 4w32 (time: 100 ms)
12.25 Houdini 1.5 x64 (time: 100 ms)
12.20 Naum 4.2 (time: 100 ms)
12.00 Rybka 3 32-bit (time: 100 ms)
11.95 IPPOLIT 0.080b3 x64 (time: 100 ms)
11.90 Gull 1.1 x64 (time: 100 ms)
11.85 Critter 0.90 64-bit (time: 100 ms)
11.85 Crab 1.0 beta 64bit (time: 100 ms)
11.80 Stockfish 1.9.1 JA 64bit (time: 100 ms)
11.75 Rybka 4x64 (time: 100 ms)
11.75 Rybka 2.2n2 32-bit (time: 100 ms)
11.75 Naum 4.1 (time: 100 ms)
11.65 Belka 1.8.22 (time: 100 ms)
11.60 Tinapa 1.01 (time: 100 ms)
11.55 Rybka 1.0 Beta 32-bit (time: 100 ms)
11.40 Hannibal 1.0a (time: 100 ms)
11.15 HIARCS 13.2 SP (time: 100 ms)
11.10 Fruit 2.1 (time: 100 ms)
11.05 Shredder 12 UCI (time: 100 ms)
10.90 Deep Sjeng c't 2010 (time: 100 ms)
10.75 Deep Sjeng WC2008 x64 (time: 100 ms)
10.70 Jonny 4.00 (time: 100 ms) :P
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Similarity Detector Available

Post by michiguel »

perejaslav wrote:------ Naum 4.2 (time: 100 ms) ------
84.30 Naum 4.1 (time: 100 ms)
75.15 Rybka 2.2n2 32-bit (time: 100 ms)
70.45 Belka 1.8.22 (time: 100 ms)
69.00 Rybka 1.0 Beta 32-bit (time: 100 ms)
65.05 Rybka 4x64 (time: 100 ms)
64.45 Rybka 3 32-bit (time: 100 ms)
63.60 IPPOLIT 0.080b3 x64 (time: 100 ms)
63.10 IvanHoe 9.48b x64 (time: 100 ms)
62.80 Rybka 4w32 (time: 100 ms)
62.15 Fruit 2.1 (time: 100 ms)
61.65 Critter 0.90 64-bit (time: 100 ms)
61.45 Houdini 1.5 x64 (time: 100 ms)
61.25 Stockfish 1.9.1 JA 64bit (time: 100 ms)
60.80 Gull 1.1 x64 (time: 100 ms)
60.55 Hannibal 1.0a (time: 100 ms)
60.45 Crab 1.0 beta 64bit (time: 100 ms)
60.10 Tinapa 1.01 (time: 100 ms)
57.80 Deep Sjeng c't 2010 (time: 100 ms)
56.80 Deep Sjeng WC2008 x64 (time: 100 ms)
56.70 Shredder 12 UCI (time: 100 ms)
56.65 HIARCS 13.2 SP (time: 100 ms)
55.45 Jonny 4.00 (time: 100 ms)
12.20 spark-1.0 (time: 100 ms)


Naum 4.2 is a clone of Rybka 2. It' even more «clonish» than IPPOLIT-Rybka affair

------ IPPOLIT 0.080b3 x64 (time: 100 ms) ------
68.60 IvanHoe 9.48b x64 (time: 100 ms)
66.45 Rybka 3 32-bit (time: 100 ms)
64.75 Houdini 1.5 x64 (time: 100 ms)
64.15 Rybka 4w32 (time: 100 ms)
63.80 Belka 1.8.22 (time: 100 ms)
63.60 Naum 4.2 (time: 100 ms)
63.15 Rybka 2.2n2 32-bit (time: 100 ms)
62.85 Rybka 4x64 (time: 100 ms)
62.70 Naum 4.1 (time: 100 ms)
61.80 Critter 0.90 64-bit (time: 100 ms)
60.20 Hannibal 1.0a (time: 100 ms)
60.00 Gull 1.1 x64 (time: 100 ms)
59.90 Rybka 1.0 Beta 32-bit (time: 100 ms)
59.90 Fruit 2.1 (time: 100 ms)
59.40 Stockfish 1.9.1 JA 64bit (time: 100 ms)
59.20 Tinapa 1.01 (time: 100 ms)
59.00 Crab 1.0 beta 64bit (time: 100 ms)
58.55 Deep Sjeng c't 2010 (time: 100 ms)
58.35 Shredder 12 UCI (time: 100 ms)
57.25 Deep Sjeng WC2008 x64 (time: 100 ms)
54.65 Jonny 4.00 (time: 100 ms)
53.75 HIARCS 13.2 SP (time: 100 ms)
11.95 spark-1.0 (time: 100 ms)


Thank you for a great tool! I think Naum 4.2 should be banned from all chess fora! :roll: :lol:
We discussed this already almost a year ago. By private email to Michael Hart, the author claims it fitted the evaluation to Rybka 2.2.

Miguel
User avatar
Don
Posts: 5106
Joined: Tue Apr 29, 2008 4:27 pm

Re: Similarity Detector Available

Post by Don »

I think there is an error in your tester of some kind - you are reporting ridiculous results that I am not able to duplicate.

I suspect that spike crashed part way through the test.
perejaslav wrote:BTW The most «non-clone engine» is Spark!
You just look at this!

------ spark-1.0 (time: 100 ms) ------
12.80 IvanHoe 9.48b x64 (time: 100 ms)
12.25 Rybka 4w32 (time: 100 ms)
12.25 Houdini 1.5 x64 (time: 100 ms)
12.20 Naum 4.2 (time: 100 ms)
12.00 Rybka 3 32-bit (time: 100 ms)
11.95 IPPOLIT 0.080b3 x64 (time: 100 ms)
11.90 Gull 1.1 x64 (time: 100 ms)
11.85 Critter 0.90 64-bit (time: 100 ms)
11.85 Crab 1.0 beta 64bit (time: 100 ms)
11.80 Stockfish 1.9.1 JA 64bit (time: 100 ms)
11.75 Rybka 4x64 (time: 100 ms)
11.75 Rybka 2.2n2 32-bit (time: 100 ms)
11.75 Naum 4.1 (time: 100 ms)
11.65 Belka 1.8.22 (time: 100 ms)
11.60 Tinapa 1.01 (time: 100 ms)
11.55 Rybka 1.0 Beta 32-bit (time: 100 ms)
11.40 Hannibal 1.0a (time: 100 ms)
11.15 HIARCS 13.2 SP (time: 100 ms)
11.10 Fruit 2.1 (time: 100 ms)
11.05 Shredder 12 UCI (time: 100 ms)
10.90 Deep Sjeng c't 2010 (time: 100 ms)
10.75 Deep Sjeng WC2008 x64 (time: 100 ms)
10.70 Jonny 4.00 (time: 100 ms) :P
perejaslav
Posts: 240
Joined: Sat Mar 18, 2006 4:01 am
Location: Cold

Re: Similarity Detector Available

Post by perejaslav »

michiguel wrote:fitted the evaluation to Rybka 2.2.

Miguel
Can we consider this as an act of crime (engine cloning)?
Otherwise I only see a double standard regarding free and commercial top-class engines!
perejaslav
Posts: 240
Joined: Sat Mar 18, 2006 4:01 am
Location: Cold

Re: Similarity Detector Available

Post by perejaslav »

Don wrote:I think there is an error in your tester of some kind - you are reporting ridiculous results that I am not able to duplicate.
I suspect that spike crashed part way through the test.
Yes maybe you are right. But what do you think about Naum-Rybka2?
User avatar
Don
Posts: 5106
Joined: Tue Apr 29, 2008 4:27 pm

Re: Similarity Detector Available

Post by Don »

Jim Logan wrote:
Don wrote:The similar.exe is designed to run on 64 bit windows and is actually a tcl script wrapped up with a tcl runtime using tclkit technology.
Any chance of getting a 32 bit version? Some of us still lag behind.
Yes, I just updated the zip file to also include a windows 32 bit version.

Of course you can run the kit directly without needing this - as long as you have a tclkitsh runtime in your path.

Don
Uri Blass
Posts: 10903
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: Similarity Detector Available

Post by Uri Blass »

perejaslav wrote:
michiguel wrote:fitted the evaluation to Rybka 2.2.

Miguel
Can we consider this as an act of crime (engine cloning)?
Otherwise I only see a double standard regarding free and commercial top-class engines!
No

I also do not consider the ippolit derivatives to be an act of crime.

Note also that you do not need to look at the code of another program in order to make your evaluation similiar to the evaluation of another program.

Looking at the output and tuning your program to generate a similiar output may be enough.

Uri
User avatar
Don
Posts: 5106
Joined: Tue Apr 29, 2008 4:27 pm

Re: Similarity Detector Available

Post by Don »

perejaslav wrote:
Don wrote:I think there is an error in your tester of some kind - you are reporting ridiculous results that I am not able to duplicate.
I suspect that spike crashed part way through the test.
Yes maybe you are right. But what do you think about Naum-Rybka2?
I would say that Rybka 2 plays a lot of the same moves as Naum.
perejaslav
Posts: 240
Joined: Sat Mar 18, 2006 4:01 am
Location: Cold

Re: Similarity Detector Available

Post by perejaslav »

------ Rybka 4x64 (time: 100 ms) ------
73.45 Rybka 4w32 (time: 100 ms)
66.50 Rybka 3 32-bit (time: 100 ms)
65.05 Naum 4.2 (time: 100 ms)
64.85 IvanHoe 9.48b x64 (time: 100 ms)
64.35 Houdini 1.5 x64 (time: 100 ms)
64.25 DeepSaros.exe ver.2.3e (time: 100 ms)
63.70 Rybka 2.2n2 32-bit (time: 100 ms)
62.85 IPPOLIT 0.080b3 x64 (time: 100 ms)
62.70 Belka 1.8.22 (time: 100 ms)
62.20 Stockfish 1.9.1 JA 64bit (time: 100 ms)
61.85 Naum 4.1 (time: 100 ms)
61.65 Critter 0.90 64-bit (time: 100 ms)
61.25 Rybka 1.0 Beta 32-bit (time: 100 ms)
60.85 Tinapa 1.01 (time: 100 ms)
60.75 Hannibal 1.0a (time: 100 ms)
60.40 Crab 1.0 beta 64bit (time: 100 ms)
59.50 Gull 1.1 x64 (time: 100 ms)
58.15 Shredder 12 UCI (time: 100 ms)
58.15 Fruit 2.1 (time: 100 ms)
58.10 Deep Sjeng c't 2010 (time: 100 ms)
57.15 Deep Sjeng WC2008 x64 (time: 100 ms)
55.85 HIARCS 13.2 SP (time: 100 ms)
54.25 Jonny 4.00 (time: 100 ms)
11.75 spark-1.0 (time: 100 ms)

As you can see even Rybka 4 x64 is 'less clone' of Rybka 4 w32 than Naum 4.2 clone of Rybka 2.2.
Amazing Similarity Detector! 8-)