Similarity Detector Available

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Similarity Detector Available

Post by michiguel »

Laskos wrote:
michiguel wrote:
Hi Kai,

Could you send me to my gmail account (mballicora) the files that Don's utility produces? Those are the ones that look

{engine name 1} move1 move2 move3 etc.
{engine name 2} move1 move2 move3 etc.

I have everything setup in Linux scripts and a C program to process the data, run bootstraps and plot it. I can analyze the whole thing in a minute.

Miguel
PS: Naum's author, as Don says, told Michael Hart in a private email that he fit Naum's evaluation to Rybka 2. At this point, this similarity is unquestionable. It has been observed by 4 different observers (Don, M. Hart, Adam Hair, and you) with different set of positions and conditions.
Hi Miguel, I have sent you the two *.data files from Don's utility. I am still digesting slowly explanation about Naum, my problem is not similarity with Rybka 2. Similarity even with Rybka 1.0beta is very high, and Strelka sources appeared a year or two before Naum 4.2. The second thing would be that if one can adjust his engine to be similar to another, then his engine must be potentially much stronger than that "another" (can be adjusted even further).

Kai
Check your email, I analyzed it and sent it back.

Regarding Naum, I am not making any interpretation, I am just stating what I was told.

Miguel
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Similarity Detector Available

Post by Laskos »

michiguel wrote:
Check your email, I analyzed it and sent it back.

Regarding Naum, I am not making any interpretation, I am just stating what I was told.

Miguel
Thanks Miguel, your nice results are as expected :).

Kai
georgerifkin
Posts: 63
Joined: Fri Jun 17, 2011 4:51 pm

Re: Similarity Detector Available

Post by georgerifkin »

mr dailey how did you test with such short time the mp engines that automatically use all the cores? is there a configuration file? thanks
User avatar
Don
Posts: 5106
Joined: Tue Apr 29, 2008 4:27 pm

Re: Similarity Detector Available

Post by Don »

georgerifkin wrote:mr dailey how did you test with such short time the mp engines that automatically use all the cores? is there a configuration file? thanks
Yes, there is a configuration file.

Here is an example configuration file for stockfish 1.8 that I made up:

----[ snip ]-----
exe = Stockfish_1.3.exe
Threads = 1
Hash = 64
Use Search Log = true
-----[snip]-----


You can set any option that is configurable by a UCI program.
georgerifkin
Posts: 63
Joined: Fri Jun 17, 2011 4:51 pm

Re: Similarity Detector Available

Post by georgerifkin »

Don wrote:
georgerifkin wrote:mr dailey how did you test with such short time the mp engines that automatically use all the cores? is there a configuration file? thanks
Yes, there is a configuration file.

Here is an example configuration file for stockfish 1.8 that I made up:

----[ snip ]-----
exe = Stockfish_1.3.exe
Threads = 1
Hash = 64
Use Search Log = true
-----[snip]-----


You can set any option that is configurable by a UCI program.
thank you
what should be the name of the configuration file?
and how do I use it? should I pass it to sim03 as a command line argument?
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Similarity Detector Available

Post by Adam Hair »

georgerifkin wrote:
Don wrote:
georgerifkin wrote:mr dailey how did you test with such short time the mp engines that automatically use all the cores? is there a configuration file? thanks
Yes, there is a configuration file.

Here is an example configuration file for stockfish 1.8 that I made up:

----[ snip ]-----
exe = Stockfish_1.3.exe
Threads = 1
Hash = 64
Use Search Log = true
-----[snip]-----


You can set any option that is configurable by a UCI program.
thank you
what should be the name of the configuration file?
and how do I use it? should I pass it to sim03 as a command line argument?
Hi George,

In this example, I would call the config file Stockfish_1.8.txt.
I use a batch file to run the similarity utility. Here is an example of the type of command I use:

sim03w64.exe -c Stockfish_1.8.txt 1000

Adam
georgerifkin
Posts: 63
Joined: Fri Jun 17, 2011 4:51 pm

Re: Similarity Detector Available

Post by georgerifkin »

Adam Hair wrote:Hi George,

In this example, I would call the config file Stockfish_1.8.txt.
I use a batch file to run the similarity utility. Here is an example of the type of command I use:

sim03w64.exe -c Stockfish_1.8.txt 1000

Adam
thanks for your help mr hair. I did already figure it out by reading the readme file
georgerifkin
Posts: 63
Joined: Fri Jun 17, 2011 4:51 pm

Re: Similarity Detector Available

Post by georgerifkin »

I'm making some tests
I would like to make a question: why, when I set a time of 5ms, the test takes way more time with some engines, for example with stockfish, than with others
the time set is always 5ms
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Similarity Detector Available

Post by Adam Hair »

georgerifkin wrote:I'm making some tests
I would like to make a question: why, when I set a time of 5ms, the test takes way more time with some engines, for example with stockfish, than with others
the time set is always 5ms
If I remember correctly, Stockfish searches 10 plies deep before sending its best move.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Similarity Detector Available

Post by Laskos »

georgerifkin wrote:I'm making some tests
I would like to make a question: why, when I set a time of 5ms, the test takes way more time with some engines, for example with stockfish, than with others
the time set is always 5ms
I guess 5ms are a little too few. Do you use time adjust for strength? If not, I don't think there is a big difference in convenience using a minimum of 10-20ms.

Kai