Similarity Detector Available

[BubbaTough]

yes, in this case komodo seems absolutley equal to stockfish 1.8....according to CCRL.!?

wait! better to leave it to the user...please test independently (yourself).

OK,

From your comments it sounds like maybe you have not actually run the test at all. If you have, and have gotten high similarity marks, let me know the exact versions and I will run a confirmation. Another great thing about the tool is the ability to do independent verification . I was planning to play with the tool after my current round of testing is over (to test similarity of my own programs just out of curiosity) and I can just throw another couple of programs in if you specify exactly what your claim is. If you haven't actually done the test yourself though, I don't really want to waste my time as the similarity of the two is not a strong enough interest of mine to want to invest the time measuring it. Sadly, my chess testing computer died, so I must meter out the little cpu time I can spare for this hobby carefully.

-Sam

[kranium]

I created a utility called similar which measures how different one chess program is from others. It does this by running 2000 position from random games and noting how often the moves agree and as output returns the percentage of moves that match.

You can get it here: http://komodochess.com/pub/similar.zip

Here is some sample output, comparing Robbolito with a few other programs:

------ RobboLito version 0.084 (time: 100 ms) ------
69.25 Houdini 1.5 w32 (time: 100 ms)
66.90 Rybka 3 (time: 100 ms)
61.70 Stockfish 1.9.1 JA 64bit (time: 100 ms)
61.35 Stockfish 1.8 JA (time: 100 ms)
59.80 Komodo64 1.2 JA (time: 100 ms)
59.15 Komodo 1.0 (time: 100 ms)
58.95 Stockfish 1.7.1 64bit (time: 100 ms)
58.95 Stockfish 1.6 64bit (time: 100 ms)
57.00 Fruit 2.3.1 (time: 100 ms)
56.20 Fruit 2.1 (time: 100 ms)


I have not tested this on windows so I'm hoping to get some feedback specific to windows.

The similar.exe is designed to run on 64 bit windows and is actually a tcl script wrapped up with a tcl runtime using tclkit technology. I am also including the "starkit" which is platform independent, but requires a tclkit runtime for your platform. It is similar to a jar file and can be taken apart and inspected and modified if you wish - assuming you know how to work with starkit's and such. google for starkit and sdx.kit for more information.

Please let me know if you find this interesting or useful. Email me at drd@mit.edu

Don

wow, amazing...
komodo and stockfish are much more similar than I would have guessed.
i was genuinely under the apparently incorrect 'assumption' that they were very different...
weird...
(i.e i thought they would certainly fail any 'clone' test...?)

If I am not mistaken the numbers that Don is showing are relevant to how Roblito compares to Komodo and then Robolito compares to Stockfish. The numbers are not a comparison of Komodo to Stockfish.

Exactly because this is not a 1D plot, it is at least 2D. This like saying Chicago is 900 miles from NY, and Chicago is 1000 miles from Denver, so Denver is very close to NY. No!!

Miguel

yes...a 2d plot!
brilliant...hadn't thought of that.
damn that explains it all!
thanks Miguel, for your response...it's all clear to me now.

[michiguel]

I created a utility called similar which measures how different one chess program is from others. It does this by running 2000 position from random games and noting how often the moves agree and as output returns the percentage of moves that match.

You can get it here: http://komodochess.com/pub/similar.zip

Here is some sample output, comparing Robbolito with a few other programs:

------ RobboLito version 0.084 (time: 100 ms) ------
69.25 Houdini 1.5 w32 (time: 100 ms)
66.90 Rybka 3 (time: 100 ms)
61.70 Stockfish 1.9.1 JA 64bit (time: 100 ms)
61.35 Stockfish 1.8 JA (time: 100 ms)
59.80 Komodo64 1.2 JA (time: 100 ms)
59.15 Komodo 1.0 (time: 100 ms)
58.95 Stockfish 1.7.1 64bit (time: 100 ms)
58.95 Stockfish 1.6 64bit (time: 100 ms)
57.00 Fruit 2.3.1 (time: 100 ms)
56.20 Fruit 2.1 (time: 100 ms)


I have not tested this on windows so I'm hoping to get some feedback specific to windows.

The similar.exe is designed to run on 64 bit windows and is actually a tcl script wrapped up with a tcl runtime using tclkit technology. I am also including the "starkit" which is platform independent, but requires a tclkit runtime for your platform. It is similar to a jar file and can be taken apart and inspected and modified if you wish - assuming you know how to work with starkit's and such. google for starkit and sdx.kit for more information.

Please let me know if you find this interesting or useful. Email me at drd@mit.edu

Don

wow, amazing...
komodo and stockfish are much more similar than I would have guessed.
i was genuinely under the apparently incorrect 'assumption' that they were very different...
weird...
(i.e i thought they would certainly fail any 'clone' test...?)

You do not know how similar K and SF are from the numbers posted. The numbers are similarity to a third party, not between them.

Miguel

[kranium]

I created a utility called similar which measures how different one chess program is from others. It does this by running 2000 position from random games and noting how often the moves agree and as output returns the percentage of moves that match.

You can get it here: http://komodochess.com/pub/similar.zip

Here is some sample output, comparing Robbolito with a few other programs:

------ RobboLito version 0.084 (time: 100 ms) ------
69.25 Houdini 1.5 w32 (time: 100 ms)
66.90 Rybka 3 (time: 100 ms)
61.70 Stockfish 1.9.1 JA 64bit (time: 100 ms)
61.35 Stockfish 1.8 JA (time: 100 ms)
59.80 Komodo64 1.2 JA (time: 100 ms)
59.15 Komodo 1.0 (time: 100 ms)
58.95 Stockfish 1.7.1 64bit (time: 100 ms)
58.95 Stockfish 1.6 64bit (time: 100 ms)
57.00 Fruit 2.3.1 (time: 100 ms)
56.20 Fruit 2.1 (time: 100 ms)


I have not tested this on windows so I'm hoping to get some feedback specific to windows.

The similar.exe is designed to run on 64 bit windows and is actually a tcl script wrapped up with a tcl runtime using tclkit technology. I am also including the "starkit" which is platform independent, but requires a tclkit runtime for your platform. It is similar to a jar file and can be taken apart and inspected and modified if you wish - assuming you know how to work with starkit's and such. google for starkit and sdx.kit for more information.

Please let me know if you find this interesting or useful. Email me at drd@mit.edu

Don

wow, amazing...
komodo and stockfish are much more similar than I would have guessed.
i was genuinely under the apparently incorrect 'assumption' that they were very different...
weird...
(i.e i thought they would certainly fail any 'clone' test...?)

You do not know how similar K and SF are from the numbers posted. The numbers are similarity to a third party, not between them.

Miguel

damn i wish i was brilliant like you
give me some time...i promise to study the GTB code,
with a little luck...who knows?

[BubbaTough]

You do not know how similar K and SF are from the numbers posted. The numbers are similarity to a third party, not between them.

Miguel

I think Don posted similarity between Komodo and others in a different thread. The numbers seemed to indicate Komodo was pretty different from Stockfish to me. I think it is most likely Norm is not understanding something, but if not I will be happy to independently verify any specific claim.

-Sam

[michiguel]

I created a utility called similar which measures how different one chess program is from others. It does this by running 2000 position from random games and noting how often the moves agree and as output returns the percentage of moves that match.

You can get it here: http://komodochess.com/pub/similar.zip

Here is some sample output, comparing Robbolito with a few other programs:

------ RobboLito version 0.084 (time: 100 ms) ------
69.25 Houdini 1.5 w32 (time: 100 ms)
66.90 Rybka 3 (time: 100 ms)
61.70 Stockfish 1.9.1 JA 64bit (time: 100 ms)
61.35 Stockfish 1.8 JA (time: 100 ms)
59.80 Komodo64 1.2 JA (time: 100 ms)
59.15 Komodo 1.0 (time: 100 ms)
58.95 Stockfish 1.7.1 64bit (time: 100 ms)
58.95 Stockfish 1.6 64bit (time: 100 ms)
57.00 Fruit 2.3.1 (time: 100 ms)
56.20 Fruit 2.1 (time: 100 ms)


I have not tested this on windows so I'm hoping to get some feedback specific to windows.

The similar.exe is designed to run on 64 bit windows and is actually a tcl script wrapped up with a tcl runtime using tclkit technology. I am also including the "starkit" which is platform independent, but requires a tclkit runtime for your platform. It is similar to a jar file and can be taken apart and inspected and modified if you wish - assuming you know how to work with starkit's and such. google for starkit and sdx.kit for more information.

Please let me know if you find this interesting or useful. Email me at drd@mit.edu

Don

wow, amazing...
komodo and stockfish are much more similar than I would have guessed.
i was genuinely under the apparently incorrect 'assumption' that they were very different...
weird...
(i.e i thought they would certainly fail any 'clone' test...?)

If I am not mistaken the numbers that Don is showing are relevant to how Roblito compares to Komodo and then Robolito compares to Stockfish. The numbers are not a comparison of Komodo to Stockfish.

Exactly because this is not a 1D plot, it is at least 2D. This like saying Chicago is 900 miles from NY, and Chicago is 1000 miles from Denver, so Denver is very close to NY. No!!

Miguel

yes...a 2d plot!
brilliant...hadn't thought of that.
damn that explains it all!
thanks Miguel, for your response...it's all clear to me now.

1 - AAABBBBBBB
2 - CCCBBBBBBB
3 - AAABBBBCCC

Compare sequence 1, 2, and 3.
1 to 2 is 70% similar.
1 to 3 is 70% similar
is 2 identical to 3? no, they are 40% similar.

Miguel

[kranium]

I created a utility called similar which measures how different one chess program is from others. It does this by running 2000 position from random games and noting how often the moves agree and as output returns the percentage of moves that match.

You can get it here: http://komodochess.com/pub/similar.zip

Here is some sample output, comparing Robbolito with a few other programs:

------ RobboLito version 0.084 (time: 100 ms) ------
69.25 Houdini 1.5 w32 (time: 100 ms)
66.90 Rybka 3 (time: 100 ms)
61.70 Stockfish 1.9.1 JA 64bit (time: 100 ms)
61.35 Stockfish 1.8 JA (time: 100 ms)
59.80 Komodo64 1.2 JA (time: 100 ms)
59.15 Komodo 1.0 (time: 100 ms)
58.95 Stockfish 1.7.1 64bit (time: 100 ms)
58.95 Stockfish 1.6 64bit (time: 100 ms)
57.00 Fruit 2.3.1 (time: 100 ms)
56.20 Fruit 2.1 (time: 100 ms)


I have not tested this on windows so I'm hoping to get some feedback specific to windows.

The similar.exe is designed to run on 64 bit windows and is actually a tcl script wrapped up with a tcl runtime using tclkit technology. I am also including the "starkit" which is platform independent, but requires a tclkit runtime for your platform. It is similar to a jar file and can be taken apart and inspected and modified if you wish - assuming you know how to work with starkit's and such. google for starkit and sdx.kit for more information.

Please let me know if you find this interesting or useful. Email me at drd@mit.edu

Don

wow, amazing...
komodo and stockfish are much more similar than I would have guessed.
i was genuinely under the apparently incorrect 'assumption' that they were very different...
weird...
(i.e i thought they would certainly fail any 'clone' test...?)

If I am not mistaken the numbers that Don is showing are relevant to how Roblito compares to Komodo and then Robolito compares to Stockfish. The numbers are not a comparison of Komodo to Stockfish.

Exactly because this is not a 1D plot, it is at least 2D. This like saying Chicago is 900 miles from NY, and Chicago is 1000 miles from Denver, so Denver is very close to NY. No!!

Miguel

yes...a 2d plot!
brilliant...hadn't thought of that.
damn that explains it all!
thanks Miguel, for your response...it's all clear to me now.

1 - AAABBBBBBB
2 - CCCBBBBBBB
3 - AAABBBBCCC

Compare sequence 1, 2, and 3.
1 to 2 is 70% similar.
1 to 3 is 70% similar
is 2 identical to 3? no, they are 40% similar.

Miguel

i get it...

stockfish/komodo/gaviotta extremely dissimilar to robbolito
r3/houdini....very similar.

yes i understand now...( )
brilliant work by you and Don...thanks?

sequence 1 = sequence 2 != sequence 3 <= anyone gives a crap...

[Don]

I created a utility called similar which measures how different one chess program is from others. It does this by running 2000 position from random games and noting how often the moves agree and as output returns the percentage of moves that match.

You can get it here: http://komodochess.com/pub/similar.zip

Here is some sample output, comparing Robbolito with a few other programs:

------ RobboLito version 0.084 (time: 100 ms) ------
69.25 Houdini 1.5 w32 (time: 100 ms)
66.90 Rybka 3 (time: 100 ms)
61.70 Stockfish 1.9.1 JA 64bit (time: 100 ms)
61.35 Stockfish 1.8 JA (time: 100 ms)
59.80 Komodo64 1.2 JA (time: 100 ms)
59.15 Komodo 1.0 (time: 100 ms)
58.95 Stockfish 1.7.1 64bit (time: 100 ms)
58.95 Stockfish 1.6 64bit (time: 100 ms)
57.00 Fruit 2.3.1 (time: 100 ms)
56.20 Fruit 2.1 (time: 100 ms)


I have not tested this on windows so I'm hoping to get some feedback specific to windows.

The similar.exe is designed to run on 64 bit windows and is actually a tcl script wrapped up with a tcl runtime using tclkit technology. I am also including the "starkit" which is platform independent, but requires a tclkit runtime for your platform. It is similar to a jar file and can be taken apart and inspected and modified if you wish - assuming you know how to work with starkit's and such. google for starkit and sdx.kit for more information.

Please let me know if you find this interesting or useful. Email me at drd@mit.edu

Don

wow, amazing...
komodo and stockfish are much more similar than I would have guessed.
i was genuinely under the apparently incorrect 'assumption' that they were very different...
weird...
(i.e i thought they would certainly fail any 'clone' test...?)

You misunderstand how the test works. Only the top comparison is relevant, what you are seeing is that komodo and stockfish play equally different from robbolito, that does not mean they play like each other.

[kranium]

I created a utility called similar which measures how different one chess program is from others. It does this by running 2000 position from random games and noting how often the moves agree and as output returns the percentage of moves that match.

You can get it here: http://komodochess.com/pub/similar.zip

Here is some sample output, comparing Robbolito with a few other programs:

------ RobboLito version 0.084 (time: 100 ms) ------
69.25 Houdini 1.5 w32 (time: 100 ms)
66.90 Rybka 3 (time: 100 ms)
61.70 Stockfish 1.9.1 JA 64bit (time: 100 ms)
61.35 Stockfish 1.8 JA (time: 100 ms)
59.80 Komodo64 1.2 JA (time: 100 ms)
59.15 Komodo 1.0 (time: 100 ms)
58.95 Stockfish 1.7.1 64bit (time: 100 ms)
58.95 Stockfish 1.6 64bit (time: 100 ms)
57.00 Fruit 2.3.1 (time: 100 ms)
56.20 Fruit 2.1 (time: 100 ms)


I have not tested this on windows so I'm hoping to get some feedback specific to windows.

The similar.exe is designed to run on 64 bit windows and is actually a tcl script wrapped up with a tcl runtime using tclkit technology. I am also including the "starkit" which is platform independent, but requires a tclkit runtime for your platform. It is similar to a jar file and can be taken apart and inspected and modified if you wish - assuming you know how to work with starkit's and such. google for starkit and sdx.kit for more information.

Please let me know if you find this interesting or useful. Email me at drd@mit.edu

Don

wow, amazing...
komodo and stockfish are much more similar than I would have guessed.
i was genuinely under the apparently incorrect 'assumption' that they were very different...
weird...
(i.e i thought they would certainly fail any 'clone' test...?)

You misunderstand how the test works. Only the top comparison is relevant, what you are seeing is that komodo and stockfish play equally different from robbolito, that does not mean they play like each other.

yes,
of course i misunderstand how your 'clone test' works...i'm a 'simple' cloner.

but i'm very happy you and all the other 'good old boys" understand it...
i'm confident that Graham B., Gabor S., Chris C., and Peter S., Tom G., Miguel B., Paul W., etc. etc.
(sorry i can't mention everyone here: the list is significant...)
will respond soon and clarify it all for us ignorants!...

[michiguel]

I created a utility called similar which measures how different one chess program is from others. It does this by running 2000 position from random games and noting how often the moves agree and as output returns the percentage of moves that match.

You can get it here: http://komodochess.com/pub/similar.zip

Here is some sample output, comparing Robbolito with a few other programs:

------ RobboLito version 0.084 (time: 100 ms) ------
69.25 Houdini 1.5 w32 (time: 100 ms)
66.90 Rybka 3 (time: 100 ms)
61.70 Stockfish 1.9.1 JA 64bit (time: 100 ms)
61.35 Stockfish 1.8 JA (time: 100 ms)
59.80 Komodo64 1.2 JA (time: 100 ms)
59.15 Komodo 1.0 (time: 100 ms)
58.95 Stockfish 1.7.1 64bit (time: 100 ms)
58.95 Stockfish 1.6 64bit (time: 100 ms)
57.00 Fruit 2.3.1 (time: 100 ms)
56.20 Fruit 2.1 (time: 100 ms)


I have not tested this on windows so I'm hoping to get some feedback specific to windows.

The similar.exe is designed to run on 64 bit windows and is actually a tcl script wrapped up with a tcl runtime using tclkit technology. I am also including the "starkit" which is platform independent, but requires a tclkit runtime for your platform. It is similar to a jar file and can be taken apart and inspected and modified if you wish - assuming you know how to work with starkit's and such. google for starkit and sdx.kit for more information.

Please let me know if you find this interesting or useful. Email me at drd@mit.edu

Don

wow, amazing...
komodo and stockfish are much more similar than I would have guessed.
i was genuinely under the apparently incorrect 'assumption' that they were very different...
weird...
(i.e i thought they would certainly fail any 'clone' test...?)

If I am not mistaken the numbers that Don is showing are relevant to how Roblito compares to Komodo and then Robolito compares to Stockfish. The numbers are not a comparison of Komodo to Stockfish.

Exactly because this is not a 1D plot, it is at least 2D. This like saying Chicago is 900 miles from NY, and Chicago is 1000 miles from Denver, so Denver is very close to NY. No!!

Miguel

yes...a 2d plot!
brilliant...hadn't thought of that.
damn that explains it all!
thanks Miguel, for your response...it's all clear to me now.

1 - AAABBBBBBB
2 - CCCBBBBBBB
3 - AAABBBBCCC

Compare sequence 1, 2, and 3.
1 to 2 is 70% similar.
1 to 3 is 70% similar
is 2 identical to 3? no, they are 40% similar.

Miguel

i get it...

stockfish/komodo/gaviotta extremely dissimilar to robbolito
r3/houdini....very similar.

yes i understand now...( )
brilliant work by you and Don...thanks?

sequence 1 = sequence 2 != sequence 3 <= anyone gives a crap...

Despite your obvious attempt to sarcasm [1] I tried to clarified a simple concept just in case. God knows I gave this subforum a try, but it is worthless. There is absolutely no interest in discussing anything and this is going to derive in yet another mud slinging contest. I'm out.

Miguel
[1] True sarcasm has a point behind it.