Similarity tester - 2nd generation - BETA

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
Rebel
Posts: 4518
Joined: Thu Aug 18, 2011 10:04 am

Re: Similarity tester - 2nd generation - BETA

Post by Rebel » Mon Aug 12, 2019 11:48 pm

Added a last feature, add comments to the HTML. For instance these long names for NN engines, store your comments in legend.txt.

http://rebel13.nl/html/nn-500ms.html

Final release tomorrow.
Everybody is unique, except me.

User avatar
Rebel
Posts: 4518
Joined: Thu Aug 18, 2011 10:04 am

Re: Similarity tester - 2nd generation - BETA

Post by Rebel » Tue Aug 13, 2019 6:27 am

Everybody is unique, except me.

User avatar
Rebel
Posts: 4518
Joined: Thu Aug 18, 2011 10:04 am

Re: Similarity tester - 2nd generation - BETA

Post by Rebel » Thu Aug 15, 2019 8:50 am

Did another experiment, run engines at depth=1 only, canceling (the main) search, thus testing mainly the evaluation function for similarity. It isn't perfect since engines may vary how they handle checks in QS, I have also seen engines extend root moves. But in general it will just work.

Example:1 - http://rebel13.nl/html/depth1.html

And now a blast from the past - http://rebel13.nl/html/fruit.html

The original Rybka 1.0 looks okay, but it is known it obfuscates the depth with 2 plies so it actually has used depth=3. The patched version has this fixed and then the similarity with Fruit 2.1 is sky-high.
Attachments
blastfromthepast.png
blastfromthepast.png (185.17 KiB) Viewed 267 times
Everybody is unique, except me.

User avatar
Rebel
Posts: 4518
Joined: Thu Aug 18, 2011 10:04 am

Re: Similarity tester - 2nd generation - BETA

Post by Rebel » Fri Aug 23, 2019 10:34 am

Chris Whittington created SIMEX EPD sets of each 10,000 positions. Each set contains a specific piece distribution. In total 100 sets representing the most common board positions in use.

Distribution list - http://rebel13.nl/html/epd.txt

Example with SIMEX - http://rebel13.nl/html/cw2.html

Download of the 100 EPD sets - http://rebel13.nl/dl.html?file=dl/simex-epd.7z

Extract the download in the EPD folder.
Everybody is unique, except me.

chrisw
Posts: 1742
Joined: Tue Apr 03, 2012 2:28 pm

Re: Similarity tester - 2nd generation - BETA

Post by chrisw » Fri Aug 23, 2019 2:06 pm

Rebel wrote:
Fri Aug 23, 2019 10:34 am
Chris Whittington created SIMEX EPD sets of each 10,000 positions. Each set contains a specific piece distribution. In total 100 sets representing the most common board positions in use.

Distribution list - http://rebel13.nl/html/epd.txt

Example with SIMEX - http://rebel13.nl/html/cw2.html

Download of the 100 EPD sets - http://rebel13.nl/dl.html?file=dl/simex-epd.7z

Extract the download in the EPD folder.
I might refine these if there’s any demand. At the moment, it selects all possible piece conformations by just the existence of KQRBNPkqrbnp, either pieces of that type for each side exist or they don’t.
Might be better to refine also by pawn count so the files would be named on basis
KQRBNP(x)kqrbnp(y) where x and y represent, say, 0 pawns, or 1-3 pawns, or 4-6 pawns, or 7-8 pawns. Four pawn categories. Adds another factor of 16 to the possible combinations.

Then I rank the combinations by frequency and save out the 100 (can be more) combinations most often occurring in games.

Post Reply