Made an update, changes:
1. New MEA that fixes a speed issue when running under Win10. MEA was extremely slow, is OK now and even runs faster on Win 7 systems.
2. Cosmetic changes to the HTML output that makes it better readable. It will no longer mark versions of the same engine as orange (similarity 60-64%) or red (65% or higher) by checking the first 2 characters of engines.
Example: http://rebel13.nl/html/ccrl.html
41 high rated CCRL engines and no single 60% found!
One sane list.
My congratulations to the current chess programmers of these engines, especially the new kids on the block while so many strong open source engines are available on Github.
Download SIMEX 2.1 - http://rebel13.nl/dl/simex2.7z
Documentation - http://rebel13.nl/misc/simex.html
SIMEX 2.1
Moderators: hgm, Rebel, chrisw
-
- Posts: 4556
- Joined: Tue Jul 03, 2007 4:30 am
Re: SIMEX 2.1
I see similarities that go beyond that on the Stockfish versions, yet they're not colored yellow as the bottom of the page seem to claim they should be?
Your beliefs create your reality, so be careful what you wish for.
-
- Posts: 4622
- Joined: Wed Oct 01, 2008 6:33 am
- Location: Regensburg, Germany
- Full name: Guenther Simon
Re: SIMEX 2.1
Something seems wrong with the results of Pedone 1.8. I guess it did not obey the search time/depth?Rebel wrote: ↑Sun Sep 01, 2019 5:44 pm Made an update, changes:
1. New MEA that fixes a speed issue when running under Win10. MEA was extremely slow, is OK now and even runs faster on Win 7 systems.
2. Cosmetic changes to the HTML output that makes it better readable. It will no longer mark versions of the same engine as orange (similarity 60-64%) or red (65% or higher) by checking the first 2 characters of engines.
Example: http://rebel13.nl/html/ccrl.html
...
Senpai 1 vs. 2 looks strange too and a few other results also seem systematically too low?
https://rwbc-chess.de
trollwatch:
Talkchess nowadays is a joke - it is full of trolls/idiots/people stuck in the pleistocene > 80% of the posts fall into this category...
trollwatch:
Talkchess nowadays is a joke - it is full of trolls/idiots/people stuck in the pleistocene > 80% of the posts fall into this category...
-
- Posts: 7025
- Joined: Thu Aug 18, 2011 12:04 pm
- Full name: Ed Schröder
Re: SIMEX 2.1
I double checked both Pedone and Senpai, the (odd looking) numbers are correct. There are 2 ways to check, the log-file of each or even more simple the created epd in the EPD_OUT folder. EPD's should have "acd 1". If not the engine in question ignores the depth=1 setting. For instance Laser and Booot, they shouldn't be in the overview, I noticed too late.Guenther wrote: ↑Mon Sep 02, 2019 11:56 amSomething seems wrong with the results of Pedone 1.8. I guess it did not obey the search time/depth?Rebel wrote: ↑Sun Sep 01, 2019 5:44 pm Made an update, changes:
1. New MEA that fixes a speed issue when running under Win10. MEA was extremely slow, is OK now and even runs faster on Win 7 systems.
2. Cosmetic changes to the HTML output that makes it better readable. It will no longer mark versions of the same engine as orange (similarity 60-64%) or red (65% or higher) by checking the first 2 characters of engines.
Example: http://rebel13.nl/html/ccrl.html
...
Senpai 1 vs. 2 looks strange too
90% of coding is debugging, the other 10% is writing bugs.
-
- Posts: 7025
- Joined: Thu Aug 18, 2011 12:04 pm
- Full name: Ed Schröder
Re: SIMEX 2.1
There are some irregularities, I will post them later.
90% of coding is debugging, the other 10% is writing bugs.
-
- Posts: 363
- Joined: Thu Jan 22, 2015 3:21 pm
- Location: Zurich, Switzerland
- Full name: Jonathan Rosenthal
Re: SIMEX 2.1
Does Winter already support such a tool? What do I need to add to an engine in order to support a tool like SIMEX?
I'm kind of curious what engines Winter (especially Winter dev) is related to
EDIT: I'm trying things out in WINE now. I get the following error at the moment:
Can't recognize 'sort DATASIMEX.DATA /rec 65000 /o DATASIMEX.DATA' as an internal or external command, or batch script.
I'm kind of curious what engines Winter (especially Winter dev) is related to
EDIT: I'm trying things out in WINE now. I get the following error at the moment:
Can't recognize 'sort DATASIMEX.DATA /rec 65000 /o DATASIMEX.DATA' as an internal or external command, or batch script.
-Jonathan
-
- Posts: 4346
- Joined: Tue Apr 03, 2012 4:28 pm
Re: SIMEX 2.1
what is the origin of the testing suite? who composed it, or did it just grow, and when was it composed? Do we know how it was composed?Rebel wrote: ↑Sun Sep 01, 2019 5:44 pm Made an update, changes:
1. New MEA that fixes a speed issue when running under Win10. MEA was extremely slow, is OK now and even runs faster on Win 7 systems.
2. Cosmetic changes to the HTML output that makes it better readable. It will no longer mark versions of the same engine as orange (similarity 60-64%) or red (65% or higher) by checking the first 2 characters of engines.
Example: http://rebel13.nl/html/ccrl.html
41 high rated CCRL engines and no single 60% found!
One sane list.
My congratulations to the current chess programmers of these engines, especially the new kids on the block while so many strong open source engines are available on Github.
Download SIMEX 2.1 - http://rebel13.nl/dl/simex2.7z
Documentation - http://rebel13.nl/misc/simex.html
-
- Posts: 7025
- Joined: Thu Aug 18, 2011 12:04 pm
- Full name: Ed Schröder
Re: SIMEX 2.1
I tried Winter, did not work. I also suspect MicroSoft sort.exe won't work under WINE, but I am no expert.jorose wrote: ↑Mon Sep 02, 2019 5:07 pm Does Winter already support such a tool? What do I need to add to an engine in order to support a tool like SIMEX?
I'm kind of curious what engines Winter (especially Winter dev) is related to
EDIT: I'm trying things out in WINE now. I get the following error at the moment:
Can't recognize 'sort DATASIMEX.DATA /rec 65000 /o DATASIMEX.DATA' as an internal or external command, or batch script.
90% of coding is debugging, the other 10% is writing bugs.
-
- Posts: 7025
- Joined: Thu Aug 18, 2011 12:04 pm
- Full name: Ed Schröder
Re: SIMEX 2.1
Don isn't longer among us, but maybe Larry can tell.
My best guess is that the 8238 positions were derived from comp-comp games. If you scroll through the simex epd's in the epd_out folder scores reasonable well fit a -1.00/+1.00 window. Also I tried a dozen position searches with 2.9 million games, no matches except known openings.
90% of coding is debugging, the other 10% is writing bugs.
-
- Posts: 4346
- Joined: Tue Apr 03, 2012 4:28 pm
Re: SIMEX 2.1
There's quite a skew in the test positions, many have all the pieces on the board. Take a look, histograms of piece count, and piece weight for the epd set.Rebel wrote: ↑Mon Sep 02, 2019 7:41 pmDon isn't longer among us, but maybe Larry can tell.
My best guess is that the 8238 positions were derived from comp-comp games. If you scroll through the simex epd's in the epd_out folder scores reasonable well fit a -1.00/+1.00 window. Also I tried a dozen position searches with 2.9 million games, no matches except known openings.
was it Don who chose them? Why early game positions?
Edit: I should learn to label things correct! 8328 it should say.