STS 1-15 epd and analysis tool

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Carlos Ylich
Posts: 175
Joined: Wed Apr 28, 2010 9:31 pm
Location: Brazil

Re: STS 1-15 epd and analysis tool

Post by Carlos Ylich »

Ok.
Thank you.
I'll test again and then speak as it was. :D
Remember Sabra and Chatila
Carlos Ylich
Posts: 175
Joined: Wed Apr 28, 2010 9:31 pm
Location: Brazil

Re: STS 1-15 epd and analysis tool

Post by Carlos Ylich »

Hello,
Is there any other program to test along with Arena 3.5? :roll:
Remember Sabra and Chatila
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: STS 1-15 epd and analysis tool

Post by Ferdy »

Carlos Ylich wrote:Ok.
Thank you.
I'll test again and then speak as it was. :D
Looks like we go that way, debugging is time consuming :( . You spent your time, and me too, and this thread is not even about arena :roll:.
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: STS 1-15 epd and analysis tool

Post by Ferdy »

I am working on STS rating, basing to the CCRL 40/4 rating list, using formula from linear regression of engine CCRL rating and its score percentage from STS test sets.
The time/pos is 200ms (on my machine) and will be automatically adjusted by the program depending on the speed of the machine where it is run.
Engine weakness are now easier to determine, by showing separate solutions per themes.

Sample output.

Code: Select all

Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
id name Stockfish 6 64 POPCNT
Hash: 128, Threads: 1, time/pos: 0.200s
Test duration: 00:05:18
Expected time to finish: 00:05:45
STS rating: 3389

  STS ID   STS1   STS2   STS3   STS4   STS5   STS6   STS7   STS8   STS9  STS10  STS11  STS12  STS13  STS14  STS15    ALL
  NumPos    100    100    100    100    100    100    100    100    100    100    100    100    100    100    100   1500
 BestCnt     84     75     73     70     76     75     69     68     70     80     73     72     78     75     48   1086
   Score    874    830    818    807    814    887    787    794    781    860    795    786    842    849    713  12237
Score(%)   87.4   83.0   81.8   80.7   81.4   88.7   78.7   79.4   78.1   86.0   79.5   78.6   84.2   84.9   71.3   81.6
  Rating   3648   3453   3399   3350   3381   3706   3261   3292   3234   3586   3297   3257   3506   3537   2932   3389

Code: Select all

Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
id name CDrill 1905
Hash: 128, Threads: 1, time/pos: 0.200s
Test duration: 00:05:54
Expected time to finish: 00:05:45
STS rating: 1983

  STS ID   STS1   STS2   STS3   STS4   STS5   STS6   STS7   STS8   STS9  STS10  STS11  STS12  STS13  STS14  STS15    ALL
  NumPos    100    100    100    100    100    100    100    100    100    100    100    100    100    100    100   1500
 BestCnt     38     29     46     32     48     46     37     28     29     56     27     33     44     45     14    552
   Score    488    433    578    443    592    700    489    406    405    647    402    470    536    580    329   7498
Score(%)   48.8   43.3   57.8   44.3   59.2   70.0   48.9   40.6   40.5   64.7   40.2   47.0   53.6   58.0   32.9   50.0
  Rating   1930   1685   2331   1730   2393   2874   1934   1565   1560   2638   1547   1850   2144   2339   1222   1983