STS Stat.exe

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

swami
Posts: 6647
Joined: Thu Mar 09, 2006 4:21 am

Re: STS Stat.exe

Post by swami »

JVMerlino wrote:
swami wrote:http://sites.google.com/site/strategict ... e/sts-stat

This is the software designed by GAILHAC Philippe of France. He's the author of chess engine called Philou. It calculated the partial credit scores /1000 based on Arena log file.

This is early version. Next version will be numbered as bugs are fixed and features added.

You can feel free to add your wish list. Especially the kind of feature you want to see in the software.
I wonder if it works with GradualTest. I'll give it a try. If not, then I guess I'll have to switch to Arena. This will save a lot of time, because I've been calculating the partial scores manually. :(

jm
I haven't tried GradualTest. But if you get the log file generated out of Gradtest, perhaps you can modify it to match the rules as stated above and run it in STS Stat.exe. Should work...

Arena is also a lot easier. This STSStat.exe tool is very unique, super fast.
User avatar
David Dahlem
Posts: 900
Joined: Wed Mar 08, 2006 9:06 pm

Re: STS Stat.exe

Post by David Dahlem »

swami wrote:
David Dahlem wrote:Thanks Philippe

Maybe i'm doing something wrong, but it's not working for me. When i try to open a .log file, i get a message "file not valid".

Also the French language is default, when i change it to English, the next time it's started with the French language. Perhaps there is a way to save the selected language as default in a future version?

Regards
Dave
Hi Dave,

Have you checked the log file to make sure that the below rule is satisfied?

Code: Select all

2. The test suites should ALWAYS end with a number before the "."epd. (for example, STS1.epd, STS2.epd...)
If not, try to edit the log file and make it in readable format ("STS 1.0 Undermining.epd" in log file should be edited to "STS1.epd")
Well, i was doing a quick test, so i made a small test.epd file with just a few positions to save time for this test. And i got this in the log file -

Analysis from C:\Arena\Epd\STS test.epd

So you are saying that i have to use your STS suites without editing the name? Hopefully i will be able to run all nine suites (900 positions) combined, instead of running 9 seperate tests for each engine.

I'll try some more testing. :oops:
Philou
Posts: 32
Joined: Fri Dec 04, 2009 1:58 pm
Location: France

Re: STS Stat.exe

Post by Philou »

swami wrote:About my wish list: I hope it will be fulfilled later :)

* To calculate total score out of 9000 for alternative moves. (Automatically add scores /1000 of STS1+STS2+STS3+....STS9)

* To Calculate total score out of 900 for main moves (Automatically add scores /100 of STS 1+STS2+STS3+....STS9)

*To Calculate Average percentage for main moves (Score/900 * 100)

* To Calculate the Average Percentage for Alternative moves (Score /9000 * 100)

* To integrate grading system in software. Grades should appear next to the score /100 and score /1000.

Code: Select all

85+ S
80+ A+
75+ A
70+ A- 
65+ B+
60+ B
55+ C+
50+ C
45+ D
40+ E
<40 ?
It's OK, but let me time to do this :D
I also want to make progress with philou :?: and work :?
User avatar
David Dahlem
Posts: 900
Joined: Wed Mar 08, 2006 9:06 pm

Re: STS Stat.exe

Post by David Dahlem »

Well, i still haven't gotten it to work yet! I renamed STS 9.0 Advancement of a-b-c Pawns.epd to STS9.epd. Then i ran the test in Arena with this resulting log file -

Rybka3-STS9.log

And this text at the top of the log file -

Analysis from C:\Arena\Epd\STS9.epd

When i try to open "Rybka3-STS9.log" with STSStat.exe, i get a "file not valid" message (in French language).

What am i doing wrong?

PS: When selecting the File/Open menu, the "files of type:" dialog window is empty.

Regards
Dave
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: STS Stat.exe

Post by bob »

swami wrote:http://sites.google.com/site/strategict ... e/sts-stat

This is the software designed by GAILHAC Philippe of France. He's the author of chess engine called Philou. It calculated the partial credit scores /1000 based on Arena log file.

This is early version. Next version will be numbered as bugs are fixed and features added.

You can feel free to add your wish list. Especially the kind of feature you want to see in the software.
One feature is source code for linux users. :)
swami
Posts: 6647
Joined: Thu Mar 09, 2006 4:21 am

Re: STS Stat.exe

Post by swami »

David Dahlem wrote:Well, i still haven't gotten it to work yet! I renamed STS 9.0 Advancement of a-b-c Pawns.epd to STS9.epd. Then i ran the test in Arena with this resulting log file -

Rybka3-STS9.log

And this text at the top of the log file -

Analysis from C:\Arena\Epd\STS9.epd

When i try to open "Rybka3-STS9.log" with STSStat.exe, i get a "file not valid" message (in French language).

What am i doing wrong?

PS: When selecting the File/Open menu, the "files of type:" dialog window is empty.

Regards
Dave
Go to the Arena folder and see if you can find Analyses.log and Analyses.rep. Click the Analyses.log and see if there's any output from the test, edit text if necessary, then run the test with STSStats.exe.

If you could, please send me the log file to nswami15 at yahoo dot com. Perhaps I may have a look at it and find out what's wrong with it.
swami
Posts: 6647
Joined: Thu Mar 09, 2006 4:21 am

Re: STS Stat.exe

Post by swami »

Philou 3.0
GAILHAC Philippe, France.

Strategic Test Suite Conditions:
Core2Quad 32 bits, Q6600, 2 GB RAM, 2.4GHZ
10 seconds per position
900 positions
Engine uses 130 Mb Hash.
Arena GUI
Subject-wise Scores:
STS (v1.0) - Undermining:

71 / 100, Grade: A-
761 / 1000, Grade: A

STS (v2.1) - Open Files and Diagonals:

61 / 100, Grade: B
651 / 1000, Grade: B+

STS (v3.0) - Knight Outposts/Centralization/Repositioning:

56 / 100, Grade: C+
668 / 1000, Grade: B+

STS (v4.1) - Square Vacancy:

61 / 100, Grade: B
709 / 1000, Grade: A-

STS (v5.0) - Bishop vs Knight:

67 / 100, Grade: B
740 / 1000, Grade: A-

STS (v6.0) - Re-Capturing:

67 / 100, Grade: A-
822 / 1000, Grade: A+

STS (v7.0) - Offer of Simplification:

65 / 100, Grade: B+
728 / 1000, Grade: A-

STS (v8.1) - Advancement of f/g/h Pawns:

45 / 100, Grade: D
592 / 1000, Grade: C+

STS (v9.0) - Advancement of a/b/c Pawns:

44 / 100, Grade: D
562/1000, Grade: C+
Overall Performance:
Total Score: 537/900

Grand Total: 6237/9000

Average: 69.3 %

Grade: B+
Regards,
Swami
User avatar
David Dahlem
Posts: 900
Joined: Wed Mar 08, 2006 9:06 pm

Re: STS Stat.exe

Post by David Dahlem »

I am not generating a .rep file. Is this needed, in addition to a .log file?

I am generating my analysis.log file with the "Write in report file" dialog. Should it be generated with the "Write in protocol file" dialog? I'll try this while waiting for your answer. :D

I have set the path to my log file to the same folder as the STSStat.exe file, this should be ok, right? This bypassses the need to browse for it.
swami
Posts: 6647
Joined: Thu Mar 09, 2006 4:21 am

Re: STS Stat.exe

Post by swami »

David Dahlem wrote:I am not generating a .rep file. Is this needed, in addition to a .log file?
I don't think this is needed. I was asking whether there's analyses.log in Arena folder, and when you open that, whether there's output generated from the test. Also, do check if it's something like STS1.epd, STS2.epd... and nothing else in the analyses log file. If not, edit the text and save it.
I am generating my analysis.log file with the "Write in report file" dialog. Should it be generated with the "Write in protocol file" dialog? I'll try this while waiting for your answer. :D
Report is generally not needed. Main thing I guess would be the analyses.log file. There's this option that overwrites the analyses after each position, so you have to configure in such a way as to append the analyses.
I have set the path to my log file to the same folder as the STSStat.exe file, this should be ok, right? This bypassses the need to browse for it.
This is also not required. I selected the log file from H:\Arena 2\analyses.log while the the tool is located at H:\STSStats\
swami
Posts: 6647
Joined: Thu Mar 09, 2006 4:21 am

Re: STS Stat.exe

Post by swami »

STS Stats Output for the recent Philou 3.0 Test done in Arena 2:

------------------------------------------------------------------

Code: Select all

File &#58;  H&#58;\Arena 2\Analyses.log

epd File &#58;  STS1.epd   

Studied module &#58;  Philou 3.0

Level&#58;  10 seconds by position
Matching moves &#58; 71 / 100
Total time &#58; 12&#58;17&#58;59
Rated time &#58; 351 Seconds

Score &#58;  761 / 1000

--------------------------------------------------------
File &#58;  H&#58;\Arena 2\Analyses.log

epd File &#58;  STS2.epd   

Studied module &#58;  Philou 3.0

Level&#58;  10 seconds by position
Matching moves &#58; 61 / 100
Total time &#58; 12&#58;17&#58;59
Rated time &#58; 467 Seconds

Score &#58;  651 / 1000

--------------------------------------------------------
File &#58;  H&#58;\Arena 2\Analyses.log

epd File &#58;  STS3.epd   

Studied module &#58;  Philou 3.0

Level&#58;  10 seconds by position
Matching moves &#58; 56 / 100
Total time &#58; 12&#58;17&#58;59
Rated time &#58; 494 Seconds

Score &#58;  668 / 1000

--------------------------------------------------------
File &#58;  H&#58;\Arena 2\Analyses.log

epd File &#58;  STS 4.EPD   

Studied module &#58;  Philou 3.0

Level&#58;  10 seconds by position
Matching moves &#58; 61 / 100
Total time &#58; 12&#58;18&#58;00
Rated time &#58; 440 Seconds

Score &#58;  709 / 1000

--------------------------------------------------------
File &#58;  H&#58;\Arena 2\Analyses.log

epd File &#58;  STS5.epd   

Studied module &#58;  Philou 3.0

Level&#58;  10 seconds by position
Matching moves &#58; 67 / 100
Total time &#58; 12&#58;17&#58;58
Rated time &#58; 372 Seconds

Score &#58;  740 / 1000

--------------------------------------------------------
File &#58;  H&#58;\Arena 2\Analyses.log

epd File &#58;  STS6.epd   

Studied module &#58;  Philou 3.0

Level&#58;  10 seconds by position
Matching moves &#58; 67 / 100
Total time &#58; 12&#58;17&#58;58
Rated time &#58; 385 Seconds

Score &#58;  822 / 1000

--------------------------------------------------------
File &#58;  H&#58;\Arena 2\Analyses.log

epd File &#58;  STS7.epd   

Studied module &#58;  Philou 3.0

Level&#58;  10 seconds by position
Matching moves &#58; 65 / 100
Total time &#58; 12&#58;17&#58;58
Rated time &#58; 396 Seconds

Score &#58;  728 / 1000

--------------------------------------------------------
File &#58;  H&#58;\Arena 2\Analyses.log

epd File &#58;  STS8.epd   

Studied module &#58;  Philou 3.0

Level&#58;  10 seconds by position
Matching moves &#58; 45 / 100
Total time &#58; 12&#58;17&#58;57
Rated time &#58; 603 Seconds

Score &#58;  592 / 1000

--------------------------------------------------------
File &#58;  H&#58;\Arena 2\Analyses.log

epd File &#58;  STS9.epd   

Studied module &#58;  Philou 3.0

Level&#58;  10 seconds by position
Matching moves &#58; 44 / 100
Total time &#58; 12&#58;17&#58;57
Rated time &#58; 652 Seconds

Score &#58;  562 / 1000

--------------------------------------------------------