Odd Arena bug found while testing sts

[Matthias Gemuh]

It takes 8 minutes to write that program. If nobody else does, I may.

It takes only seconds with an editor that has regular expression search and replace. Replace c0.*; with nothing in all the files and you are done.
look here http://www.mediafire.com/file/zzot2ntmnfi/sts.ZIP

Hat off

[jwes]

I don't have any problems with regular test suites in Arena. Is there an easy way to convert the STS suites to regular suites, with only a best move, and not the scored moves?

Good idea!

Arena erroneously includes new move into "searching move" as it doesn't understand partial credit moves.

However, Arena works perfectly when there is only best move in the Epds. (without any secondary moves in Id tag)

I hope someone can come up with best moves only epds of these 900 positions. I could offer this as separate download. I've asked Dann if he could do it with the tools he has.

It takes 8 minutes to write that program. If nobody else does, I may.

It takes only seconds with an editor that has regular expression search and replace. Replace c0.*; with nothing in all the files and you are done.
look here http://www.mediafire.com/file/zzot2ntmnfi/sts.ZIP

Thanks!

I will offer this up as separate download with credit to you.

I hope the Arena bug of introducing new move wouldn't be seen when testing these.

I tried it on sts 2.0 with arena and it did not occur.

[swami]

I don't have any problems with regular test suites in Arena. Is there an easy way to convert the STS suites to regular suites, with only a best move, and not the scored moves?

Good idea!

Arena erroneously includes new move into "searching move" as it doesn't understand partial credit moves.

However, Arena works perfectly when there is only best move in the Epds. (without any secondary moves in Id tag)

I hope someone can come up with best moves only epds of these 900 positions. I could offer this as separate download. I've asked Dann if he could do it with the tools he has.

It takes 8 minutes to write that program. If nobody else does, I may.

It takes only seconds with an editor that has regular expression search and replace. Replace c0.*; with nothing in all the files and you are done.
look here http://www.mediafire.com/file/zzot2ntmnfi/sts.ZIP

Thanks!

I will offer this up as separate download with credit to you.

I hope the Arena bug of introducing new move wouldn't be seen when testing these.

I tried it on sts 2.0 with arena and it did not occur.

I didn't get this bug either.

I tried opening the log file via STS Stat 2.exe and this is what I get:

Code: Select all

File :  H:\Arena Beta 5\Analyses.log

epd File :  STS1.epd   

Studied module :  Bsc 3.7f

Level:  10 seconds by position
Matching moves : 56 / 100
Grade : C+
Total time : 12:18:46
Rated time : 477 Seconds

Score :  662 / 1000
Grade : B+

--------------------------------------------------------
File :  H:\Arena Beta 5\Analyses.log

epd File :  STS2.epd   

Studied module :  Bsc 3.7f

Level:  10 seconds by position
Matching moves : 41 / 100
Grade : E
Total time : 12:18:46
Rated time : 638 Seconds

Score :  508 / 1000
Grade : C

--------------------------------------------------------
File :  H:\Arena Beta 5\Analyses.log

epd File :  STS3.epd   

Studied module :  Bsc 3.7f

Level:  10 seconds by position
Matching moves : 45 / 100
Grade : D
Total time : 12:18:46
Rated time : 622 Seconds

Score :  598 / 1000
Grade : C+

--------------------------------------------------------
File :  H:\Arena Beta 5\Analyses.log

epd File :  STS4.epd   

Studied module :  Bsc 3.7f

Level:  10 seconds by position
Matching moves : 39 / 100
Grade : ?
Total time : 12:18:45
Rated time : 649 Seconds

Score :  524 / 1000
Grade : C

--------------------------------------------------------
File :  H:\Arena Beta 5\Analyses.log

epd File :  STS5.epd   

Studied module :  Bsc 3.7f

Level:  10 seconds by position
Matching moves : 57 / 100
Grade : C+
Total time : 12:18:45
Rated time : 465 Seconds

Score :  673 / 1000
Grade : B+

--------------------------------------------------------
File :  H:\Arena Beta 5\Analyses.log

epd File :  STS6.epd   

Studied module :  Bsc 3.7f

Level:  10 seconds by position
Matching moves : 57 / 100
Grade : C+
Total time : 12:18:45
Rated time : 504 Seconds

Score :  776 / 1000
Grade : A

--------------------------------------------------------
File :  H:\Arena Beta 5\Analyses.log

epd File :  STS7.epd   

Studied module :  Bsc 3.7f

Level:  10 seconds by position
Matching moves : 45 / 100
Grade : D
Total time : 12:18:46
Rated time : 630 Seconds

Score :  561 / 1000
Grade : C+

--------------------------------------------------------
File :  H:\Arena Beta 5\Analyses.log

epd File :  STS8.epd   

Studied module :  Bsc 3.7f

Level:  10 seconds by position
Matching moves : 34 / 100
Grade : ?
Total time : 12:18:47
Rated time : 701 Seconds

Score :  482 / 1000
Grade : D

--------------------------------------------------------
File :  H:\Arena Beta 5\Analyses.log

epd File :  STS9.epd   

Studied module :  Bsc 3.7f

Level:  10 seconds by position
Matching moves : 32 / 100
Grade : ?
Total time : 12:18:45
Rated time : 727 Seconds

Score :  451 / 1000
Grade : D

----------------------------------------------------------------------------------------------------------------------------------
                |  STS1  |  STS2  |  STS3  |  STS4  |  STS5  |  STS6  |  STS7  |  STS8  |  STS9  |
----------------------------------------------------------------------------------------------------------------------------------
Bsc 3.7f  |    56    |    41    |    45    |    39    |    57    |    57    |    45    |    34    |    32    |
----------------------------------------------------------------------------------------------------------------------------------
Grade              |    C+    |    E    |    D    |    ?    |    C+    |    C+    |    D    |    ?    |    ?    |
Score / 1000     |    662    |    508    |    598    |    524    |    673    |    776    |    561    |    482    |    451    |
Grade              |    B+    |    C    |    C+    |    C    |    B+    |    A    |    C+    |    D    |    D    |
Best Move :  406 / 900  45.11 %  Grade : D
Total :           5235 / 9000  58.16 %  Grade : C+
----------------------------------------------------------------------------------------------------------------------------------

I renamed your files to STS1.epd, STS2.epd and so on... so as to see what output is being shown in STSStat.

I didn't expect it to show up /1000 scores since you have taken out Id tags with secondary moves. I expected only the /100.

I was wondering if this is a bug with Arena introducing moves on its own and awarding points for a 1000 point scale?

For a 100 point scale, Arena did award points correctly, ofcourse.

[jwes]

I renamed your files to STS1.epd, STS2.epd and so on... so as to see what output is being shown in STSStat.

I didn't expect it to show up /1000 scores since you have taken out Id tags with secondary moves. I expected only the /100.

I was wondering if this is a bug with Arena introducing moves on its own and awarding points for a 1000 point scale?

For a 100 point scale, Arena did award points correctly, ofcourse.

You will have to ask the author of STSStat. I am using the new set to run the tests and then the original to get the partial credit scores with a script I wrote.

[David Dahlem]

Does anyone have these STS suites in Gradual Test format, or have a tool that will convert them to Gradual Test format?

Thanks
Dave