STS results.

[wolfman]

I'm testing for some months engines using STS and I like to share the results.

Testconditions.

STS(q10).
Arena 3.0 GUI.
Maximum time to find matching move = 10 seconds .
Computer with intel Q6600 cpu, internal memory = 2gb.
All engines are using 1 cpu.
OS = Windows 7 64bits.

STS(i13).
Arena 3.0 GUI.
Maximum time to find matching move =13 seconds.
Computer with intel I5 cpu, internal memory = 4gb.
All engines are using 1 cpu.
OS = Windows 7 64bits.

STS(a29).
Arena 3.0 GUI.
Maximum time to find matching move = 29 seconds.
Computer with intel Atom450 cpu. internal memory = 2gb.
All engines are using 1 cpu.
OS = Windows 7 32bits.

Reports will have following items.
STS(code), Engine, Version, 32 or 64 bits.
# = STS number.
MM = number of Matching Moves. Higher number is better.
RT =Rated Time in seconds. Lower time is better.
PV = Performance Value. An emperical formula is used, based on MM and RT.
MM is more influencing PV than RT. Higher value is better.

Example of reporting.

STS(i13) Stockfish 2.11JA-64.
# //MM// RT // PV
01 // 82 // 287 // 1210
02 // 82 // 321 // 1152
03 // 87 // 269 // 1587
04 // 89 // 211 // 1939
05 // 78 // 334 // 932
06 // 83 // 303 // 1242
07 // 82 // 330 // 1138
08 // 68 // 521 // 432
09 // 77 // 382 // 825
10 // 87 // 209 // 1774
11 // 83 // 265 // 1317
12 // 87 // 251 // 1636
13 // 86 // 239 // 1595
14 // 85 // 246 // 1501
Total // 1156 // 4168 // 1225

[Aser Huerga]

Thanks, STS is a very interesting suite. Did you test many engines till now?
Waiting for more results ...