STS suite with Stockfish 1.4 and 1.5.1

[Jouni]

With STS it's impossible to notice any improvement from 1.4 to 1.5.1.
I have ran 5 first suites with both. Results (32b single and 1 minute for each position):

1.4: 91+87+83+90+77 = 428 used time 102m56s
1.5.1: 87+89+78+86+79 = 419 used time 106m13s

Jouni

[swami]

With STS it's impossible to notice any improvement from 1.4 to 1.5.1.
I have ran 5 first suites with both. Results (32b single and 1 minute for each position):

1.4: 91+87+83+90+77 = 428 used time 102m56s
1.5.1: 87+89+78+86+79 = 419 used time 106m13s

Jouni

Thanks for running the tests, you should also take into account the priority of certain test suite.

For example, someone reported that Shredder 11 scored overall 1 point higher than Shredder 12, but Shredder 12 did improve the "Square Vacancy" knowledge 8 points more... so that contributed to better playing than shredder 11.

Also, so far only 6 test suites are available, within a year there will be around 15 - 20, comparison between 2 versions on 15-20 test suites will give more accurate info. You couldn't rely on playing strength based on 6 test suites... but you can rely on knowledge of them on these.

[swami]

I have ran 5 first suites with both. Results (32b single and 1 minute for each position):

BTW, Jouni, 6th version "Re-Capturing" was released a month ago. You might want to add that to the collection as well!

[Jouni]

In suite number 6 1.5.1 was better with 83 vs 79. So total score was 507 for 1.4 and 502 for 1.5.1. But as always in test suites total time is more important and there new Stockfish was slightly better:

1.4 total time 129m48s
1.5.1 total time 128m18s

Jouni