Here's my first 20 core test runs (same 24 positions, each run 4 times). All results are geometric mean for a 24 position run.
Code: Select all
run 1 run 2 run 3 run 4 avg
speedup 15.0 15.0 15.0 15.3 15.1
nps 16.3 16.4 16.3 16.3 16.3
The speedup has really captured my attention, because it is right at the theoretical max (15.1 with max of 16.3 based on NPS numbers). I am fixing to create another set of test positions just to be sure that these positions don't somehow happen to artificially inflate the speedup results. I am not sure exactly how I am going to choose this test set. I was leaning toward either (a) taking a set of positions from a long time control game played on ICC, or else (b) a random set of positions extracted from GM games (the way I extract starting positions for cluster testing).
A much larger set of positions would be better, statistically, but not so good practically as the tests would take forever to run. More on this later....
