Stockfish 10 Skill-Level Elo Testrun

[pohl4711]

Because I need a good opponent for my ChessGenius- King-Element, I did a huge experiment, to measure the Elo of the Skill-Levels of Stockfish 10. So, I can use my Smartphone and the excellent Droidfish-App for playing.

https://www.sp-cc.de/experiments.htm


I made two large testruns with Stockfish 10, playing RoundRobin vs. itself with different Skill-Levels.
First testrun: Level 20-10 (11000 games, 1'+1'', singlecore)
Second testrun: Level 10-0 (5500 games 1'+1'', singlecore)
Then both game-pools were linked together and ORDO-calculated (fixed to 3450 Elo to Stockfish 10, Level 20, which is the Elo of Stockfish 10 in the CEGT-ratinglist (40m/4', singleCPU)).

Code: Select all

     Program                        Elo    +    -   Games   Score   Av.Op.  Draws

   1 Stockfish 10 bmi2 (100%)     : 3450   47   47  2000    98.5 %   2601    2.8 %
   2 Stockfish 10 lev=19 (95%)    : 2905   22   22  2000    73.9 %   2656   16.9 %
   3 Stockfish 10 lev=18 (90%)    : 2872   22   22  2000    71.2 %   2659   17.6 %
   4 Stockfish 10 lev=17 (85%)    : 2815   22   22  2000    66.0 %   2665   17.7 %
   5 Stockfish 10 lev=16 (80%)    : 2761   21   21  2000    60.8 %   2670   20.4 %
   6 Stockfish 10 lev=15 (75%)    : 2657   21   21  2000    50.3 %   2681   19.9 %
   7 Stockfish 10 lev=14 (70%)    : 2571   21   21  2000    41.5 %   2689   15.6 %
   8 Stockfish 10 lev=13 (65%)    : 2483   21   21  2000    32.7 %   2698   13.9 %
   9 Stockfish 10 lev=12 (60%)    : 2406   22   22  2000    25.5 %   2706   12.4 %
  10 Stockfish 10 lev=11 (55%)    : 2320   21   21  2000    18.3 %   2714   10.5 %
  11 Stockfish 10 lev=10 (50%)    : 2221   16   16  3000    36.9 %   2386    5.9 %
  12 Stockfish 10 lev=9 (45%)     : 2129   26   26  1000    81.8 %   1720    4.0 %
  13 Stockfish 10 lev=8 (40%)     : 2067   25   25  1000    76.8 %   1726    4.2 %
  14 Stockfish 10 lev=7 (35%)     : 1976   25   25  1000    68.8 %   1735    4.9 %
  15 Stockfish 10 lev=6 (30%)     : 1881   25   25  1000    60.2 %   1745    3.4 %
  16 Stockfish 10 lev=5 (25%)     : 1823   25   25  1000    54.9 %   1751    2.8 %
  17 Stockfish 10 lev=4 (20%)     : 1678   26   26  1000    42.0 %   1765    2.5 %
  18 Stockfish 10 lev=3 (15%)     : 1538   28   28  1000    30.1 %   1779    1.1 %
  19 Stockfish 10 lev=2 (10%)     : 1443   29   29  1000    22.7 %   1789    1.0 %
  20 Stockfish 10 lev=1 (5%)      : 1341   32   32  1000    15.4 %   1799    0.3 %
  21 Stockfish 10 lev=0 (0%)      : 1231   36   36  1000     8.8 %   1810    0.3 %

(Stockfish 10: 3450 Elo is the CEGT-ranking 40m/4'), The percent-numbers in brackets are the value of the "strength-meter" in the Droidfish-App for Smartphones...

[AdminX]

Thanks, that is good data to have. Only wish it also iincluded average depth for each level. Still very nice.

PS: What are the specs of your Smartphone?

[pohl4711]

Thanks, that is good data to have. Only wish it also iincluded average depth for each level. Still very nice.

PS: What are the specs of your Smartphone?

Sorry, I forgot to say, the test was done on a Intel-Notebook.... not on my Smartphone.
Stockfish is around 1.4 MN/s (singlecore) on this machine.
And I used the Stockfish Framework 8moves openings.