Latest Stockfish...

[royb]

Another update - this change doubles the number of skill levels from 20 to 40.

As an example, if you were to move from playing level 4 vs level 5 prior to this change, depending upon your hardware, that could be a 130 point ELO jump ..a pretty nasty jump for a human to adjust to..

Code: Select all

100 rounds and 100 games completed...
time control: 600+10
Date: 07/30/16 : 23:23:41
100 game(s) loaded
Rank Name                 Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
------------------------------------------------------------------------------------------------------
   1 Stockfish 073016-y    3164   0.0   34   34   100   67.0  67.0   62   28   10  62.0  10.0  3036 
   2 Stockfish 073016-2y   3036 129.0   34   34   100   33.0  33.0   28   62   10  28.0  10.0  3164 
------------------------------------------------------------------------------------------------------

Code: Select all

with the extra levels, the jump will only be ~half as much ELO:
100 rounds and 100 games completed...
time control: 600+10
Date: 07/30/16 : 23:27:08
100 game(s) loaded
Rank Name                 Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
------------------------------------------------------------------------------------------------------
   1 Stockfish 073016-y    3125   0.0   32   32   100   57.5  57.5   52   37   11  52.0  11.0  3075 
   2 Stockfish 073016-2y   3075  50.9   32   32   100   42.5  42.5   37   52   11  37.0  11.0  3125 
------------------------------------------------------------------------------------------------------

Code: Select all

note: 
old level 20 == new level 40
old level 19 == new level 38 -> level 39 did not exist under the level command
...
old level 5 == new level 10
new level 9 ( did not exist prior)
old level 4 == new level 8 
..etc etc

the first set of games above were played at levels 8 & 10, the second set of games were played at levels 9 & 10...

source and Mac exe can be found here

https://github.com/MichaelB7/Stockfish

I like this concept a lot. Will these changes be added back into the mainline Stockfish code?

[MikeB]

I like this concept a lot. Will these changes be added back into the mainline Stockfish code?

I'm not sure - it's a change I will carry forward even if they do not. the Skill Level command is not one they are focused on and understandably so.

[MikeB]

Another update - this change doubles the number of skill levels from 20 to 40.

As an example, if you were to move from playing level 4 vs level 5 prior to this change, depending upon your hardware, that could be a 130 point ELO jump ..a pretty nasty jump for a human to adjust to..

Code: Select all

100 rounds and 100 games completed...
time control: 600+10
Date: 07/30/16 : 23:23:41
100 game(s) loaded
Rank Name                 Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
------------------------------------------------------------------------------------------------------
   1 Stockfish 073016-y    3164   0.0   34   34   100   67.0  67.0   62   28   10  62.0  10.0  3036 
   2 Stockfish 073016-2y   3036 129.0   34   34   100   33.0  33.0   28   62   10  28.0  10.0  3164 
------------------------------------------------------------------------------------------------------

Code: Select all

with the extra levels, the jump will only be ~half as much ELO:
100 rounds and 100 games completed...
time control: 600+10
Date: 07/30/16 : 23:27:08
100 game(s) loaded
Rank Name                 Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
------------------------------------------------------------------------------------------------------
   1 Stockfish 073016-y    3125   0.0   32   32   100   57.5  57.5   52   37   11  52.0  11.0  3075 
   2 Stockfish 073016-2y   3075  50.9   32   32   100   42.5  42.5   37   52   11  37.0  11.0  3125 
------------------------------------------------------------------------------------------------------

Code: Select all

note: 
old level 20 == new level 40
old level 19 == new level 38 -> level 39 did not exist under the level command
...
old level 5 == new level 10
new level 9 ( did not exist prior)
old level 4 == new level 8 
..etc etc

the first set of games above were played at levels 8 & 10, the second set of games were played at levels 9 & 10...

source and Mac exe can be found here

https://github.com/MichaelB7/Stockfish

Somebody pointed to me that new level 10 was too strong to relative to old level 5.

This updates fixes that - source and exe updated on Github

Code: Select all

1110 of 1500 games completed...
time control: 600+10
Date: 07/31/16 : 16:11:56
1110 game(s) loaded
Rank Name                 Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
-------------------------------------------------------------------------------------
   1 Stockfish 073116-y    3104   0.0   16   16   740  377.0  50.9  354  340   46  47.8   6.2  3098 
   2 Stockfish 073116-2y   3104   0.2   16   16   741  377.5  50.9  351  337   53  47.4   7.2  3098 
   3 Stockfish 072516-y    3091  12.8   16   16   739  355.5  48.1  325  353   61  44.0   8.3  3104 
-------------------------------------------------------------------------------------
1110 game(s) loaded

The two 73116 versions above are exactly the same and are running at level 10, 72516 version is running at the old level 5. so it looks like the bug is fixed. Introducing levels also introduces randomization, so the noise factor is probably greater than normal testing - but most humans would have hard time deciding if one program is 20 ELO points stronger - but the difference before this fix was in the hundreds of ELO . Also I now placed the Mac exe in a zipped file so it would not get mangled during the upload and download process.

Source and Mac exe can be found here:

https://github.com/MichaelB7/Stockfish

[MikeB]

fyi, did some quick 100 game runs between levels to see what the ELO difference might be - very unscientific as these bars are quite large

Code: Select all

Level Δ 
0
1    +44
2   +112
3    +23
4    +90
5    +45
6   +121
7    +24
8    +62
9    +13
10   +66
11    +5
12  +106
13   +17
14   +82 
15   +33
16   +95

the fact that the ELO jumps more going from an odd number level to even number level makes sense due the integer coding used. Perhaps a roughly 90 ELO jump to from odd level to an even level and a smaller , perhaps not even a perceived ELO increase of 20 to 30 ELO, when going from an even level to odd number level.

Level 10 might be a good club level (1400-1600) to start at , expert level players would want to start at level 16 or higher , some of this also depends on how much time you allow SF and the speed of your computer - ymmv.

[MikeB]

this is probably a more accurate depiction of ratings differences between the new SF levels...

Code: Select all

100 rounds and 3600 games completed...
time control: 1200+20
Date: 08/01/16 : 02:38:11
Rank Name                   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   
-------------------------------------------------------------------------------------
   1 Stockfish-Level-08    0.0   27   27   800  628.5  78.6  620  163   17  77.5   2.1  
   2 Stockfish-Level-07   58.9   25   25   800  574.5  71.8  565  216   19  70.6   2.4  
   3 Stockfish-Level-06   41.5   24   24   800  532.5  66.6  522  257   21  65.2   2.6  
   4 Stockfish-Level-05   71.5   23   23   800  456.5  57.1  448  335   17  56.0   2.1  
   5 Stockfish-Level-04   38.9   23   23   800  413.5  51.7  407  380   13  50.9   1.6  
   6 Stockfish-Level-03   81.9   24   24   800  323.5  40.4  317  470   13  39.6   1.6   
   7 Stockfish-Level-02   35.6   24   24   800  286.0  35.8  279  507   14  34.9   1.8  
   8 Stockfish-Level-01   70.4   25   25   800  217.5  27.2  213  578    9  26.6   1.1   
   9 Stockfish-Level-00   56.8   27   27   800  167.5  20.9  165  630    5  20.6   0.6  
-------------------------------------------------------------------------------------

[MikeB]

source and MacOS exe download available below

https://github.com/MichaelB7/Stockfish

Code: Select all

100 rounds and 300 games completed...
time control: 3000+50 ( 30 sec game 0.5 sec increment)
Date: 08/11/16 : 17:57:20
300 game(s) loaded
Rank Name                 Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
-----------------------------------------------------------------------------------------------------
   1 Stockfish 081116-2y   3124   0.0   21   21   200  110.0  55.0   52   32  116  26.0  58.0  3088 
   2 Stockfish 073116-2y   3112  12.3   21   21   200  104.5  52.2   47   38  115  23.5  57.5  3094 
   3 Komodo 10.1 64-bit    3064  47.4   21   21   200   85.5  42.8   41   70   89  20.5  44.5  3118 
-----------------------------------------------------------------------------------------------------


incorporates the latest commits, plus Ronald's syzygy TB updates and supports 40 skill levels

[MikeB]

saw this position posted on fishcooking:

[d]8/6p1/7p/4k2P/8/2PK4/6P1/8 w - - 0 1

Code: Select all

info depth 39 seldepth 42 multipv 1 score mate 16 nodes 86984627 nps 32109496 hashfull 314 tbhits 0 time 2709 pv c3c4 e5f4 d3d4 f4f5 d4d5 g7g5 c4c5 f5f6 c5c6 f6e7 g2g4 e7e8 d5e6 e8d8 e6d6 d8c8 c6c7 c8b7 d6d7 b7b6 c7c8q b6b5 c8c3 b5a4 d7d6 a4b5 c3b3 b5a6 d6c6 a6a5 b3b5

[MikeB]

source and MacOS exe download available below

https://github.com/MichaelB7/Stockfish

Code: Select all

100 rounds and 300 games completed...
time control: 3000+50 ( 30 sec game 0.5 sec increment)
Date: 08/11/16 : 17:57:20
300 game(s) loaded
Rank Name                 Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
-----------------------------------------------------------------------------------------------------
   1 Stockfish 081116-2y   3124   0.0   21   21   200  110.0  55.0   52   32  116  26.0  58.0  3088 
   2 Stockfish 073116-2y   3112  12.3   21   21   200  104.5  52.2   47   38  115  23.5  57.5  3094 
   3 Komodo 10.1 64-bit    3064  47.4   21   21   200   85.5  42.8   41   70   89  20.5  44.5  3118 
-----------------------------------------------------------------------------------------------------


incorporates the latest commits, plus Ronald's syzygy TB updates and supports 40 skill levels

Code: Select all

100 rounds and 300 games completed...
time control: 30000+500 (5 minute game + 5 second increment)
Date: 08/12/16 : 18:36:14
300 game(s) loaded
Rank Name                 Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
------------------------------------------------------------------------------------------------------
   1 Stockfish 081116-2y   3119   0.0   18   18   200  108.5  54.2   49   32  119  24.5  59.5  3090 
   2 Stockfish 073116-2y   3109  10.1   18   18   200  103.5  51.7   36   29  135  18.0  67.5  3096 
   3 Komodo 10.1 64-bit    3072  36.8   18   18   200   88.0  44.0   32   56  112  16.0  56.0  3114 
------------------------------------------------------------------------------------------------------

[Nordlandia]

SF drew H4 Pro with e2 pawn removed as odds. Nice performance nevertheless.

[pgn][Event "EXPERT-PC, Slow 180m+30s"]
[Site "EXPERT-PC"]
[Date "2016.08.15"]
[Round "1"]
[White "Stockfish 130816 64 BMI2"]
[Black "Houdini 4 Pro x64"]
[Result "1/2-1/2"]
[SetUp "1"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPP1PPP/RNBQKBNR w KQkq - 0 1"]
[PlyCount "81"]

1. d4 d5 2. c4 Nf6 3. Nf3 g6 (3... Nc6 4. cxd5 Nxd5 {0.44/23 Houdini 4 x64}) 4.
Be2 Bg7 (4... Bg7 5. Nc3 O-O {-0.88/23 Deep Fritz 13}) 5. Nc3 O-O (5... Nc6 {
-0.64/26 Stockfish 080716 64 POPCNT}) 6. O-O Nc6 7. Ne5 Nxe5 8. dxe5 Ne4 (8...
Ne4 9. Nxe4 dxe4 {-0.54/28 Komodo 10 64-bit}) 9. Nxe4 dxe4 (9... dxe4 10. Bf4
Qd7 {-0.63/26 Stockfish 080716 64 POPCNT}) 10. Bf4 b6 11. Qb3 c5 12. Qg3 Be6 (
12... Be6 13. b3 Qd7 {-0.76/24 Komodo 9 64-bit}) 13. b3 Qd7 (13... Qc7 14. h4
Rfd8 {-0.68/30 Komodo 10.1 64-bit}) 14. Rad1 (14. h4 h5 15. Rad1 {-0.81/21
Fritz 11 SE}) 14... Qc7 (14... Qc7 {-0.68/26 Stockfish 7 64}) 15. h4 Rad8 (
15... Rad8 16. Rxd8 Rxd8 {-0.57/29 Komodo 10.1 64-bit}) 16. h5 Rd4 (16... Rd4
17. Rfe1 Rfd8 {-0.72/31 Stockfish 5 64 SSE4.2}) 17. Rb1 Rfd8 (17... Rfd8 18.
Rfe1 Qd7 {-0.69/32 Komodo 10.1 64-bit}) 18. a3 Ra8 (18... Qd7 19. Rfe1 Qc6 {
-0.71/27 Stockfish 6 64}) 19. h6 Bh8 20. Rfc1 Rc8 (20... Rad8 21. Re1 Kf8 {
-0.81/31 Stockfish 5 64 SSE4.2}) 21. b4 Rdd8 (21... e3 {-0.68/29 Stockfish 6
x64}) 22. Rb2 Qb7 (22... Qb7 23. Rbb1 Qb8 {-0.54/17 Deep Rybka 4 w32}) 23. a4
cxb4 (23... cxb4 24. Rxb4 Rc5 {-0.36/27 Stockfish 7 64}) 24. Rxb4 Rc5 (24...
Rc5 25. Rb5 Rdc8 {-0.51/24 Stockfish 7 64 POPCNT}) 25. Rb5 Rdc8 (25... Qc7 {
-0.42/28 Stockfish 7 64 POPCNT}) 26. Rd1 Qc7 (26... Qc6 27. Qe3 {-0.14/29
Stockfish 160716 64 POPCNT}) 27. a5 Kf8 (27... bxa5 28. Qa3 Rxb5 {-0.30/22
Houdini 1.5 w32}) 28. axb6 (28. axb6 axb6 {-0.17/26 Stockfish 7 64}) 28... axb6
(28... axb6 29. Rd4 Bf5 {-0.26/29 Stockfish 7 64 POPCNT}) 29. Rd4 Qb7 (29...
Bf5 30. Rd5 {-0.07/29 Stockfish 240716 64 POPCNT}) 30. Qb3 Rxb5 (30... Rxb5 31.
Qxb5 f6 {0.00/31 Komodo 10.1 64-bit full Syzygy on SSD 8350}) 31. Qxb5 f6 (
31... f6 32. Be3 f5 {0.00/35 Komodo 9.2 64-bit}) 32. Be3 f5 (32... f5 33. c5
Bxe5 {0.00/36 Stockfish 240716 64 POPCNT}) 33. c5 Bxe5 (33... Bxe5 34. Rd1 Qc6
{0.00/38 Komodo 10 64-bit}) 34. Rd1 Qc6 (34... Qc6 35. cxb6 Qxb5 {0.00/33
Stockfish 7 64}) 35. cxb6 Qxb5 (35... Qxb5 36. Bxb5 f4 {0.00/37 Stockfish 5 64
SSE4.2}) 36. Bxb5 f4 (36... f4 37. Bd4 Bxd4 {0.00/36 Stockfish 7 64 POPCNT})
37. Bd4 (37. Bd4 Bxd4 38. Rxd4 {0.00/37 Stockfish 7 64}) 37... Bxd4 (37... Bxd4
38. Rxd4 Rb8 {0.00/39 Stockfish 5 64 SSE4.2}) 38. Rxd4 Rb8 (38... Rb8 39. Rxe4
Rxb6 {-0.05/27 Deep Fritz 13}) 39. Rxe4 Rxb6 (39... Bf5 40. Rxf4 Rxb6 {0.00/26
Fritz 15}) 40. Rxf4+ Bf5 41. Ba4 1/2-1/2

[/pgn]

https://en.lichess.org/dKk02sGB#0

[whereagles]

"Latest stockfish" is highly perishable concept...

Just sayin'