Regression Test:Stockfish 11r99

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Regression Test:Stockfish 11r99

Post by MikeB »

Honey and Oki-Maguro (Big Tuna) vs Stockfish 11r99 - the last SF commit before NNUE
Wanted to see progress of NN using 4 threads. Have never run this test before against SF 11r99

Settings ...
Current date : time (EDST)
Date: 09/17/20 : 06:38:25

CMD2=Honey-12-W-AMD.exe ENG2=Honey-12-1520 EVFILE2=./eval/20200824-1520.bin
CMD3=Oki-Maguro-12-W-AMD.exe ENG3=Oki-Maguro-12-1520 EVFILE3=./eval/20200824-1520.bin
CMD5=stockfish-11r99.exe ENG5=Stockfish-11r99
Threads: 4
Concurrency: 15
Hash: 256
Time: 60+1

PGN File: c:/cluster.mfb/pgn/09170638.pgn
Games: 1998
Projected-> Time: 8h:6m:12s
60+1.000

3 Books used equally in sequence random selection:
333 openings played twice - 666 games 1st book is very unbalanced - NBSC_30k_5mvs.epd (Pohl) - this book is so unbalanced, that noticeably weaker engines obtain better results than more normal books such as the two below
333 openings played twice - 666 games 2nd book is more standard chess lines - DrSullivan500.epd
333 openings played twice - 666 games 3rd book is a cross between the first two - Drawkiller_balanced_small500.epd (Pohl)

PGN File:
https://www.dropbox.com/s/y4bvly2zgc6hf ... 4.pgn?dl=0

Results:
https://www.dropbox.com/s/cp1jt7609ma9vyb/elo.txt?dl=0

Early Results:

Code: Select all

PGN File: c:/cluster.mfb/pgn/09170638.pgn
Time Control: Time Control-> base+inc: 60+1.000
Games: 1998
Threads: 4
Hash: 256

Current date : time (EDST)
Date: 09/17/20 : 06:50:08

Projected-> Time: 8h:6m:12s
     Run -> Time: 0h:11m:43s

31 game(s) loaded
Rank Name                Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR
---------------------------------------------------------------------------------------------------------

   1 Honey-12-1520        3523   0.0   93   93    21   11.5  54.8    7    5    9  33.3  42.9  3490
   2 Oki-Maguro-12-1520   3520   3.4   87   87    21   11.5  54.8    5    3   13  23.8  61.9  3492
   3 Stockfish-11r99      3457  63.5   92   92    20    8.0  40.0    3    7   10  15.0  50.0  3522
---------------------------------------------------------------------------------------------------------

  Δ = delta from the next higher rated opponent
  # = number of games played
  Σ = total score, 1 point for win, 1/2 point for draw

LOS:
                    Ho Ok St
Honey-12-1520          52 88
Oki-Maguro-12-1520  47    88
Stockfish-11r99     11 11

31 game(s) loaded

loops/scheduled: 1/87

waiting: 335
  ...seconds remaining:   328
Image