Live Tournament SF+NNUE, Lc0, Ethereal, SF+Classical Eval, Komodo, Stockfish+NNUE PO, (3m+2s) (12 Rounds)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Live Tournament SF+NNUE, Lc0, Ethereal, SF+Classical Eval, Komodo, Stockfish+NNUE PO, (3m+2s) (12 Rounds)

Post by mwyoung »

Tournament SF+NNUE, Lc0, Ethereal, SF+Classical Eval, Komodo, Stockfish+NNUE PO, (3m+2s) (12 Rounds)

Hardware 2950x, RTX 2080 Ti

Stockfish 260820 (NN-1705)
Lc0 26.1 (NN-J92-70)
Stockfish+NNUE PO (NN-1705)
Ethereal 12.25
Stockfish 240820+Classical Eval Only
Komodo 14

Ponder off.
TC=3m+2s
32 threads.
4 Gb hash.
6 man TB, and 10, 7 man TB.
Opening book 6 moves.
Default settings.

Live Stream:
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Live Tournament SF+NNUE, Lc0, Ethereal, SF+Classical Eval, Komodo, Stockfish+NNUE PO, (3m+2s) (12 Rounds)

Post by mwyoung »

Update 1

Code: Select all

Result:
----------------------------------------------------------------------------------------
  #  name                        games    wins   draws  losses   score    los%  elo+/-
  1. SF+NNUE PO 290720 x64 avx2     29       9      20       0    19.0    99.9   111.5
  2. Stockfish 260820               26       7      19       0    16.5    99.6    95.9
  3. Stockfish 240820               23       4      14       5    11.0    36.9   -15.1
  4. Lc0 v0.26.1                    19       2      15       2     9.5    50.0    -0.0
  5. Komodo 14 64-bit               23       1      15       7     8.5     1.7   -92.8
  6. Ethereal 12.25 (POPCNT)        26       0      17       9     8.5     0.1  -125.4

Cross table:
----------------------------------------------------------------------------------------
  #  name                           score   games         1         2         3         4         5         6
  1. SF+NNUE PO 290720 x64 avx2      19.0      29         x     =====     =111=    ======     ==111  1====11=
  2. Stockfish 260820                16.5      26     =====         x    ===11=       1==      =1=1  1===1===
  3. Stockfish 240820                11.0      23     =000=    ===00=         x        =1    ==1===      1==1
  4. Lc0 v0.26.1                      9.5      19    ======       0==        =0         x     =1===       ==1
  5. Komodo 14 64-bit                 8.5      23     ==000      =0=0    ==0===     =0===         x       ==1
  6. Ethereal 12.25 (POPCNT)          8.5      26  0====00=  0===0===      0==0       ==0       ==0         x

Tech:
----------------------------------------------------------------------------------------

Tech (average nodes, depths, time/m per move, others per game), counted for computing moves only, ignored moves with zero nodes:
  #  name                          nodes/m         NPS  depth/m   time/m    moves     time
  1. SF+NNUE PO 290720 x64 avx2    115364K    23559980     38.1      4.9     51.9    253.9
  2. Stockfish 260820              108886K    24311295     39.2      4.5     60.8    272.2
  3. Stockfish 240820              190736K    40897691     40.5      4.7     58.0    270.7
  4. Lc0 v0.26.1                      104K       23346     10.0      4.5     65.6    292.2
  5. Komodo 14 64-bit              196763K    38299524     35.4      5.1     50.5    259.6
  6. Ethereal 12.25 (POPCNT)       191763K    41504754     29.6      4.6     63.9    295.3
     all ---                       132024K    28786682     32.5      4.7     58.1    273.1
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Live Tournament SF+NNUE, Lc0, Ethereal, SF+Classical Eval, Komodo, Stockfish+NNUE PO, (3m+2s) (12 Rounds)

Post by mwyoung »

End of Match.

Code: Select all

Result:
----------------------------------------------------------------------------------------
  #  name                        games    wins   draws  losses   score    los%  elo+/-
  1. SF+NNUE PO 290720 x64 avx2     60      18      42       0    39.0   100.0   107.5
  2. Stockfish 260820               60      10      50       0    35.0    99.9    58.5
  3. Stockfish 240820               60       8      42      10    29.0    31.9   -11.6
  4. Lc0 v0.26.1                    60       6      51       3    31.5    84.1    17.4
  5. Komodo 14 64-bit               60       4      42      14    25.0     0.9   -58.5
  6. Ethereal 12.25 (POPCNT)        60       0      41      19    20.5     0.0  -113.9

Cross table:
----------------------------------------------------------------------------------------
  #  name                           score   games            1            2            3            4            5            6
  1. SF+NNUE PO 290720 x64 avx2      39.0      60            x ============ =111=1=1==1= ========1=== ==111==1===1 1====11=1=11
  2. Stockfish 260820                35.0      60 ============            x ===11==1==== 1=========== =1=11==1==== 1===1=======
  3. Stockfish 240820                29.0      60 =000=0=0==0= ===00==0====            x =1====0===== ==1=====11== 1==11=====1=
  4. Lc0 v0.26.1                     31.5      60 ========0=== 0=========== =0====1=====            x =1========1= ==1==1====1=
  5. Komodo 14 64-bit                25.0      60 ==000==0===0 =0=00==0==== ==0=====00== =0========0=            x ==11===11===
  6. Ethereal 12.25 (POPCNT)         20.5      60 0====00=0=00 0===0======= 0==00=====0= ==0==0====0= ==00===00===            x

Tech:
----------------------------------------------------------------------------------------

Tech (average nodes, depths, time/m per move, others per game), counted for computing moves only, ignored moves with zero nodes:
  #  name                          nodes/m         NPS  depth/m   time/m    moves     time
  1. SF+NNUE PO 290720 x64 avx2    117795K    24694883     39.9      4.8     54.9    261.8
  2. Stockfish 260820              108053K    23706152     40.6      4.6     59.3    270.4
  3. Stockfish 240820              183725K    40935039     41.8      4.5     62.1    278.9
  4. Lc0 v0.26.1                      100K       21776      9.9      4.6     61.8    285.0
  5. Komodo 14 64-bit              181390K    38325371     36.5      4.7     60.6    286.8
  6. Ethereal 12.25 (POPCNT)       194638K    41790221     29.9      4.7     61.1    284.7
     all ---                       128047K    28297781     32.9      4.6     60.0    277.9

Tournament finished! Elapsed: 1d 4:04:16
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.