Live Tournament Stockfish, Lc0, Ethereal, Xiphos, Komodo Stockfish+NNUE PO, (15m+15s) (4 Rounds)

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Dann Corbit, Harvey Williamson

mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Live Tournament Stockfish, Lc0, Ethereal, Xiphos, Komodo Stockfish+NNUE PO, (15m+15s) (4 Rounds)

Post by mwyoung »

Live Tournament Stockfish, Lc0, Ethereal, Xiphos, Komodo Stockfish+NNUE PO, (15m+15s) (4 Rounds)

Hardware 2950x, RTX 2080 Ti

Stockfish 220820 (NN-2257)
Lc0 26.1 (NN-J92-70)
Stockfish+NNUE PO (NN-2257)
Ethereal 12.25
Xiphos 0.6
Komodo 14

Ponder off.
TC=15m+15s
32 threads.
4 Gb hash.
6 man TB, and 10, 7 man TB.
Opening book 6 moves.
Default settings.

Live Stream:https://www.youtube.com/watch?v=RZzJaSAyJi8
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Live Tournament Stockfish, Lc0, Ethereal, Xiphos, Komodo Stockfish+NNUE PO, (15m+15s) (4 Rounds)

Post by mwyoung »

Update 1

Code: Select all

Result:
----------------------------------------------------------------------------------------
  #  name                        games    wins   draws  losses   score    los%  elo+/-
  1. SF+NNUE PO 290720 x64 avx2      8       2       6       0     5.0    92.1    88.7
  2. Ethereal 12.25 (POPCNT)         5       2       2       1     3.0    71.8    70.4
  3. Stockfish 240820                8       1       7       0     4.5    84.1    43.7
  4. Lc0 v0.26.1                     8       0       8       0     4.0-nan(ind)    -0.0
  5. Komodo 14 64-bit                7       0       7       0     3.5-nan(ind)    -0.0
  6. Xiphos 0.6 NO-POPCNT            8       0       4       4     2.0     2.3  -190.8

Cross table:
----------------------------------------------------------------------------------------
  #  name                           score   games         1         2         3         4         5         6
  1. SF+NNUE PO 290720 x64 avx2       5.0       8         x         1       ===         =         =        1=
  2. Ethereal 12.25 (POPCNT)          3.0       5         0         x         =                   =        11
  3. Stockfish 240820                 4.5       8       ===         =         x       ===                   1
  4. Lc0 v0.26.1                      4.0       8         =                 ===         x       ===         =
  5. Komodo 14 64-bit                 3.5       7         =         =                 ===         x        ==
  6. Xiphos 0.6 NO-POPCNT             2.0       8        0=        00         0         =        ==         x

Tech:
----------------------------------------------------------------------------------------

Tech (average nodes, depths, time/m per move, others per game), counted for computing moves only, ignored moves with zero nodes:
  #  name                          nodes/m         NPS  depth/m   time/m    moves     time
  1. SF+NNUE PO 290720 x64 avx2   1076499K    38474123     53.5     28.0     53.5   1496.9
  2. Ethereal 12.25 (POPCNT)      1248191K    41345286     35.9     30.2     55.6   1678.5
  3. Stockfish 240820             1096589K    37545682     51.4     29.2     49.3   1438.4
  4. Lc0 v0.26.1                     1220K       48574     12.1     25.1     76.4   1918.3
  5. Komodo 14 64-bit             1042211K    35700869     46.5     29.2     59.6   1739.1
  6. Xiphos 0.6 NO-POPCNT          834154K    33706387     45.7     24.7     72.4   1791.1
     all ---                       778550K    29272751     39.3     27.2     61.5   1675.6
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Live Tournament Stockfish, Lc0, Ethereal, Xiphos, Komodo Stockfish+NNUE PO, (15m+15s) (4 Rounds)

Post by mwyoung »

Update 2

Code: Select all

Result:
----------------------------------------------------------------------------------------
  #  name                        games    wins   draws  losses   score    los%  elo+/-
  1. Lc0 v0.26.1                    18       3      15       0    10.5    95.8    58.5
  2. SF+NNUE PO 290720 x64 avx2     18       2      16       0    10.0    92.1    38.8
  3. Stockfish 240820               14       2      12       0     8.0    92.1    50.0
  4. Ethereal 12.25 (POPCNT)        15       2      10       3     7.0    32.7   -23.2
  5. Komodo 14 64-bit               15       0      14       1     7.0    15.9   -23.2
  6. Xiphos 0.6 NO-POPCNT           16       0      11       5     5.5     1.3  -112.3

Cross table:
----------------------------------------------------------------------------------------
  #  name                           score   games         1         2         3         4         5         6
  1. Lc0 v0.26.1                     10.5      18         x      ====       ===       1==      ===1      ===1
  2. SF+NNUE PO 290720 x64 avx2      10.0      18      ====         x      ====      1===       ===       1==
  3. Stockfish 240820                 8.0      14       ===      ====         x       =1=         =       1==
  4. Ethereal 12.25 (POPCNT)          7.0      15       0==      0===       =0=         x       ===        11
  5. Komodo 14 64-bit                 7.0      15      ===0       ===         =       ===         x      ====
  6. Xiphos 0.6 NO-POPCNT             5.5      16      ===0       0==       0==        00      ====         x

Tech:
----------------------------------------------------------------------------------------

Tech (average nodes, depths, time/m per move, others per game), counted for computing moves only, ignored moves with zero nodes:
  #  name                          nodes/m         NPS  depth/m   time/m    moves     time
  1. Lc0 v0.26.1                      975K       37483     11.9     26.0     69.5   1807.6
  2. SF+NNUE PO 290720 x64 avx2    912613K    32447710     55.5     28.1     54.7   1539.1
  3. Stockfish 240820             1053554K    37474414     51.0     28.1     57.5   1616.6
  4. Ethereal 12.25 (POPCNT)      1190601K    43104669     41.5     27.6     64.8   1789.9
  5. Komodo 14 64-bit             1036218K    37430907     45.7     27.7     66.5   1840.0
  6. Xiphos 0.6 NO-POPCNT          853822K    34469857     44.9     24.8     72.3   1789.6
     all ---                       780117K    29680730     40.3     26.9     64.2   1728.7
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Live Tournament Stockfish, Lc0, Ethereal, Xiphos, Komodo Stockfish+NNUE PO, (15m+15s) (4 Rounds)

Post by mwyoung »

End of Match.

Code: Select all

Result:
----------------------------------------------------------------------------------------
  #  name                        games    wins   draws  losses   score    los%  elo+/-
  1. Lc0 v0.26.1                    20       4      16       0    12.0    97.7    70.4
  2. Stockfish 240820               20       4      16       0    12.0    97.7    70.4
  3. SF+NNUE PO 290720 x64 avx2     20       2      18       0    11.0    92.1    34.9
  4. Ethereal 12.25 (POPCNT)        20       2      13       5     8.5    12.8   -52.5
  5. Xiphos 0.6 NO-POPCNT           20       1      13       6     7.5     2.9   -88.7
  6. Komodo 14 64-bit               20       0      18       2     9.0     7.9   -34.9

Cross table:
----------------------------------------------------------------------------------------
  #  name                           score   games         1         2         3         4         5         6
  1. Lc0 v0.26.1                     12.0      20         x      ====      ====      1==1      ===1      ===1
  2. Stockfish 240820                12.0      20      ====         x      ====      =1==      1==1      ===1
  3. SF+NNUE PO 290720 x64 avx2      11.0      20      ====      ====         x      1===      1===      ====
  4. Ethereal 12.25 (POPCNT)          8.5      20      0==0      =0==      0===         x      11=0      ====
  5. Xiphos 0.6 NO-POPCNT             7.5      20      ===0      0==0      0===      00=1         x      ====
  6. Komodo 14 64-bit                 9.0      20      ===0      ===0      ====      ====      ====         x

Tech:
----------------------------------------------------------------------------------------

Tech (average nodes, depths, time/m per move, others per game), counted for computing moves only, ignored moves with zero nodes:
  #  name                          nodes/m         NPS  depth/m   time/m    moves     time
  1. Lc0 v0.26.1                      914K       36383     11.7     25.1     76.2   1913.9
  2. Stockfish 240820              960915K    35367791     50.6     27.2     61.6   1674.5
  3. SF+NNUE PO 290720 x64 avx2    914944K    32057856     55.8     28.5     54.0   1539.8
  4. Ethereal 12.25 (POPCNT)      1125655K    42861136     41.6     26.3     71.5   1876.5
  5. Xiphos 0.6 NO-POPCNT          870336K    34174750     43.7     25.5     68.9   1754.7
  6. Komodo 14 64-bit             1037085K    38562556     44.5     26.9     68.9   1853.0
     all ---                       786845K    30436333     40.3     26.5     66.8   1768.3
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.