NNUE engines will probably start to cluster in their own cluster. New dendrogram.

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

NNUE engines will probably start to cluster in their own cluster. New dendrogram.

Post by Laskos »

Some are showing some relatedness, here SV_22.07_2141 and Gekkehenker_27.06 net. They all are not that related to SF or Lc0 (and any other of these 2 types), even those trained on SF games and using SF search. Here only "nightnurse" is not trained on SF games and all are using SF binary for search.
In fact, they seem a bit more related to Lc0 than to SF, but just a bit.

Code: Select all

sim version 3

  Key:

  1) Lc0 96x8 (time: 100 ms  scale: 1.0)
  2) Lc0 SV_3010 (time: 100 ms  scale: 1.0)
  3) Lc0 T40 (time: 100 ms  scale: 1.0)
  4) Lc0 T70 (time: 100 ms  scale: 1.0)
  5) SF_FiNN02 (time: 100 ms  scale: 1)
  6) SF_NNUE_GK (time: 100 ms  scale: 1)
  7) SF_NNUE_nightnurse (time: 100 ms  scale: 1)
  8) SF_NNUE_SV_2441 (time: 100 ms  scale: 1)
  9) Stockfish 10 (time: 100 ms  scale: 1)
 10) Stockfish 11 (time: 100 ms  scale: 1)
 11) Stockfish 6 (time: 100 ms  scale: 1)
 12) Stockfish 8 (time: 100 ms  scale: 1)
 13) Stockfish dev (time: 100 ms  scale: 1)
 14) Stockfish dev Bis (time: 100 ms  scale: 1)
 15) Andscacs (time: 100 ms  scale: 1)
 16) Komodo 14 (time: 100 ms  scale: 1)
 17) Ethereal (time: 100 ms  scale: 1)

         1     2     3     4     5     6     7     8     9    10    11    12    13    14    15    16    17
  1.  ----- 63.60 64.23 67.24 46.61 53.10 51.52 53.24 50.62 50.30 47.90 49.45 50.57 50.42 47.98 49.50 49.73
  2.  63.60 ----- 74.82 70.39 46.82 53.96 51.30 55.22 51.30 51.23 48.35 50.07 51.76 51.92 48.46 49.84 49.00
  3.  64.23 74.82 ----- 70.25 46.08 53.28 51.01 53.87 50.23 50.10 47.41 49.22 50.44 50.45 48.06 49.15 48.14
  4.  67.24 70.39 70.25 ----- 47.63 55.83 52.67 56.71 52.62 52.61 49.78 51.07 52.62 52.18 49.73 50.44 50.30
  5.  46.61 46.82 46.08 47.63 ----- 50.76 48.09 50.46 47.71 48.15 45.04 47.51 47.84 48.07 45.74 46.16 45.39
  6.  53.10 53.96 53.28 55.83 50.76 ----- 54.60 60.96 55.12 55.38 51.52 54.33 55.80 55.24 52.05 52.11 51.76
  7.  51.52 51.30 51.01 52.67 48.09 54.60 ----- 55.07 50.79 50.53 47.80 50.33 50.39 50.34 48.82 48.97 48.64
  8.  53.24 55.22 53.87 56.71 50.46 60.96 55.07 ----- 52.65 53.02 49.65 52.02 53.03 52.61 49.87 50.51 50.12
  9.  50.62 51.30 50.23 52.62 47.71 55.12 50.79 52.65 ----- 64.79 56.43 61.67 63.57 63.51 56.05 55.83 56.25
 10.  50.30 51.23 50.10 52.61 48.15 55.38 50.53 53.02 64.79 ----- 55.52 60.31 66.04 65.53 55.55 55.90 54.95
 11.  47.90 48.35 47.41 49.78 45.04 51.52 47.80 49.65 56.43 55.52 ----- 60.96 54.79 54.86 56.02 54.90 54.05
 12.  49.45 50.07 49.22 51.07 47.51 54.33 50.33 52.02 61.67 60.31 60.96 ----- 59.03 58.62 58.55 56.19 55.45
 13.  50.57 51.76 50.44 52.62 47.84 55.80 50.39 53.03 63.57 66.04 54.79 59.03 ----- 66.06 54.88 54.60 53.96
 14.  50.42 51.92 50.45 52.18 48.07 55.24 50.34 52.61 63.51 65.53 54.86 58.62 66.06 ----- 54.22 54.90 54.47
 15.  47.98 48.46 48.06 49.73 45.74 52.05 48.82 49.87 56.05 55.55 56.02 58.55 54.88 54.22 ----- 53.91 53.44
 16.  49.50 49.84 49.15 50.44 46.16 52.11 48.97 50.51 55.83 55.90 54.90 56.19 54.60 54.90 53.91 ----- 53.86
 17.  49.73 49.00 48.14 50.30 45.39 51.76 48.64 50.12 56.25 54.95 54.05 55.45 53.96 54.47 53.44 53.86 -----

Image
dkappe
Posts: 1632
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: NNUE engines will probably start to cluster in their own cluster. New dendrogram.

Post by dkappe »

I’m disappointed you didn’t include night nurse, lizardfish and toga III in your analysis, as none of those were trained from stockfish evals.

Edit: sorry. Oversight.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".