Here is a test with all Minic nets again (more info about the nets here :
https://github.com/tryingsomestuff/NNUE-Nets)
Code: Select all
Rank Name Elo +/- Games Score Draw
1 minic_2.53_nn-97f742aaefcd 273 17 1488 82.8% 26.3%
2 minic_2.53_napping_nexus 180 15 1488 73.8% 33.5%
3 minic_2.53_nascent_nutrient 71 14 1488 60.1% 38.0%
4 minic_3.02_nettling_nemesis 26 14 1488 53.8% 36.0%
5 minic_3.08 24 14 1488 53.4% 41.4%
6 minic_3.07 3 13 1488 50.4% 41.6%
7 minic_3.06_nocturnal_nadir -31 14 1487 45.5% 40.9%
8 minic_3.05_nibbled_nutshell -34 14 1487 45.2% 36.4%
9 minic_3.04_noisy_notch -65 14 1487 40.8% 40.2%
10 minic_3.03_niggling_nymph -110 15 1487 34.7% 34.9%
11 minic_3.02_narcotized_nightshift -120 15 1488 33.3% 34.8%
12 minic_3.01_nefarious_nucleus -211 17 1488 22.9% 25.7%
So clearly there is two blocks, the 3 MinicNNUE2.53 nets and a lower ratings Minic3 nets.
"nettling nemesis", is a net based on SF data, and is still the strongest (unofficial) Minic 3 net.
Good news it the very good progress between "nefarious nucleus" (that played TCECS20) and "naive nostalgia" (embeded in Minic 3.07) that is playing TCEC S21 currently. This a a more than 200Elo progress.
On Minic3 NNUE architecture, most recent net "negligible nystagmus" is playing nearly at the same level as "nettling nemesis" (based on SF data), this probably means that not much progress can now be done without changing seriously the net.
The "nibbled nutshell" net is such a net with a different topology (much smaller one) and is performing good at short TC but not a longer ones.
Finally the halfpk SF architecture and code used in Minic 2.53 is still quite far away from current Minic3 status, with some 250Elo gap between current Minic3.08 and MinicNNUE2.53 using the best SV net (back in september 2020).
So let's go back to work ...