Great Performance of Ethereal NNUE

[mehmet123]

At TCEC Tournament Ethereal 13.88 NNUE finished League 1 with a great performance (30 / 44). At 6 months before the performance of Ethereal 13.56 is only 14.5/28 at Season 22 Leauge 1.
Ethereal NNUE could be 3rd in Super League ahead of Lc0.

[dkappe]

Well, Ethereal at CCC just won a game pair off of Stockfish. Interesting times.

[Jouni]

Looking from NCM testing SF progress after version 15 is +-0 ELO.

[dkappe]

Looking from NCM testing SF progress after version 15 is +-0 ELO.

https://nextchessmove.com/dev-builds

Perhaps you are reading the chart differently from me. The gain looks like 10-15 elo, though SF7 is maybe at the limit of what one can usefully test.

[mehmet123]

Looking from NCM testing SF progress after version 15 is +-0 ELO.

According to progress test elo difference is +5.45 elo at 8 threads test.
https://github.com/glinscott/fishtest/w ... sion-Tests

[Jouni]

In NCM 3 tests after v15 were 440 438 and 440. And now 3 latest 440 439 441. Tiny progress.

[Lazy_Frank]

Yesterday i had a little conversion with Jeroen Noomen in TCEC chat.
He said he believes Ethereal is clearly 4th best engine now.
I tend to agree.

[mehmet123]

In NCM 3 tests after v15 were 440 438 and 440. And now 3 latest 440 439 441. Tiny progress.

NCM test alone does not show the power of the engine.Stockfish 7 is very weak according to Stockfish 15. Stockfish 170222 is -19 elo weaker than Stockfish 130222 for NCM. But regression tests show +15.72 elo at VLTC (180'' + 1.8")
……....…......…...........................................
Author: Michael Chaly
Date: Thu Feb 17 20:45:21 2022 +0100
Timestamp: 1645127121

Tune search at very long time control

This patch is a result of tuning done by user @candirufish after 150k games.

Since the tuned values were really interesting and touched heuristics
that are known for their non-linear scaling I decided to run limited
games LTC match, even if the STC test was really bad (which was expected).
After seeing the results of the LTC match, I also run a VLTC (very long
time control) SPRTtest, which passed.

The main difference is in extensions: this patch allows much more
singular/double extensions, both in terms of allowing them at lower
depths and with lesser margins.

Failed STC:
https://tests.stockfishchess.org/tests/ ... 58c0cd3b46
LLR: -2.94 (-2.94,2.94) <0.00,2.50>
Total: 4968 W: 1194 L: 1398 D: 2376 Elo -14.27
Ptnml(0-2): 47, 633, 1294, 497, 13

Performed well at LTC in a fixed-length match:
https://tests.stockfishchess.org/tests/ ... 58c0cd3b4a
ELO: 3.36 +-1.8 (95%) LOS: 100.0%
Total: 30000 W: 7966 L: 7676 D: 14358 Elo +3.36
Ptnml(0-2): 36, 2936, 8755, 3248, 25

Passed VLTC SPRT test:
https://tests.stockfishchess.org/tests/ ... 7ec884f939
LLR: 2.96 (-2.94,2.94) <0.50,3.00>
Total: 4400 W: 1326 L: 1127 D: 1947 Elo +15.72
Ptnml(0-2): 13, 309, 1348, 526, 4

closes https://github.com/official-stockfish/S ... /pull/3937

Bench: 6318903

[Angle]

At TCEC Tournament Ethereal 13.88 NNUE finished League 1 with a great performance (30 / 44). At 6 months before the performance of Ethereal 13.56 is only 14.5/28 at Season 22 Leauge 1.

The most amazing thing for me is that Ethereal finished League 1 with only one(!) loss in 44 games vs Berserk, Rubi, Revenge, Seer, Koivisto, Minic, Scorpio, Arasan... Very impressive result!

Ethereal NNUE could be 3rd in Super League ahead of Lc0.

I would not rush to such conclusions. Let's see.

[mehmet123]

At TCEC Tournament Ethereal 13.88 NNUE finished League 1 with a great performance (30 / 44). At 6 months before the performance of Ethereal 13.56 is only 14.5/28 at Season 22 Leauge 1.

The most amazing thing for me is that Ethereal finished League 1 with only one(!) loss in 44 games vs Berserk, Rubi, Revenge, Seer, Koivisto, Minic, Scorpio, Arasan... Very impressive result!

Ethereal NNUE could be 3rd in Super League ahead of Lc0.

I would not rush to such conclusions. Let's see.

I was surprised by the poor performance of Koivisto (21.5 /44) at Leauge 1.
Koivisto was performing very well at TCEC tournaments. In the TCEC Cup 9 Tournament, Lc0 eliminated Koivisto at the end of the 28th game with a 14.5- 13.5 score.