What is Happening with Stockfish ?

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
Deberger
Posts: 91
Joined: Sat Nov 02, 2019 6:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

What is Happening with Stockfish ?

Post by Deberger »

1) Some recent changes show negative Elo !

https://github.com/glinscott/fishtest/w ... sion-Tests

2) Is there a moratorium on NNUE testing?

https://tests.stockfishchess.org/nns
Raphexon
Posts: 476
Joined: Sun Mar 17, 2019 12:00 pm
Full name: Henk Drost

Re: What is Happening with Stockfish ?

Post by Raphexon »

Not a lot of new nets to test.

There have been periods of drought before.
Tests are also done with a new book, elo gains for imbalanced openings may not always translate to elo for balanced openings.
User avatar
yurikvelo
Posts: 710
Joined: Sat Dec 06, 2014 1:53 pm

Re: What is Happening with Stockfish ?

Post by yurikvelo »

there was big change in fishtest framework - highly imbalanced openings like UHO_XXL_+0.90_+1.19.epd, which mean ~1.0 evaluation on starting position.
elo measurements with these kind of books might show slightly different result when tested with classical balanced and drawish 8moves_v3
Deberger wrote: Tue Oct 26, 2021 10:17 am 2) Is there a moratorium on NNUE testing?
press "show non-default nets" and see how many nets have been tested in fact: 108 nets were tested in fishtest after last successful net (not counting development and tests outside fishtest)
User avatar
Deberger
Posts: 91
Joined: Sat Nov 02, 2019 6:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

Re: What is Happening with Stockfish ?

Post by Deberger »

yurikvelo wrote: Tue Oct 26, 2021 10:51 pm 108 nets were tested in fishtest after last successful net (not counting development and tests outside fishtest)
Okay, more than 100 tests in 33 days, (from Sept 13 to Oct 16) - that's good.

However, for the past 16 days, (from Oct 16 to present) - no visible testing at all.

So I ask again:

Is there a moratorium on NNUE testing?

https://tests.stockfishchess.org/nns
User avatar
yurikvelo
Posts: 710
Joined: Sat Dec 06, 2014 1:53 pm

Re: What is Happening with Stockfish ?

Post by yurikvelo »