The Great Stockfish NPS Debate

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

DrCliche
Posts: 65
Joined: Sun Aug 19, 2018 10:57 pm
Full name: Nickolas Reynolds

Re: The Great Stockfish NPS Debate

Post by DrCliche »

syzygy wrote: Sun Aug 29, 2021 2:59 amA horizon effect would mean that the search manages to push a tactical trick behind the search horizon, which seems rather unlikely here.
This may not be the standard/consensus definition among chess programmers, but I would say the horizon effect is when anything is pushed beyond the search horizon. In my view it need not be a tactical trick, it may simply be recognition of some positional feature, as well.

It does seem unlikely that any modernish A/B engine with quiescence search and tactics-oriented extension heuristics could be caught flat-footed by anything but the deepest tactics, but I could certainly see even Stockfish 14 failing to notice a relevant positional feature until it's much too late. There are still test positions and puzzles that Stockfish needs a helping hand to solve.
Ferdy
Posts: 4851
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: The Great Stockfish NPS Debate

Post by Ferdy »

dkappe wrote: Thu Aug 26, 2021 9:40 pm With the Stockfish nets getting ever bigger, a small but vocal minority has voiced concern that a drop in NPS could somehow harm its fitness as a chess engine. Maybe it is vulnerable to being “outsearched” by a strong, nimble competitor.

I decided to run a test with SF10 against its successors to see if the slower ones do suffer from some sort of horizon effect and fall off a cliff. The conclusion? Nope. The bigger the net, the more resistant the SF version seems to be to being outsearched.

Image

The full article can be found here. https://github.com/dkappe/leela-chess-w ... NPS-Debate
It is more like -- it is outsearched but not outplayed.
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: The Great Stockfish NPS Debate

Post by MikeB »

NPS has been overated for a long long time.
Image