Policy networks in search

Discussion of chess software programming and technical issues.

Moderator: Ras

Madeleine Birchfield
Posts: 512
Joined: Tue Sep 29, 2020 4:29 pm
Location: Dublin, Ireland
Full name: Madeleine Birchfield

Policy networks in search

Post by Madeleine Birchfield »

It is well known that one could replace the move ordering heuristic code in an engine's alpha-beta search with a policy neural network. What other selectivity heuristics (pruning, extensions, etc) could also be replaced by the policy network?
smatovic
Posts: 3474
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: Policy networks in search

Post by smatovic »

IMO you can replace all HCSH (handcrafted search heuristics) with neural networks, it just a matter of the the extra compute time needed for nn inference during search, bigger/multiple nets vs. deeper search, a tradeoff.

--
Srdja