Stockfish: what are recent game sources for NNUE?

Discussion of chess software programming and technical issues.

Moderator: Ras

User avatar
phhnguyen
Posts: 1537
Joined: Wed Apr 21, 2010 4:58 am
Location: Australia
Full name: Nguyen Hong Pham

Stockfish: what are recent game sources for NNUE?

Post by phhnguyen »

Just a curious question: what are the recent/new game sources for training new NNUEs of SF?

I knew SF code has a specific branch (tools) to create training games from self-play, but that branch has not been updated in a few years, and it can't run with recent SF code/NNUE. I knew the Lc0 team created a large database (for NNUE training) a few years ago. Thus, I don’t know what/where the new game sources for NNUE training are for recent SF versions.

(Many people suggested using SF Discord to ask about SF, but I have some bad experiences with it since some of my questions scrolled up and disappeared quickly, and some other questions got no answer for a very long time.)
https://banksiagui.com
The most features chess GUI, based on opensource Banksia - the chess tournament manager
jdart
Posts: 4423
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Stockfish: what are recent game sources for NNUE?

Post by jdart »

lc0 data can be obtained from here: https://storage.lczero.org/files/training_data/.

In addition, Linmiao Xu aka linrock has posted some datasets in bullet format here: https://huggingface.co/linrock. These go up to 2024 and don't have the latest lc0 data. I have had no luck converting the latest lc0 data to bullet: I think the lc0 data format has changed and the converter (https://github.com/linrock/lc0-data-converter) has not been updated to read it properly.