NNUE - Programmer and User Poll available

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
Rebel
Posts: 7468
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

NNUE - Programmer and User Poll available

Post by Rebel »

90% of coding is debugging, the other 10% is writing bugs.
Edsel Apostol
Posts: 803
Joined: Mon Jul 17, 2006 5:53 am
Full name: Edsel Apostol

Re: NNUE - Programmer and User Poll available

Post by Edsel Apostol »

Option #2 is not very clear. There are 2 ways to use the game collection here.

First one is just like how SF use the scored positions from Leela training games (scored by Leela itself? correct me if I am wrong). In this method, an engine can learn from the eval of another engine.

Second one is to just use these game collection/positions and score it by your own evaluation. This wouldn't learn the eval of another engine. I prefer this second way. I can just download all the games I could find in the net, score each position from my own engine, and use that for training.

If the purists wouldn't accept the second way for Option#2, it must also not be acceptable for them the way HCE tuners use a collection of games from CCRL or from lichess for example as they are played by other engines not their own, which most of the HCE tuners are doing nowadays.

Option #3 is very limiting. One needs to let his engine play against itself, for hundreds of thousands to millions of games, and it will take weeks of non-stop computing. That's a great barrier of entry for hobbyist programmers.
User avatar
hgm
Posts: 28441
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: NNUE - Programmer and User Poll available

Post by hgm »

There also is a difference between learning from evaluations, and learning from game results.
User avatar
Rebel
Posts: 7468
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: NNUE - Programmer and User Poll available

Post by Rebel »

Edsel Apostol wrote: Sun Jul 04, 2021 7:54 am
Option #2 is not very clear. There are 2 ways to use the game collection here.

First one is just like how SF use the scored positions from Leela training games (scored by Leela itself? correct me if I am wrong). In this method, an engine can learn from the eval of another engine.

Second one is to just use these game collection/positions and score it by your own evaluation. This wouldn't learn the eval of another engine. I prefer this second way. I can just download all the games I could find in the net, score each position from my own engine, and use that for training.

If the purists wouldn't accept the second way for Option#2, it must also not be acceptable for them the way HCE tuners use a collection of games from CCRL or from lichess for example as they are played by other engines not their own, which most of the HCE tuners are doing nowadays.

Option #3 is very limiting. One needs to let his engine play against itself, for hundreds of thousands to millions of games, and it will take weeks of non-stop computing. That's a great barrier of entry for hobbyist programmers.
Option 2 is in use as long as I can remember. Opening books, learning files were made from game collections. Games are public domain material.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Rebel
Posts: 7468
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: NNUE - Programmer and User Poll available

Post by Rebel »

Current voting :

Code: Select all

Programmer Poll               User Poll

Option      Vote   Perc       Option      Vote   Perc
Option 1     2    22.2%       Option 1     0       0% 
Option 2     5    55.5%       Option 2     3      50%
Option 3     2    22.2%       Option 3     3      50%

1. My preference is that programmers are allowed to use any existing network for their engine.
2. My preference is that programmers are allowed to use any game collection to create their own network.
3. My preference is that I am in favor that any programmer creates his own network either from human game collections or from his own engine.
Pretty poor regarding the number of votes.

I think it's important data for TD's and the rating list folks to make decisions regarding this complex issue.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Rebel
Posts: 7468
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: NNUE - Programmer and User Poll available

Post by Rebel »

Poll will close next Friday, July 9.
90% of coding is debugging, the other 10% is writing bugs.