Dispelling the Myth of NNUE with LazySMP: An Analysis

[mwyoung]

Stockfish gained an inordinate amount of strength with the introduction of NNUE, as did all engines which have followed in Stockfish's footsteps.

Not Schooner, which attempted the CFish NNUE port. Schooner achieved a large -40 elo loss. Work on NNUE has been abandoned for the moment, but I may look at it again in the future.

If you lose elo with SF's NNUE, you surely must have done something wrong? Bad conditions to run it? No attempts to scale it? Not using AVX(/2) builds? Not using official SF networks?

Official SF nets might be the problem. Since I have not finished my own tuning efforts (who can finish?), I tried:

nn-03744f8d56d8.nnue
nn-82215d0fd0df.nnue
nn-eba324f53044.nnue

AVX is on the agenda to look at. My hardware is supposed to handle it, but does it make that much difference?

If you have followed this thread. The truth is no. Unless your NNUE engine will also scale well like Ethereal. You will have to test.

[AndrewGrant]

AVX is on the agenda to look at. My hardware is supposed to handle it, but does it make that much difference?

If you did not also update your makefile to match CFish, then you compiled basic forloops for everything, and the result was probably 5x slower than it should be. What is your NPS on Schooner normally? What was your NPS running an SF NN?

[D Sceviour]

AVX is on the agenda to look at. My hardware is supposed to handle it, but does it make that much difference?

If you did not also update your makefile to match CFish, then you compiled basic forloops for everything, and the result was probably 5x slower than it should be. What is your NPS on Schooner normally? What was your NPS running an SF NN?

Big difference.

nps: 139012 NNUE composite
nps: 2289469 alpha-beta SSE

What should be expected?

[AndrewGrant]

AVX is on the agenda to look at. My hardware is supposed to handle it, but does it make that much difference?

If you did not also update your makefile to match CFish, then you compiled basic forloops for everything, and the result was probably 5x slower than it should be. What is your NPS on Schooner normally? What was your NPS running an SF NN?

Big difference.

nps: 139012 NNUE composite
nps: 2289469 alpha-beta SSE

What should be expected?

I lose about 30% speed when I copy pasted SF's 2x256 nets. I lose about 15% using a 2x128 Net.
You are losing 95%. That is why you lost elo. Go look at CFish's makefile, and set some flags to match the nnue files.

[D Sceviour]

AVX is on the agenda to look at. My hardware is supposed to handle it, but does it make that much difference?

If you did not also update your makefile to match CFish, then you compiled basic forloops for everything, and the result was probably 5x slower than it should be. What is your NPS on Schooner normally? What was your NPS running an SF NN?

Big difference.

nps: 139012 NNUE composite
nps: 2289469 alpha-beta SSE

What should be expected?

I lose about 30% speed when I copy pasted SF's 2x256 nets. I lose about 15% using a 2x128 Net.
You are losing 95%. That is why you lost elo. Go look at CFish's makefile, and set some flags to match the nnue files.

OK! Got it. I will look at that maybe in the new year. My project for today is creating a program to disassemble polyglot books. Somebody said that program does not exist. If not, it will exist shortly.

[AndrewGrant]

Testing Ethereal TCEC (2x128 NNUE) vs Ethereal Master (12.82, not NNUE)

Code: Select all

10.0s+0.1s
Ethereal-NNUE-1C vs Ethereal-1C : 1380 - 663 - 1457  [0.602] 3500 +72
Ethereal-NNUE-2C vs Ethereal-2C : 1925 - 797 - 2278  [0.613] 5000 +80
Ethereal-NNUE-4C vs Ethereal-4C :  370 - 169 -  461  [0.601] 1000 +71

This test is a more direct comparison of scaling, and shows that the NNUE branch scales about the same as the non-NNUE branch. In 3 different core count configurations, (1, 2, and 4), Ethereal NNUE beats Ethereal non-NNUE by approx +70 elo. Note that this +70 is not an important number. The important point is that the 1-thread vs 1-thread test yielded near equal results to the 2-thread vs 2-thread, and the 4-thread vs 4-thread test, suggesting that despite wildly different evaluation functions, both versions scale in a similar if not exact fashion.

As of now, I've seen no conclusive evidence that NNUE causes engines to scale poorly, nor am I sold that engines even have different scaling when replacing their evaluation function with Shogi halfkp NNs. What say you, naysayer? Why am I seeing what I am seeing?

[Michel]

OK! Got it. I will look at that maybe in the new year. My project for today is creating a program to disassemble polyglot books. Somebody said that program does not exist. If not, it will exist shortly.

Look at the polyglot option dump-book. This may be what you want. Below some sample output.

Code: Select all

Dump of "performance.bin" for white.
1: 1. e4{33%} a6 2. d4{100%} b5 3. Nf3{64%} e6 4. Bd3{100%} Bb7 5. O-O{75%} c5 6. c3{100%} Nf6 7. Re1{100%} 
2: 1. e4{33%} a6 2. d4{100%} b5 3. Nf3{64%} e6 4. Bd3{100%} Bb7 5. Qe2{25%} 
3: 1. e4{33%} a6 2. d4{100%} b5 3. Nf3{64%} Bb7 4. Bd3{100%} e6 {trans: line=1, ply=8}
4: 1. e4{33%} a6 2. d4{100%} b5 3. Bd3{36%} Bb7 4. Nf3{100%} {trans: line=3, ply=7}
5: 1. e4{33%} a6 2. d4{100%} e6 3. Nf3{56%} b5 {trans: line=1, ply=6}
6: 1. e4{33%} a6 2. d4{100%} e6 3. Nf3{56%} c5 4. c3{100%} d5 5. e5{100%} Bd7 6. Bd3{100%} cxd4 7. Nxd4{100%} Nc6 8. Nxc6{100%} 
7: 1. e4{33%} a6 2. d4{100%} e6 3. Bd3{44%} 
8: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Qe2{61%} cxd4 7. cxd4{100%} 
9: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Qe2{61%} d5 7. e5{100%} 
10: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Qe2{61%} Be7 7. O-O{100%} d5 8. e5{100%} Nfd7 9. a3{100%} 
11: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Qe2{61%} Be7 7. O-O{100%} Nc6 8. a3{100%} 
12: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Nbd2{22%} cxd4 7. cxd4{100%} 
13: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Nbd2{22%} d5 7. e5{100%} 
14: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Nbd2{22%} Nc6 7. a3{100%} d5 8. e5{100%} Nd7 9. O-O{100%} 
15: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Nbd2{22%} Be7 7. O-O{100%} cxd4 8. cxd4{100%} Ba6 9. Bxa6{100%} Nxa6 10. Qe2{100%} Nc7 11. d5{100%} d6 12. dxe6{100%} 
16: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. e5{18%} 
17: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. O-O{13%} cxd4 6. Nxd4{100%} a6 7. c4{100%} 
18: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} d6 5. O-O{68%} Nd7 6. c4{100%} 
19: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} d6 5. c4{32%} Nd7 6. Nc3{100%} 
20: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} g6 5. Bg5{100%} 
...
...

[Guenther]

OK! Got it. I will look at that maybe in the new year. My project for today is creating a program to disassemble polyglot books. Somebody said that program does not exist. If not, it will exist shortly.

Look at the polyglot option dump-book. This may be what you want. Below some sample output.

Code: Select all

Dump of "performance.bin" for white.
1: 1. e4{33%} a6 2. d4{100%} b5 3. Nf3{64%} e6 4. Bd3{100%} Bb7 5. O-O{75%} c5 6. c3{100%} Nf6 7. Re1{100%} 
2: 1. e4{33%} a6 2. d4{100%} b5 3. Nf3{64%} e6 4. Bd3{100%} Bb7 5. Qe2{25%} 
3: 1. e4{33%} a6 2. d4{100%} b5 3. Nf3{64%} Bb7 4. Bd3{100%} e6 {trans: line=1, ply=8}
4: 1. e4{33%} a6 2. d4{100%} b5 3. Bd3{36%} Bb7 4. Nf3{100%} {trans: line=3, ply=7}
5: 1. e4{33%} a6 2. d4{100%} e6 3. Nf3{56%} b5 {trans: line=1, ply=6}
6: 1. e4{33%} a6 2. d4{100%} e6 3. Nf3{56%} c5 4. c3{100%} d5 5. e5{100%} Bd7 6. Bd3{100%} cxd4 7. Nxd4{100%} Nc6 8. Nxc6{100%} 
7: 1. e4{33%} a6 2. d4{100%} e6 3. Bd3{44%} 
8: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Qe2{61%} cxd4 7. cxd4{100%} 
9: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Qe2{61%} d5 7. e5{100%} 
10: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Qe2{61%} Be7 7. O-O{100%} d5 8. e5{100%} Nfd7 9. a3{100%} 
11: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Qe2{61%} Be7 7. O-O{100%} Nc6 8. a3{100%} 
12: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Nbd2{22%} cxd4 7. cxd4{100%} 
13: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Nbd2{22%} d5 7. e5{100%} 
14: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Nbd2{22%} Nc6 7. a3{100%} d5 8. e5{100%} Nd7 9. O-O{100%} 
15: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. Nbd2{22%} Be7 7. O-O{100%} cxd4 8. cxd4{100%} Ba6 9. Bxa6{100%} Nxa6 10. Qe2{100%} Nc7 11. d5{100%} d6 12. dxe6{100%} 
16: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. c3{87%} Nf6 6. e5{18%} 
17: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} c5 5. O-O{13%} cxd4 6. Nxd4{100%} a6 7. c4{100%} 
18: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} d6 5. O-O{68%} Nd7 6. c4{100%} 
19: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} d6 5. c4{32%} Nd7 6. Nc3{100%} 
20: 1. e4{33%} b6 2. d4{100%} e6 3. Nf3{57%} Bb7 4. Bd3{100%} g6 5. Bg5{100%} 
...
...

@Andrew sorry for this offspring about polyglot book dump (started by Denis), may be the thread could be split up?

@Michel
No one ever answered my post about book dump not working correctly in most cases on Windows (at least).
Note that I am mostly interested in the first part not working (cut off lines from the dump file)

http://talkchess.com/forum3/viewtopic.p ... mp#p718824

I tried to compile Polyglot on my machine (latest snapshot from HGMs repo) today, but it gave me errors due to multiple definitions
of pg_header and pg_header magic IIRC.

Here is a very simple example for what is going on here with the dump file not written correctly:
It looks like Polyglot always already exits before the dump is fully written?

Any idea for a fix?

Code: Select all

[Event "?"]
[Site "?"]
[Date "2013.11.03"]
[Number "1"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A01"]
[PlyCount "12"]

1. b3 e5 2. Bb2 Nc6 3. e3 d6 4. Nf3 Nf6 5. d3 Be7 6. Be2 O-O 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "2"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A33"]
[PlyCount "12"]

1. c4 c5 2. Nf3 Nf6 3. Nc3 Nc6 4. d4 cxd4 5. Nxd4 e6 6. Ndb5 d5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "3"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A38"]
[PlyCount "12"]

1. c4 c5 2. g3 Nc6 3. Bg2 g6 4. Nc3 Bg7 5. Nf3 Nf6 6. O-O O-O 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "4"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A25"]
[PlyCount "12"]

1. c4 e5 2. Nc3 Nc6 3. g3 f5 4. Bg2 Nf6 5. d3 Bc5 6. e3 O-O 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "5"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A29"]
[PlyCount "12"]

1. c4 e5 2. Nc3 Nf6 3. Nf3 Nc6 4. g3 Bb4 5. Bg2 O-O 6. O-O Re8 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "6"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A29"]
[PlyCount "12"]

1. c4 e5 2. Nc3 Nf6 3. g3 Bb4 4. Bg2 O-O 5. Nf3 Nc6 6. O-O d6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "7"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A29"]
[PlyCount "12"]

1. c4 e5 2. g3 Nf6 3. Bg2 d5 4. cxd5 Nxd5 5. Nc3 Nb6 6. Nf3 Nc6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "8"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D27"]
[PlyCount "12"]

1. d4 d5 2. c4 dxc4 3. Nf3 Nf6 4. e3 e6 5. Bxc4 c5 6. O-O a6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "9"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D45"]
[PlyCount "12"]

1. d4 d5 2. c4 c6 3. Nf3 Nf6 4. Nc3 e6 5. e3 Nbd7 6. Qc2 Bd6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "10"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D46"]
[PlyCount "12"]

1. d4 d5 2. c4 c6 3. Nf3 Nf6 4. Nc3 e6 5. e3 Nbd7 6. Bd3 dxc4 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "11"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D33"]
[PlyCount "12"]

1. d4 d5 2. c4 e6 3. Nc3 c5 4. cxd5 exd5 5. Nf3 Nc6 6. g3 Nf6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "12"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D35"]
[PlyCount "12"]

1. d4 d5 2. c4 e6 3. Nc3 Nf6 4. cxd5 exd5 5. Nf3 c6 6. Bf4 Bd6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "13"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D53"]
[PlyCount "12"]

1. d4 d5 2. c4 e6 3. Nc3 Nf6 4. Bg5 Be7 5. Nf3 h6 6. Bh4 O-O 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "14"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D37"]
[PlyCount "12"]

1. d4 d5 2. c4 e6 3. Nf3 Nf6 4. Nc3 Be7 5. Bf4 O-O 6. e3 c5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "15"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D30"]
[PlyCount "12"]

1. d4 d5 2. Nf3 Nf6 3. c4 e6 4. e3 Be7 5. Bd3 O-O 6. b3 b6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "16"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A84"]
[PlyCount "12"]

1. d4 f5 2. c4 e6 3. Nc3 Nf6 4. Nf3 Bb4 5. g3 b6 6. Bg2 Bb7 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "17"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A90"]
[PlyCount "12"]

1. d4 f5 2. g3 Nf6 3. Bg2 e6 4. c4 d5 5. Nf3 c6 6. O-O Bd6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "18"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "E32"]
[PlyCount "12"]

1. d4 Nf6 2. c4 e6 3. Nc3 Bb4 4. Qc2 O-O 5. a3 Bxc3+ 6. Qxc3 b6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "19"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "E48"]
[PlyCount "12"]

1. d4 Nf6 2. c4 e6 3. Nc3 Bb4 4. e3 O-O 5. Bd3 c5 6. Nge2 d5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "20"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "E53"]
[PlyCount "12"]

1. d4 Nf6 2. c4 e6 3. Nc3 Bb4 4. e3 O-O 5. Bd3 d5 6. Nf3 c5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "21"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "E24"]
[PlyCount "12"]

1. d4 Nf6 2. c4 e6 3. Nc3 Bb4 4. f3 d5 5. a3 Bxc3+ 6. bxc3 c5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "22"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "E12"]
[PlyCount "12"]

1. d4 Nf6 2. c4 e6 3. Nf3 b6 4. a3 Bb7 5. Nc3 d5 6. cxd5 Nxd5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "23"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "E15"]
[PlyCount "12"]

1. d4 Nf6 2. c4 e6 3. Nf3 b6 4. g3 Ba6 5. b3 Bb4+ 6. Bd2 Be7 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "24"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "E17"]
[PlyCount "12"]

1. d4 Nf6 2. c4 e6 3. Nf3 b6 4. g3 Bb7 5. Bg2 Be7 6. O-O O-O 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "25"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D85"]
[PlyCount "12"]

1. d4 Nf6 2. c4 g6 3. Nc3 d5 4. cxd5 Nxd5 5. e4 Nxc3 6. bxc3 Bg7 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "26"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D96"]
[PlyCount "12"]

1. d4 Nf6 2. c4 g6 3. Nc3 d5 4. Nf3 Bg7 5. Qb3 dxc4 6. Qxc4 O-O 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "27"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D92"]
[PlyCount "12"]

1. d4 Nf6 2. c4 g6 3. Nc3 d5 4. Bf4 Bg7 5. Nf3 O-O 6. Rc1 dxc4 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "28"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "E85"]
[PlyCount "12"]

1. d4 Nf6 2. c4 g6 3. Nc3 Bg7 4. e4 d6 5. f3 O-O 6. Be3 e5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "29"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "E92"]
[PlyCount "12"]

1. d4 Nf6 2. c4 g6 3. Nc3 Bg7 4. e4 d6 5. Nf3 O-O 6. Be2 e5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.25"]
[Number "30"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A31"]
[PlyCount "12"]

1. d4 Nf6 2. Nf3 c5 3. c4 cxd4 4. Nxd4 Nc6 5. Nc3 e6 6. e3 Qb6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "31"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B25"]
[PlyCount "12"]

1. e4 c5 2. Nc3 Nc6 3. g3 g6 4. Bg2 Bg7 5. d3 d6 6. f4 e6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "32"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B26"]
[PlyCount "12"]

1. e4 c5 2. Nc3 Nc6 3. g3 g6 4. Bg2 Bg7 5. d3 e6 6. Be3 d6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "33"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B22"]
[PlyCount "12"]

1. e4 c5 2. c3 d5 3. exd5 Qxd5 4. d4 e6 5. Nf3 Nf6 6. Be2 Nc6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "34"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B22"]
[PlyCount "12"]

1. e4 c5 2. c3 Nf6 3. e5 Nd5 4. d4 cxd4 5. Nf3 Nc6 6. cxd4 d6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "35"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B30"]
[PlyCount "12"]

1. e4 c5 2. Nf3 Nc6 3. Bb5 e6 4. Nc3 Nge7 5. O-O a6 6. Bxc6 Nxc6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "36"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B34"]
[PlyCount "12"]

1. e4 c5 2. Nf3 Nc6 3. d4 cxd4 4. Nxd4 g6 5. Nc3 Bg7 6. Be3 Nf6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.21"]
[Number "37"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B38"]
[PlyCount "12"]

1. e4 c5 2. Nf3 Nc6 3. d4 cxd4 4. Nxd4 g6 5. c4 Bg7 6. Be3 Nf6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "38"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B52"]
[PlyCount "12"]

1. e4 c5 2. Nf3 d6 3. Bb5+ Bd7 4. Bxd7+ Qxd7 5. O-O Nc6 6. c3 Nf6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "39"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B62"]
[PlyCount "12"]

1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Nxd4 Nc6 5. Nc3 Nf6 6. Bg5 e6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "40"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B86"]
[PlyCount "12"]

1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Nxd4 Nf6 5. Nc3 a6 6. Bc4 e6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "41"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B92"]
[PlyCount "12"]

1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Nxd4 Nf6 5. Nc3 a6 6. Be2 e5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "42"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B84"]
[PlyCount "12"]

1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Nxd4 Nf6 5. Nc3 a6 6. Be2 e6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "43"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B90"]
[PlyCount "12"]

1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Nxd4 Nf6 5. Nc3 a6 6. h3 e6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "44"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B72"]
[PlyCount "12"]

1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Nxd4 Nf6 5. Nc3 g6 6. Be3 Bg7 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "45"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B45"]
[PlyCount "12"]

1. e4 c5 2. Nf3 e6 3. d4 cxd4 4. Nxd4 Nc6 5. Nc3 Nf6 6. a3 Be7 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "46"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B18"]
[PlyCount "12"]

1. e4 c6 2. d4 d5 3. Nc3 dxe4 4. Nxe4 Bf5 5. Ng3 Bg6 6. h4 h6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "47"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B12"]
[PlyCount "12"]

1. e4 c6 2. d4 d5 3. e5 c5 4. dxc5 e6 5. Be3 Nd7 6. Nc3 Nxe5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "48"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B12"]
[PlyCount "12"]

1. e4 c6 2. d4 d5 3. e5 Bf5 4. Nc3 e6 5. g4 Bg6 6. Nge2 c5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.25"]
[Number "49"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "B08"]
[PlyCount "12"]

1. e4 d6 2. d4 Nf6 3. Nc3 g6 4. Nf3 Bg7 5. Be2 O-O 6. O-O c5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "50"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C24"]
[PlyCount "12"]

1. e4 e5 2. Bc4 Nf6 3. d3 Bc5 4. Nf3 d6 5. c3 Bb6 6. Nbd2 O-O 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.21"]
[Number "51"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C78"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nc6 3. Bb5 a6 4. Ba4 Nf6 5. O-O b5 6. Bb3 Bb7 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "52"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C80"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nc6 3. Bb5 a6 4. Ba4 Nf6 5. O-O Nxe4 6. d4 b5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "53"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C87"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nc6 3. Bb5 a6 4. Ba4 Nf6 5. O-O Be7 6. Re1 b5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "54"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C69"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nc6 3. Bb5 a6 4. Bxc6 dxc6 5. O-O f6 6. d4 Bg4 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.21"]
[Number "55"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C65"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nc6 3. Bb5 Nf6 4. d3 Bc5 5. O-O d6 6. c3 O-O 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "56"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C67"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nc6 3. Bb5 Nf6 4. O-O Nxe4 5. d4 Nd6 6. Bxc6 dxc6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "57"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C55"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nc6 3. Bc4 Nf6 4. d3 Be7 5. O-O O-O 6. Bb3 d6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "58"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C45"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nc6 3. d4 exd4 4. Nxd4 Bc5 5. Nxc6 Qf6 6. Qd2 dxc6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "59"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C45"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nc6 3. d4 exd4 4. Nxd4 Bc5 5. Be3 Qf6 6. c3 Nge7 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "60"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C43"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nf6 3. d4 exd4 4. e5 Ne4 5. Qxd4 d5 6. exd6 Nxd6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.21"]
[Number "61"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C42"]
[PlyCount "12"]

1. e4 e5 2. Nf3 Nf6 3. Nxe5 d6 4. Nf3 Nxe4 5. d4 d5 6. Bd3 Nc6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "62"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C39"]
[PlyCount "12"]

1. e4 e5 2. f4 exf4 3. Nf3 g5 4. h4 g4 5. Ne5 Nf6 6. Bc4 d5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "63"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C18"]
[PlyCount "12"]

1. e4 e6 2. d4 d5 3. Nc3 Bb4 4. e5 c5 5. a3 Bxc3+ 6. bxc3 Ne7 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "64"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C06"]
[PlyCount "12"]

1. e4 e6 2. d4 d5 3. Nd2 Nf6 4. e5 Nfd7 5. Bd3 c5 6. c3 Nc6 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.21"]
[Number "65"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "C02"]
[PlyCount "12"]

1. e4 e6 2. d4 d5 3. e5 c5 4. c3 Nc6 5. Nf3 Qb6 6. a3 Bd7 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2014.03.22"]
[Number "66"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A30"]
[PlyCount "12"]

1. Nf3 c5 2. c4 Nf6 3. g3 b6 4. Bg2 Bb7 5. O-O e6 6. Nc3 Be7 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "67"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "D30"]
[PlyCount "12"]

1. Nf3 d5 2. c4 c6 3. d4 e6 4. Nbd2 Nf6 5. g3 Be7 6. Bg2 O-O 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "68"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A13"]
[PlyCount "12"]

1. Nf3 d5 2. c4 e6 3. b3 Be7 4. Bb2 Bf6 5. Nc3 c5 6. cxd5 exd5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Number "69"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A14"]
[PlyCount "12"]

1. Nf3 d5 2. c4 e6 3. g3 Nf6 4. Bg2 Be7 5. b3 O-O 6. O-O c5 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2013.11.03"]
[Number "70"]
[White "?"]
[Black "?"]
[Result "1/2-1/2"]
[ECO "A11"]
[PlyCount "12"]

1. g3 Nf6 2. Bg2 d5 3. Nf3 c6 4. O-O Bg4 5. d3 Nbd7 6. c4 e6 1/2-1/2

Code: Select all

polyglot make-book -pgn GS70.pgn -min-game 1 -max-ply 12 -bin GS70.bin

Code: Select all

Dump of "GS70.bin" for white.
1: 1. e4{50%} c6 2. d4{100%} d5 3. e5{67%} c5 4. dxc5{100%} e6 5. Be3{100%} Nd7 6. Nc3{100%} 
2: 1. e4{50%} c6 2. d4{100%} d5 3. e5{67%} Bf5 4. Nc3{100%} e6 5. g4{100%} Bg6 6. Nge2{100%} 
3: 1. e4{50%} c6 2. d4{100%} d5 3. Nc3{33%} dxe4 4. Nxe4{100%} Bf5 5. Ng3{100%} Bg6 6. h4{100%} 
4: 1. e4{50%} c5 2. Nf3{73%} d6 3. d4{86%} cxd4 4. Nxd4{100%} Nc6 5. Nc3{100%} Nf6 6. Bg5{100%} 
5: 1. e4{50%} c5 2. Nf3{73%} d6 3. d4{86%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} a6 6. Be2{50%} 
6: 1. e4{50%} c5 2. Nf3{73%} d6 3. d4{86%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} a6 6. h3{25%} 
7: 1. e4{50%} c5 2. Nf3{73%} d6 3. d4{86%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} a6 6. Bc4{25%} 
8: 1. e4{50%} c5 2. Nf3{73%} d6 3. d4{86%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} g6 6. Be3{100%} 
9: 1. e4{50%} c5 2. Nf3{73%} d6 3. d4{86%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} Nc6 {trans: line=4, ply=10}
10: 1. e4{50%} c5 2. Nf3{73%} d6 3. Bb5+{14%} Bd7 4. Bxd7+{100%} Qxd7 5. O-O{100%} Nc6 6. c3{100%} 
11: 1. e4{50%} c5 2. Nf3{73%} e6 3. d4{100%} cxd4 4. Nxd4{100%} Nc6 5. Nc3{100%} Nf6 6. a3{100%} 
12: 1. e4{50%} c5 2. Nf3{73%} Nc6 3. d4{67%} cxd4 4. Nxd4{100%} d6 {trans: line=4, ply=8}
13: 1. e4{50%} c5 2. Nf3{73%} Nc6 3. d4{67%} cxd4 4. Nxd4{100%} e6 {trans: line=11, ply=8}
14: 1. e4{50%} c5 2. Nf3{73%} Nc6 3. d4{67%} cxd4 4. Nxd4{100%} g6 5. c4{50%} Bg7 6. Be3{100%} 
15: 1. e4{50%} c5 2. Nf3{73%} Nc6 3. d4{67%} cxd4 4. Nxd4{100%} g6 5. Nc3{50%} Bg7 6. Be3{100%} 
16: 1. e4{50%} c5 2. Nf3{73%} Nc6 3. Bb5{33%} e6 4. Nc3{100%} Nge7 5. O-O{100%} a6 6. Bxc6{100%} 
17: 1. e4{50%} c5 2. c3{13%} d5 3. exd5{100%} Qxd5 4. d4{100%} e6 5. Nf3{100%} Nf6 6. Be2{100%} 
18: 1. e4{50%} c5 2. c3{13%} Nf6 3. e5{100%} Nd5 4. d4{100%} cxd4 5. Nf3{100%} Nc6 6. cxd4{100%} 
19: 1. e4{50%} c5 2. Nc3{13%} Nc6 3. g3{100%} g6 4. Bg2{100%} Bg7 5. d3{100%} d6 6. f4{100%} 
20: 1. e4{50%} c5 2. Nc3{13%} Nc6 3. g3{100%} g6 4. Bg2{100%} Bg7 5. d3{100%} e6 6. Be3{100%} 
21: 1. e4{50%} d6 2. d4{100%} Nf6 3. Nc3{100%} g6 4. Nf3{100%} Bg7 5. Be2{100%} O-O 6. O-O{100%} 
22: 1. e4{50%} e6 2. d4{100%} d5 3. Nc3{33%} Bb4 4. e5{100%} c5 5. a3{100%} Bxc3+ 6. bxc3{100%} 
23: 1. e4{50%} e6 2. d4{100%} d5 3. Nd2{33%} Nf6 4. e5{100%} Nfd7 5. Bd3{100%} c5 6. c3{100%} 
24: 1. e4{50%} e6 2. d4{100%} d5 3. e5{33%} c5 4. c3{100%} Nc6 5. Nf3{100%} Qb6 6. a3{100%} 
25: 1. e4{50%} e5 2. Nf3{85%} Nc6 3. Bb5{67%} a6 4. Ba4{75%} Nf6 5. O-O{100%} b5 6. Bb3{100%} 
26: 1. e4{50%} e5 2. Nf3{85%} Nc6 3. Bb5{67%} a6 4. Ba4{75%} Nf6 5. O-O{100%} Be7 6. Re1{100%} 
27: 1. e4{50%} e5 2. Nf3{85%} Nc6 3. Bb5{67%} a6 4. Ba4{75%} Nf6 5. O-O{100%} Nxe4 6. d4{100%} 
28: 1. e4{50%} e5 2. Nf3{85%} Nc6 3. Bb5{67%} a6 4. Bxc6{25%} dxc6 5. O-O{100%} f6 6. d4{100%} 
29: 1. e4{50%} e5 2. Nf3{85%} Nc6 3. Bb5{67%} Nf6 4. d3{50%} Bc5 5. O-O{100%} d6 6. c3{100%} 
30: 1. e4{50%} e5 2. Nf3{85%} Nc6 3. Bb5{67%} Nf6 4. O-O{50%} Nxe4 5. d4{100%} Nd6 6. Bxc6{100%} 
31: 1. e4{50%} e5 2. Nf3{85%} Nc6 3. d4{22%} exd4 4. Nxd4{100%} Bc5 5. Be3{50%} Qf6 6. c3{100%} 
32: 1. e4{50%} e5 2. Nf3{85%} Nc6 3. d4{22%} exd4 4. Nxd4{100%} Bc5 5. Nxc6{50%} Qf6 6. Qd2{100%} 
33: 1. e4{50%} e5 2. Nf3{85%} Nc6 3. Bc4{11%} Nf6 4. d3{100%} Be7 5. O-O{100%} O-O 6. Bb3{100%} 
34: 1. e4{50%} e5 2. Nf3{85%} Nf6 3. Nxe5{50%} d6 4. Nf3{100%} Nxe4 5. d4{100%} d5 6. Bd3{100%} 
35: 1. e4{50%} e5 2. Nf3{85%} Nf6 3. d4{50%} exd4 4. e5{100%} Ne4 5. Qxd4{100%} d5 6. exd6{100%} 
36: 1. e4{50%} e5 2. Bc4{8%} Nf6 3. d3{100%} Bc5 4. Nf3{100%} d6 5. c3{100%} Bb6 6. Nbd2{100%} 
37: 1. e4{50%} e5 2. f4{8%} exf4 3. Nf3{100%} g5 4. h4{100%} g4 5. Ne5{100%} Nf6 6. Bc4{100%} 
38: 1. d4{33%} d5 2. c4{88%} c6 3. Nf3{100%} e6 4. Nbd2{100%} Nf6 5. g3{100%} Be7 6. Bg2{100%} 
39: 1. d4{33%} d5 2. c4{88%} c6 3. Nf3{100%} Nf6 4. Nc3{100%} e6 5. e3{100%} Nbd7 6. Bd3{50%} 
40: 1. d4{33%} d5 2. c4{88%} c6 3. Nf3{100%} Nf6 4. Nc3{100%} e6 5. e3{100%} Nbd7 6. Qc2{50%} 
41: 1. d4{33%} d5 2. c4{88%} dxc4 3. Nf3{100%} Nf6 4. e3{100%} e6 5. Bxc4{100%} c5 6. O-O{100%} 
42: 1. d4{33%} d5 2. c4{88%} e6 3. Nc3{75%} c5 4. cxd5{100%} exd5 5. Nf3{100%} Nc6 6. g3{100%} 
43: 1. d4{33%} d5 2. c4{88%

Code: Select all

Dump of "GS70.bin" for black.
1: 1. Nf3 d5{75%} 2. c4 e6{67%} 3. b3 Be7{100%} 4. Bb2 Bf6{100%} 5. Nc3 c5{100%} 6. cxd5 exd5{100%} 
2: 1. Nf3 d5{75%} 2. c4 e6{67%} 3. d4 Nf6{100%} 4. Nc3 Be7{100%} 5. Bf4 O-O{100%} 6. e3 c5{100%} 
3: 1. Nf3 d5{75%} 2. c4 e6{67%} 3. d4 Nf6{100%} 4. Nc3 Be7{100%} 5. Bg5 h6{100%} 6. Bh4 O-O{100%} 
4: 1. Nf3 d5{75%} 2. c4 e6{67%} 3. d4 Nf6{100%} 4. e3 Be7{100%} 5. Bd3 O-O{100%} 6. b3 b6{100%} 
5: 1. Nf3 d5{75%} 2. c4 e6{67%} 3. g3 Nf6{100%} 4. Bg2 Be7{100%} 5. b3 O-O{100%} 6. O-O c5{100%} 
6: 1. Nf3 d5{75%} 2. c4 c6{33%} 3. d4 Nf6{67%} 4. Nc3 e6{100%} 5. e3 Nbd7{100%} 6. Qc2 Bd6{100%} 
7: 1. Nf3 d5{75%} 2. c4 c6{33%} 3. d4 Nf6{67%} 4. Nc3 e6{100%} 5. e3 Nbd7{100%} 6. Bd3 dxc4{100%} 
8: 1. Nf3 d5{75%} 2. c4 c6{33%} 3. d4 e6{33%} 4. Nbd2 Nf6{100%} 5. g3 Be7{100%} 6. Bg2 O-O{100%} 
9: 1. Nf3 d5{75%} 2. d4 Nf6{100%} 3. c4 e6{100%} {trans: line=2, ply=6}
10: 1. Nf3 c5{25%} 2. c4 Nf6{100%} 3. Nc3 Nc6{100%} 4. d4 cxd4{100%} 5. Nxd4 e6{100%} 6. Ndb5 d5{100%} 
11: 1. Nf3 c5{25%} 2. c4 Nf6{100%} 3. Nc3 Nc6{100%} 4. d4 cxd4{100%} 5. Nxd4 e6{100%} 6. e3 Qb6{100%} 
12: 1. Nf3 c5{25%} 2. c4 Nf6{100%} 3. d4 cxd4{100%} 4. Nxd4 Nc6{100%} 5. Nc3 {trans: line=10, ply=9}
13: 1. Nf3 c5{25%} 2. c4 Nf6{100%} 3. g3 b6{100%} 4. Bg2 Bb7{100%} 5. O-O e6{100%} 6. Nc3 Be7{100%} 
14: 1. Nf3 c5{25%} 2. e4 d6{64%} 3. Bb5+ Bd7{100%} 4. Bxd7+ Qxd7{100%} 5. O-O Nc6{100%} 6. c3 Nf6{100%} 
15: 1. Nf3 c5{25%} 2. e4 d6{64%} 3. d4 cxd4{100%} 4. Nxd4 Nf6{83%} 5. Nc3 a6{80%} 6. Be2 e5{50%} 
16: 1. Nf3 c5{25%} 2. e4 d6{64%} 3. d4 cxd4{100%} 4. Nxd4 Nf6{83%} 5. Nc3 a6{80%} 6. Be2 e6{50%} 
17: 1. Nf3 c5{25%} 2. e4 d6{64%} 3. d4 cxd4{100%} 4. Nxd4 Nf6{83%} 5. Nc3 a6{80%} 6. Bc4 e6{100%} 
18: 1. Nf3 c5{25%} 2. e4 d6{64%} 3. d4 cxd4{100%} 4. Nxd4 Nf6{83%} 5. Nc3 a6{80%} 6. h3 e6{100%} 
19: 1. Nf3 c5{25%} 2. e4 d6{64%} 3. d4 cxd4{100%} 4. Nxd4 Nf6{83%} 5. Nc3 g6{20%} 6. Be3 Bg7{100%} 
20: 1. Nf3 c5{25%} 2. e4 d6{64%} 3. d4 cxd4{100%} 4. Nxd4 Nc6{17%} 5. Nc3 Nf6{100%} 6. Bg5 e6{100%} 
21: 1. Nf3 c5{25%} 2. e4 Nc6{27%} 3. Bb5 e6{100%} 4. Nc3 Nge7{100%} 5. O-O a6{100%} 6. Bxc6 Nxc6{100%} 
22: 1. Nf3 c5{25%} 2. e4 Nc6{27%} 3. d4 cxd4{100%} 4. Nxd4 g6{100%} 5. Nc3 Bg7{100%} 6. Be3 Nf6{100%} 
23: 1. Nf3 c5{25%} 2. e4 Nc6{27%} 3. d4 cxd4{100%} 4. Nxd4 g6{100%} 5. c4 Bg7{100%} 6. Be3 Nf6{100%} 
24: 1. Nf3 c5{25%} 2. e4 e6{9%} 3. d4 cxd4{100%} 4. Nxd4 Nc6{100%} 5. Nc3 Nf6{100%} 6. a3 Be7{100%} 
25: 1. b3 e5{100%} 2. Bb2 Nc6{100%} 3. e3 d6{100%} 4. Nf3 Nf6{100%} 5. d3 Be7{100%} 6. Be2 O-O{100%} 
26: 1. c4 e5{67%} 2. Nc3 Nf6{67%} 3. Nf3 Nc6{100%} 4. g3 Bb4{100%} 5. Bg2 O-O{100%} 6. O-O d6{50%} 
27: 1. c4 e5{67%} 2. Nc3 Nf6{67%} 3. Nf3 Nc6{100%} 4. g3 Bb4{100%} 5. Bg2 O-O{100%} 6. O-O Re8{50%} 
28: 1. c4 e5{67%} 2. Nc3 Nf6{67%} 3. g3 Bb4{100%} 4. Bg2 O-O{100%} 5. Nf3 Nc6{100%} {trans: line=26, ply=10}
29: 1. c4 e5{67%} 2. Nc3 Nc6{33%} 3. g3 f5{100%} 4. Bg2 Nf6{100%} 5. d3 Bc5{100%} 6. e3 O-O{100%} 
30: 1. c4 e5{67%} 2. g3 Nf6{100%} 3. Nc3 {trans: line=28, ply=5}
31: 1. c4 e5{67%} 2. g3 Nf6{100%} 3. Bg2 d5{100%} 4. cxd5 Nxd5{100%} 5. Nc3 Nb6{100%} 6. Nf3 Nc6{100%} 
32: 1. c4 c5{33%} 2. Nf3 {trans: line=10, ply=3}
33: 1. c4 c5{33%} 2. g3 Nc6{100%} 3. Bg2 g6{100%} 4. Nc3 Bg7{100%} 5. Nf3 Nf6{100%} 6. O-O O-O{100%} 
34: 1. d4 Nf6{57%} 2. Nf3 c5{100%} 3. c4 {trans: line=12, ply=5}
35: 1. d4 Nf6{57%} 2. c4 e6{58%} 3. Nc3 Bb4{100%} 4. Qc2 O-O{100%} 5. a3 Bxc3+{100%} 6. Qxc3 b6{100%} 
36: 1. d4 Nf6{57%} 2. c4 e6{58%} 3. Nc3 Bb4{100%} 4. e3 O-O{100%} 5. Bd3 c5{50%} 6. Ne2 d5{100%} 
37: 1. d4 Nf6{57%} 2. c4 e6{58%} 3. Nc3 Bb4{100%} 4. e3 O-O{100%} 5. Bd3 d5{50%} 6. Nf3 c5{100%} 
38: 1. d4 Nf6{57%} 2. c4 e6{58%} 3. Nc3 Bb4{100%} 4. f3 d5{100%} 5. a3 Bxc3+{100%} 6. bxc3 c5{100%} 
39: 1. d4 Nf6{57%} 2. c4 e6{58%} 3. Nf3 b6{100%} 4. a3 Bb7{100%} 5. Nc3 d5{100%} 6. cxd5 Nxd5{100%} 
40: 1. d4 Nf6{57%} 2. c4 e6{58%} 3. Nf3 b6{100%} 4. g3 Ba6{50%} 5. b3 Bb4+{100%} 6. Bd2 Be7{100%} 
41: 1. d4 Nf6{57%} 2. c4 e6{58%} 3. Nf3 b6{100%} 4. g3 Bb7{50%} 5. Bg2 Be7{100%} 6. O-O O-O{100%} 
42: 1. d4 Nf6{57%} 2. c4 g6{42%} 3. Nc3 d5{60%} 4. Bf4 Bg7{100%} 5. Nf3 O-O{100%} 6. Rc1 dxc4

[xr_a_y]

I posted this for MinicNNUE in october (so SF implementation at that time). SF11 gauntlet versus Minic using more threads. Far from converged results, but threading looks good with NNUE.

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   0 stockfish.11                   
   1 minic_dev_uci_nnue_8t         136      38     196   68.6%   42.3% 
   2 minic_dev_uci_nnue_4t          52      35     197   57.4%   47.7% 
   3 minic_dev_uci_nnue_2t         -44      33     197   43.7%   53.8% 
   4 stockfish.10                  -44      30     197   43.7%   61.9% 
   5 minic_dev_uci_nnue            -90      38     197   37.3%   39.1% 
   6 stockfish.9                  -133      32     197   31.7%   53.3%

[mwyoung]

Testing Ethereal TCEC (2x128 NNUE) vs Ethereal Master (12.82, not NNUE)

Code: Select all

10.0s+0.1s
Ethereal-NNUE-1C vs Ethereal-1C : 1380 - 663 - 1457  [0.602] 3500 +72
Ethereal-NNUE-2C vs Ethereal-2C : 1925 - 797 - 2278  [0.613] 5000 +80
Ethereal-NNUE-4C vs Ethereal-4C :  370 - 169 -  461  [0.601] 1000 +71

This test is a more direct comparison of scaling, and shows that the NNUE branch scales about the same as the non-NNUE branch. In 3 different core count configurations, (1, 2, and 4), Ethereal NNUE beats Ethereal non-NNUE by approx +70 elo. Note that this +70 is not an important number. The important point is that the 1-thread vs 1-thread test yielded near equal results to the 2-thread vs 2-thread, and the 4-thread vs 4-thread test, suggesting that despite wildly different evaluation functions, both versions scale in a similar if not exact fashion.

As of now, I've seen no conclusive evidence that NNUE causes engines to scale poorly, nor am I sold that engines even have different scaling when replacing their evaluation function with Shogi halfkp NNs. What say you, naysayer? Why am I seeing what I am seeing?

That is simple to answer. No one was talking about your engine.

The issue was with Stockfish NNUE. The claims about faulty testing in CCRL. Was about Stickfish NNUE.