T40.T8.610 net for TCEC15 SuFi

[corres]

The developers of Lc0 and their helpers decided during TCEC 15 Super Final Leela uses the net T40.T8.610
https://groups.google.com/forum/#!topic ... 6KjgY2KdE4
I made some test on my dual GPU machine with this net and with the older net 42176.
The net 42176 was earlier the best against Stockfish.
In a standardized test net T40.T8.610 was valued to 14.9 Rating Score and net 42176 was valued to 7.5 Rating Score.
My system: Ryzen 7 1800x 8x4000 MHz CPU, 24 GB RAM, 2xRTX 2060 GPU, Win 10 64 bits
Common parameters of Leela:
Lc0 version 0.21.1
Threads: 4
Backend: Multiplexing
BackendOptions: backend=cudnn-fp16,(gpu=0),(gpu=1)
NNcacheSize: 5000000
MiniBatchSize: 512
Others are Default

Test 1 - Speed Test: Go Nodes 10000000
Results
Net 42176 max nps = 52392 (Depth 17, Nodes 4492793)
Net T40.T8.160 max nps = 55707 (Depth 18, Nodes 6681918)

Test 2 - Match between Lc0-s using net 42176 and T40.T8.610, respectively.
Played 50 opening positions with reversed color.
TC: 1 min + 2 sec / move
Result
DUALx Lc0-v0.21.1 : DUAL Lc0-v0.21.1 = 4 : 3 (93 draw) 100 games.
Dualx Lc0 used the net 42176 and DUAL Lc0 used the net T40.T8.610.
As we can see in my test the two net are very closed to each other.
At least on my machine the net T40.T8.610 does not seem better than the older net 42176.

You can download the pgn from
wikisend.com/download
File ID: 575214
Password: leela0

[MikeGL]

The developers of Lc0 and their helpers decided during TCEC 15 Super Final Leela uses the net T40.T8.610
https://groups.google.com/forum/#!topic ... 6KjgY2KdE4
I made some test on my dual GPU machine with this net and with the older net 42176.
The net 42176 was earlier the best against Stockfish.
In a standardized test net T40.T8.610 was valued to 14.9 Rating Score and net 42176 was valued to 7.5 Rating Score.
My system: Ryzen 7 1800x 8x4000 MHz CPU, 24 GB RAM, 2xRTX 2060 GPU, Win 10 64 bits
Common parameters of Leela:
Lc0 version 0.21.1
Threads: 4
Backend: Multiplexing
BackendOptions: backend=cudnn-fp16,(gpu=0),(gpu=1)
NNcacheSize: 5000000
MiniBatchSize: 512
Others are Default

Test 1 - Speed Test: Go Nodes 10000000
Results
Net 42176 max nps = 52392 (Depth 17, Nodes 4492793)
Net T40.T8.160 max nps = 55707 (Depth 18, Nodes 6681918)

Test 2 - Match between Lc0-s using net 42176 and T40.T8.610, respectively.
Played 50 opening positions with reversed color.
TC: 1 min + 2 sec / move
Result
DUALx Lc0-v0.21.1 : DUAL Lc0-v0.21.1 = 4 : 3 (93 draw) 100 games.
Dualx Lc0 used the net 42176 and DUAL Lc0 used the net T40.T8.610.
As we can see in my test the two net are very closed to each other.
At least on my machine the net T40.T8.610 does not seem better than the older net 42176.

You can download the pgn from
wikisend.com/download
File ID: 575214
Password: leela0

Thanks for the info. checking the games now

[corres]

...
Thanks for the info. checking the games now

Thanks.
As I see I forgot to mark I used for test 6 men syzygy and 5 men Nalimov (for the Fritz 11 GUI only) also.
Sorry.

[corres]

Among developers of Leela and among the fan of Leele was a long dispute about which net would be sent to TCEC final.
There were peoples who thought T40.T8.610 would be the best because it is optimized to 7 men syzygy and there were peoples who wanted to send the last 42xxx net.
I made a test between net T40.T8.610 and 42332 (one of the last best, Lc0-Elo 3231) because I was curious to know the difference.
Machine and parameters were the above.

Results

1, Net 42332 speed test: (go nodes 10000000)
max nps = 50002 (Depth 17, Nodes 2290647)

2, Match between net T40.T8.610 and net 42332
DUAL lc0-v0.21.1 : DUALx lc0-v.21.1 = 6 : 2 (92 draw) 100 games (TC: 1 min + 2 sec / move)
In this match DUAL lc0 used the net T40.T8.610 file and DUALx lc0 used the net 42332 file.
So in my test the net T40.T8.610 proved to be the better.
To determine the exact difference between them we would need much more games.

You can download the pgn:
http://s000.tinyupload.com/?file_id=087 ... 4300122759