T40.T8.610 net for TCEC15 SuFi

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
corres
Posts: 1640
Joined: Wed Nov 18, 2015 10:41 am
Location: hungary

T40.T8.610 net for TCEC15 SuFi

Post by corres » Fri May 10, 2019 11:48 pm

The developers of Lc0 and their helpers decided during TCEC 15 Super Final Leela uses the net T40.T8.610
https://groups.google.com/forum/#!topic ... 6KjgY2KdE4
I made some test on my dual GPU machine with this net and with the older net 42176.
The net 42176 was earlier the best against Stockfish.
In a standardized test net T40.T8.610 was valued to 14.9 Rating Score and net 42176 was valued to 7.5 Rating Score.
My system: Ryzen 7 1800x 8x4000 MHz CPU, 24 GB RAM, 2xRTX 2060 GPU, Win 10 64 bits
Common parameters of Leela:
Lc0 version 0.21.1
Threads: 4
Backend: Multiplexing
BackendOptions: backend=cudnn-fp16,(gpu=0),(gpu=1)
NNcacheSize: 5000000
MiniBatchSize: 512
Others are Default

Test 1 - Speed Test: Go Nodes 10000000
Results
Net 42176 max nps = 52392 (Depth 17, Nodes 4492793)
Net T40.T8.160 max nps = 55707 (Depth 18, Nodes 6681918)

Test 2 - Match between Lc0-s using net 42176 and T40.T8.610, respectively.
Played 50 opening positions with reversed color.
TC: 1 min + 2 sec / move
Result
DUALx Lc0-v0.21.1 : DUAL Lc0-v0.21.1 = 4 : 3 (93 draw) 100 games.
Dualx Lc0 used the net 42176 and DUAL Lc0 used the net T40.T8.610.
As we can see in my test the two net are very closed to each other.
At least on my machine the net T40.T8.610 does not seem better than the older net 42176.

You can download the pgn from
wikisend.com/download
File ID: 575214
Password: leela0

MikeGL
Posts: 900
Joined: Thu Sep 01, 2011 12:49 pm

Re: T40.T8.610 net for TCEC15 SuFi

Post by MikeGL » Sat May 11, 2019 9:28 am

corres wrote:
Fri May 10, 2019 11:48 pm
The developers of Lc0 and their helpers decided during TCEC 15 Super Final Leela uses the net T40.T8.610
https://groups.google.com/forum/#!topic ... 6KjgY2KdE4
I made some test on my dual GPU machine with this net and with the older net 42176.
The net 42176 was earlier the best against Stockfish.
In a standardized test net T40.T8.610 was valued to 14.9 Rating Score and net 42176 was valued to 7.5 Rating Score.
My system: Ryzen 7 1800x 8x4000 MHz CPU, 24 GB RAM, 2xRTX 2060 GPU, Win 10 64 bits
Common parameters of Leela:
Lc0 version 0.21.1
Threads: 4
Backend: Multiplexing
BackendOptions: backend=cudnn-fp16,(gpu=0),(gpu=1)
NNcacheSize: 5000000
MiniBatchSize: 512
Others are Default

Test 1 - Speed Test: Go Nodes 10000000
Results
Net 42176 max nps = 52392 (Depth 17, Nodes 4492793)
Net T40.T8.160 max nps = 55707 (Depth 18, Nodes 6681918)

Test 2 - Match between Lc0-s using net 42176 and T40.T8.610, respectively.
Played 50 opening positions with reversed color.
TC: 1 min + 2 sec / move
Result
DUALx Lc0-v0.21.1 : DUAL Lc0-v0.21.1 = 4 : 3 (93 draw) 100 games.
Dualx Lc0 used the net 42176 and DUAL Lc0 used the net T40.T8.610.
As we can see in my test the two net are very closed to each other.
At least on my machine the net T40.T8.610 does not seem better than the older net 42176.

You can download the pgn from
wikisend.com/download
File ID: 575214
Password: leela0
Thanks for the info. checking the games now
I told my wife that a husband is like a fine wine; he gets better with age. The next day, she locked me in the cellar.

corres
Posts: 1640
Joined: Wed Nov 18, 2015 10:41 am
Location: hungary

Re: T40.T8.610 net for TCEC15 SuFi

Post by corres » Sat May 11, 2019 11:31 am

MikeGL wrote:
Sat May 11, 2019 9:28 am
...
Thanks for the info. checking the games now
Thanks.
As I see I forgot to mark I used for test 6 men syzygy and 5 men Nalimov (for the Fritz 11 GUI only) also.
Sorry.

corres
Posts: 1640
Joined: Wed Nov 18, 2015 10:41 am
Location: hungary

Re: T40.T8.610 net for TCEC15 SuFi

Post by corres » Mon May 13, 2019 12:18 pm

Among developers of Leela and among the fan of Leele was a long dispute about which net would be sent to TCEC final.
There were peoples who thought T40.T8.610 would be the best because it is optimized to 7 men syzygy and there were peoples who wanted to send the last 42xxx net.
I made a test between net T40.T8.610 and 42332 (one of the last best, Lc0-Elo 3231) because I was curious to know the difference.
Machine and parameters were the above.

Results

1, Net 42332 speed test: (go nodes 10000000)
max nps = 50002 (Depth 17, Nodes 2290647)

2, Match between net T40.T8.610 and net 42332
DUAL lc0-v0.21.1 : DUALx lc0-v.21.1 = 6 : 2 (92 draw) 100 games (TC: 1 min + 2 sec / move)
In this match DUAL lc0 used the net T40.T8.610 file and DUALx lc0 used the net 42332 file.
So in my test the net T40.T8.610 proved to be the better.
To determine the exact difference between them we would need much more games.

You can download the pgn:
http://s000.tinyupload.com/?file_id=087 ... 4300122759

Post Reply