Comparisons:Jhorthos J13B.2-188 with Leela 63390 and SV 384x30-T60-3350

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Comparisons:Jhorthos J13B.2-188 with Leela 63390 and SV 384x30-T60-3350

Post by corres »

For tests I used my DUAL GPUs (2 x RTX 2060 OC) and Leela ver.0.25.0
Parameters were as default (kiudee), exclude:
Threads 4 x 4000 MHz
Backend Multiplexing
BackendOptions (backend=cudnn-fp16,gpu=0),(backend=cudnn-fp16,gpu=1)
NNCacheSize 20000000
MinibatchSize 64
Start positions were 100 opening positions selected for NN testing with reversed colors (200 games)
TC was 1 min + 2 sec / move.
Results:
Test 1,
Jhorthos 320 x 24 - J13B.2-188 : Leela 320 x 24 - 63390(Elo ~2972) = 7 : 16 (177 draw) 200 games

Test 2,
Jhorthos 320 x 24 -J13B.2-188 : SV 384 x 30 - T60 - 3350 = 4 : 17 (179 draw) 200 games.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: Comparisons:Jhorthos J13B.2-188 with Leela 63390 and SV 384x30-T60-3350

Post by corres »

corres wrote: Wed May 06, 2020 9:27 am For tests I used my DUAL GPUs (2 x RTX 2060 OC) and Leela ver.0.25.0
Parameters were as default (kiudee), exclude:
Threads 4 x 4000 MHz
Backend Multiplexing
BackendOptions (backend=cudnn-fp16,gpu=0),(backend=cudnn-fp16,gpu=1)
NNCacheSize 20000000
MinibatchSize 64
Start positions were 100 opening positions selected for NN testing with reversed colors 200 games
TC was 1 min + 2 sec / move.
Syzygy 6 men
Results:
Test 1,
Jhorthos 320 x 24 - J13B.2-188 : Leela 320 x 24 - 63390(Elo ~2972) = 7 : 16 (177 draw) 200 games

Test 2,
Jhorthos 320 x 24 -J13B.2-188 : SV 384 x 30 - T60 - 3350 = 4 : 17 (179 draw) 200 games.
I made a new test between Stockfish dev on Threadripper 2950x and Leela ver.0.25.0 on my DUAL with new SV net.
Test 3,
Stockfish200502 : SV 384 x 30 - T60 - 3350 = 21 : 15 (164 draw) 200 games

Hardware for Stockfish: Threadripper 2950x 16 cores 4000 MHz
Stockfish was on default parameter.
Hardware for Leela was as the above and 2 x RTX 2060 OC (my DUAL)
Parameters for Leela, the used TC and openings was as in the Test 1 and Test 2.

You can download the games from wikisend.com
FileID: 245088
Password: leela
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: Comparisons:Jhorthos J13B.2-188 with Leela 63390 and SV 384x30-T60-3350

Post by corres »

corres wrote: Fri May 08, 2020 10:06 am
corres wrote: Wed May 06, 2020 9:27 am For tests I used my DUAL GPUs (2 x RTX 2060 OC) and Leela ver.0.25.0
Parameters were as default (kiudee), exclude:
Threads 4 x 4000 MHz
Backend Multiplexing
BackendOptions (backend=cudnn-fp16,gpu=0),(backend=cudnn-fp16,gpu=1)
NNCacheSize 20000000
MinibatchSize 64
Start positions were 100 opening positions selected for NN testing with reversed colors 200 games
TC was 1 min + 2 sec / move.
Syzygy 6 men
Results:
Test 1,
Jhorthos 320 x 24 - J13B.2-188 : Leela 320 x 24 - 63390(Elo ~2972) = 7 : 16 (177 draw) 200 games

Test 2,
Jhorthos 320 x 24 -J13B.2-188 : SV 384 x 30 - T60 - 3350 = 4 : 17 (179 draw) 200 games.
I made a new test between Stockfish dev on Threadripper 2950x and Leela ver.0.25.0 on my DUAL with new SV-T60-3350 net:
Test 3,
Stockfish200502 : SV 384 x 30 - T60 - 3350 = 21 : 15 (164 draw) 200 games

Hardware for Stockfish: Threadripper 2950x 16 cores 4000 MHz
Stockfish was on default parameter and Hash = 2 GB, Contempt = +24
Hardware for Leela was as the above and 2 x RTX 2060 OC (my DUAL)
Parameters for Leela, the used TC and openings was as in the Test 1 and Test 2.

You can download the games from wikisend.com
FileID: 245088
Password: leela
I re-run the Test 3 instead of my DUAL with my TRIAD (1 x RTX 2080 Ti + 2 x RTX 2060).
Result
Test 4,
SV-T60-3350 on my TRIAD : Stockfish200502 = 19 : 16 (165 draw) 200 games
Stockfish parameters was as the above: Hash = 2 GB, Contempt = +24 and it was run on Threadripper 2950x
threads 16 x 4000 MHz, no HT, no Turbo.

Note
My DUAL chess-power ~ 1 x RTX 2080 Ti, my TRIAD chess-power ~ 2 x RTX 2080 Ti.

You can download the full 4 tests from
wikisend.com
FileID:977024
Password: leela