Strong Leela nets competition
Moderators: hgm, Dann Corbit, Harvey Williamson
Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Strong Leela nets competition
I made a competition among strong Leela nets.
Parameters
Used Leela: v.0.22.0
GPUs: 2 x RTX 2060 OC
Threads: 4 X 4GHz
Backend: Multiplexing
BackendOptions: backend=cudnn-fp16,(gpu=0),(gpu=1)
NNCacheSize: 10000000
MaxPrefetchBatch: 64
Others are Default
Time Control: 1 min + 2 sec / move
50 opening positions played with alternated colors
Results
T40B.4-160 : 42872 = 4 : 3 (93 draw) 100 games
42872 : J13B.2-188 = 9 : 6 (85 draw) 100 games
T40B.4-160 : J13B.2-188 = 9 : 3 (88 draw) 100 games
In Points
T40B.4-160 net 13 points
42872 net 12 points
J13B.2-188 net 9 points
I made test with 384x30-T40-970 "big net" with disappointing result
J13B.2-188 : 384x30-T40-970 = 17(!) : 3 (80 draw) 100 games.
Seeing the result I did not make further test with it.
Parameters
Used Leela: v.0.22.0
GPUs: 2 x RTX 2060 OC
Threads: 4 X 4GHz
Backend: Multiplexing
BackendOptions: backend=cudnn-fp16,(gpu=0),(gpu=1)
NNCacheSize: 10000000
MaxPrefetchBatch: 64
Others are Default
Time Control: 1 min + 2 sec / move
50 opening positions played with alternated colors
Results
T40B.4-160 : 42872 = 4 : 3 (93 draw) 100 games
42872 : J13B.2-188 = 9 : 6 (85 draw) 100 games
T40B.4-160 : J13B.2-188 = 9 : 3 (88 draw) 100 games
In Points
T40B.4-160 net 13 points
42872 net 12 points
J13B.2-188 net 9 points
I made test with 384x30-T40-970 "big net" with disappointing result
J13B.2-188 : 384x30-T40-970 = 17(!) : 3 (80 draw) 100 games.
Seeing the result I did not make further test with it.
Re: Strong Leela nets competition
J13B.4 is strong at LTC on strong hardware, or so it seems to me.corres wrote: ↑Fri Nov 08, 2019 8:13 pmI made a competition among strong Leela nets.
Parameters
Used Leela: v.0.22.0
GPUs: 2 x RTX 2060 OC
Threads: 4 X 4GHz
Backend: Multiplexing
BackendOptions: backend=cudnn-fp16,(gpu=0),(gpu=1)
NNCacheSize: 10000000
MaxPrefetchBatch: 64
Others are Default
Time Control: 1 min + 2 sec / move
50 opening positions played with alternated colors
Results
T40B.4-160 : 42872 = 4 : 3 (93 draw) 100 games
42872 : J13B.2-188 = 9 : 6 (85 draw) 100 games
T40B.4-160 : J13B.2-188 = 9 : 3 (88 draw) 100 games
In Points
T40B.4-160 net 13 points
42872 net 12 points
J13B.2-188 net 9 points
I made test with 384x30-T40-970 "big net" with disappointing result
J13B.2-188 : 384x30-T40-970 = 17(!) : 3 (80 draw) 100 games.
Seeing the result I did not make further test with it.
Re: Strong Leela nets competition
You can download the .zip filecorres wrote: ↑Fri Nov 08, 2019 8:13 pmI made a competition among strong Leela nets.
Parameters
Used Leela: v.0.22.0
GPUs: 2 x RTX 2060 OC
Threads: 4 X 4GHz
Backend: Multiplexing
BackendOptions: backend=cudnn-fp16,(gpu=0),(gpu=1)
NNCacheSize: 10000000
MaxPrefetchBatch: 64
Others are Default
Time Control: 1 min + 2 sec / move
50 opening positions played with alternated colors
Results
T40B.4-160 : 42872 = 4 : 3 (93 draw) 100 games
42872 : J13B.2-188 = 9 : 6 (85 draw) 100 games
T40B.4-160 : J13B.2-188 = 9 : 3 (88 draw) 100 games
In Points
T40B.4-160 net 13 points
42872 net 12 points
J13B.2-188 net 9 points
I made test with 384x30-T40-970 "big net" with disappointing result
J13B.2-188 : 384x30-T40-970 = 17(!) : 3 (80 draw) 100 games.
Seeing the result I did not make further test with it.
wikisend.com
File ID: 621504
Password: leela
Re: Strong Leela nets competition
Playing big NNs against small NNs is one thing. Playing those NNs against Stockfish is a whole new Ball Game .
You "MAY" get different results if you play them against Stockfish.
"MAY" because your GPUs are weak and will be unable to fully utilize the powere of large NNs.
So, they may again lose on your Setup.
That's the Problem with testing of NNs.
One has to take into account BOTH the NN being used AND the GPU... TWO Factors involved.
You "MAY" get different results if you play them against Stockfish.
"MAY" because your GPUs are weak and will be unable to fully utilize the powere of large NNs.
So, they may again lose on your Setup.
That's the Problem with testing of NNs.
One has to take into account BOTH the NN being used AND the GPU... TWO Factors involved.
i7 5960X @ 4.1 Ghz, 64 GB G.Skill RipJaws RAM, Twin Asus ROG Strix OC 11 GB Geforce 2080 Tis
Re: Strong Leela nets competition
in TCEC Leela lost 2 games already…. it's play is crap, and seems no improvement has been made..
It is loser engine whose play only depends on strong GPU's...





Re: Strong Leela nets competition
Sometimes you also should make some test, do you not think that?shrapnel wrote: ↑Sat Nov 09, 2019 11:15 amPlaying big NNs against small NNs is one thing. Playing those NNs against Stockfish is a whole new Ball Game .
You "MAY" get different results if you play them against Stockfish.
"MAY" because your GPUs are weak and will be unable to fully utilize the powere of large NNs.
So, they may again lose on your Setup.
That's the Problem with testing of NNs.
One has to take into account BOTH the NN being used AND the GPU... TWO Factors involved.
I have no Twin RTX 2080 Ti only a twin RTX 2060 OC.
I put my openings on net and you should play two matches: a match (100 games) between the last Stockfish dev and your favorite big net as well as a match (100 games) between the last Stockfish dev and T40B.4-160 net with the same parameters. It takes about a day test, if you use 1 min + 2 sec / move TC (shorter time is bad!). If the big net will get better result against Stockfish than T40B.4-160 will, you are right.
It would be the exact evidence.
Any other is only ''bla-di-bla".
-
- Posts: 682
- Joined: Mon Jan 16, 2012 5:34 am
Re: Strong Leela nets competition
I guess you are joking! Did you check what kind of custom positions they are testing for? Most of them are like that, I did not check all of them though!
Leela will probably play at 3000 rating! But not surprising!
NN are not trained for such custom positions that you wont see 1 in billion games.
Re: Strong Leela nets competition
My response was to Shrapnel,,, since he keeps bashing all other engines and praise Leela... to show him that Lc0 is patzer engine too….



- Nordlandia
- Posts: 2729
- Joined: Fri Sep 25, 2015 7:38 pm
- Location: Sortland, Norway
Re: Strong Leela nets competition
Try this position!
Lyudmil Tsvetkov claimed black wins. But Lc0 did not manage to win against SF Dev and SF 10.
Also he claimed that white wins here too.
5+5 Blitz | Lc0 (2080 Super) vs 7-core SF Dev
Lyudmil Tsvetkov claimed black wins. But Lc0 did not manage to win against SF Dev and SF 10.
Also he claimed that white wins here too.
5+5 Blitz | Lc0 (2080 Super) vs 7-core SF Dev