The tests are as follows;
Used PC: AMD Ryzen 7 1800x 8x4000 MHz processor and 2 x RTX 2060 OC-ed GPUs
1, Leela ver.0.22 tests
Common parameters:
NNCacheSize 10000000
MiniBatchSize 512
MaxPrefetchBatch 64.
NET 42850
Single GPU with plus parameters Backend cudnn-FP16 and Threads 2
Max speed = 28.4 kn/sec (Depth = 22, Nodes = 7.69 Mn)
DUAL GPU with plus parameters Backend Multiplexing BackendOptions backend=cudnn-FP16,(gpu=0),(gpu=1) and Threads 4
Max speed = 46.0 kn/sec (Depth = 22, Nodes = 7.42 Mn)
NET 320x24 J13B.2-136 (JHorthos)
Single GPU (plus pamaters as above)
Max speed =15.1 kn/sec (Depth = 19, Nodes = 5.47 Mn)
DUAL GPU plus parameters as above
Max speed = 28.6 kn/sec (Depth = 19, Nodes = 5.68 Mn)
2, Allie ver.0.5-dev tests
NET 42850
Single GPU
Parameters: UseFP16 = ON, GPUCores = 1, others are DEFAULT
Max speed = 119 kn/sec (Depth = 15, Nodes = 4.82 Mn)
DUAL GPU
Parameterts: UseFP16 = ON, GPUCores = 2, others are DEFAULT
Nax Speed = 236 kn/sec (Depth = 15, Nodes = 4.79 Mn)
NET 320x24 J13B.2-136 (JHorthos)
Single GPU
Parameters as above
Max speed = 66.5 kn/sec (Depth = 14, Nodes = 6.33 Mn)
DUAL GPU
Parameters as above
Max speed = 135 kn/sec (Depth = 14, Nodes = 6.18 Mn)
As we can see Allie is more faster but its search depth is shallower than Leela have.
Maybe in the good role of Allie the used special NET is an important factor.
Some speed tests with Leela and Allie
Moderators: hgm, Rebel, chrisw
-
- Posts: 3657
- Joined: Wed Nov 18, 2015 11:41 am
- Location: hungary
-
- Posts: 1243
- Joined: Sat Dec 13, 2008 7:00 pm
Re: Some speed tests with Leela and Allie
Node speeds reported by lc0 based engines are nonsense because cache hits are counted as full nodes. Likewise, the reported depth for MCTS-based engines is arbitrary.
You can't conclude anything from these numbers.
You can't conclude anything from these numbers.
-
- Posts: 708
- Joined: Mon Jan 16, 2012 6:34 am
Re: Some speed tests with Leela and Allie
Totally irrelevant.corres wrote: ↑Thu Sep 19, 2019 9:21 pm The tests are as follows;
Used PC: AMD Ryzen 7 1800x 8x4000 MHz processor and 2 x RTX 2060 OC-ed GPUs
1, Leela ver.0.22 tests
Common parameters:
NNCacheSize 10000000
MiniBatchSize 512
MaxPrefetchBatch 64.
NET 42850
Single GPU with plus parameters Backend cudnn-FP16 and Threads 2
Max speed = 28.4 kn/sec (Depth = 22, Nodes = 7.69 Mn)
DUAL GPU with plus parameters Backend Multiplexing BackendOptions backend=cudnn-FP16,(gpu=0),(gpu=1) and Threads 4
Max speed = 46.0 kn/sec (Depth = 22, Nodes = 7.42 Mn)
NET 320x24 J13B.2-136 (JHorthos)
Single GPU (plus pamaters as above)
Max speed =15.1 kn/sec (Depth = 19, Nodes = 5.47 Mn)
DUAL GPU plus parameters as above
Max speed = 28.6 kn/sec (Depth = 19, Nodes = 5.68 Mn)
2, Allie ver.0.5-dev tests
NET 42850
Single GPU
Parameters: UseFP16 = ON, GPUCores = 1, others are DEFAULT
Max speed = 119 kn/sec (Depth = 15, Nodes = 4.82 Mn)
DUAL GPU
Parameterts: UseFP16 = ON, GPUCores = 2, others are DEFAULT
Nax Speed = 236 kn/sec (Depth = 15, Nodes = 4.79 Mn)
NET 320x24 J13B.2-136 (JHorthos)
Single GPU
Parameters as above
Max speed = 66.5 kn/sec (Depth = 14, Nodes = 6.33 Mn)
DUAL GPU
Parameters as above
Max speed = 135 kn/sec (Depth = 14, Nodes = 6.18 Mn)
As we can see Allie is more faster but its search depth is shallower than Leela have.
Maybe in the good role of Allie the used special NET is an important factor.
Allie authour explain how he count nodes in Leela discord and Tcec twitch chat.
Leela discord--- Technical channel is the best to discuss NN stuffs.
-
- Posts: 1631
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: Some speed tests with Leela and Allie
I don’t think he knows who he’s talking to.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
- Posts: 3657
- Joined: Wed Nov 18, 2015 11:41 am
- Location: hungary
Re: Some speed tests with Leela and Allie
It is true if you use the the same binary and the same NET for different GPUs you can rank those GPUs based on the yielded speed.Gian-Carlo Pascutto wrote: ↑Thu Sep 19, 2019 9:24 pm Node speeds reported by lc0 based engines are nonsense because cache hits are counted as full nodes. Likewise, the reported depth for MCTS-based engines is arbitrary.
You can't conclude anything from these numbers.
If you use the same NET and the same GPU for different binaries "maybe" you have some guessing about the rank of the binaries. Obviously a lot of game need to decide about the ratings.
Why you think that in the case of given Net and given binary there is no any connection between speed and the chess power?
As if the TCEC and CCC experiments - together with private experiments - can show other...
You would be right if every each binary of Leela would compute the speed with different mode.
-
- Posts: 1243
- Joined: Sat Dec 13, 2008 7:00 pm
Re: Some speed tests with Leela and Allie
Because the speed changes if you change the cache size (reason, see previous post).
(There's still a positive correlation in the general case, but you can come up with pathological examples I'm sure)
If you change the binary, you don't even know if nodes are counted the same way.
-
- Posts: 3657
- Joined: Wed Nov 18, 2015 11:41 am
- Location: hungary
Re: Some speed tests with Leela and Allie
Please, read my post again and do not miss the parameters.Gian-Carlo Pascutto wrote: ↑Thu Sep 19, 2019 10:35 pmBecause the speed changes if you change the cache size (reason, see previous post).
(There's still a positive correlation in the general case, but you can come up with pathological examples I'm sure)
If you change the binary, you don't even know if nodes are counted the same way.
Using the same NET and parameters if I change the binaries yielded from the same source the speeds will differ only because of "noise".
If I use different binaries from different sources but the sources are not far from each other
(as Crem stated) then in the case of the same NET the connection between speed and depth may be
rather similar.
I think everybody have right to get such a conclusion from my results what she/he would like.
Last edited by corres on Thu Sep 19, 2019 11:03 pm, edited 1 time in total.
-
- Posts: 3657
- Joined: Wed Nov 18, 2015 11:41 am
- Location: hungary
Re: Some speed tests with Leela and Allie
...
Totally irrelevant.
Allie authour explain how he count nodes in Leela discord and Tcec twitch chat.
Leela discord--- Technical channel is the best to discuss NN stuffs.
[/quote]
Why you think you are the only one who read my post?
No everybody like just the high-flown articles.
Totally irrelevant.
Allie authour explain how he count nodes in Leela discord and Tcec twitch chat.
Leela discord--- Technical channel is the best to discuss NN stuffs.
[/quote]
Why you think you are the only one who read my post?
No everybody like just the high-flown articles.