which is strongest NN network for cpu only?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

which is strongest NN network for cpu only?

Post by lkaufman »

Which NN network, Lc0 or other, is currently believed to be the strongest one for use only on a CPU, no GPU? I've seen posts on this before, but this is always changing. I understand it should be a small network.
Komodo rules!
User avatar
Tibono
Posts: 79
Joined: Sat Aug 01, 2015 6:16 pm
Location: France

Re: which is strongest NN network for cpu only?

Post by Tibono »

Hello Larry,

indeed a size balance affair, according to your CPU. Strongest on my old laptop (CPU T4500@2,3Ghz) using 1 single core is 11258-112x9-se (distilled by Dietrich Kappe). I know, it is an old one, but I could find no convincing one within more recent stuff. My associated setting: MiniBatchSize 16, MaxPrefetch 0, CPuct 1.7
Not a definite statement, but should you like to perform tests, a must include one.
User avatar
pohl4711
Posts: 2433
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: which is strongest NN network for cpu only?

Post by pohl4711 »

lkaufman wrote: Fri Sep 06, 2019 8:14 pm Which NN network, Lc0 or other, is currently believed to be the strongest one for use only on a CPU, no GPU? I've seen posts on this before, but this is always changing. I understand it should be a small network.
No doubt, that LD2 is the strongest for CPU. 10x128 built out of T40 training games.

https://lc0.org/ld2
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: which is strongest NN network for cpu only?

Post by lkaufman »

pohl4711 wrote: Fri Sep 06, 2019 9:05 pm
lkaufman wrote: Fri Sep 06, 2019 8:14 pm Which NN network, Lc0 or other, is currently believed to be the strongest one for use only on a CPU, no GPU? I've seen posts on this before, but this is always changing. I understand it should be a small network.
No doubt, that LD2 is the strongest for CPU. 10x128 built out of T40 training games.

https://lc0.org/ld2
Thanks, do you happen to know what Lc0 version and what settings would be best with LD2 for CPU use? Is there any maximum number of threads that will contribute to strength?
Komodo rules!
User avatar
pohl4711
Posts: 2433
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: which is strongest NN network for cpu only?

Post by pohl4711 »

lkaufman wrote:
Thanks, do you happen to know what Lc0 version and what settings would be best with LD2 for CPU use? Is there any maximum number of threads that will contribute to strength?
The latest lc0 0.22.0, no reason to choose an older version. And when lc0 thinks on CPU only, there is no thread-limit. The more Threads/Cores the better the chess. But I did not test that with more than 8 threads/4 cores...
Recommended settings (especially on slow CPUs (Smartphones...)) are:
MiniBatchsize = 8 and MaxPrefetch = 0.
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: which is strongest NN network for cpu only?

Post by dkappe »

pohl4711 wrote: Fri Sep 06, 2019 9:05 pm
lkaufman wrote: Fri Sep 06, 2019 8:14 pm Which NN network, Lc0 or other, is currently believed to be the strongest one for use only on a CPU, no GPU? I've seen posts on this before, but this is always changing. I understand it should be a small network.
No doubt, that LD2 is the strongest for CPU. 10x128 built out of T40 training games.

https://lc0.org/ld2
There is significant doubt. There's a sweet spot for CPU which depends on nps. Generally, the slower the CPU, the better 11258-112x9-se performs vs nets like LD2. Indeed, on slow Android devices, 11258-48x5-se outperforms LD2 comfortably. The best thing is to grab a few nets and test them out on your particular setup
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
mesilikas
Posts: 39
Joined: Mon Jan 01, 2018 12:54 pm

Re: which is strongest NN network for cpu only?

Post by mesilikas »

Can you recommend some settings dkappe?
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: which is strongest NN network for cpu only?

Post by dkappe »

mesilikas wrote: Fri Sep 06, 2019 11:35 pm Can you recommend some settings dkappe?
Default should be good for starters (though a higher number of threads are useful on more powerful CPU's).
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: which is strongest NN network for cpu only?

Post by lkaufman »

dkappe wrote: Fri Sep 06, 2019 11:24 pm
pohl4711 wrote: Fri Sep 06, 2019 9:05 pm
lkaufman wrote: Fri Sep 06, 2019 8:14 pm Which NN network, Lc0 or other, is currently believed to be the strongest one for use only on a CPU, no GPU? I've seen posts on this before, but this is always changing. I understand it should be a small network.
No doubt, that LD2 is the strongest for CPU. 10x128 built out of T40 training games.

https://lc0.org/ld2
There is significant doubt. There's a sweet spot for CPU which depends on nps. Generally, the slower the CPU, the better 11258-112x9-se performs vs nets like LD2. Indeed, on slow Android devices, 11258-48x5-se outperforms LD2 comfortably. The best thing is to grab a few nets and test them out on your particular setup
OK, I'll rephrase the question. What is the best network and settings for any NN on 7 threads of an 8 core, very fast i7 machine? LD2 is beating 11248 on that config by 345 elo in my current test, so the question is whether some other network is even better, and whether default settings are appropriate?
Komodo rules!
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: which is strongest NN network for cpu only?

Post by Modern Times »

lkaufman wrote: Sat Sep 07, 2019 12:02 am
OK, I'll rephrase the question. What is the best network and settings for any NN on 7 threads of an 8 core, very fast i7 machine? LD2 is beating 11248 on that config by 345 elo in my current test, so the question is whether some other network is even better, and whether default settings are appropriate?
So how strong is LD2 on that set-up Larry ?