which is strongest NN network for cpu only?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
lkaufman
Posts: 3766
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: which is strongest NN network for cpu only?

Post by lkaufman » Fri Sep 06, 2019 10:46 pm

Modern Times wrote:
Fri Sep 06, 2019 10:17 pm
lkaufman wrote:
Fri Sep 06, 2019 10:02 pm

OK, I'll rephrase the question. What is the best network and settings for any NN on 7 threads of an 8 core, very fast i7 machine? LD2 is beating 11248 on that config by 345 elo in my current test, so the question is whether some other network is even better, and whether default settings are appropriate?
So how strong is LD2 on that set-up Larry ?
I don't have any other test results yet, but 11248 cpu only is several hundred elo below the best cpu engines so I suppose even LD2 isn't one of the top CPU engines, but pretty good.
Komodo rules!

mwyoung
Posts: 1644
Joined: Wed May 12, 2010 8:00 pm

Re: which is strongest NN network for cpu only?

Post by mwyoung » Sat Sep 07, 2019 12:31 am

lkaufman wrote:
Fri Sep 06, 2019 10:02 pm
dkappe wrote:
Fri Sep 06, 2019 9:24 pm
pohl4711 wrote:
Fri Sep 06, 2019 7:05 pm
lkaufman wrote:
Fri Sep 06, 2019 6:14 pm
Which NN network, Lc0 or other, is currently believed to be the strongest one for use only on a CPU, no GPU? I've seen posts on this before, but this is always changing. I understand it should be a small network.
No doubt, that LD2 is the strongest for CPU. 10x128 built out of T40 training games.

https://lc0.org/ld2
There is significant doubt. There's a sweet spot for CPU which depends on nps. Generally, the slower the CPU, the better 11258-112x9-se performs vs nets like LD2. Indeed, on slow Android devices, 11258-48x5-se outperforms LD2 comfortably. The best thing is to grab a few nets and test them out on your particular setup
OK, I'll rephrase the question. What is the best network and settings for any NN on 7 threads of an 8 core, very fast i7 machine? LD2 is beating 11248 on that config by 345 elo in my current test, so the question is whether some other network is even better, and whether default settings are appropriate?

After running over 10,000 test games with Lc0. Here is what I know. The smaller nets perform best on CPU, the biggest nets run best on RTX GPU's (320x24b). And by best I mean better Elo gains with everything else being equal.

And for the love of god don't core cut your processor by using 7 threads, and a 8 core machine running Lc0. That is a waste of resources. You are wasting 1 core of your system to run windows, and it does not need that much run time. There is a better way. One easy way if using the Fritz GUI is to configure Lc0 to run at below normal priority. Then run Lc0 or a A/B engine with all 8 cores for best performance. You can do this by checking the below normal box when setting up Lc0. This is the best setup for running Lc0 by itself, not 2 engine testing....
Professing themselves to be wise, they became fools,
Take on me. foes 0

dkappe
Posts: 273
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: which is strongest NN network for cpu only?

Post by dkappe » Sat Sep 07, 2019 1:13 am

lkaufman wrote:
Fri Sep 06, 2019 10:02 pm
OK, I'll rephrase the question. What is the best network and settings for any NN on 7 threads of an 8 core, very fast i7 machine? LD2 is beating 11248 on that config by 345 elo in my current test, so the question is whether some other network is even better, and whether default settings are appropriate?
I'm surprised that 11248 does even that well. Part of my work distilling 11258 to smaller sizes was finding the best combination of NPS and smarts. For a reasonable CPU, LD2 may be among the best. For a less powerful CPU 11258-112x9-se (112 filters by 9 blocks) may do better than LD2.

Ferdy
Posts: 4113
Joined: Sun Aug 10, 2008 1:15 pm
Location: Philippines

Re: which is strongest NN network for cpu only?

Post by Ferdy » Sat Sep 07, 2019 9:58 pm

TC is also a factor.

Image

mesilikas
Posts: 28
Joined: Mon Jan 01, 2018 11:54 am

Re: which is strongest NN network for cpu only?

Post by mesilikas » Sat Sep 07, 2019 10:25 pm

What about other settings (smart prunning, max prefetch, cpuct etc) Ferdy? Are you use default ?

Ferdy
Posts: 4113
Joined: Sun Aug 10, 2008 1:15 pm
Location: Philippines

Re: which is strongest NN network for cpu only?

Post by Ferdy » Sun Sep 08, 2019 6:25 am

mesilikas wrote:
Sat Sep 07, 2019 10:25 pm
What about other settings (smart prunning, max prefetch, cpuct etc) Ferdy? Are you use default ?
Other options are on their default values.

Update, added more games in tc 5m+3s and add new tc 10m+3s.

Image

Ferdy
Posts: 4113
Joined: Sun Aug 10, 2008 1:15 pm
Location: Philippines

Re: which is strongest NN network for cpu only?

Post by Ferdy » Sun Sep 08, 2019 4:40 pm

Added 256x20 at tc 10m+3s. It only scored around 17% after 36 games.

Image

Raphexon
Posts: 115
Joined: Sun Mar 17, 2019 11:00 am
Full name: Henk Drost

Re: which is strongest NN network for cpu only?

Post by Raphexon » Sun Sep 08, 2019 4:48 pm

Ferdy wrote:
Sat Sep 07, 2019 9:58 pm
TC is also a factor.

Image
NN-cache is a factor too.
But only if it gets filled up.

User avatar
Laskos
Posts: 9545
Joined: Wed Jul 26, 2006 8:21 pm
Full name: Kai Laskos

Re: which is strongest NN network for cpu only?

Post by Laskos » Sun Sep 08, 2019 6:49 pm

Ferdy wrote:
Sun Sep 08, 2019 4:40 pm
Added 256x20 at tc 10m+3s. It only scored around 17% after 36 games.

Image

Very good Ferdy. A proof that longer TC favor bigger, slower nets.

mwyoung
Posts: 1644
Joined: Wed May 12, 2010 8:00 pm

Re: which is strongest NN network for cpu only?

Post by mwyoung » Mon Sep 09, 2019 2:07 am

Laskos wrote:
Sun Sep 08, 2019 6:49 pm
Ferdy wrote:
Sun Sep 08, 2019 4:40 pm
Added 256x20 at tc 10m+3s. It only scored around 17% after 36 games.

Image

Very good Ferdy. A proof that longer TC favor bigger, slower nets.erers er
Or bigger hardware. That is why ccrl test and others can not gadge Lc0 correctly. Faster Hardware equals longer time controls.
Professing themselves to be wise, they became fools,
Take on me. foes 0

Post Reply