Lc0 GPU load

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
lovetb
Posts: 17
Joined: Thu Dec 13, 2018 5:57 am
Full name: MR PRASHANTH KRISHNACHARI

Lc0 GPU load

Post by lovetb » Tue Mar 05, 2019 12:17 am

Hi, I have been using Lc0 for a week now. The GPU load keeps going up & down.
You can see in the graph below,

Image

It doesn't stay at 100% like the CPUs when playing Stockfish.

Is this normal ?

mwyoung
Posts: 1795
Joined: Wed May 12, 2010 8:00 pm

Re: Lc0 GPU load

Post by mwyoung » Tue Mar 05, 2019 1:03 am

lovetb wrote:
Tue Mar 05, 2019 12:17 am
Hi, I have been using Lc0 for a week now. The GPU load keeps going up & down.
You can see in the graph below,

Image

It doesn't stay at 100% like the CPUs when playing Stockfish.

Is this normal ?
Yes, looks exactly like my graph. Put a 5xxxx NN on and see what happends.
Professing themselves to be wise, they became fools,
Take on me. foes 0

User avatar
M ANSARI
Posts: 3413
Joined: Thu Mar 16, 2006 6:10 pm

Re: Lc0 GPU load

Post by M ANSARI » Tue Mar 05, 2019 7:42 am

Maybe thermal issues and GPU is throttling?

lovetb
Posts: 17
Joined: Thu Dec 13, 2018 5:57 am
Full name: MR PRASHANTH KRISHNACHARI

Re: Lc0 GPU load

Post by lovetb » Tue Mar 05, 2019 7:52 am

M ANSARI wrote:
Tue Mar 05, 2019 7:42 am
Maybe thermal issues and GPU is throttling?
You are right. I left the case open for better air circulation & I unsinstalled MSI Afterburner.
I had better results.

Image

mwyoung
Posts: 1795
Joined: Wed May 12, 2010 8:00 pm

Re: Lc0 GPU load

Post by mwyoung » Tue Mar 05, 2019 3:00 pm

lovetb wrote:
Tue Mar 05, 2019 7:52 am
M ANSARI wrote:
Tue Mar 05, 2019 7:42 am
Maybe thermal issues and GPU is throttling?
You are right. I left the case open for better air circulation & I unsinstalled MSI Afterburner.
I had better results.

Image
If you reinstall msi afterburner. And go to settings and setup a custom fan curve. You will not have to leave your case open.

Unless your case has inadequate air flow.

The Factory fan curve is not good when running Lc0.

I have my fan curve hitting 100% fan speed when temps hit 60c. And this fan curve has worked very well.
Professing themselves to be wise, they became fools,
Take on me. foes 0

User avatar
M ANSARI
Posts: 3413
Joined: Thu Mar 16, 2006 6:10 pm

Re: Lc0 GPU load

Post by M ANSARI » Tue Mar 05, 2019 6:51 pm

I think throttling of the GPU was the cause of a few lost points for Lc0 in TCEC 14. There were a few moves that simply made no sense and I was using the same network with similar hardware. It might actually make sense to have some sort of water cooling for the GPU's.

smatovic
Posts: 1041
Joined: Wed Mar 10, 2010 9:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic
Contact:

Re: Lc0 GPU load

Post by smatovic » Tue Mar 05, 2019 7:21 pm

M ANSARI wrote:
Tue Mar 05, 2019 6:51 pm
I think throttling of the GPU was the cause of a few lost points for Lc0 in TCEC 14. There were a few moves that simply made no sense and I was using the same network with similar hardware. It might actually make sense to have some sort of water cooling for the GPU's.
Yea :)

I built a custom water cooling for my 275 Watt Fury X, and for hobbyists i can recommend a Zalman Reserator all in one passive cooler plus 120mm radiator and a 120mm water-temperature controlled fan. I really like the Zalman, i estimate it alone cools about 150 Watt...

https://www.newegg.com/Product/Product. ... 6835118111

As a rule of thumb - a 120mm radiator cools about 100 Watt, depended on the rpm of the fans.

--
Srdja
Last edited by smatovic on Tue Mar 05, 2019 7:38 pm, edited 1 time in total.

mwyoung
Posts: 1795
Joined: Wed May 12, 2010 8:00 pm

Re: Lc0 GPU load

Post by mwyoung » Tue Mar 05, 2019 7:25 pm

M ANSARI wrote:
Tue Mar 05, 2019 6:51 pm
I think throttling of the GPU was the cause of a few lost points for Lc0 in TCEC 14. There were a few moves that simply made no sense and I was using the same network with similar hardware. It might actually make sense to have some sort of water cooling for the GPU's.
Lc0 is very hard on a GPU. If you do not have a beefy air cooler. It will beat up a GPU. I bought a card with a beefy air cooler with triple fans. And I still had use a custom fan curve to keep temp under control. At full load now the card runs in the low 60's c.

After testing I found that it was not my temps causing weak play and moves. It was using minibatchsize = 1024. I lost some NPS by going back to 256, but test play is now much better. And the latest 4xxxx nets are on the verge of overtaking the latest DEV. of Stockfish playing on a 2950x at 5+5 TC. Around 10 elo difference.
Professing themselves to be wise, they became fools,
Take on me. foes 0

lovetb
Posts: 17
Joined: Thu Dec 13, 2018 5:57 am
Full name: MR PRASHANTH KRISHNACHARI

Re: Lc0 GPU load

Post by lovetb » Wed Mar 06, 2019 10:46 am

Thanks for all your replies.

If I try to host the GPU out of the box using a raiser card adopter something like shown below, will it affect the performance?
The idea is to give the gpu more cooler air to breath & to cool down.

Image

smatovic
Posts: 1041
Joined: Wed Mar 10, 2010 9:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic
Contact:

Re: Lc0 GPU load

Post by smatovic » Wed Mar 06, 2019 11:34 am

lovetb wrote:
Wed Mar 06, 2019 10:46 am
Thanks for all your replies.

If I try to host the GPU out of the box using a raiser card adopter something like shown below, will it affect the performance?
The idea is to give the gpu more cooler air to breath & to cool down.
Maybe this 6 way LC0 rig via PCIe risers is of interest for you

https://groups.google.com/forum/#!msg/l ... ihGJYCAwAJ

--
Srdja

Post Reply