I stumbled upon this article on the new Nvidia RTX GPUs

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: I stumbled upon this article on the new Nvidia RTX GPUs

Post by Laskos »

Werewolf wrote: Thu Sep 10, 2020 10:07 pm
Laskos wrote: Thu Sep 10, 2020 9:55 pm
Werewolf wrote: Thu Sep 10, 2020 9:09 pm A very long conversation on Lc0 discord yesterday suggested they wouldn't be that great
The reason? Not as great as possible 150% improvement or much much lower than that?
I didn’t stay for the whole thing but the gist of it was:

1) Lc0 uses tensor cores
2) new tensor performance has 2 values
3) Lc0 uses the lower one, which means the 3080 will be about the same as a 2080Ti.

We need clarity over premise 1 for starters.
I see, thanks. I see these values here for example, but I don't understand the issue:

https://www.anandtech.com/show/16057/nv ... 0-rtx-3090

Would be nasty if power consumption increases as much as the performance.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: I stumbled upon this article on the new Nvidia RTX GPUs

Post by Laskos »

mwyoung wrote: Thu Sep 10, 2020 10:13 pm
Laskos wrote: Thu Sep 10, 2020 9:55 pm
Werewolf wrote: Thu Sep 10, 2020 9:09 pm A very long conversation on Lc0 discord yesterday suggested they wouldn't be that great
The reason? Not as great as possible 150% improvement or much much lower than that?
If you are able to run 2 cards in your system, and it is for running Lc0. Buying a RTX 3070 for $499 would be great. RTX 2070+RTX 3070, and this should give you some very nice gains when running Lc0.
After 3070 appears and it disappoints us, 2070 and 2070 Super will go on cheapo, and I might go for additional one of those.
Werewolf
Posts: 1795
Joined: Thu Sep 18, 2008 10:24 pm

Re: I stumbled upon this article on the new Nvidia RTX GPUs

Post by Werewolf »

Laskos wrote: Thu Sep 10, 2020 10:19 pm
Werewolf wrote: Thu Sep 10, 2020 10:07 pm
Laskos wrote: Thu Sep 10, 2020 9:55 pm
Werewolf wrote: Thu Sep 10, 2020 9:09 pm A very long conversation on Lc0 discord yesterday suggested they wouldn't be that great
The reason? Not as great as possible 150% improvement or much much lower than that?
I didn’t stay for the whole thing but the gist of it was:

1) Lc0 uses tensor cores
2) new tensor performance has 2 values
3) Lc0 uses the lower one, which means the 3080 will be about the same as a 2080Ti.

We need clarity over premise 1 for starters.
I see, thanks. I see these values here for example, but I don't understand the issue:

https://www.anandtech.com/show/16057/nv ... 0-rtx-3090

Would be nasty if power consumption increases as much as the performance.
So one issue is that although the new tensor cores are better than the old ones, there are fewer of them in the new cards.

Anyway, here's an interesting read

https://en.wikipedia.org/wiki/List_of_N ... _30_series

scroll right until you get to tensor TFLOPS and you have to ignore sparse because apparently Lc0 doesn't use it.
From this alone the figures look ok, so I'm not sure what the issue was.
Lars Sandin
Posts: 2032
Joined: Sun Nov 18, 2007 5:17 pm
Location: Sundsvall, Sweden

Re: I stumbled upon this article on the new Nvidia RTX GPUs

Post by Lars Sandin »

mwyoung wrote: Thu Sep 10, 2020 10:13 pm
Laskos wrote: Thu Sep 10, 2020 9:55 pm
Werewolf wrote: Thu Sep 10, 2020 9:09 pm A very long conversation on Lc0 discord yesterday suggested they wouldn't be that great
The reason? Not as great as possible 150% improvement or much much lower than that?
If you are able to run 2 cards in your system, and it is for running Lc0. Buying a RTX 3070 for $499 would be great. RTX 2070+RTX 3070, and this should give you some very nice gains when running Lc0.
Unfortunately it doesn’t seem to be quite as simple this time around. :cry:

https://www.tomshardware.com/news/nvi ... r-rtx-3090
Lars Sandin, SSDF
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: I stumbled upon this article on the new Nvidia RTX GPUs

Post by mwyoung »

Lars Sandin wrote: Thu Sep 10, 2020 10:32 pm
mwyoung wrote: Thu Sep 10, 2020 10:13 pm
Laskos wrote: Thu Sep 10, 2020 9:55 pm
Werewolf wrote: Thu Sep 10, 2020 9:09 pm A very long conversation on Lc0 discord yesterday suggested they wouldn't be that great
The reason? Not as great as possible 150% improvement or much much lower than that?
If you are able to run 2 cards in your system, and it is for running Lc0. Buying a RTX 3070 for $499 would be great. RTX 2070+RTX 3070, and this should give you some very nice gains when running Lc0.
Unfortunately it doesn’t seem to be quite as simple this time around. :cry:

https://www.tomshardware.com/news/nvi ... r-rtx-3090
I do not think Lc0 is using this tech when running Lc0 on 2 or more cards. Does anyone know for sure.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
JohnW
Posts: 381
Joined: Thu Nov 22, 2012 12:20 am
Location: New Hampshire

Re: I stumbled upon this article on the new Nvidia RTX GPUs

Post by JohnW »

User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: I stumbled upon this article on the new Nvidia RTX GPUs

Post by Laskos »

Werewolf wrote: Thu Sep 10, 2020 10:31 pm
Laskos wrote: Thu Sep 10, 2020 10:19 pm
Werewolf wrote: Thu Sep 10, 2020 10:07 pm
Laskos wrote: Thu Sep 10, 2020 9:55 pm
Werewolf wrote: Thu Sep 10, 2020 9:09 pm A very long conversation on Lc0 discord yesterday suggested they wouldn't be that great
The reason? Not as great as possible 150% improvement or much much lower than that?
I didn’t stay for the whole thing but the gist of it was:

1) Lc0 uses tensor cores
2) new tensor performance has 2 values
3) Lc0 uses the lower one, which means the 3080 will be about the same as a 2080Ti.

We need clarity over premise 1 for starters.
I see, thanks. I see these values here for example, but I don't understand the issue:

https://www.anandtech.com/show/16057/nv ... 0-rtx-3090

Would be nasty if power consumption increases as much as the performance.
So one issue is that although the new tensor cores are better than the old ones, there are fewer of them in the new cards.

Anyway, here's an interesting read

https://en.wikipedia.org/wiki/List_of_N ... _30_series

scroll right until you get to tensor TFLOPS and you have to ignore sparse because apparently Lc0 doesn't use it.
From this alone the figures look ok, so I'm not sure what the issue was.
Anandtech and Wiki seem to disagree exactly in our case. I misread something?
Werewolf
Posts: 1795
Joined: Thu Sep 18, 2008 10:24 pm

Re: I stumbled upon this article on the new Nvidia RTX GPUs

Post by Werewolf »

The Anandtech article does indeed use different figures. Very odd.

My interpretation of the Anandtech article is negative though, since it claims 2080Ti tensor as 114; and 3080 as 119 TFLOPS (note fp16 non sparse).

That’s a tiny improvement.
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: I stumbled upon this article on the new Nvidia RTX GPUs

Post by Milos »

chrisw wrote: Thu Sep 10, 2020 9:57 pm
Laskos wrote: Thu Sep 10, 2020 8:36 pm https://www.engadget.com/nvidia-rtx-309 ... 59544.html

If I understood correctly, the improvement in our case compared to 2xxx generation will be great, right?
If yes, I am starting putting aside bit by bit, so that in November I will get a 3070.
The real deal will be when (if ever) GPU and CPU functionality are on one chip, able to seamlessly address the same memory and there are included asm instructions to perform matrix operations (plus C+++)
That will never happen at least for high-end GPUs, mostly due to thermal problems/packaging of the SoC that would contain both CPU and GPU. What we really need is GPU that can access main memory seamlessly and concurrently with CPU.
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: I stumbled upon this article on the new Nvidia RTX GPUs

Post by Milos »

Laskos wrote: Thu Sep 10, 2020 9:55 pm
Werewolf wrote: Thu Sep 10, 2020 9:09 pm A very long conversation on Lc0 discord yesterday suggested they wouldn't be that great
The reason? Not as great as possible 150% improvement or much much lower than that?
http://talkchess.com/forum3/viewtopic.p ... 9&#p846617