CUDA cores seem to perform well. Maybe for Leela case a 60-70% or so over RTX 2080 (non-super), but let's see the benches.mmt wrote: ↑Wed Sep 16, 2020 9:17 pmA lot of reviews of 3080 are out but they focus almost exclusively on games. The closest I've seen is this https://babeltechreviews.com/rtx-3080-a ... hmarked/4/ with a 27% increase of half-float performance over 2080Ti.
I stumbled upon this article on the new Nvidia RTX GPUs
Moderators: hgm, Dann Corbit, Harvey Williamson
Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Re: I stumbled upon this article on the new Nvidia RTX GPUs
Re: I stumbled upon this article on the new Nvidia RTX GPUs
However maybe a bit less than 50% improvement with 3070 over my 2070 next month. This time 3080 seems the best deal. Last time it was 2070 or 2060. But aside money, 3080 seems way too large, and it consumes like an air conditioner, in real terms in excess of 350W.Laskos wrote: ↑Wed Sep 16, 2020 10:07 pmCUDA cores seem to perform well. Maybe for Leela case a 60-70% or so over RTX 2080 (non-super), but let's see the benches.mmt wrote: ↑Wed Sep 16, 2020 9:17 pmA lot of reviews of 3080 are out but they focus almost exclusively on games. The closest I've seen is this https://babeltechreviews.com/rtx-3080-a ... hmarked/4/ with a 27% increase of half-float performance over 2080Ti.
Re: I stumbled upon this article on the new Nvidia RTX GPUs
After all, if only for Chess and Go, maybe the best is to spend just $250 and get a second hand 2060 Super on top of my 2070, close to 100% boost. Will anyway have to upgrade the case and the overall cooling.Laskos wrote: ↑Wed Sep 16, 2020 11:32 pmHowever maybe a bit less than 50% improvement with 3070 over my 2070 next month. This time 3080 seems the best deal. Last time it was 2070 or 2060. But aside money, 3080 seems way too large, and it consumes like an air conditioner, in real terms in excess of 350W.Laskos wrote: ↑Wed Sep 16, 2020 10:07 pmCUDA cores seem to perform well. Maybe for Leela case a 60-70% or so over RTX 2080 (non-super), but let's see the benches.mmt wrote: ↑Wed Sep 16, 2020 9:17 pmA lot of reviews of 3080 are out but they focus almost exclusively on games. The closest I've seen is this https://babeltechreviews.com/rtx-3080-a ... hmarked/4/ with a 27% increase of half-float performance over 2080Ti.
Re: I stumbled upon this article on the new Nvidia RTX GPUs
Or buy yourself 20 cores and abandon giant networks that insist on GPULaskos wrote: ↑Thu Sep 17, 2020 10:28 amAfter all, if only for Chess and Go, maybe the best is to spend just $250 and get a second hand 2060 Super on top of my 2070, close to 100% boost. Will anyway have to upgrade the case and the overall cooling.Laskos wrote: ↑Wed Sep 16, 2020 11:32 pmHowever maybe a bit less than 50% improvement with 3070 over my 2070 next month. This time 3080 seems the best deal. Last time it was 2070 or 2060. But aside money, 3080 seems way too large, and it consumes like an air conditioner, in real terms in excess of 350W.Laskos wrote: ↑Wed Sep 16, 2020 10:07 pmCUDA cores seem to perform well. Maybe for Leela case a 60-70% or so over RTX 2080 (non-super), but let's see the benches.mmt wrote: ↑Wed Sep 16, 2020 9:17 pmA lot of reviews of 3080 are out but they focus almost exclusively on games. The closest I've seen is this https://babeltechreviews.com/rtx-3080-a ... hmarked/4/ with a 27% increase of half-float performance over 2080Ti.
Re: I stumbled upon this article on the new Nvidia RTX GPUs
Well, machine learning is important per se, and regarding board games, Go and some other turn based games not relying on AB search and massive pruning are best played by PCs using GPUs. Then, although I almost never play video games, to try one or two of the high end can be enjoyable.chrisw wrote: ↑Thu Sep 17, 2020 11:47 amOr buy yourself 20 cores and abandon giant networks that insist on GPULaskos wrote: ↑Thu Sep 17, 2020 10:28 amAfter all, if only for Chess and Go, maybe the best is to spend just $250 and get a second hand 2060 Super on top of my 2070, close to 100% boost. Will anyway have to upgrade the case and the overall cooling.Laskos wrote: ↑Wed Sep 16, 2020 11:32 pmHowever maybe a bit less than 50% improvement with 3070 over my 2070 next month. This time 3080 seems the best deal. Last time it was 2070 or 2060. But aside money, 3080 seems way too large, and it consumes like an air conditioner, in real terms in excess of 350W.Laskos wrote: ↑Wed Sep 16, 2020 10:07 pmCUDA cores seem to perform well. Maybe for Leela case a 60-70% or so over RTX 2080 (non-super), but let's see the benches.mmt wrote: ↑Wed Sep 16, 2020 9:17 pmA lot of reviews of 3080 are out but they focus almost exclusively on games. The closest I've seen is this https://babeltechreviews.com/rtx-3080-a ... hmarked/4/ with a 27% increase of half-float performance over 2080Ti.
Re: I stumbled upon this article on the new Nvidia RTX GPUs
Someone who understands better can see and explain something here?
https://www.reddit.com/r/MachineLearnin ... 0_for_dnn/
https://www.reddit.com/r/MachineLearnin ... 0_for_dnn/
-
- Posts: 1617
- Joined: Wed Mar 10, 2010 9:18 pm
- Location: Hamburg, Germany
- Full name: Srdja Matovic
- Contact:
Re: I stumbled upon this article on the new Nvidia RTX GPUs
Page 22 seems interesting:Laskos wrote: ↑Fri Sep 18, 2020 9:44 amSomeone who understands better can see and explain something here?
https://www.reddit.com/r/MachineLearnin ... 0_for_dnn/
https://www.nvidia.com/content/dam/en-z ... per-V1.pdf
But I am not able to forecast you how this 2xFP32 and 2xTensorOps of RTX 30xx will translate to current Lc0.
--
Srdja
Re: I stumbled upon this article on the new Nvidia RTX GPUs
What I gathered says "it's complicated", the cycles come from many parts of the computation, so is the cycle number reduction by different components like tensor cores. CUDA etc. The range 1.40 to 2.20 is still possible for the speed-up from RTX 2080 to 3080 with Lc0 as it is built now. Some links:smatovic wrote: ↑Fri Sep 18, 2020 10:54 amPage 22 seems interesting:Laskos wrote: ↑Fri Sep 18, 2020 9:44 amSomeone who understands better can see and explain something here?
https://www.reddit.com/r/MachineLearnin ... 0_for_dnn/
https://www.nvidia.com/content/dam/en-z ... per-V1.pdf
But I am not able to forecast you how this 2xFP32 and 2xTensorOps of RTX 30xx will translate to current Lc0.
--
Srdja
https://timdettmers.com/2020/09/07/whic ... nsor_Cores
https://www.pugetsystems.com/labs/hpc/R ... nary-1885/
-
- Posts: 1617
- Joined: Wed Mar 10, 2010 9:18 pm
- Location: Hamburg, Germany
- Full name: Srdja Matovic
- Contact:
Re: I stumbled upon this article on the new Nvidia RTX GPUs
Hmm, according to all those articles and papers, a slow down of RTX 3080 compared to RTX 2080 TI in some AI tasks is also possible.Laskos wrote: ↑Fri Sep 18, 2020 11:40 amWhat I gathered says "it's complicated", the cycles come from many parts of the computation, so is the cycle number reduction by different components like tensor cores. CUDA etc. The range 1.40 to 2.20 is still possible for the speed-up from RTX 2080 to 3080 with Lc0 as it is built now. Some links:smatovic wrote: ↑Fri Sep 18, 2020 10:54 amPage 22 seems interesting:Laskos wrote: ↑Fri Sep 18, 2020 9:44 amSomeone who understands better can see and explain something here?
https://www.reddit.com/r/MachineLearnin ... 0_for_dnn/
https://www.nvidia.com/content/dam/en-z ... per-V1.pdf
But I am not able to forecast you how this 2xFP32 and 2xTensorOps of RTX 30xx will translate to current Lc0.
--
Srdja
https://timdettmers.com/2020/09/07/whic ... nsor_Cores
https://www.pugetsystems.com/labs/hpc/R ... nary-1885/
You should compare 3080 with 2080 TI, they have similar SM core count.
--
Srdja
Re: I stumbled upon this article on the new Nvidia RTX GPUs
I seem to manage to extrapolate from this chart:smatovic wrote: ↑Fri Sep 18, 2020 4:17 pmHmm, according to all those articles and papers, a slow down of RTX 3080 compared to RTX 2080 TI in some AI tasks is also possible.Laskos wrote: ↑Fri Sep 18, 2020 11:40 amWhat I gathered says "it's complicated", the cycles come from many parts of the computation, so is the cycle number reduction by different components like tensor cores. CUDA etc. The range 1.40 to 2.20 is still possible for the speed-up from RTX 2080 to 3080 with Lc0 as it is built now. Some links:smatovic wrote: ↑Fri Sep 18, 2020 10:54 amPage 22 seems interesting:Laskos wrote: ↑Fri Sep 18, 2020 9:44 amSomeone who understands better can see and explain something here?
https://www.reddit.com/r/MachineLearnin ... 0_for_dnn/
https://www.nvidia.com/content/dam/en-z ... per-V1.pdf
But I am not able to forecast you how this 2xFP32 and 2xTensorOps of RTX 30xx will translate to current Lc0.
--
Srdja
https://timdettmers.com/2020/09/07/whic ... nsor_Cores
https://www.pugetsystems.com/labs/hpc/R ... nary-1885/
You should compare 3080 with 2080 TI, they have similar SM core count.
--
Srdja
https://www.pugetsystems.com/labs/hpc/R ... nary-1885/

Here we cannot compare directly old RTX 2080 Ti numbers with the RTX 3080 test. RTX 3080 test (1023 images/sec) uses significantly newer drivers, TensorFlow version, testing setup. But we have RTX Titan tested now which got 1082 images/sec on FP16 with the old result which was 653, compared with RTX 2080 Ti of 532 (old result). By extrapolation, with the "old setup" 3080 would get 617 images/sec, and now we can compare to 2080 Ti (532) and 2080 (382). The speed-up RTX 2080 --> 3080 is about 60%, which is good but not great.