Upcoming graphics cards for Leela

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Werewolf
Posts: 1175
Joined: Thu Sep 18, 2008 8:24 pm

Upcoming graphics cards for Leela

Post by Werewolf » Sat Aug 11, 2018 4:23 pm

According to this site

http://www.hexus.net/tech/news/graphics ... r-roundup/

new cards from Nvidia are on their way. The speed difference is mentioned with existing cards. Unless my maths is off I calculate the following speedups based on an old 1060 = 1

TITAN RTS = 3.40
TITAN V = 2.96
2080 = 2.46
1080Ti = 2.28
2070 = 1.95
1080 = 1.64
1070 = 1.37
2060 = 1.27
1060 = 1

Obviously the measurements they used may not apply neatly to Leela, but it gives an idea. Looks to me Nvidia are starting to slow down a bit at the top end.

Werewolf
Posts: 1175
Joined: Thu Sep 18, 2008 8:24 pm

Re: Upcoming graphics cards for Leela

Post by Werewolf » Tue Aug 21, 2018 9:00 am

Here's some better info, based on what's now released and in terms of TFLOPS, rather than FPS or something silly like that.

Titan RTX (??)
Quadro RTX 6000 - 15.9
Titan V - 14.9 (29.8 half P)
2080 Ti - 13.4
Quadro P6000 - 11.7
1080 Ti - 11.3
Quadro RTX 5000 - 10.6
2080 - 10.1
Quadro P5000 - 9.5
1080 - 8.9
2070 - 7.5
1060 - 4.4

Dann Corbit
Posts: 9780
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Upcoming graphics cards for Leela

Post by Dann Corbit » Tue Aug 21, 2018 11:32 pm

I just bought a 1080 Ti because you can get them under $700 now.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

Nay Lin Tun
Posts: 501
Joined: Mon Jan 16, 2012 5:34 am

Re: Upcoming graphics cards for Leela

Post by Nay Lin Tun » Tue Aug 21, 2018 11:53 pm

Dann Corbit wrote:
Tue Aug 21, 2018 11:32 pm
I just bought a 1080 Ti because you can get them under $700 now.
Well, for AI (Leela ). New cards are advertised as 10x faster ?? :shock:
https://wccftech.com/nvidia-rtx-2080-ti ... y-tracing/

Dann Corbit
Posts: 9780
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Upcoming graphics cards for Leela

Post by Dann Corbit » Wed Aug 22, 2018 12:02 am

Nay Lin Tun wrote:
Tue Aug 21, 2018 11:53 pm
Dann Corbit wrote:
Tue Aug 21, 2018 11:32 pm
I just bought a 1080 Ti because you can get them under $700 now.
Well, for AI (Leela ). New cards are advertised as 10x faster ?? :shock:
https://wccftech.com/nvidia-rtx-2080-ti ... y-tracing/
If Werewolf's numbers are accurate, then 2080 Ti - 13.4 over 1080 Ti - 11.3: gives:
13.4 / 11.3 = 1.18 times faster. 18%.
Cost of 2080 ti is $1199.00

1199.00 / 650 = 1.84 or 84% more.

I get a lot better mips per dollar.
I also bought 4 smaller cards recently (1060? I forget).
I am going to put those in one of my Unix boxes.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

jkiliani
Posts: 143
Joined: Wed Jan 17, 2018 12:26 pm

Re: Upcoming graphics cards for Leela

Post by jkiliani » Wed Aug 22, 2018 1:48 am

Werewolf wrote:
Tue Aug 21, 2018 9:00 am
Here's some better info, based on what's now released and in terms of TFLOPS, rather than FPS or something silly like that.

Titan RTX (??)
Quadro RTX 6000 - 15.9
Titan V - 14.9 (29.8 half P)
2080 Ti - 13.4
Quadro P6000 - 11.7
1080 Ti - 11.3
Quadro RTX 5000 - 10.6
2080 - 10.1
Quadro P5000 - 9.5
1080 - 8.9
2070 - 7.5
1060 - 4.4
I think this is incorrect. While we don't have actual test benchmarks yet, the RTX lineup shares wiith the Titan V one important advantage over the GTX 10x0 cards: It can utilize fp16 inference fully, which gives a factor of 2 to speed in addition to the TFLOPS you posted. Currently, a Titan V can do around triple the Leela NPS that a 1080Ti can do, and the 2080Ti should be very close to that.

Milos
Posts: 3348
Joined: Wed Nov 25, 2009 12:47 am

Re: Upcoming graphics cards for Leela

Post by Milos » Wed Aug 22, 2018 2:22 am

jkiliani wrote:
Wed Aug 22, 2018 1:48 am
Werewolf wrote:
Tue Aug 21, 2018 9:00 am
Here's some better info, based on what's now released and in terms of TFLOPS, rather than FPS or something silly like that.

Titan RTX (??)
Quadro RTX 6000 - 15.9
Titan V - 14.9 (29.8 half P)
2080 Ti - 13.4
Quadro P6000 - 11.7
1080 Ti - 11.3
Quadro RTX 5000 - 10.6
2080 - 10.1
Quadro P5000 - 9.5
1080 - 8.9
2070 - 7.5
1060 - 4.4
I think this is incorrect. While we don't have actual test benchmarks yet, the RTX lineup shares wiith the Titan V one important advantage over the GTX 10x0 cards: It can utilize fp16 inference fully, which gives a factor of 2 to speed in addition to the TFLOPS you posted. Currently, a Titan V can do around triple the Leela NPS that a 1080Ti can do, and the 2080Ti should be very close to that.
Why this BS-ing when it is also known that neither 2070, nor 2080, nor 2080Ti will have real FP16, i.e. all 3 will have it as 10xx cards at 1:64 rate?
Only Quadro's and Titan RTX will have actual FP16.

jkiliani
Posts: 143
Joined: Wed Jan 17, 2018 12:26 pm

Re: Upcoming graphics cards for Leela

Post by jkiliani » Wed Aug 22, 2018 2:37 am

Milos wrote:
Wed Aug 22, 2018 2:22 am
Why this BS-ing when it is also known that neither 2070, nor 2080, nor 2080Ti will have real FP16, i.e. all 3 will have it as 10xx cards at 1:64 rate?
Only Quadro's and Titan RTX will have actual FP16.
Someone who actually works for Nvidia driver development has stated the exact opposite of this on Leela Discord: "Rtx 2080ti is almost same as titan v for lc0" (by Ankan, https://chessprogramming.wikispaces.com/Ankan+Banerjee). So if you want to call BS on me, you'd better back that up with actual data.

Milos
Posts: 3348
Joined: Wed Nov 25, 2009 12:47 am

Re: Upcoming graphics cards for Leela

Post by Milos » Wed Aug 22, 2018 3:01 am

jkiliani wrote:
Wed Aug 22, 2018 2:37 am
Milos wrote:
Wed Aug 22, 2018 2:22 am
Why this BS-ing when it is also known that neither 2070, nor 2080, nor 2080Ti will have real FP16, i.e. all 3 will have it as 10xx cards at 1:64 rate?
Only Quadro's and Titan RTX will have actual FP16.
Someone who actually works for Nvidia driver development has stated the exact opposite of this on Leela Discord: "Rtx 2080ti is almost same as titan v for lc0" (by Ankan, https://chessprogramming.wikispaces.com/Ankan+Banerjee). So if you want to call BS on me, you'd better back that up with actual data.
Sorry that I believe more the most reputable graphics and hardware in general test and review website than hearsay of some quasi insider especially when it defies common sense.
https://www.techpowerup.com/gpudb/3305/ ... tx-2080-ti

Nay Lin Tun
Posts: 501
Joined: Mon Jan 16, 2012 5:34 am

Re: Upcoming graphics cards for Leela

Post by Nay Lin Tun » Wed Aug 22, 2018 6:44 am

This looks like detail article. (in short, 2080Ti will perform 2 x AI works than 1080Ti)
http://timdettmers.com/2018/08/21/which ... -learning/

Post Reply