Page 4 of 6

Re: how good is a GeForce GTX 1060 6GB for Leela ?

Posted: Tue May 01, 2018 3:11 pm
by jpqy
Milos..can you make a screen..

As these guys has better graphic cards and get lower nodes/sec. than you get.

https://docs.google.com/spreadsheets/d/ ... =857482380

Run it with ID229

Re: how good is a GeForce GTX 1060 6GB for Leela ?

Posted: Tue May 01, 2018 3:13 pm
by Werewolf
Dann Corbit wrote:Titan V has tensor cores.
But they are fiddly to use and you have to program especially for them.
The Titan V also "only" has 640 of them. I suspect its successor will cram in many more.

Re: how good is a GeForce GTX 1060 6GB for Leela ?

Posted: Tue May 01, 2018 3:19 pm
by Werewolf
Milos wrote:
Judging be the current proper benchmark (LC0 on cuDNN), Titan V is only 3.5 times faster than GTX 960, and 2.2 times 1080ti. And GTX 960 is at least 15 times cheaper than Titan V.
How do you work that out? The Titan V isn't 2.2x faster than a 1080 ti according to either the GFLOPS (12300 vs 10600 respectively) or the benchmarks here

https://docs.google.com/spreadsheets/d/ ... edit#gid=0

Unless I'm misreading them.

Re: how good is a GeForce GTX 1060 6GB for Leela ?

Posted: Tue May 01, 2018 4:47 pm
by Dann Corbit
Werewolf wrote:
Dann Corbit wrote:Titan V has tensor cores.
But they are fiddly to use and you have to program especially for them.
The Titan V also "only" has 640 of them. I suspect its successor will cram in many more.
They can multiply a small matrix in a single cycle (the tensor cores).

Re: how good is a GeForce GTX 1060 6GB for Leela ?

Posted: Tue May 01, 2018 4:51 pm
by Milos
Werewolf wrote:
Milos wrote:
Judging be the current proper benchmark (LC0 on cuDNN), Titan V is only 3.5 times faster than GTX 960, and 2.2 times 1080ti. And GTX 960 is at least 15 times cheaper than Titan V.
How do you work that out? The Titan V isn't 2.2x faster than a 1080 ti according to either the GFLOPS (12300 vs 10600 respectively) or the benchmarks here

https://docs.google.com/spreadsheets/d/ ... edit#gid=0

Unless I'm misreading them.
You should look at windows version of LC0-cudnn on Titan V since CUDA libs for windows are obviously better for tensor cores (Titan V) than linux ones.

Re: how good is a GeForce GTX 1060 6GB for Leela ?

Posted: Tue May 01, 2018 4:55 pm
by Milos
Dann Corbit wrote:
Werewolf wrote:
Dann Corbit wrote:Titan V has tensor cores.
But they are fiddly to use and you have to program especially for them.
The Titan V also "only" has 640 of them. I suspect its successor will cram in many more.
They can multiply a small matrix in a single cycle (the tensor cores).
4x4 one to be precise. Since LC0 kernal is 3x3 there is roughly only 1/3 efficiency ((27+9*2)/(81+16*3) operations) when running LC0 only on tensor cores, assuming ofc that they are fully loaded and that cuDNN libs are efficient for them, which is a big question mark at the moment.

Re: how good is a GeForce GTX 1060 6GB for Leela ?

Posted: Tue May 01, 2018 5:00 pm
by Albert Silver
Milos wrote:
Werewolf wrote:
Milos wrote:
Judging be the current proper benchmark (LC0 on cuDNN), Titan V is only 3.5 times faster than GTX 960, and 2.2 times 1080ti. And GTX 960 is at least 15 times cheaper than Titan V.
How do you work that out? The Titan V isn't 2.2x faster than a 1080 ti according to either the GFLOPS (12300 vs 10600 respectively) or the benchmarks here

https://docs.google.com/spreadsheets/d/ ... edit#gid=0

Unless I'm misreading them.
You should look at windows version of LC0-cudnn on Titan V since CUDA libs for windows are obviously better for tensor cores (Titan V) than linux ones.
Is it enough to download and install CUDA or do I need something else such as special commandline or executable? If so, can you point the way?

Re: how good is a GeForce GTX 1060 6GB for Leela ?

Posted: Tue May 01, 2018 5:04 pm
by Milos
Albert Silver wrote:
Milos wrote:
Werewolf wrote:
Milos wrote:
Judging be the current proper benchmark (LC0 on cuDNN), Titan V is only 3.5 times faster than GTX 960, and 2.2 times 1080ti. And GTX 960 is at least 15 times cheaper than Titan V.
How do you work that out? The Titan V isn't 2.2x faster than a 1080 ti according to either the GFLOPS (12300 vs 10600 respectively) or the benchmarks here

https://docs.google.com/spreadsheets/d/ ... edit#gid=0

Unless I'm misreading them.
You should look at windows version of LC0-cudnn on Titan V since CUDA libs for windows are obviously better for tensor cores (Titan V) than linux ones.
Is it enough to download and install CUDA or do I need something else such as special commandline or executable? If so, can you point the way?
You need to compile proper executable, however there are already precompiles available.
Look here:
https://github.com/mooskagh/leela-chess/tree/master/lc0

Re: how good is a GeForce GTX 1060 6GB for Leela ?

Posted: Tue May 01, 2018 5:26 pm
by Albert Silver
Milos wrote:
Albert Silver wrote:
Milos wrote:
Werewolf wrote:
Milos wrote:
Judging be the current proper benchmark (LC0 on cuDNN), Titan V is only 3.5 times faster than GTX 960, and 2.2 times 1080ti. And GTX 960 is at least 15 times cheaper than Titan V.
How do you work that out? The Titan V isn't 2.2x faster than a 1080 ti according to either the GFLOPS (12300 vs 10600 respectively) or the benchmarks here

https://docs.google.com/spreadsheets/d/ ... edit#gid=0

Unless I'm misreading them.
You should look at windows version of LC0-cudnn on Titan V since CUDA libs for windows are obviously better for tensor cores (Titan V) than linux ones.
Is it enough to download and install CUDA or do I need something else such as special commandline or executable? If so, can you point the way?
You need to compile proper executable, however there are already precompiles available.
Look here:
https://github.com/mooskagh/leela-chess/tree/master/lc0
Ok, that worked, thanks. I had downloaded CUDA 9.1, so renamed the files to 90 where needed. How do I do a full-tune? Or is that no longer done?

Re: how good is a GeForce GTX 1060 6GB for Leela ?

Posted: Tue May 01, 2018 5:27 pm
by Milos
Albert Silver wrote:
Milos wrote:
Albert Silver wrote:
Milos wrote:
Werewolf wrote:
Milos wrote:
Judging be the current proper benchmark (LC0 on cuDNN), Titan V is only 3.5 times faster than GTX 960, and 2.2 times 1080ti. And GTX 960 is at least 15 times cheaper than Titan V.
How do you work that out? The Titan V isn't 2.2x faster than a 1080 ti according to either the GFLOPS (12300 vs 10600 respectively) or the benchmarks here

https://docs.google.com/spreadsheets/d/ ... edit#gid=0

Unless I'm misreading them.
You should look at windows version of LC0-cudnn on Titan V since CUDA libs for windows are obviously better for tensor cores (Titan V) than linux ones.
Is it enough to download and install CUDA or do I need something else such as special commandline or executable? If so, can you point the way?
You need to compile proper executable, however there are already precompiles available.
Look here:
https://github.com/mooskagh/leela-chess/tree/master/lc0
Ok, that worked, thanks. I had downloaded CUDA 9.1, so renamed the files to 90 where needed. How do I do a full-tune? Or is that no longer done?
Download 9.0 directly it is available from NVIDIA just search other releases.
Tuning is not required since cuDNN is already tuned to your specific GPU.