Milos wrote:Days of Alpha0 on normal hardware are years away.
Sounds like you're conflating model training with running the program.
Sounds you can't really read well, coz I was comparing training time from the start and arguing about ludicrous 4 hours figure.
For chess it would take even more.
For chess it takes less.
Again no clue, no substance, no elaboration, just one-liner.
But keep on dreaming, no one can take that from you.
Your case isn't advanced by being an asshole.
-Carl
And you clearly show that your lack of manners largely surpasses any competence you might have. You are really taking it too personally.
It's not that bad being wrong from time to time .
Last edited by Milos on Wed Dec 06, 2017 6:56 pm, edited 1 time in total.
jhellis3 wrote:Why are you using old GPU architectures for your comparison. The 1080 has no tensor units, so obviously it will be much slower.
The V100 on the other hand should be ~75%+ the performance of a TPU2.
Show me open community that has access to V100?
I am comparing to what common ppl have access too.
You seems to be sticking to apples and oranges most of the time.
Milos wrote:4 hours my ass (pardon my french). Try training it on state-of-the-art 1080.
Fully trained network requres 12h on 5000 gen1 TPUs for self-games and 64 gen2 TPUs for training itself.
Gen1 TPU is like 30x K80 which is like 5x 1080 in performance.
So you'd need like 375k training days with 1080, which is like 1000 years!!!
Your math is wrong. I think it is doable with a distributed effort smaller than what was used for Stockfish.
Care to elaborate, add any substance beyond your one-liner childish reply?
5000*5*12/(24*365) = 34.25 years
So you claim single gen1 TPU is just only like 5x stronger than Nvidia 1080 GPU????
Gee, you really have no clue about hardware, do you?
TPU is like 92 TOPS, 1080 is 0.3TFLOPS. Please educate yourself before trying to run discussions with one-liner replies.
This really seems revolutionary !
Beating Stockfish 10-0 is no joke.
I wonder when such a Program would be made available to customers at a reasonable price ?