corres wrote: ↑
Sat Dec 28, 2019 11:34 am
Hai wrote: ↑
Sat Dec 28, 2019 9:06 am
Bigger nets are stronger, when they have trained enough. And of course the mb get bigger and bigger.
That's completely normal.
The Sergio nets should be already stronger on 1 rtx gpu then other nets, so you can use 2 rtx gpus for even bigger nets.
Alone the dimension is not a guarantee for being stronger.
It is pity but using a simple RTX card - even if it is a 2080 Ti - jhorthos T40B.4-160 net is stronger than any sergio's big nets. Maybe using LTC they would have the same power.
I have tested Sergio's latest 256x20b and 384x30b nets on RTX 2070 OC-ed GPU. They are very strong, this guy is up to something. Observe that his 256x20b net is smaller and faster than both JHorthos and T40 regular 256x20b nets.
His 384x30-t40-1573 behaves this way:
In 100 games at 60'' + 0.6'' it is weaker than the best net I had so far, jhorthos T40B.4-200, some 50 Elo points weaker in 200 games.
In 40 games at 900'' + 9'' they came completely equal in strength and it is beyond error margins that this Big Net scales better to LTC. If this holds, it would be stronger than T40B.4-200 at tournament time control even on one RTX GPU. This Big Net strangely performs better tactically at 30s/position on Arasan test suite compared to T40B.4-200. And comes about equal positionally (strange behavior of the Big Net, I would have expected the opposite).
The nice surprise came with Sergio's 256x20-t40-1400 net. Aside from very long time controls, this net seems to be the strongest around for RTX GPUs, from bullet TC to rapid TC, at least. In 400 games at 30'' + 0.3'', 256x20-t40-1400 net beat T40B.4-200 by about 20 +/- 7 Elo points (1 standard deviation), which is remarkable. I guess Sergio's nets are now the strongest around for RTX GPUs, with 256x20b nets at shorter and medium TC, and maybe (not sure) the 384x30b 1573 net at very long TC. And the Big Net has yet a lot of learning path to accomplish. Good job of Sergio.