LCzero network

[Milos]

Nets vary in speed, even among test30 nets there is quite a variarion. Strength is measured at same time control, not same number of nodes. Same time control could mean different number of nodes.

Interesting. Do you know why? I guess most assume same-size NN = same speed.

Different net, different policy head, different expansion rate, different NNcache usage, different nps.

[chrisw]

Nets vary in speed, even among test30 nets there is quite a variarion. Strength is measured at same time control, not same number of nodes. Same time control could mean different number of nodes.

Interesting. Do you know why? I guess most assume same-size NN = same speed.

Because, amongst other reasons, the amount of data involved, its variability in amount, the need to parallelise and thread and throw data at GPU in volume, means that all kind of weird things conspire together to speed stuff up or slow stuff down. If your code is serial, it’s also quite logical not just in “logic” but in time flow, but when parallel with all sorts of different stuff happening at the same time, usually with unknown times at which one part of the parallel events are done, well, it’s a bit like herding cats. Stuff happens and so on, little changes in flow can have large effects, or not. Robust process it isn’t. Deterministic, it isn’t.