Looking inside NNs

[jwes]

I ran across this which claims to explain the predictions of a NN. I have no idea if it works, but it would be interesting to run it on AlphaZero or giraffe.
code is here

[Henk]

There are three things you should know about a neural network.
It is slow, slow and slow.

I am only talking about one CPU. I have no GPU.

[Dann Corbit]

There are three things you should know about a neural network.
It is slow, slow and slow.

I am only talking about one CPU. I have no GPU.

A 2 TF GPU does not cost very much.

[Henk]

I only buy new hardware after ten years. My computer is 'only' five years old and you always buy too early.

[Dann Corbit]

I only buy new hardware after ten years. My computer is 'only' five years old and you always buy too early.

You don't need a whole new computer, just a card to pop into it.
https://www.videocardbenchmark.net/gpu_value.html
Most MIPS per Dollar:
Radeon RX 550

About $100.

[Henk]

If it is only plug in and play.

I also am scared of opening machines I know nothing about. Maybe if there are good instruction videos.

They also told me never to repair your TV yourself because you may get electro shock.

[jdart]

It's also, by the nature of the thing, kind of opaque. You can explain a traditional chess evaluation function in words but explaining what a NN does in evaluation is difficult (the linked software provides a local linear approximation but that is not a good model of the NN in general).

--Jon

[Dann Corbit]

If it is only plug in and play.

I also am scared of opening machines I know nothing about. Maybe if there are good instruction videos.

They also told me never to repair your TV yourself because you may get electro shock.

Unplug your computer from the wall and there is no danger.
If you are nervous to do it, find a friend who will do it for you.
It is at two minute job.

[Henk]

I think computershop do upgrades too. But then I probably pay 100 euro more.

My father upgraded his computer some years ago. But was not a success for after a few years it was still too slow.


Value of hardware and software is just like firework. Zero.

I remember university department buying expensive graphical chip in 1991 for tons or millions of dollars. Being worthless after three years. I remember they were complaining about it.

[Dann Corbit]

I think computershop do upgrades too. But then I probably pay 100 euro more.

My father upgraded his computer some years ago. But was not a success for after a few years it was still too slow.


Value of hardware and software is just like firework. Zero.

I remember university department buying expensive graphical chip in 1991 for tons or millions of dollars. Being worthless after three years. I remember they were complaining about it.

All hardware decays exponentially in comparison to previous generations. But during the period that you use it, the value is palpable.

Therefore, it is not necessary to avoid buying hardware simply because it will be out of date quickly.

But if you are not comfortable performing the upgrade or you are not comfortable having a friend perform the upgrade or you are not interested in performing an upgrade or you do not feel the value of the upgrade is equivalent to the price then I suggest that you do not perform the upgrade.