Search found 893 matches

by smatovic
Thu Nov 19, 2020 9:57 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: You've trained a brilliant NN(UE) King-Piece Network. Now what?
Replies: 22
Views: 4160

Re: You've trained a brilliant NN(UE) King-Piece Network. Now what?

... ? Okay, sorry for jumping on you, got it the wrong way... AFAIK Google used bfloat16 on TPU gen2 for training A0 and INT8 on TPU gen1 for inference: http://talkchess.com/forum3/viewtopic.php?f=7&t=70504&p=796255#p796255 My gut feeling tells me that bfloat16 for the weights with upcoming support...
by smatovic
Thu Nov 19, 2020 8:57 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: You've trained a brilliant NN(UE) King-Piece Network. Now what?
Replies: 22
Views: 4160

Re: You've trained a brilliant NN(UE) King-Piece Network. Now what?

You've trained a brilliant NN(UE) King-Piece Network. Now what?
Maybe you should go commercial?

--
Srdja
by smatovic
Thu Nov 19, 2020 8:53 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: You've trained a brilliant NN(UE) King-Piece Network. Now what?
Replies: 22
Views: 4160

Re: You've trained a brilliant NN(UE) King-Piece Network. Now what?

Dude, you are funny, "Don't copy SF NNUE, you are lame!!!111", "Where are the papers for NN implementations???", "I got +100 Elo sitting in here but won't publish it!!!111", what shall 'we' make out of this?

Maybe you should go commercial? Seriously, could relax some things?

--
Srdja
by smatovic
Thu Nov 19, 2020 5:01 am
Forum: Computer Chess Club: General Topics
Topic: CPU Vector Unit, the new jam for NNs...
Replies: 8
Views: 1776

Re: CPU Vector Unit, the new jam for NNs...

That seems to be Helium . Surely it will be faster for NNUE than ARM general purpose - whether it is better than NEON - per Watt, yes. For instance Huawei was talking about Dual Neural Processing in their ARM CPU while Qualcomm talks about Hexagon NN. I believe it's more than just Helium. There are...
by smatovic
Wed Nov 18, 2020 7:06 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: 4 x Intel Xeon good idea?
Replies: 23
Views: 3345

Re: 4 x Intel Xeon good idea?

If you run 24/7 the cents per kilowatt-hour can make a difference and a CPU with smaller fab process might pay off, imho, sitting in Europe with ~30 Eurocents/kWh. -- Srdja These are your German prices. If you ran your server in Serbia for example you'd pay 5.8 eurocents/kWh during the day and only...
by smatovic
Wed Nov 18, 2020 6:59 pm
Forum: Computer Chess Club: General Topics
Topic: GPU rumors 2020
Replies: 38
Views: 13491

Re: GPU rumors 2020

Alrighty, this is a beast, AMD Arcturus MI100 with CDNA architecture for HPC: http://3s81si1s5ygj3mzby34dq6qf-wpengine.netdna-ssl.com/wp-content/uploads/2020/11/amd-arcturus-feeds-speeds.jpg https://www.nextplatform.com/2020/11/16/amd-at-a-tipping-point-with-instinct-mi100-gpu-accelerators/ 92.3 TFL...
by smatovic
Wed Nov 18, 2020 6:52 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: 4 x Intel Xeon good idea?
Replies: 23
Views: 3345

Re: 4 x Intel Xeon good idea?

If you run 24/7 the cents per kilowatt-hour can make a difference and a CPU with smaller fab process might pay off, imho, sitting in Europe with ~30 Eurocents/kWh. -- Srdja These are your German prices. If you ran your server in Serbia for example you'd pay 5.8 eurocents/kWh during the day and only...
by smatovic
Wed Nov 18, 2020 4:04 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: 4 x Intel Xeon good idea?
Replies: 23
Views: 3345

Re: 4 x Intel Xeon good idea?

If you run 24/7 the cents per kilowatt-hour can make a difference and a CPU with smaller fab process might pay off, imho, sitting in Europe with ~30 Eurocents/kWh.

--
Srdja
by smatovic
Wed Nov 18, 2020 8:23 am
Forum: Computer Chess Club: General Topics
Topic: CPU Vector Unit, the new jam for NNs...
Replies: 8
Views: 1776

CPU Vector Unit, the new jam for NNs...

Heyho, you are already aware of it, NNUE uses the CPU Vector Unit to boost NNs, so here a lill biased overview of SIMD units in CPUs... - the term SIMD and Vector Unit can be used analogous - a SIMD unit executes n times the same instruction/operation on different data - SIMD units differ in bit wid...
by smatovic
Wed Nov 18, 2020 7:07 am
Forum: Computer Chess Club: General Topics
Topic: Apple New Mac Mini
Replies: 2
Views: 735

Re: Apple New Mac Mini

Interesting SoC design, 4 high-performance cores with each 4x 128 bit SIMD units (ARM NEO based) for boosting things like NNs, a lot of beef for an mobile processor, my Core2 T9300 laptop CPU has only 1x 128 bit SSE4 unit per core....remains open how Apple intends to scale this SoC up on Mac Pro mod...