GPT-3 is interesting as it contains the whole internet. The GPT-3 model contains what? Input data / hyperparameters / weights / biases that's a few petabytes. I save my whole model into json and just load when I want to waste electricity. I haven't actually directly tried GPT-3. GPT-2 when I played with it was horrible.
Cerebras - but honey, can it play chess?
Moderator: Ras
-
JohnWoe
- Posts: 529
- Joined: Sat Mar 02, 2013 11:31 pm
Re: Cerebras - but honey, can it play chess?
Can it generate a chess program? If it's feed all the opens source engines. Then some Stockfish clone might pop out.
GPT-3 is interesting as it contains the whole internet. The GPT-3 model contains what? Input data / hyperparameters / weights / biases that's a few petabytes. I save my whole model into json and just load when I want to waste electricity. I haven't actually directly tried GPT-3. GPT-2 when I played with it was horrible.
GPT-3 is interesting as it contains the whole internet. The GPT-3 model contains what? Input data / hyperparameters / weights / biases that's a few petabytes. I save my whole model into json and just load when I want to waste electricity. I haven't actually directly tried GPT-3. GPT-2 when I played with it was horrible.
-
towforce
- Posts: 12580
- Joined: Thu Mar 09, 2006 12:57 am
- Location: Birmingham UK
- Full name: Graham Laight
Re: Cerebras - but honey, can it play chess?
On a smaller scale, I have recently suggested that instead of directly evaluating a position, the NN should be writing an evaluation function that is well suited to the position (or at least selecting which EF components to use) - link.
Human chess is partly about tactics and strategy, but mostly about memory
-
smatovic
- Posts: 3361
- Joined: Wed Mar 10, 2010 10:18 pm
- Location: Hamburg, Germany
- Full name: Srdja Matovic
Re: Cerebras - but honey, can it play chess?
-
smatovic
- Posts: 3361
- Joined: Wed Mar 10, 2010 10:18 pm
- Location: Hamburg, Germany
- Full name: Srdja Matovic
Re: Cerebras - but honey, can it play chess?
Followup:
Condor Galaxy 1 (CG-1) supercomputer up and running, "beyond GPU", 4 exaFLOP in AI (FP16), supporting up to 600 billion parameters, and extensible up to 100 trillion, CG-2 and CG-3 to CG-9 to be completed in 2024:
https://www.cerebras.net/condor-galaxy-1
https://www.cerebras.net/press-release/ ... innovation
--
Srdja
Condor Galaxy 1 (CG-1) supercomputer up and running, "beyond GPU", 4 exaFLOP in AI (FP16), supporting up to 600 billion parameters, and extensible up to 100 trillion, CG-2 and CG-3 to CG-9 to be completed in 2024:
https://www.cerebras.net/condor-galaxy-1
https://www.cerebras.net/press-release/ ... innovation
--
Srdja
-
smatovic
- Posts: 3361
- Joined: Wed Mar 10, 2010 10:18 pm
- Location: Hamburg, Germany
- Full name: Srdja Matovic
Re: Cerebras - but honey, can it play chess?
Update on Cerebras:
What Is Cerebras Going To Do With That $1.1 Billion In New Funding?
https://www.nextplatform.com/2025/10/01 ... w-funding/
Wafer scale chip, trillions of transistors running >1 GHz, gigabytes of SRAM, looks impressive.
--
Srdja
What Is Cerebras Going To Do With That $1.1 Billion In New Funding?
https://www.nextplatform.com/2025/10/01 ... w-funding/
Wafer scale chip, trillions of transistors running >1 GHz, gigabytes of SRAM, looks impressive.
--
Srdja