Is Scorpio stronger than AlphaZero?
Moderators: hgm, Rebel, chrisw
-
- Posts: 512
- Joined: Tue Sep 29, 2020 4:29 pm
- Location: Dublin, Ireland
- Full name: Madeleine Birchfield
Is Scorpio stronger than AlphaZero?
It is now widespread knowledge that engines such as Stockfish, Leela, and Dragon are hundreds of elo stronger than the AlphaZero which destroyed Stockfish 9 in 2017. But what about Daniel Shawul's Scorpio, the sixth best engine currently at TCEC? Unfortunately, rhe most recent versions of Scorpio do not seem to be tested by the rating lists such as CCRL, so one cannot simply compare Scorpio's elo with AlphaZero's estimated elo. However, one could perform the same experiment as the Deepmind team did in AlphaZero vs Stockfish 9 with same strength hardware, only this time replacing AlphaZero with Scorpio, and comparing the results of Scorpio and AlphaZero against Stockfish 9.
-
- Posts: 4185
- Joined: Tue Mar 14, 2006 11:34 am
- Location: Ethiopia
Re: Is Scorpio stronger than AlphaZero?
None of the engine's you mentioned come close to A0, because that is a real breakthrough. You can re-implement its algorithm and improve up on it and make it stronger than A0 like Stockfish/Leela is right now, but it never compares to A0 IMO. To venture where no has gone before is what matters the most.
Anyway if you really really want to know Scorpio strength, take a look at CEGT or fastgm tests, CCRL seems to have problems installing engines that require a bit more than extracting an exe. Also May I suggest you take a step back of from starting so many posts in talkchess -- I certainly didn't ask for Scorpio to be compared to A0.
Anyway if you really really want to know Scorpio strength, take a look at CEGT or fastgm tests, CCRL seems to have problems installing engines that require a bit more than extracting an exe. Also May I suggest you take a step back of from starting so many posts in talkchess -- I certainly didn't ask for Scorpio to be compared to A0.
-
- Posts: 543
- Joined: Sun Sep 06, 2020 4:40 am
- Full name: Connor McMonigle
Re: Is Scorpio stronger than AlphaZero?
+1Daniel Shawul wrote: ↑Sun Jul 11, 2021 4:37 am ...
Also May I suggest you take a step back of from starting so many posts in talkchess -- I certainly didn't ask for Scorpio to be compared to A0.
-
- Posts: 1787
- Joined: Tue Apr 19, 2016 6:08 am
- Location: U.S.A
- Full name: Andrew Grant
Re: Is Scorpio stronger than AlphaZero?
+2connor_mcmonigle wrote: ↑Sun Jul 11, 2021 6:28 am+1Daniel Shawul wrote: ↑Sun Jul 11, 2021 4:37 am ...
Also May I suggest you take a step back of from starting so many posts in talkchess -- I certainly didn't ask for Scorpio to be compared to A0.
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
-
- Posts: 512
- Joined: Tue Sep 29, 2020 4:29 pm
- Location: Dublin, Ireland
- Full name: Madeleine Birchfield
Re: Is Scorpio stronger than AlphaZero?
I disagree with this to be honest. Deep reinforcement learning has been around in computer chess since Giraffe by Matthew Tan in 2016, who eventually joined the Deepmind team to create AlphaGo, AlphaGo Zero, and AlphaZero. MCTS has been around since 2007. The combination of MCTS search with deep reinforcement learning and neural nets for evaluation, pruning, and move ordering already came in 2016 with AlphaGo, and fused policy-value networks and training from zero came in 2017 with AlphaGo Zero.Daniel Shawul wrote: ↑Sun Jul 11, 2021 4:37 am None of the engine's you mentioned come close to A0, because that is a real breakthrough. You can re-implement its algorithm and improve up on it and make it stronger than A0 like Stockfish/Leela is right now, but it never compares to A0 IMO. To venture where no has gone before is what matters the most.
The go engine Leela Zero was started in 2017 by Gian-Carlo Pascutto to prove the results of AlphaGo Zero worked. Leela Chess Zero was forked from the Leela Zero project later thst year by Gary Linscott to see if the techniques of AlphaGo Zero and Leela Zero worked in chess. It just so happened that around the same time, Deepmind released the AlphaZero preprint which generated a lot of controversey over the AlphaZero-Stockfish games, and the Leela project gained a lot of publicity from outsiders who wanted Leela to replicate the controversial AlphaZero results.
AlphaZero was an incredible breakthrough for general game playing algorithms, showing that one algorithm could be used for multiple games to reach state-of-the-art performance at the time, but the real breakthrough in the core algorithms used in Leela and other GPU based engines, such as deep reinforcement learning, was already in Giraffe, AlphaGo, and finally AlphaGo Zero, from where the Leela Chees Zero project was derived.
Thanks, I was wondering why CCRL stopped testing Leela and Stoofvlees after 2018/early 2019 and never tested Scorpio. I'll have a look through the other rating lists again; for FGRL I didn't remember seeing Scorpio in any of the usual rating lists such as 60s+0.6s and 10m+6s, and the same with CGET in 4/40 for example, but maybe things have changed.Daniel Shawul wrote: ↑Sun Jul 11, 2021 4:37 am Anyway if you really really want to know Scorpio strength, take a look at CEGT or fastgm tests, CCRL seems to have problems installing engines that require a bit more than extracting an exe.
Note taken. But I was curious, as it did seem that Scorpio is getting close to AlphaZero level.Daniel Shawul wrote: ↑Sun Jul 11, 2021 4:37 am Also May I suggest you take a step back of from starting so many posts in talkchess -- I certainly didn't ask for Scorpio to be compared to A0.
-
- Posts: 4346
- Joined: Tue Apr 03, 2012 4:28 pm
Re: Is Scorpio stronger than AlphaZero?
+3AndrewGrant wrote: ↑Sun Jul 11, 2021 6:44 am+2connor_mcmonigle wrote: ↑Sun Jul 11, 2021 6:28 am+1Daniel Shawul wrote: ↑Sun Jul 11, 2021 4:37 am ...
Also May I suggest you take a step back of from starting so many posts in talkchess -- I certainly didn't ask for Scorpio to be compared to A0.
-
- Posts: 2273
- Joined: Mon Sep 29, 2008 1:50 am
Re: Is Scorpio stronger than AlphaZero?
+4chrisw wrote: ↑Sun Jul 11, 2021 10:45 am+3AndrewGrant wrote: ↑Sun Jul 11, 2021 6:44 am+2connor_mcmonigle wrote: ↑Sun Jul 11, 2021 6:28 am+1Daniel Shawul wrote: ↑Sun Jul 11, 2021 4:37 am ...
Also May I suggest you take a step back of from starting so many posts in talkchess -- I certainly didn't ask for Scorpio to be compared to A0.
What is the point of trying to stir up all these contentious issues...? It seems very close to trolling.
Ideas=science. Simplification=engineering.
Without ideas there is nothing to simplify.
Without ideas there is nothing to simplify.
-
- Posts: 4346
- Joined: Tue Apr 03, 2012 4:28 pm
Re: Is Scorpio stronger than AlphaZero?
Arguably, site traffic. Else you would have to assume that someone with intimate knowledge of just about every piece of technical and personal gossip over the last twenty years would have remained entirely silent during those twenty years and then suddenly is pouring out every possible contentious and potentially argumentative point ever raised in all those twenty years, with new contentious threads on a daily basis.Michel wrote: ↑Sun Jul 11, 2021 11:34 am+4chrisw wrote: ↑Sun Jul 11, 2021 10:45 am+3AndrewGrant wrote: ↑Sun Jul 11, 2021 6:44 am+2connor_mcmonigle wrote: ↑Sun Jul 11, 2021 6:28 am+1Daniel Shawul wrote: ↑Sun Jul 11, 2021 4:37 am ...
Also May I suggest you take a step back of from starting so many posts in talkchess -- I certainly didn't ask for Scorpio to be compared to A0.
What is the point of trying to stir up all these contentious issues...? It seems very close to trolling.
-
- Posts: 512
- Joined: Tue Sep 29, 2020 4:29 pm
- Location: Dublin, Ireland
- Full name: Madeleine Birchfield
Re: Is Scorpio stronger than AlphaZero?
All right, conversation done. Could the mods close this thread? Thanks.
-
- Posts: 27851
- Joined: Fri Mar 10, 2006 10:06 am
- Location: Amsterdam
- Full name: H G Muller
Re: Is Scorpio stronger than AlphaZero?
[Moderation] Thread locked at request of OP