Future of computer chess: 2 top engines?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

syzygy
Posts: 5557
Joined: Tue Feb 28, 2012 11:56 pm

Re: Future of computer chess: 2 top engines?

Post by syzygy »

Jouni wrote: Mon Oct 12, 2020 1:40 pm I fear, that soon we have only 2 top engines. Stockfish + derivates and Lc0 + derivates. I hope to be wrong :) .
For many years Rybka was the only top engine.
Madeleine Birchfield
Posts: 512
Joined: Tue Sep 29, 2020 4:29 pm
Location: Dublin, Ireland
Full name: Madeleine Birchfield

Re: Future of computer chess: 2 top engines?

Post by Madeleine Birchfield »

Ozymandias wrote: Mon Oct 12, 2020 6:14 pm Komodo 11.2 is only 26 Elo points behind version 14, at CCRL 40/15. It was released on July 17, 2017. SF had been the clear number one for over a year, by the time Lc0 matured, and now it is again; this last T60 run has been rather disappointing, not to mention incredibly long.
The main reason why Leela is somewhat competitive in TCEC is because Leela has oursourced net training to jhorthos and the J92 nets are better than the T60 nets. But even then it is weaker than Stockfish.
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: Future of computer chess: 2 top engines?

Post by Ozymandias »

Madeleine Birchfield wrote: Mon Oct 12, 2020 7:42 pm
Ozymandias wrote: Mon Oct 12, 2020 6:14 pm Komodo 11.2 is only 26 Elo points behind version 14, at CCRL 40/15. It was released on July 17, 2017. SF had been the clear number one for over a year, by the time Lc0 matured, and now it is again; this last T60 run has been rather disappointing, not to mention incredibly long.
The main reason why Leela is somewhat competitive in TCEC is because Leela has oursourced net training to jhorthos and the J92 nets are better than the T60 nets. But even then it is weaker than Stockfish.
That, and because Lc0 scales better with HW. TCEC uses high end configurations for both GPU and CPU. But not even that + long time controls are enough to close the gap.
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Future of computer chess: 2 top engines?

Post by Dann Corbit »

Ozymandias wrote: Mon Oct 12, 2020 8:04 pm
Madeleine Birchfield wrote: Mon Oct 12, 2020 7:42 pm
Ozymandias wrote: Mon Oct 12, 2020 6:14 pm Komodo 11.2 is only 26 Elo points behind version 14, at CCRL 40/15. It was released on July 17, 2017. SF had been the clear number one for over a year, by the time Lc0 matured, and now it is again; this last T60 run has been rather disappointing, not to mention incredibly long.
The main reason why Leela is somewhat competitive in TCEC is because Leela has oursourced net training to jhorthos and the J92 nets are better than the T60 nets. But even then it is weaker than Stockfish.
That, and because Lc0 scales better with HW. TCEC uses high end configurations for both GPU and CPU. But not even that + long time controls are enough to close the gap.
These statements are true for millionaires but not for ordinary people.
Which is to say, it is a lot cheaper to buy a super high end GPU than to buy a super high end CPU machine.
Of course, you may also have to buy a new power supply.
For example, a 2080 super can be bought for $760

and a 1200W power supply for around $40:

so around $800 gets you extremely high compute power for chess. To get equivalent compute power through a regular computer system would be more expensive.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
jdart
Posts: 4366
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Future of computer chess: 2 top engines?

Post by jdart »

Lc0 is interesting because it finds lines other engines miss, but it still seems like it also steps into blunders that other engines will not fall for.
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Future of computer chess: 2 top engines?

Post by Dann Corbit »

For Vincent's recent tough problems list, LC0 solved one in a few seconds that bleeding edge Stockfish failed to solve in an hour using 60 threads and 65 GB RAM with full 6 man TB files.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Gary Internet
Posts: 60
Joined: Thu Jan 04, 2018 7:09 pm

Re: Future of computer chess: 2 top engines?

Post by Gary Internet »

Jouni wrote: Mon Oct 12, 2020 7:12 pm And now SF has +30 ELO patch/net if I understand correct :o . Soon 1 top engine.
Please can you point me in the direction of wherever you read about this? Stockfish Dev is already 23 Elo above above Stockfish 12. If one patch/net really does gain 30 Elo above that 23, we're basically already on Stockfish 13 by the usual benchmark of +50 Elo = a new release.
AndrewGrant
Posts: 1750
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: Future of computer chess: 2 top engines?

Post by AndrewGrant »

Top 2? Hah, no. Its going to be

1. Stockfish
2. Komodo
3. Anyone in the top 10 who uses NNUE
3. Anyone in the top 10 who uses NNUE
3. Anyone in the top 10 who uses NNUE
4. Leela

Yeah, right now Stockfish and Leela are the only projects that truely have the resources to train these Networks.
But do you think Chess.com is okay with that? Igel author himself is renting out machines to do it.
Oh, and the cheaters will obfuscate Stockfish Networks :)

The great Irony is that the Leela fans will be the ones to force the issue, if it is ever forced ;)
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
User avatar
lucasart
Posts: 3232
Joined: Mon May 31, 2010 1:29 pm
Full name: lucasart

Re: Future of computer chess: 2 top engines?

Post by lucasart »

AndrewGrant wrote: Tue Oct 13, 2020 7:38 am Igel author himself is renting out machines to do it.
Smart move. In a gold rush, sell shovels :lol:
Theory and practice sometimes clash. And when that happens, theory loses. Every single time.
Uri Blass
Posts: 10268
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: Future of computer chess: 2 top engines?

Post by Uri Blass »

Ozymandias wrote: Mon Oct 12, 2020 8:04 pm
Madeleine Birchfield wrote: Mon Oct 12, 2020 7:42 pm
Ozymandias wrote: Mon Oct 12, 2020 6:14 pm Komodo 11.2 is only 26 Elo points behind version 14, at CCRL 40/15. It was released on July 17, 2017. SF had been the clear number one for over a year, by the time Lc0 matured, and now it is again; this last T60 run has been rather disappointing, not to mention incredibly long.
The main reason why Leela is somewhat competitive in TCEC is because Leela has oursourced net training to jhorthos and the J92 nets are better than the T60 nets. But even then it is weaker than Stockfish.
That, and because Lc0 scales better with HW. TCEC uses high end configurations for both GPU and CPU. But not even that + long time controls are enough to close the gap.
I do not know if LC0 scales better with HW relative to stockfish.
More draws at longer time control are natural result of less mistakes.

If I remove 1-1 results I see that stockfish is leading 6-1 against lc0 in the match of TCEC.

We have the following results that are not 1-1
1)stockfish 1.5 lc0 0.5 games 17-18
2)lc0 1.5-stockfish 0.5 games 23-24
3)stockfish 1.5 lc0 0.5 games 47-48
4) stockfish 1.5 lc0 0.5 games 53-54
5)stockfish 1.5 lc0 0.5 games 59-60
6)stockfish 1.5 lc0 0.5 games 73-74
7)stockfish 1.5 lc0 0.5 games 75-76.