Page 2 of 6

Re: Future of computer chess: 2 top engines?

Posted: Mon Oct 12, 2020 7:35 pm
by syzygy
Jouni wrote: Mon Oct 12, 2020 1:40 pm I fear, that soon we have only 2 top engines. Stockfish + derivates and Lc0 + derivates. I hope to be wrong :) .
For many years Rybka was the only top engine.

Re: Future of computer chess: 2 top engines?

Posted: Mon Oct 12, 2020 7:42 pm
by Madeleine Birchfield
Ozymandias wrote: Mon Oct 12, 2020 6:14 pm Komodo 11.2 is only 26 Elo points behind version 14, at CCRL 40/15. It was released on July 17, 2017. SF had been the clear number one for over a year, by the time Lc0 matured, and now it is again; this last T60 run has been rather disappointing, not to mention incredibly long.
The main reason why Leela is somewhat competitive in TCEC is because Leela has oursourced net training to jhorthos and the J92 nets are better than the T60 nets. But even then it is weaker than Stockfish.

Re: Future of computer chess: 2 top engines?

Posted: Mon Oct 12, 2020 8:04 pm
by Ozymandias
Madeleine Birchfield wrote: Mon Oct 12, 2020 7:42 pm
Ozymandias wrote: Mon Oct 12, 2020 6:14 pm Komodo 11.2 is only 26 Elo points behind version 14, at CCRL 40/15. It was released on July 17, 2017. SF had been the clear number one for over a year, by the time Lc0 matured, and now it is again; this last T60 run has been rather disappointing, not to mention incredibly long.
The main reason why Leela is somewhat competitive in TCEC is because Leela has oursourced net training to jhorthos and the J92 nets are better than the T60 nets. But even then it is weaker than Stockfish.
That, and because Lc0 scales better with HW. TCEC uses high end configurations for both GPU and CPU. But not even that + long time controls are enough to close the gap.

Re: Future of computer chess: 2 top engines?

Posted: Tue Oct 13, 2020 12:17 am
by Dann Corbit
Ozymandias wrote: Mon Oct 12, 2020 8:04 pm
Madeleine Birchfield wrote: Mon Oct 12, 2020 7:42 pm
Ozymandias wrote: Mon Oct 12, 2020 6:14 pm Komodo 11.2 is only 26 Elo points behind version 14, at CCRL 40/15. It was released on July 17, 2017. SF had been the clear number one for over a year, by the time Lc0 matured, and now it is again; this last T60 run has been rather disappointing, not to mention incredibly long.
The main reason why Leela is somewhat competitive in TCEC is because Leela has oursourced net training to jhorthos and the J92 nets are better than the T60 nets. But even then it is weaker than Stockfish.
That, and because Lc0 scales better with HW. TCEC uses high end configurations for both GPU and CPU. But not even that + long time controls are enough to close the gap.
These statements are true for millionaires but not for ordinary people.
Which is to say, it is a lot cheaper to buy a super high end GPU than to buy a super high end CPU machine.
Of course, you may also have to buy a new power supply.
For example, a 2080 super can be bought for $760

and a 1200W power supply for around $40:

so around $800 gets you extremely high compute power for chess. To get equivalent compute power through a regular computer system would be more expensive.

Re: Future of computer chess: 2 top engines?

Posted: Tue Oct 13, 2020 12:20 am
by jdart
Lc0 is interesting because it finds lines other engines miss, but it still seems like it also steps into blunders that other engines will not fall for.

Re: Future of computer chess: 2 top engines?

Posted: Tue Oct 13, 2020 1:43 am
by Dann Corbit
For Vincent's recent tough problems list, LC0 solved one in a few seconds that bleeding edge Stockfish failed to solve in an hour using 60 threads and 65 GB RAM with full 6 man TB files.

Re: Future of computer chess: 2 top engines?

Posted: Tue Oct 13, 2020 5:38 am
by Gary Internet
Jouni wrote: Mon Oct 12, 2020 7:12 pm And now SF has +30 ELO patch/net if I understand correct :o . Soon 1 top engine.
Please can you point me in the direction of wherever you read about this? Stockfish Dev is already 23 Elo above above Stockfish 12. If one patch/net really does gain 30 Elo above that 23, we're basically already on Stockfish 13 by the usual benchmark of +50 Elo = a new release.

Re: Future of computer chess: 2 top engines?

Posted: Tue Oct 13, 2020 7:38 am
by AndrewGrant
Top 2? Hah, no. Its going to be

1. Stockfish
2. Komodo
3. Anyone in the top 10 who uses NNUE
3. Anyone in the top 10 who uses NNUE
3. Anyone in the top 10 who uses NNUE
4. Leela

Yeah, right now Stockfish and Leela are the only projects that truely have the resources to train these Networks.
But do you think Chess.com is okay with that? Igel author himself is renting out machines to do it.
Oh, and the cheaters will obfuscate Stockfish Networks :)

The great Irony is that the Leela fans will be the ones to force the issue, if it is ever forced ;)

Re: Future of computer chess: 2 top engines?

Posted: Tue Oct 13, 2020 7:59 am
by lucasart
AndrewGrant wrote: Tue Oct 13, 2020 7:38 am Igel author himself is renting out machines to do it.
Smart move. In a gold rush, sell shovels :lol:

Re: Future of computer chess: 2 top engines?

Posted: Tue Oct 13, 2020 8:00 am
by Uri Blass
Ozymandias wrote: Mon Oct 12, 2020 8:04 pm
Madeleine Birchfield wrote: Mon Oct 12, 2020 7:42 pm
Ozymandias wrote: Mon Oct 12, 2020 6:14 pm Komodo 11.2 is only 26 Elo points behind version 14, at CCRL 40/15. It was released on July 17, 2017. SF had been the clear number one for over a year, by the time Lc0 matured, and now it is again; this last T60 run has been rather disappointing, not to mention incredibly long.
The main reason why Leela is somewhat competitive in TCEC is because Leela has oursourced net training to jhorthos and the J92 nets are better than the T60 nets. But even then it is weaker than Stockfish.
That, and because Lc0 scales better with HW. TCEC uses high end configurations for both GPU and CPU. But not even that + long time controls are enough to close the gap.
I do not know if LC0 scales better with HW relative to stockfish.
More draws at longer time control are natural result of less mistakes.

If I remove 1-1 results I see that stockfish is leading 6-1 against lc0 in the match of TCEC.

We have the following results that are not 1-1
1)stockfish 1.5 lc0 0.5 games 17-18
2)lc0 1.5-stockfish 0.5 games 23-24
3)stockfish 1.5 lc0 0.5 games 47-48
4) stockfish 1.5 lc0 0.5 games 53-54
5)stockfish 1.5 lc0 0.5 games 59-60
6)stockfish 1.5 lc0 0.5 games 73-74
7)stockfish 1.5 lc0 0.5 games 75-76.