TCEC S15, END of an ERA event is much more Brutal than I thought!

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
nabildanial
Posts: 104
Joined: Thu Jun 05, 2014 3:29 am
Location: Malaysia

Re: TCEC S15, END of an ERA event is much more Brutal than I thought!

Post by nabildanial » Wed May 15, 2019 5:35 pm

Leo wrote:
Wed May 15, 2019 2:22 pm
SF has a chance if LZ throughs away some games like it did last time.
So, that means no chance then because Leela has been very solid so far in this SuFi.

Uri Blass
Posts: 8530
Joined: Wed Mar 08, 2006 11:37 pm
Location: Tel-Aviv Israel

Re: TCEC S15, END of an ERA event is much more Brutal than I thought!

Post by Uri Blass » Wed May 15, 2019 6:08 pm

Laskos wrote:
Wed May 15, 2019 12:03 pm
Nay Lin Tun wrote:
Wed May 15, 2019 11:04 am
After 26 games in TCEC SUFI, Leela is leading with 15-11.

My prediction for TCEC was just 55-45 Leela win.
cap4.PNG
Yes, I expected long ago 2:1 Win/Loss ratio for Leela, something on the lines +14 -7 =79. Let's see. I predicted that when the previous S14 was underway with 32930 net.

It IS an end of an era, if anything, the hardware for Leela is below the hardware for Stockfish in the current TCEC. GPU has much more room for improvement than CPU, we will assist in 1-2 years at a complete dominance strength-wise of NN-bases engines. FPGA might come next for chess engines, but it's a bit more involved to make them play chess.
I think that price comparison is wrong.
From my point of view if it is possible to generate a better chess player with lc0's hardware relative to Stockfish's hardware then lc0's hardware is better.

Edit:I understand that price comparison may be interesting for buyers but definition of the term better hardware cannot be dependent on the price.

User avatar
Laskos
Posts: 9316
Joined: Wed Jul 26, 2006 8:21 pm
Full name: Kai Laskos

Re: TCEC S15, END of an ERA event is much more Brutal than I thought!

Post by Laskos » Wed May 15, 2019 6:18 pm

Uri Blass wrote:
Wed May 15, 2019 6:08 pm
Laskos wrote:
Wed May 15, 2019 12:03 pm
Nay Lin Tun wrote:
Wed May 15, 2019 11:04 am
After 26 games in TCEC SUFI, Leela is leading with 15-11.

My prediction for TCEC was just 55-45 Leela win.
cap4.PNG
Yes, I expected long ago 2:1 Win/Loss ratio for Leela, something on the lines +14 -7 =79. Let's see. I predicted that when the previous S14 was underway with 32930 net.

It IS an end of an era, if anything, the hardware for Leela is below the hardware for Stockfish in the current TCEC. GPU has much more room for improvement than CPU, we will assist in 1-2 years at a complete dominance strength-wise of NN-bases engines. FPGA might come next for chess engines, but it's a bit more involved to make them play chess.
I think that price comparison is wrong.
From my point of view if it is possible to generate a better chess player with lc0's hardware relative to Stockfish's hardware then lc0's hardware is better.
So, you define "better hardware" as the hardware which allows for a better chess player on that hardware? I guess you will never be wrong with your assessment of hardware as defined by you.

Uri Blass
Posts: 8530
Joined: Wed Mar 08, 2006 11:37 pm
Location: Tel-Aviv Israel

Re: TCEC S15, END of an ERA event is much more Brutal than I thought!

Post by Uri Blass » Wed May 15, 2019 6:27 pm

Laskos wrote:
Wed May 15, 2019 6:18 pm
Uri Blass wrote:
Wed May 15, 2019 6:08 pm
Laskos wrote:
Wed May 15, 2019 12:03 pm
Nay Lin Tun wrote:
Wed May 15, 2019 11:04 am
After 26 games in TCEC SUFI, Leela is leading with 15-11.

My prediction for TCEC was just 55-45 Leela win.
cap4.PNG
Yes, I expected long ago 2:1 Win/Loss ratio for Leela, something on the lines +14 -7 =79. Let's see. I predicted that when the previous S14 was underway with 32930 net.

It IS an end of an era, if anything, the hardware for Leela is below the hardware for Stockfish in the current TCEC. GPU has much more room for improvement than CPU, we will assist in 1-2 years at a complete dominance strength-wise of NN-bases engines. FPGA might come next for chess engines, but it's a bit more involved to make them play chess.
I think that price comparison is wrong.
From my point of view if it is possible to generate a better chess player with lc0's hardware relative to Stockfish's hardware then lc0's hardware is better.
So, you define "better hardware" as the hardware which allows for a better chess player on that hardware? I guess you will never be wrong with your assessment of hardware as defined by you.
The better hardware is not known in this case because I do not know what is possible to do with the hardwares.
It is certainly possible to produce something better than stockfish with the cpu and something better than lc0 with the gpu.

Jouni
Posts: 1958
Joined: Wed Mar 08, 2006 7:15 pm

Re: TCEC S15, END of an ERA event is much more Brutal than I thought!

Post by Jouni » Wed May 15, 2019 6:55 pm

OK now even I agree END of an ERA! Currently SuFi Win Probability LC0 96.7 % Stockfish 3.3% someone just calculated :!: .
Jouni

Modern Times
Posts: 2366
Joined: Thu Jun 07, 2012 9:02 pm

Re: TCEC S15, END of an ERA event is much more Brutal than I thought!

Post by Modern Times » Wed May 15, 2019 8:14 pm

Whether Lc0 is stronger than Stockfish depends on how much an individual is prepared to spend on a GPU. That is the bottom line. For some it will be stronger, for others it won't.

I have a low cost GPU, so for me Stockfish is stronger by far.
.

Opinions expressed here are my own, and not necessarily those of the CCRL Group.

zullil
Posts: 5558
Joined: Mon Jan 08, 2007 11:31 pm
Location: PA USA
Full name: Louis Zulli

Re: TCEC S15, END of an ERA event is much more Brutal than I thought!

Post by zullil » Wed May 15, 2019 8:50 pm

I wonder if this defeat---assuming it happens---will spur any interest in (re)considering alternatives to "lazy SMP". Perhaps there really are better options, at least when core counts and time controls reach TCEC-levels.

User avatar
Laskos
Posts: 9316
Joined: Wed Jul 26, 2006 8:21 pm
Full name: Kai Laskos

Re: TCEC S15, END of an ERA event is much more Brutal than I thought!

Post by Laskos » Wed May 15, 2019 9:15 pm

zullil wrote:
Wed May 15, 2019 8:50 pm
I wonder if this defeat---assuming it happens---will spur any interest in (re)considering alternatives to "lazy SMP". Perhaps there really are better options, at least when core counts and time controls reach TCEC-levels.
Lazy SMP is already very good on something like TCEC machine. On 43 cores the effective speed-up I guess is in the range of 20-25. With YBW it was maybe 10-12. I doubt another approach will go much above 30-32 with AB engines. It won't change much against Lc0. It's a bit the opposite, I guess Lc0 scaling to 4 and 8 GPUs can be considerably improved.

These are my guesses, don't take them at literal values.

supersharp77
Posts: 728
Joined: Sat Jul 05, 2014 5:54 am
Location: Southwest USA

Re: TCEC S15, END of an ERA event is much more Brutal than I thought!

Post by supersharp77 » Thu May 16, 2019 4:20 am

Laskos wrote:
Wed May 15, 2019 12:03 pm
Nay Lin Tun wrote:
Wed May 15, 2019 11:04 am
After 26 games in TCEC SUFI, Leela is leading with 15-11.

My prediction for TCEC was just 55-45 Leela win.
cap4.PNG
Yes, I expected long ago 2:1 Win/Loss ratio for Leela, something on the lines +14 -7 =79. Let's see. I predicted that when the previous S14 was underway with 32930 net.

It IS an end of an era, if anything, the hardware for Leela is below the hardware for Stockfish in the current TCEC. GPU has much more room for improvement than CPU, we will assist in 1-2 years at a complete dominance strength-wise of NN-bases engines. FPGA might come next for chess engines, but it's a bit more involved to make them play chess.
These results are meaningless unless they are 100% Repeatable.....Anyone else been able to recreate LC0's (AlphaZero's) results vs Stockfish engines? :D :wink:

mwyoung
Posts: 1601
Joined: Wed May 12, 2010 8:00 pm

Re: TCEC S15, END of an ERA event is much more Brutal than I thought!

Post by mwyoung » Thu May 16, 2019 4:38 am

Nay Lin Tun wrote:
Wed May 15, 2019 11:04 am
After 26 games in TCEC SUFI, Leela is leading with 15-11.

My prediction for TCEC was just 55-45 Leela win.
cap4.PNG

If you have been watching testing here. This is no surprise at all. Lc0 has been clearly stronger then stockfish for months when given very good hardware.
Professing themselves to be wise, they became fools,
Take on me. foes 0

Post Reply