LC0 - how to catch up?

Discussion of chess software programming and technical issues.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.

LC0 - how to catch up?

Poll ended at Wed May 16, 2018 9:34 am

No need to catch up, she won't pass Stockfish
7
41%
Take her weights and make it alphabeta
3
18%
Her net is bloated, take Giraffe and tune it
1
6%
LC0? Did i miss something?
6
35%
 
Total votes: 17

smatovic
Posts: 487
Joined: Wed Mar 10, 2010 9:18 pm
Location: Germany
Full name: Srdja Matovic
Contact:

LC0 - how to catch up?

Post by smatovic » Mon Apr 16, 2018 9:34 am

Stunning progress in the last weeks,
maybe it is a bit too early,
but i believe here is an paradigm shift underway.

So how do the old school chess programmers intend to catch up with LC0?

--
Srdja

Vinvin
Posts: 4086
Joined: Thu Mar 09, 2006 8:40 am

Re: LC0 - how to catch up?

Post by Vinvin » Mon Apr 16, 2018 10:35 am

Image

Uri Blass
Posts: 8150
Joined: Wed Mar 08, 2006 11:37 pm
Location: Tel-Aviv Israel

Re: LC0 - how to catch up?

Post by Uri Blass » Mon Apr 16, 2018 12:18 pm

smatovic wrote:Stunning progress in the last weeks,
maybe it is a bit too early,
but i believe here is an paradigm shift underway.

So how do the old school chess programmers intend to catch up with LC0?

--
Srdja
I do not see a progress in the last weeks but a regression.

smatovic
Posts: 487
Joined: Wed Mar 10, 2010 9:18 pm
Location: Germany
Full name: Srdja Matovic
Contact:

Re: LC0 - how to catch up?

Post by smatovic » Mon Apr 16, 2018 12:33 pm

Image

smatovic
Posts: 487
Joined: Wed Mar 10, 2010 9:18 pm
Location: Germany
Full name: Srdja Matovic
Contact:

Re: LC0 - how to catch up?

Post by smatovic » Mon Apr 16, 2018 12:35 pm

I do not see a progress in the last weeks but a regression.
I mean the last weeks since the selfplay and training started.

--
Srdja

Henk
Posts: 5246
Joined: Mon May 27, 2013 8:31 am

Re: LC0 - how to catch up?

Post by Henk » Mon Apr 16, 2018 12:36 pm

I don't even know whether development using zero method or alpha beta method cost more electricity. Probably the first I guess.

They told me in 1994 if you know no better algorithm then use neural network. Don't know if that is still valid.

smatovic
Posts: 487
Joined: Wed Mar 10, 2010 9:18 pm
Location: Germany
Full name: Srdja Matovic
Contact:

Re: LC0 - how to catch up?

Post by smatovic » Mon Apr 16, 2018 1:01 pm

They told me in 1994 if you know no better algorithm then use neural network. Don't know if that is still valid.
They told me in 2008 the same for Monte-Carlo methods...

--
Srdja

Hai
Posts: 351
Joined: Sun Aug 04, 2013 11:19 am

Re: LC0 - how to catch up?

Post by Hai » Mon Apr 16, 2018 4:21 pm

Uri Blass wrote:
smatovic wrote:Stunning progress in the last weeks,
maybe it is a bit too early,
but i believe here is an paradigm shift underway.

So how do the old school chess programmers intend to catch up with LC0?

--
Srdja
I do not see a progress in the last weeks but a regression.
That's bad for you if you can't see the progress, because I can see a big progress.

Ras
Posts: 984
Joined: Tue Aug 30, 2016 6:19 pm
Contact:

Re: LC0 - how to catch up?

Post by Ras » Mon Apr 16, 2018 4:40 pm

Three things:

1) Alpha0 had that stunning hardware optimised for NNs although frameworks for GPUs already existed - but they wouldn't cut it, that's why Google came up with TPUs.

2) Low hanging fruit. Progress becomes harder over time.

3) You can't actually debug an NN.

Uri Blass
Posts: 8150
Joined: Wed Mar 08, 2006 11:37 pm
Location: Tel-Aviv Israel

Re: LC0 - how to catch up?

Post by Uri Blass » Mon Apr 16, 2018 5:09 pm

Hai wrote:
Uri Blass wrote:
smatovic wrote:Stunning progress in the last weeks,
maybe it is a bit too early,
but i believe here is an paradigm shift underway.

So how do the old school chess programmers intend to catch up with LC0?

--
Srdja
I do not see a progress in the last weeks but a regression.
That's bad for you if you can't see the progress, because I can see a big progress.
I read in the forum and look in the graph and in the last days I do not see a progress based on the reports.

There was a progress in march but the graph shows no progress in the last days and it is not only the graph but also what people report here.

http://lczero.org/

Post Reply