LC0 - how to catch up?

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

LC0 - how to catch up?

Poll ended at Wed May 16, 2018 11:34 am

No need to catch up, she won't pass Stockfish
7
41%
Take her weights and make it alphabeta
3
18%
Her net is bloated, take Giraffe and tune it
1
6%
LC0? Did i miss something?
6
35%
 
Total votes: 17

smatovic
Posts: 2639
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

LC0 - how to catch up?

Post by smatovic »

Stunning progress in the last weeks,
maybe it is a bit too early,
but i believe here is an paradigm shift underway.

So how do the old school chess programmers intend to catch up with LC0?

--
Srdja
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: LC0 - how to catch up?

Post by Vinvin »

Image
Uri Blass
Posts: 10267
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: LC0 - how to catch up?

Post by Uri Blass »

smatovic wrote:Stunning progress in the last weeks,
maybe it is a bit too early,
but i believe here is an paradigm shift underway.

So how do the old school chess programmers intend to catch up with LC0?

--
Srdja
I do not see a progress in the last weeks but a regression.
smatovic
Posts: 2639
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: LC0 - how to catch up?

Post by smatovic »

Image
smatovic
Posts: 2639
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: LC0 - how to catch up?

Post by smatovic »

I do not see a progress in the last weeks but a regression.
I mean the last weeks since the selfplay and training started.

--
Srdja
Henk
Posts: 7216
Joined: Mon May 27, 2013 10:31 am

Re: LC0 - how to catch up?

Post by Henk »

I don't even know whether development using zero method or alpha beta method cost more electricity. Probably the first I guess.

They told me in 1994 if you know no better algorithm then use neural network. Don't know if that is still valid.
smatovic
Posts: 2639
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: LC0 - how to catch up?

Post by smatovic »

They told me in 1994 if you know no better algorithm then use neural network. Don't know if that is still valid.
They told me in 2008 the same for Monte-Carlo methods...

--
Srdja
Hai
Posts: 598
Joined: Sun Aug 04, 2013 1:19 pm

Re: LC0 - how to catch up?

Post by Hai »

Uri Blass wrote:
smatovic wrote:Stunning progress in the last weeks,
maybe it is a bit too early,
but i believe here is an paradigm shift underway.

So how do the old school chess programmers intend to catch up with LC0?

--
Srdja
I do not see a progress in the last weeks but a regression.
That's bad for you if you can't see the progress, because I can see a big progress.
Ras
Posts: 2487
Joined: Tue Aug 30, 2016 8:19 pm
Full name: Rasmus Althoff

Re: LC0 - how to catch up?

Post by Ras »

Three things:

1) Alpha0 had that stunning hardware optimised for NNs although frameworks for GPUs already existed - but they wouldn't cut it, that's why Google came up with TPUs.

2) Low hanging fruit. Progress becomes harder over time.

3) You can't actually debug an NN.
Uri Blass
Posts: 10267
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: LC0 - how to catch up?

Post by Uri Blass »

Hai wrote:
Uri Blass wrote:
smatovic wrote:Stunning progress in the last weeks,
maybe it is a bit too early,
but i believe here is an paradigm shift underway.

So how do the old school chess programmers intend to catch up with LC0?

--
Srdja
I do not see a progress in the last weeks but a regression.
That's bad for you if you can't see the progress, because I can see a big progress.
I read in the forum and look in the graph and in the last days I do not see a progress based on the reports.

There was a progress in march but the graph shows no progress in the last days and it is not only the graph but also what people report here.

http://lczero.org/