LCZero: Progress and Scaling. Relation to CCRL Elo

[Albert Silver]

did want to add that just after i posted that, i watched a game against rybka 3 that quickly boiled down to an early endgame. rybka evaluated drawish & stayed there, leela +2 or so (ended drawn). i realized the answer there is pretty obvious too; not every game contains an endgame, but most would've, & the large majority probably ended decisively.

also forgot to mention the other hardware aspect to the tactical problem; while we're waiting for millions of games & hoping she stumbles upon the solution often enough to learn it, i'm guessing google used training h/w that could calculate several orders beyond what lc0 does. but i'm hopefully wrong & it was volume-focused.

stumbled on this graph (re strength vs stockfish based on time per move) which is interesting as well

If you are really interested in the project, and how it worked, you should not 'guess' what Google did, or 'stumble' on the graph they published and just read their paper and the countless articles on it.

[jp]

Good question, though, about generated LC0 training games vs generated AZ training games. (Time/nps per move comparison?)

[yanquis1972]

did want to add that just after i posted that, i watched a game against rybka 3 that quickly boiled down to an early endgame. rybka evaluated drawish & stayed there, leela +2 or so (ended drawn). i realized the answer there is pretty obvious too; not every game contains an endgame, but most would've, & the large majority probably ended decisively.

also forgot to mention the other hardware aspect to the tactical problem; while we're waiting for millions of games & hoping she stumbles upon the solution often enough to learn it, i'm guessing google used training h/w that could calculate several orders beyond what lc0 does. but i'm hopefully wrong & it was volume-focused.

stumbled on this graph (re strength vs stockfish based on time per move) which is interesting as well

If you are really interested in the project, and how it worked, you should not 'guess' what Google did, or 'stumble' on the graph they published and just read their paper and the countless articles on it.

then i'm not 'really' interested.

[duncan]

I just posted in this thread the result for ID292, it is the strongest ever (the standard v0.10 CPU and GPU build on master).

so this nightmare may soon be over.

(although perhaps I am taking this too seriously)

[Milos]

If you are really interested in the project, and how it worked, you should not 'guess' what Google did, or 'stumble' on the graph they published and just read their paper and the countless articles on it.

He would also know that particular Figure 2 is totally bogus at least concerning SF's performance.

[jp]

He would also know that particular Figure 2 is totally bogus at least concerning SF's performance.

The blue line performance in that Figure 2 is terrible anyway, even if they provide green lines for distraction.

[yanquis1972]

do they say "this graph is bogus btw" in their own paper, or would i have to read the dozens of articles to find that?

i guess the main problem is, while chess & chess engines fascinate me & are an on/off hobby, i have no knowledge in the sciences. did i miss a forum rule? is there one particular degree i should pursue or will i need a couple? is post-grad at least recommended? would appreciate any further advice on what i need to do before posting on the internet.

[jp]

do they say "this graph is bogus btw" in their own paper, or would i have to read the dozens of articles to find that?

That would make the paper worth reading.

[mirek]

If you are really interested in the project, and how it worked, you should not 'guess' what Google did, or 'stumble' on the graph they published and just read their paper and the countless articles on it.

He would also know that particular Figure 2 is totally bogus at least concerning SF's performance.

Then I have a question that I already asked before. Can you show measured numbers of true SF8 scaling on 64 cores for i.e. 1s / move vs 1min / move? Something other than your word that would prove your claim.

[JJJ]

based on selfplay testing, I see progress are coming back and fast now ! I can raise my hope again.