SPCC: Testrun of Lc0 LS 12.2 finished

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
pohl4711
Posts: 2433
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

SPCC: Testrun of Lc0 LS 12.2 finished

Post by pohl4711 »

NN-testrun of Lc0 0.23.1 with Leelenstein 12.2 Net finished - impressive progress!

https://www.sp-cc.de

(Perhaps you have to clear your browsercache or reload the website)
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: SPCC: Testrun of Lc0 LS 12.2 finished

Post by Ozymandias »

Lc0 0.23.1 58613+ (what does the "+" mean?)
User avatar
pohl4711
Posts: 2433
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testrun of Lc0 LS 12.2 finished

Post by pohl4711 »

Ozymandias wrote: Sun Dec 29, 2019 5:57 pm Lc0 0.23.1 58613+ (what does the "+" mean?)
Just take a look below the ratinglist...

58613+ settings: CPuct=2.00, FpuValue=0.50, PolicyTemperature=1.50
58573+ settings: CPuct=2.70, FpuValue=0.50, PolicyTemperature=1.53
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: SPCC: Testrun of Lc0 LS 12.2 finished

Post by Ozymandias »

pohl4711 wrote: Sun Dec 29, 2019 7:53 pm
Ozymandias wrote: Sun Dec 29, 2019 5:57 pm Lc0 0.23.1 58613+ (what does the "+" mean?)
Just take a look below the ratinglist...

58613+ settings: CPuct=2.00, FpuValue=0.50, PolicyTemperature=1.50
58573+ settings: CPuct=2.70, FpuValue=0.50, PolicyTemperature=1.53
Any idea how much Elo those settings squeezed?
User avatar
pohl4711
Posts: 2433
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testrun of Lc0 LS 12.2 finished

Post by pohl4711 »

Ozymandias wrote: Sun Dec 29, 2019 9:25 pm
pohl4711 wrote: Sun Dec 29, 2019 7:53 pm
Ozymandias wrote: Sun Dec 29, 2019 5:57 pm Lc0 0.23.1 58613+ (what does the "+" mean?)
Just take a look below the ratinglist...

58613+ settings: CPuct=2.00, FpuValue=0.50, PolicyTemperature=1.50
58573+ settings: CPuct=2.70, FpuValue=0.50, PolicyTemperature=1.53
Any idea how much Elo those settings squeezed?
If you look at the full ratinglist, you see, that LD2 Net gained +20 Elo.

Click on “See the ORDO-rating of the archive-gamebase with all NN-testruns“
Jouni
Posts: 3281
Joined: Wed Mar 08, 2006 8:15 pm

Re: SPCC: Testrun of Lc0 LS 12.2 finished

Post by Jouni »

Now You are testing 25.12. SF. But there is only one patch with Elo +0.41. Better to wait?
Jouni
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: SPCC: Testrun of Lc0 LS 12.2 finished

Post by Ozymandias »

pohl4711 wrote: Mon Dec 30, 2019 5:39 amIf you look at the full ratinglist, you see, that LD2 Net gained +20 Elo.

Click on “See the ORDO-rating of the archive-gamebase with all NN-testruns“
Thx.
alchemist888
Posts: 9
Joined: Fri Mar 29, 2019 3:02 pm
Full name: Denis S.

Re: SPCC: Testrun of Lc0 LS 12.2 finished

Post by alchemist888 »

pohl4711 wrote: Sun Dec 29, 2019 12:39 pm NN-testrun of Lc0 0.23.1 with Leelenstein 12.2 Net finished - impressive progress!

https://www.sp-cc.de

(Perhaps you have to clear your browsercache or reload the website)
Thanks for the tests! I happy to see that NNs can improve on old training material with small changes in engine, settings and better training methods.

P.S.
I think that in the table you should swap the name of the engine and network. Because the engine is almost always Lc0, but the networks are different. This will be more convenient for perception in my opinion
ernest
Posts: 2041
Joined: Wed Mar 08, 2006 8:30 pm

Re: SPCC: Testrun of Lc0 LS 12.2 finished

Post by ernest »

Jouni wrote: Tue Dec 31, 2019 10:55 am Now You are testing 25.12. SF. But there is only one patch with Elo +0.41. Better to wait?
On NCM there is a +5 Elo jump... :wink:
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: SPCC: Testrun of Lc0 LS 12.2 finished

Post by Vinvin »

ernest wrote: Wed Jan 01, 2020 3:33 pm
Jouni wrote: Tue Dec 31, 2019 10:55 am Now You are testing 25.12. SF. But there is only one patch with Elo +0.41. Better to wait?
On NCM there is a +5 Elo jump... :wink:
NCM has a ±4 error.