SPCC: Testrun of Lc0 805123 finished

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
pohl4711
Posts: 2825
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

SPCC: Testrun of Lc0 805123 finished

Post by pohl4711 »

NN-testrun of Lc0 0.30dev (same binary as in TCEC) with net 805123 finished.


https://www.sp-cc.de


(Perhaps you have to clear your browsercache (press <STRG>+<SHIFT>+<DEL>) or reload the website))
ernest
Posts: 2053
Joined: Wed Mar 08, 2006 8:30 pm

Re: SPCC: Testrun of Lc0 805123 finished

Post by ernest »

You wrote : "Next ratinglist- and VLTC-regression-testruns: Stockfish 221004"

Well, let's see : NCM (https://nextchessmove.com/dev-builds) found quite a bad score for that version !

(of course NCM is not SPCC 8-) )
Jouni
Posts: 3722
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: SPCC: Testrun of Lc0 805123 finished

Post by Jouni »

Yes rating is now +1.48 ELO over SF15. Minimal progress in 6 months! Is there chance, that Dragon reach SF level now?
Jouni
User avatar
pohl4711
Posts: 2825
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testrun of Lc0 805123 finished

Post by pohl4711 »

Jouni wrote: Wed Oct 05, 2022 8:46 am Yes rating is now +1.48 ELO over SF15. Minimal progress in 6 months! Is there chance, that Dragon reach SF level now?
Perhaps a restart with this (best so far in my testings) version could make sense:
Stockfish 220817 has 3814 SPCC-Elo, means +12 Elo to SF 15,
but this is not my decision, of course.
mehmet123
Posts: 694
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: SPCC: Testrun of Lc0 805123 finished

Post by mehmet123 »

NCM results doesn't show the real power of Stockfish. Stockfish 7 is very weak according to Stockfish 16 Dev versions. If the oppponent is Komodo Dragon we could reach more accurate results.
User avatar
pohl4711
Posts: 2825
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testrun of Lc0 805123 finished

Post by pohl4711 »

mehmet123 wrote: Wed Oct 05, 2022 6:06 pm NCM results doesn't show the real power of Stockfish. Stockfish 7 is very weak according to Stockfish 16 Dev versions. If the oppponent is Komodo Dragon we could reach more accurate results.

NCM is nonsense, SF 7 is much too weak as opponent for latest SF devs.
I refer only to my own testings..
User avatar
Ozymandias
Posts: 1537
Joined: Sun Oct 25, 2009 2:30 am

Re: SPCC: Testrun of Lc0 805123 finished

Post by Ozymandias »

pohl4711 wrote: Wed Oct 05, 2022 6:00 pmPerhaps a restart with this (best so far in my testings) version could make sense:
Stockfish 220817 has 3814 SPCC-Elo, means +12 Elo to SF 15,
How much is it above this one, in your testing?

Author: Michael Chaly
Date: Mon Feb 7 17:30:35 2022 +0100
Timestamp: 1644251435
User avatar
pohl4711
Posts: 2825
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testrun of Lc0 805123 finished

Post by pohl4711 »

Ozymandias wrote: Fri Oct 07, 2022 8:12 am
pohl4711 wrote: Wed Oct 05, 2022 6:00 pmPerhaps a restart with this (best so far in my testings) version could make sense:
Stockfish 220817 has 3814 SPCC-Elo, means +12 Elo to SF 15,
How much is it above this one, in your testing?

Author: Michael Chaly
Date: Mon Feb 7 17:30:35 2022 +0100
Timestamp: 1644251435
1 Stockfish 221004 avx2 : 3807 8 8 7000 69.0% 3664 61.4%
2 Stockfish 220927 avx2 : 3804 8 8 7000 68.7% 3664 62.1%
3 Stockfish 15 220418 : 3802 7 7 8000 69.5% 3655 60.7%
User avatar
Ozymandias
Posts: 1537
Joined: Sun Oct 25, 2009 2:30 am

Re: SPCC: Testrun of Lc0 805123 finished

Post by Ozymandias »

I see 221004 and 220927, but not 220207.
User avatar
pohl4711
Posts: 2825
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testrun of Lc0 805123 finished

Post by pohl4711 »

Ozymandias wrote: Sat Oct 08, 2022 9:00 am I see 221004 and 220927, but not 220207.
Oh. 220207 is long ago...
That was before release of SF 15...

If I look in my old diagrams (with Zoom), I can say, I did not test 220207, but 220205: 3804 SPCC-Elo