NCM Stockfish Dev testing

Discussion of computer chess matches and engine tournaments.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
Jouni
Posts: 2005
Joined: Wed Mar 08, 2006 7:15 pm

NCM Stockfish Dev testing

Post by Jouni » Fri Sep 08, 2017 6:25 am

https://nextchessmove.com/dev-builds

How is +60 ELO to SF8 explained?? Unbalanced book?
Jouni

JJJ
Posts: 1286
Joined: Sat Apr 19, 2014 11:47 am

Re: NCM Stockfish Dev testing

Post by JJJ » Fri Sep 08, 2017 7:49 am

It is compared to Stockfish 7, not 8.That's might explain why there is more elo than it should be.

I also see the time control is lower than Stockfish long time control test. 30 sec +0,3 would explain why more elo.

Jouni
Posts: 2005
Joined: Wed Mar 08, 2006 7:15 pm

Re: NCM Stockfish Dev testing

Post by Jouni » Fri Sep 08, 2017 9:40 am

They have 30+0,3s and 2 CPU. Should be close to framework 60+0,6s?
Jouni

JJJ
Posts: 1286
Joined: Sat Apr 19, 2014 11:47 am

Re: NCM Stockfish Dev testing

Post by JJJ » Fri Sep 08, 2017 10:28 am

Many patches are doing better at shorter time control.

Andre
Posts: 93
Joined: Thu Jul 23, 2009 3:40 am

Re: NCM Stockfish Dev testing

Post by Andre » Fri Sep 08, 2017 11:06 pm

It's +130 compared to SF7 and around +60 compared to SF8

JJJ
Posts: 1286
Joined: Sat Apr 19, 2014 11:47 am

Re: NCM Stockfish Dev testing

Post by JJJ » Sat Sep 09, 2017 12:00 am

Andre wrote:It's +130 compared to SF7 and around +60 compared to SF8
Of course it should be +30 compared to SF8 in reality, so I guess time control helps a lot here.

Jouni
Posts: 2005
Joined: Wed Mar 08, 2006 7:15 pm

Re: NCM Stockfish Dev testing

Post by Jouni » Sat Jan 13, 2018 8:32 am

So they were testing WITHOUT book! And now they are re-testing all versions with 8 moves book - waste of time?
Jouni

Jouni
Posts: 2005
Joined: Wed Mar 08, 2006 7:15 pm

Re: NCM Stockfish Dev testing

Post by Jouni » Sat Jan 13, 2018 7:18 pm

Now everything is displayed exactly and PGN available, great! But draw after move 34 seems to be a little premature?
Jouni

User avatar
Ozymandias
Posts: 1126
Joined: Sun Oct 25, 2009 12:30 am

Re: NCM Stockfish Dev testing

Post by Ozymandias » Mon Jan 15, 2018 9:23 am

Jouni wrote:PGN available
Not anymore.

Jouni
Posts: 2005
Joined: Wed Mar 08, 2006 7:15 pm

Re: NCM Stockfish Dev testing

Post by Jouni » Mon Jan 15, 2018 12:39 pm

Let see what happens next. But this is definitely bad:

Code: Select all

-draw \
    movenumber=34 \
    movecount=8 \
    score=20 \
My suggestion is to re-test one version per month after SF8. And all 2018 versions.
Jouni

Post Reply