Page 1 of 1

NCM Stockfish Dev testing

Posted: Fri Sep 08, 2017 8:25 am
by Jouni
https://nextchessmove.com/dev-builds

How is +60 ELO to SF8 explained?? Unbalanced book?

Re: NCM Stockfish Dev testing

Posted: Fri Sep 08, 2017 9:49 am
by JJJ
It is compared to Stockfish 7, not 8.That's might explain why there is more elo than it should be.

I also see the time control is lower than Stockfish long time control test. 30 sec +0,3 would explain why more elo.

Re: NCM Stockfish Dev testing

Posted: Fri Sep 08, 2017 11:40 am
by Jouni
They have 30+0,3s and 2 CPU. Should be close to framework 60+0,6s?

Re: NCM Stockfish Dev testing

Posted: Fri Sep 08, 2017 12:28 pm
by JJJ
Many patches are doing better at shorter time control.

Re: NCM Stockfish Dev testing

Posted: Sat Sep 09, 2017 1:06 am
by Andre
It's +130 compared to SF7 and around +60 compared to SF8

Re: NCM Stockfish Dev testing

Posted: Sat Sep 09, 2017 2:00 am
by JJJ
Andre wrote:It's +130 compared to SF7 and around +60 compared to SF8
Of course it should be +30 compared to SF8 in reality, so I guess time control helps a lot here.

Re: NCM Stockfish Dev testing

Posted: Sat Jan 13, 2018 9:32 am
by Jouni
So they were testing WITHOUT book! And now they are re-testing all versions with 8 moves book - waste of time?

Re: NCM Stockfish Dev testing

Posted: Sat Jan 13, 2018 8:18 pm
by Jouni
Now everything is displayed exactly and PGN available, great! But draw after move 34 seems to be a little premature?

Re: NCM Stockfish Dev testing

Posted: Mon Jan 15, 2018 10:23 am
by Ozymandias
Jouni wrote:PGN available
Not anymore.

Re: NCM Stockfish Dev testing

Posted: Mon Jan 15, 2018 1:39 pm
by Jouni
Let see what happens next. But this is definitely bad:

Code: Select all

-draw \
    movenumber=34 \
    movecount=8 \
    score=20 \
My suggestion is to re-test one version per month after SF8. And all 2018 versions.