ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Stockfish testing at STC and LTC: one question
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions Flat
View previous topic :: View next topic  
Author Message
Uri Blass



Joined: 08 Mar 2006
Posts: 7831
Location: Tel-Aviv Israel

PostPost subject: Re: Stockfish testing at STC and LTC: one question    Posted: Fri Sep 22, 2017 2:33 am Reply to topic Reply with quote

Jouni wrote:
It's usual, that excellent patch gives +4 ELO at STC, but +2 at LTC. So is this indicating, that at 360+3,6 level we get probably NOTHING? And may be regression at tournament level!


It is usual that the stockfish team have no interest how much elo they get otherwise they could do better by using fixed number of games.

We know almost nothing about the elo improvement of a patch from
results of SPRT.

Performance of +4 elo when they pass SPRT at STC means nothing becuase if you test the patch many times the patch may fail SPRT in part of the cases and give also 0 elo or 1 elo so the average result is clearly less than 4 elo.
Back to top
View user's profile Send private message
Display posts from previous:   
Subject Author Date/Time
Stockfish testing at STC and LTC: one question Jouni Uski Tue Sep 19, 2017 6:53 am
      Re: Stockfish testing at STC and LTC: one question daniel jose Tue Sep 19, 2017 3:39 pm
      Re: Stockfish testing at STC and LTC: one question Joseph Ellis Tue Sep 19, 2017 3:40 pm
            Re: Stockfish testing at STC and LTC: one question daniel jose Tue Sep 19, 2017 3:41 pm
      Re: Stockfish testing at STC and LTC: one question Robert Houdart Tue Sep 19, 2017 4:17 pm
      Re: Stockfish testing at STC and LTC: one question Evert Glebbeek Tue Sep 19, 2017 4:20 pm
      Re: Stockfish testing at STC and LTC: one question Mark Lefler Thu Sep 21, 2017 1:19 am
      Re: Stockfish testing at STC and LTC: one question Uri Blass Fri Sep 22, 2017 2:33 am
      Re: Stockfish testing at STC and LTC: one question Jon Dart Sun Sep 24, 2017 6:42 pm
            Re: Stockfish testing at STC and LTC: one question Dann Corbit Mon Sep 25, 2017 6:41 pm
                  Re: Stockfish testing at STC and LTC: one question Jon Dart Mon Sep 25, 2017 7:12 pm
                        Re: Stockfish testing at STC and LTC: one question Uri Blass Mon Sep 25, 2017 9:05 pm
                              Re: Stockfish testing at STC and LTC: one question Dann Corbit Mon Sep 25, 2017 9:44 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads