ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

optimal aspiration window for stockfish question
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions Flat
View previous topic :: View next topic  
Author Message
Robert Hyatt



Joined: 27 Feb 2006
Posts: 17887
Location: Birmingham, AL

PostPost subject: Re: test results    Posted: Fri Mar 16, 2012 7:16 pm Reply to topic Reply with quote

Rebel wrote:
bob wrote:
Karlo Bala wrote:
bob wrote:
Here is the output from BayesElo first:

2 Crafty-23.5R06-200 2650 4 4 30000 64% 2539 22%
3 Crafty-23.5R06-24 2650 4 4 30000 64% 2539 22%
4 Crafty-23.5R06-100 2649 4 4 30000 63% 2539 22%
5 Crafty-23.5R06-30 2648 4 4 30000 63% 2539 22%
6 Crafty-23.5R06-50 2648 4 4 30000 63% 2539 22%
7 Crafty-23.5R06-300 2648 4 4 30000 63% 2539 22%
8 Crafty-23.5R06-20 2648 4 4 30000 63% 2539 22%
9 Crafty-23.5R06-10 2645 4 4 30000 63% 2539 22%
10 Crafty-23.5-2 2645 4 4 30000 63% 2539 22%
11 Crafty-23.5R06-1 2645 4 4 30000 63% 2539 22%
12 Crafty-23.5R06-8 2644 4 4 30000 63% 2539 22%
13 Crafty-23.5R06-5 2643 4 4 30000 63% 2539 22%
14 Crafty-23.5-1 2641 4 4 30000 63% 2539 22%
15 Crafty-23.5R06-2 2636 4 4 30000 62% 2539 22%


version 23.5-1 and 23.5-2 are simply two consecutive runs with the same version to provide a normal result. The rest of the tests are version 23.5R06 and were tested where the -n is the aspiration window (delta value in the code posted yesterday). 23.5R06-1 means the aspiration window was +/- 1 with delta=1. 1 and 2 are a bit low, and by the time it gets to 10, it is pretty optimal. Bigger doesn't seem to hurt at all up to +/- 3.0 pawns... I was expecting a better result in the 20-40 range, the reason I ran the big numbers was to produce some worse results so that there is a recognizable curve with a clear optimal value, and worse results on either side. Didn't get exactly what I expected, as you can see...


What is the average depth?


A quick looks says that the average is in the 13-14-15 range. I looked at a few logs and there are plenty of re-searches going on, so it is having a chance to exert influence.

What should not be forgotten is the saturation of the hash table. With an almost full hash table researches will become very expensive and it would make sense to widen the window.


That's one problem I really don't have to deal with. I don't hash the q-search, so I really don't see much in terms of saturation. When I was testing this stuff, I found that hashing the q-search reduced the total tree size by about 10%, but it slowed the program down by almost exactly the same amount. A wash. But by not hashing the q-search, the stress on the ttable is greatly reduced, which tends to make this pay off (not hashing qsearch) in real long games without sufficient memory for the ttable. 8 gigs gives 512 million entries, which is a lot even for a long 40/2hr type game...

I run fast games with a modest hash on the cluster, just to try to keep things within perspective...
Back to top
View user's profile Send private message
Display posts from previous:   
Subject Author Date/Time
optimal aspiration window for stockfish question Uri Blass Mon Mar 12, 2012 11:14 am
      Re: optimal aspiration window for stockfish question Ed Schroder Mon Mar 12, 2012 12:55 pm
            Re: optimal aspiration window for stockfish question Marco Costalba Mon Mar 12, 2012 6:47 pm
                  Re: optimal aspiration window for stockfish question Don Dailey Mon Mar 12, 2012 9:41 pm
                        Re: optimal aspiration window for stockfish question Robert Hyatt Wed Mar 14, 2012 10:18 pm
                              Re: optimal aspiration window for stockfish question Marco Costalba Thu Mar 15, 2012 6:15 am
                                    Re: optimal aspiration window for stockfish question Robert Hyatt Thu Mar 15, 2012 2:06 pm
                                          Re: optimal aspiration window for stockfish question Robert Hyatt Thu Mar 15, 2012 5:30 pm
                                                Re: optimal aspiration window for stockfish question Robert Hyatt Thu Mar 15, 2012 8:11 pm
                                                      Re: optimal aspiration window for stockfish question (update Robert Hyatt Thu Mar 15, 2012 9:55 pm
                                                            Re: optimal aspiration window for stockfish question (update Miguel A. Ballicora Thu Mar 15, 2012 10:23 pm
                                                                  Re: optimal aspiration window for stockfish question (update Robert Hyatt Fri Mar 16, 2012 3:29 am
                                                                        Re: test results Robert Hyatt Fri Mar 16, 2012 3:41 am
                                                                              Re: test results Rémi Coulom Fri Mar 16, 2012 8:38 am
                                                                                    Re: test results Robert Hyatt Fri Mar 16, 2012 5:20 pm
                                                                              Re: test results Karlo Bala Jr. Fri Mar 16, 2012 11:30 am
                                                                                    Re: test results Robert Hyatt Fri Mar 16, 2012 5:26 pm
                                                                                          Re: test results Ed Schroder Fri Mar 16, 2012 6:31 pm
                                                                                          Re: test results Robert Hyatt Fri Mar 16, 2012 7:16 pm
                                          Re: optimal aspiration window for stockfish question Vincent Diepeveen Sat Mar 17, 2012 1:44 pm
                                                Re: optimal aspiration window for stockfish question Robert Hyatt Sat Mar 17, 2012 4:11 pm
                                                      Re: optimal aspiration window for stockfish question Marco Costalba Sat Mar 17, 2012 5:28 pm
                                                            Re: optimal aspiration window for stockfish question Robert Hyatt Sun Mar 18, 2012 3:28 am
                                                                  Re: optimal aspiration window for stockfish question Lucas Braesch Sun Mar 18, 2012 5:55 am
                                                                        Re: optimal aspiration window for stockfish question Joona Kiiski Sun Mar 18, 2012 9:02 am
                  Re: optimal aspiration window for stockfish question Robert Houdart Mon Mar 12, 2012 10:44 pm
                        Re: optimal aspiration window for stockfish question Robert Houdart Tue Mar 13, 2012 9:18 am
                              Re: optimal aspiration window for stockfish question Uri Blass Tue Mar 13, 2012 10:12 am
                                    Re: optimal aspiration window for stockfish question Karlo Bala Jr. Wed Mar 14, 2012 7:46 pm
                                          Re: optimal aspiration window for stockfish question Robert Hyatt Thu Mar 15, 2012 9:49 pm
                  Re: optimal aspiration window for stockfish question Lucas Braesch Wed Mar 14, 2012 4:10 pm
                        Re: optimal aspiration window for stockfish question Eelco de Groot Wed Mar 14, 2012 7:30 pm
                              Re: optimal aspiration window for stockfish question Lucas Braesch Thu Mar 15, 2012 2:03 am
                                    Re: optimal aspiration window for stockfish question Marco Costalba Thu Mar 15, 2012 6:13 am
      Re: optimal aspiration window for stockfish question Eelco de Groot Tue Mar 13, 2012 10:20 am
            Re: optimal aspiration window for stockfish question Uri Blass Tue Mar 13, 2012 12:57 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads