Re pondering

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

bezzy3004

Re pondering

Post by bezzy3004 »

I am the original poster of this topic and am sorry i have started a feud! I only wanted to know how to obtain the best quality chess possible. ponder on or off simple.
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Re pondering

Post by kranium »

i think all will agree that an engine is stronger if it can ponder between moves...
User avatar
Matthias Gemuh
Posts: 3245
Joined: Thu Mar 09, 2006 9:10 am

Re: Re pondering

Post by Matthias Gemuh »

kranium wrote:i think all will agree that an engine is stronger if it can ponder between moves...

This is only true if some extra CPU is used that would otherwised not be used.

If the same amount of CPU is used in both cases, an engine is WEAKER if pondering is ON. Remember that each ponder miss is a waste of CPU.
Hash tables may help to reduce the waste but cannot eliminate it.

Matthias.
My engine was quite strong till I added knowledge to it.
http://www.chess.hylogic.de
User avatar
Graham Banks
Posts: 41451
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Re pondering

Post by Graham Banks »

bezzy3004 wrote:I am the original poster of this topic and am sorry i have started a feud! I only wanted to know how to obtain the best quality chess possible. ponder on or off simple.
As you can see, there are arguments both ways. :wink:
Whereas I do all my testing with ponder off in order to meet CCRL criteria, I think you'll have more fun watching a ponder on tournament in progress.
In the past, I recall seeing some testing that was done to measure how much stronger engines played with ponder on as opposed to ponder off. The difference was negligible.

Cheers, Graham.
gbanksnz at gmail.com
User avatar
hgm
Posts: 27808
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Re pondering

Post by hgm »

I still have little to add to what I originally said:

If you want to play a number of games on a dual, play two games simultaneous with ponder off, with twice longer time control. The engines will then play stronger than when you play one game at the time at the nominal TC with ponder on. In both cases you use 100% of the CPU, but in the former case 20-30% of the CPU time will be wasted because engines are pondering about the wrong move.

The other arguments that have been mentioned, like "butthen engines take tuns in thinking, in stead of thinking all the time" you should only pay attention to if you care abotthem and are willing to sacrifice quality for it or wait longer for your results.
User avatar
hgm
Posts: 27808
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Re pondering

Post by hgm »

Graham Banks wrote:In the past, I recall seeing some testing that was done to measure how much stronger engines played with ponder on as opposed to ponder off. The difference was negligible.
This is interesting, and certainly true for micro-Max (as it does not know how to ponder :lol: ). But I would have expected a 20-Elo improvement, or so, for engines with a good ponder implementation.
User avatar
Graham Banks
Posts: 41451
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Re pondering

Post by Graham Banks »

hgm wrote:
Graham Banks wrote:In the past, I recall seeing some testing that was done to measure how much stronger engines played with ponder on as opposed to ponder off. The difference was negligible.
This is interesting, and certainly true for micro-Max (as it does not know how to ponder :lol: ). But I would have expected a 20-Elo improvement, or so, for engines with a good ponder implementation.
20 ELO is negligible in the bigger scheme of things. Just my opinion.
gbanksnz at gmail.com
mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

Re: Re pondering

Post by mcostalba »

Graham Banks wrote: 20 ELO is negligible in the bigger scheme of things. Just my opinion.

I can assure you that when you are fighting hard with your code just to squeeze that extra bit of speed or tweaking a parameter to death just to find the optimal tuning you are very very far from the bigger scheme of things in that moment :D :D
User avatar
Matthias Gemuh
Posts: 3245
Joined: Thu Mar 09, 2006 9:10 am

Re: Re pondering

Post by Matthias Gemuh »

hgm wrote:... I would have expected a 20-Elo improvement, or so, for engines with a good ponder implementation.

Such a huge gain is only possible if some opponents ponder so badly that they lose that much Elo approx.

Graham is right that games with ponder ON are more fun to watch, though.

Matthias.
My engine was quite strong till I added knowledge to it.
http://www.chess.hylogic.de
User avatar
Graham Banks
Posts: 41451
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Re pondering

Post by Graham Banks »

mcostalba wrote:
Graham Banks wrote: 20 ELO is negligible in the bigger scheme of things. Just my opinion.

I can assure you that when you are fighting hard with your code just to squeeze that extra bit of speed or tweaking a parameter to death just to find the optimal tuning you are very very far from the bigger scheme of things in that moment :D :D
True. I certainly didn't mean to downplay the efforts of the engine authors in this regard. 8-)
gbanksnz at gmail.com