Crafty benchmark question

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

Spock

Crafty benchmark question

Post by Spock »

I post this here because it is more likely to get Bob's attention, or perhaps another Crafty expert.

Double-clicking on the Crafty exe, and then typing "bench" runs a benchmark but only for quite a short period of time. Is there an extra parameter that will make it run longer ? And a parameter to tell it how much hash to use during the bench ? Is the latter just in the crafty.rc file ?

thanks
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Crafty benchmark question

Post by bob »

Spock wrote:I post this here because it is more likely to get Bob's attention, or perhaps another Crafty expert.

Double-clicking on the Crafty exe, and then typing "bench" runs a benchmark but only for quite a short period of time. Is there an extra parameter that will make it run longer ? And a parameter to tell it how much hash to use during the bench ? Is the latter just in the crafty.rc file ?

thanks
We will probably revise this before long since hardware has continued to get faster. To answer your questions, in order:

(1) no, it runs for a specific search depth in each position so that the benchmark is comparable across platforms;

(2) you should run with default hash, otherwise you again change a variable that makes it impossible to compare with other benchmark results.