COLLECTION: Which engines comes with an own bench test?

[Frank Quisinsky]

Hi there,

I am not up to date with all the available engines.

So the question is:

Which engines comes with an own bench test?

I have interest to collect a little bit and to add bench results of SWCR hardware on my webpage.

I know Crafty have a good bench test. But perhaps other engines have a good bench system too.

Important ist:

Name of engine?
Parameter for starting the bench in text mode.

For an example:
Crafty = "bench"

Best
Frank

[tmokonen]

TSCP has a somewhat similar benchmark command (bench is the command to start the benchmark in text mode).

[CRoberson]

NoonianChess and Ares both have their own bench test which can be started at a command prompt.

NoonianChess -bench -fd depth
Ares -bench -fd depth

I wouldn't run NoonianChess any deeper than 10 ply; it is too slow. Depending on the speed of the computer, you could run Ares 14 ply deep or more.

Ares -bench -fd 12 // searches a set of positions 12 ply deep.

Ares reports several things including NPS and time. Time is reported in milliseconds, so 12640 is 12.64 seconds. Ares with -fd 10 takes 12.64 seconds on my laptop (Intel Core 2 Duo T5500) in 32 bit mode.

[Volker Annuss]

Hi Frank,

there is a kind of benchmark inside Hermann. It is not made for users. I normally use it for measuring time to depth but sometimes also as a benchmark how fast Hermann runs different computers.

You can make your own benchmark. Write the following commands to a file benchmark.txt

Code: Select all

ucitest
setoption name Hash value 256
setoption name OwnBook value false
setoption name blocking value true
position startpos
go depth 12
position startpos moves e2e4 e7e5 g1f3 b8c6
go depth 11
position fen qnbrnkrb/pppppppp/8/8/8/8/PPPPPPPP/QNBRNKRB w KQkq - 0 1   
go depth 11
position fen rbnkbqnr/pppppppp/8/8/8/8/PPPPPPPP/RBNKBQNR w HAha - 0 1 
go depth 11

You can use any of Hermanns uci options for benchmarking, for example Hash, MultiPV or even NumberOfProcessors which will give you a different output every time.

ucitest is required for benchmarking. It makes Hermann accept uci commands but print benchmark output.

setoption name blocking value true is a hidden uci option that is also required for benchmarking. It prevents Hermann from looking for input during search. Otherwise the search would get interrupted by the next position and go commands or Hermann would stop too early because end of input file.

Start Hermann from the command line with

Code: Select all

Hermann.exe <benchmark.txt

Or copy the uci commands to the clipboard, start Hermann by double clicking Hermann.exe, right click on the window title bar and select Bearbeiten/Einfügen (Edit/Insert?).

You get 4 columns output. 1st: Position number, 2nd: time for this position, 3rd: time for all positions until now, 4th: geometric average time for all positions until now.

Greetings
Volker


edit: typo

[royb]

Frank,

Stockfish 1.7.1 has a bench command. Use it like this:

stockfish.exe bench 32 1 10 default depth

(Meaning use 32MB hash, 1 thread and analyze a default set of positions each to depth 10)

Roy

[Frank Quisinsky]

Hi,

I will try all

I think I should add the bench results of SWCR hardware on my page. It would be great if others which create a rating list make the same. More easy for users to compare it.

Thanks again to all for the comments.

Best
Frank

[Frank Quisinsky]

Message delete, edit.
Made a mistake.

Add the message on Talkchess tournament forum:
http://www.talkchess.com/forum/viewtopi ... 356#359356

Used the wrong thread and forum, sorry!

[Frank Quisinsky]

Information added on www.amateurschach.de

Hope that others which created a rating list do it too.

Best
Frank

[Frank Quisinsky]

Hi Charles,

I used for the information I got from Ares 1004 only the np/s. Hope this is right.

Thanks

Best
Frank

[Frank Quisinsky]

Hi,

information added on my swcr webpage.

With parameter:
bench 256 1 20

Thanks
Best