Stockfish benchmark data

[Adam Hair]

I am trying to collect Stockfish nodes per second data from the computer chess community and I hope to get plenty of volunteers. The information will be useful for comparing computer chess results between computers.

I have created a package that can be downloaded at http://www.mediafire.com/file/3ivy28eqx ... _bench.zip . In that package you will find the various official compiles of Stockfish 8 (and the source code) and directions for running a script that will collect nps data for 30 positions searched to depth 24. I am hoping that people will submit data for various numbers of CPUs, especially 1 CPU and the max number of CPUs their computer has. The process took 8 1/2 minutes using 1 CPU of my i7 3840QM processor.

I will be posting people'e submissions at http://adamsccpages.blogspot.com/p/stoc ... hmark.html . I will greatly appreciate it if you are willing to devote some time to generate the data.

Thanks,
Adam

Would also be nice if you display the average time in the table.

I will do that.

[Adam Hair]

I am trying to collect Stockfish nodes per second data from the computer chess community and I hope to get plenty of volunteers. The information will be useful for comparing computer chess results between computers.

I have created a package that can be downloaded at http://www.mediafire.com/file/3ivy28eqx ... _bench.zip . In that package you will find the various official compiles of Stockfish 8 (and the source code) and directions for running a script that will collect nps data for 30 positions searched to depth 24. I am hoping that people will submit data for various numbers of CPUs, especially 1 CPU and the max number of CPUs their computer has. The process took 8 1/2 minutes using 1 CPU of my i7 3840QM processor.

I will be posting people'e submissions at http://adamsccpages.blogspot.com/p/stoc ... hmark.html . I will greatly appreciate it if you are willing to devote some time to generate the data.

Thanks,
Adam

Happy to run it if there's a command line version for Linux. The tclkit script doesn't work for me even after installing tclkit.

Code: Select all

matthew@bigfoot:~/Downloads/Linux$ ./Stockfish_8_bench.sh 
couldn't read file "/home/matthew/Downloads/Linux/sim03.kit/main.tcl": no such file or directory
    while executing
"source /home/matthew/Downloads/Linux/sim03.kit/main.tcl"
    ("uplevel" body line 1)
    invoked from within
"uplevel [list source [file join $self main.tcl]]"

Is there a reason why this needs a GUI?

There is no reason beyond trying to make this as easy as possible for people with little technical knowledge, which usually frustrates people who know what they are doing . I use this Tcl script for feeding positions to engines simply because it works for me and I lack the ability to write my own script.

What I can and should do is include the positions with the package so that alternative methods for running ths benchmark can be used.

[Adam Hair]

Stockfish does not recognize the Clear Hash command.

Code: Select all

Engine->Adapter: Unknown command: Clear Hash

It was sent like this,

Code: Select all

Adapter->Engine: Clear Hash

Perhaps this should have been,

Code: Select all

Adapter->Engine: setoption name Clear Hash

But since ucinewgame was sent before every position startpos ... perhaps the Hash was cleared.

Looks like I forgot how to send an uci command during the time I was without a computer.

[Adam Hair]

I will follow Michael's and T. Poppins recommendations..

[Adam Hair]

I have updated the benchmark list with the submissions I have received:

http://adamsccpages.blogspot.com/p/stoc ... hmark.html

[MikeB]

I have updated the benchmark list with the submissions I have received:

http://adamsccpages.blogspot.com/p/stoc ... hmark.html

Adam that is excellent - I have one minor correction on the MacPro results I sent you, the CPU is the "X5690" processor not the "X5675" processor. Sorry if I made that typo. Appreciate you doing this - hopefully folks send you more results.

Just for kicks, I will send you the Cfish-8 results for the Mac Pro - you will see a big difference.

[Jesse Gersenson]

is the source code available?

I wrote a simple command-line script which:
1. downloads engine
2. detects number of cores, OS, CPU info, RAM info
3. asks you your name
4. runs benchmark
5. uploads results to webserver

Perhaps some of these ideas could be applied to your script.

I'll release my code after the .bat file's been tested.

[Guenther]

I have updated the benchmark list with the submissions I have received:

http://adamsccpages.blogspot.com/p/stoc ... hmark.html

Adam, if you make the last column aware of one decimal it would look even better. (= adding .0 to integers)
May be we could also split processor/frequency for beautifying?
BTW the data would be something for a google table with all its features :)

Thanks for the work, also for the latest simtest results in the EO forum.