TalkChess.com

Large Pages code ported from Brainfish by Thomas Zipproth

Both for Windows Popcnt and Bmi2
All 10 engines in the Honey family were enabled with Large Pages, including the functional equivalent Stockfish, Black-Diamond, Bluefish and Weakfish

Some runs
3970x - Windows 10 Pro

Before LP:
Stockfish-XI
bench 2048 64 26
===========================
Total time (ms) : 40053
Nodes searched : 3825860217
Nodes/second : 95519941

After LP
Stockfish-XI-LP
bench 2048 64 26
===========================
Total time (ms) : 40486
Nodes searched : 4186128286
Nodes/second : 103396934

Before LP:
Honey-XI
bench 2048 64 26
===========================
Total time (ms) : 42417
Nodes searched : 4031868048
Nodes/second : 95053116

After LP
Honey-XI-LP
bench 2048 64 26
===========================
Total time (ms) : 42289
Nodes searched : 4353576891
Nodes/second : 102948210

Before LP:
Weakfish-XI
bench 2048 64 14

===========================
Total time (ms) : 151909
Nodes searched : 18787154052
Nodes/second : 123673739

After LP:
Weakfish-XI-LP
bench 2048 64 14
===========================
Total time (ms) : 137214
Nodes searched : 18347938746
Nodes/second : 133717687

This what it will look like when running from the terminal, "b" is a shortcut for bench. You will see feedback when Large pages are enabled. No feedback means they are not enabled.

Also , it does seem to me much more efficient, when you set the memory to 2048 or a multiple of 2048. e.g.

# Stockfish-XI-LP b 24000 64 26
Stockfish XI-LP by T. Romstad, M. Costalba, J. Kiiski, G. Linscott
info string Hash LargePages 16 Mb
info string Hash LargePages 24000 Mb

===========================
Total time (ms) : 81096
Nodes searched : 8352466673
Nodes/second : 102994804

versus:

# Stockfish-XI-LP b 32768 64 26 >/dev/null
info string Hash LargePages 16 Mb
info string Hash LargePages 32768 Mb
===========================
Total time (ms) : 72008
Nodes searched : 7581919305
Nodes/second : 105292735

Enjoy!
https://github.com/MichaelB7/Stockfish/releases/tag/XI

To Enable Large Pages in Windows 10 Pro ( admin account required)

PLEASE UNDERSTAND THE RISKS BEFORE YOU DO THIS - enabling Large Pages can slow your system to CRAWL if you have insufficient memory. I would recommend at least 128 GB of RAM. I assume no responsibility for any action you take. At the minimum, I would divide the RAM you have by 4 and use that as your max hash for all engines running. It's probably best to reboot your machine if you re planning to use a big hash ( 25% of your RAM) relative to the memory you have

• On the Start menu, click Run. In the Open box, type gpedit.msc.
  
  On the Local Group Policy Editor console, expand Computer Configuration, and then expand Windows Settings.
  
  Expand Security Settings, and then expand Local Policies.
  
  Select the User Rights Assignment folder.
  
  The policies will be displayed in the details pane.
  
  In the pane, double-click Lock pages in memory.
  
  In the Local Security Setting - Lock pages in memory dialog box, click Add User or Group.

For those that may be interested, I just pushed the changes to build Honey and related binaries with large pages to Github.

https://github.com/MichaelB7/Stockfish/ ... c5c123a3b7

You have to set largepages to 'yes' , in the makefile. There is threadripper flag that sets the cache parameter to the 3970x. You may want to change to match your CPU.

Build.sh builds all 10 PGO binaires on both my Mac and Threadripper box your mileage may vary. Just few items need to be changed between OS.
It requires a fairly compliant UNIX shell under the hood. For that functionality under windows , you need to install MYSYS2 and a few other items. IT also requires setting paths in the environment. It's not for everyone. Google is your friend if you get stuck

For those that like bleeding edge binaries :

https://github.com/MichaelB7/Stockfish/ ... es/Windows

also includes base x64 , which should run on the early 64 bit windows machines which do not have popcnt or sse4.2 .

These development binaries have the 25 commits since Stockfish 11 ( really 20, since 5 were reverted) .

All versions are enabled for Large Pages - which is on by default, but can be turned off in the uci settings.

This is not a release.