I ported Roland's Cfish patches to my Stockfish branch:
https://git.sesse.net/?p=stockfish;a=co ... fbd53f4c17
https://git.sesse.net/?p=stockfish;a=co ... 82a3763797
They're only lightly tested, so beware.
7-men Syzygy attempt
Moderators: hgm, Rebel, chrisw
-
- Posts: 560
- Joined: Sun Nov 08, 2015 11:10 pm
Re: 7-men Syzygy attempt
After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.
There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.
There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.
-
- Posts: 2821
- Joined: Fri Sep 25, 2015 9:38 pm
- Location: Sortland, Norway
Re: 7-men Syzygy attempt
Shouldn't NUMA offset some of this slowness compared to running without NUMA?noobpwnftw wrote:After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.
There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.
Something equilavent to running a overclocked system vs stock speed.
-
- Posts: 560
- Joined: Sun Nov 08, 2015 11:10 pm
Re: 7-men Syzygy attempt
This estimation is based on performance using NUMA-aware generator.Nordlandia wrote:Shouldn't NUMA offset some of this slowness compared to running without NUMA?noobpwnftw wrote:After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.
There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.
Something equilavent to running a overclocked system vs stock speed.
Pawnful building is on another machine that does not suffer slowdown without it, probably due to better hardware configuration.
-
- Posts: 300
- Joined: Mon Apr 30, 2018 11:51 pm
Re: 7-men Syzygy attempt
This is actually amazingly fast :-) Just a few weeks ago, the general sentiment was “it will take a year or more to build all tables, it will probably be closer to 100 TB, nobody's doing it or interested in it”… and now we're talking something like 30–35 TB, full pawnless set two weeks out and the rest mere months away?noobpwnftw wrote:After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.
There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.
Something tells me I'll need to start thinking about disks…
-
- Posts: 741
- Joined: Tue May 22, 2007 11:13 am
Re: 7-men Syzygy attempt
What I like to know is how are people able to afford the enormous resources (~1.5 Tb RAM and dozens of cores) for such hobby computations? Or are they using idle company resources somehow?Sesse wrote:This is actually amazingly fast Just a few weeks ago, the general sentiment was “it will take a year or more to build all tables, it will probably be closer to 100 TB, nobody's doing it or interested in it”… and now we're talking something like 30–35 TB, full pawnless set two weeks out and the rest mere months away?noobpwnftw wrote:After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.
There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.
Something tells me I'll need to start thinking about disks…
-
- Posts: 560
- Joined: Sun Nov 08, 2015 11:10 pm
Re: 7-men Syzygy attempt
Two cents: this is real science, once and for all, like prime search, people devote serious hardware for its worth.Rein Halbersma wrote:What I like to know is how are people able to afford the enormous resources (~1.5 Tb RAM and dozens of cores) for such hobby computations? Or are they using idle company resources somehow?Sesse wrote:This is actually amazingly fast Just a few weeks ago, the general sentiment was “it will take a year or more to build all tables, it will probably be closer to 100 TB, nobody's doing it or interested in it”… and now we're talking something like 30–35 TB, full pawnless set two weeks out and the rest mere months away?noobpwnftw wrote:After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.
There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.
Something tells me I'll need to start thinking about disks…
-
- Posts: 300
- Joined: Mon Apr 30, 2018 11:51 pm
Re: 7-men Syzygy attempt
Evidently, the link between me and the FTP server is having issues somewhere:
`KRRBNvKR.rtbz' at 4293282352 (56%) 159.2K/s eta:6h7m [Receiving data]
--- 112.73.74.24 ping statistics ---
1324 packets transmitted, 1086 received, 17% packet loss, time 1330692ms
rtt min/avg/max/mdev = 357.033/528.587/714.175/98.094 ms
Looks like the hop between xe-5-1-2.200.rtsw2.ashb.net.internet2.edu and 218.30.54.56 (CHINANET-US-POP)
`KRRBNvKR.rtbz' at 4293282352 (56%) 159.2K/s eta:6h7m [Receiving data]
--- 112.73.74.24 ping statistics ---
1324 packets transmitted, 1086 received, 17% packet loss, time 1330692ms
rtt min/avg/max/mdev = 357.033/528.587/714.175/98.094 ms
Looks like the hop between xe-5-1-2.200.rtsw2.ashb.net.internet2.edu and 218.30.54.56 (CHINANET-US-POP)
-
- Posts: 560
- Joined: Sun Nov 08, 2015 11:10 pm
Re: 7-men Syzygy attempt
Kind folks also provided a mirror:Sesse wrote:Evidently, the link between me and the FTP server is having issues somewhere:
`KRRBNvKR.rtbz' at 4293282352 (56%) 159.2K/s eta:6h7m [Receiving data]
--- 112.73.74.24 ping statistics ---
1324 packets transmitted, 1086 received, 17% packet loss, time 1330692ms
rtt min/avg/max/mdev = 357.033/528.587/714.175/98.094 ms
Looks like the hop between xe-5-1-2.200.rtsw2.ashb.net.internet2.edu and 218.30.54.56 (CHINANET-US-POP)
http://tablebase.lichess.ovh/tables/standard/7/
-
- Posts: 300
- Joined: Mon Apr 30, 2018 11:51 pm
Re: 7-men Syzygy attempt
tablebase.sesse.net will also mirror, as soon as I can get everything downloaded and verified somehow (are there checksums anywhere?).
Edit: The OVH mirror was much, much faster for me—a tad under 500 Mbit/sec.
Edit: The OVH mirror was much, much faster for me—a tad under 500 Mbit/sec.