7-men Syzygy attempt

[Sesse]

I ported Roland's Cfish patches to my Stockfish branch:

https://git.sesse.net/?p=stockfish;a=co ... fbd53f4c17
https://git.sesse.net/?p=stockfish;a=co ... 82a3763797

They're only lightly tested, so beware.

[noobpwnftw]

After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.

There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.

[Nordlandia]

After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.

There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.

Shouldn't NUMA offset some of this slowness compared to running without NUMA?

Something equilavent to running a overclocked system vs stock speed.

[noobpwnftw]

After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.

There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.

Shouldn't NUMA offset some of this slowness compared to running without NUMA?

Something equilavent to running a overclocked system vs stock speed.

This estimation is based on performance using NUMA-aware generator.

Pawnful building is on another machine that does not suffer slowdown without it, probably due to better hardware configuration.

[Sesse]

After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.

There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.

This is actually amazingly fast :-) Just a few weeks ago, the general sentiment was “it will take a year or more to build all tables, it will probably be closer to 100 TB, nobody's doing it or interested in it”… and now we're talking something like 30–35 TB, full pawnless set two weeks out and the rest mere months away?

Something tells me I'll need to start thinking about disks…

[Rein Halbersma]

After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.

There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.

This is actually amazingly fast Just a few weeks ago, the general sentiment was “it will take a year or more to build all tables, it will probably be closer to 100 TB, nobody's doing it or interested in it”… and now we're talking something like 30–35 TB, full pawnless set two weeks out and the rest mere months away?

Something tells me I'll need to start thinking about disks…

What I like to know is how are people able to afford the enormous resources (~1.5 Tb RAM and dozens of cores) for such hobby computations? Or are they using idle company resources somehow?

[noobpwnftw]

After receiving Ronald's NUMA-aware buff, all 4v3 pawnless tables are expected to be built in about 10-15 days.

There are more about 50% more pawnful ones than pawnless ones in number, and they are usually 4x slower to build. So it will still be months away from having the full set.

This is actually amazingly fast Just a few weeks ago, the general sentiment was “it will take a year or more to build all tables, it will probably be closer to 100 TB, nobody's doing it or interested in it”… and now we're talking something like 30–35 TB, full pawnless set two weeks out and the rest mere months away?

Something tells me I'll need to start thinking about disks…

What I like to know is how are people able to afford the enormous resources (~1.5 Tb RAM and dozens of cores) for such hobby computations? Or are they using idle company resources somehow?

Two cents: this is real science, once and for all, like prime search, people devote serious hardware for its worth.

[Sesse]

Evidently, the link between me and the FTP server is having issues somewhere:

`KRRBNvKR.rtbz' at 4293282352 (56%) 159.2K/s eta:6h7m [Receiving data]
--- 112.73.74.24 ping statistics ---
1324 packets transmitted, 1086 received, 17% packet loss, time 1330692ms
rtt min/avg/max/mdev = 357.033/528.587/714.175/98.094 ms

Looks like the hop between xe-5-1-2.200.rtsw2.ashb.net.internet2.edu and 218.30.54.56 (CHINANET-US-POP)

[noobpwnftw]

Evidently, the link between me and the FTP server is having issues somewhere:

`KRRBNvKR.rtbz' at 4293282352 (56%) 159.2K/s eta:6h7m [Receiving data]
--- 112.73.74.24 ping statistics ---
1324 packets transmitted, 1086 received, 17% packet loss, time 1330692ms
rtt min/avg/max/mdev = 357.033/528.587/714.175/98.094 ms

Looks like the hop between xe-5-1-2.200.rtsw2.ashb.net.internet2.edu and 218.30.54.56 (CHINANET-US-POP)

Kind folks also provided a mirror:
http://tablebase.lichess.ovh/tables/standard/7/

[Sesse]

tablebase.sesse.net will also mirror, as soon as I can get everything downloaded and verified somehow (are there checksums anywhere?).

Edit: The OVH mirror was much, much faster for me—a tad under 500 Mbit/sec.