7-men Syzygy attempt

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

noobpwnftw
Posts: 560
Joined: Sun Nov 08, 2015 11:10 pm

Re: 7-men Syzygy attempt

Post by noobpwnftw »

Ozymandias wrote: Mon Jul 02, 2018 6:39 am
noobpwnftw wrote: Sun Jul 01, 2018 7:34 pmAll 5v2 pawnful tables are now built.
How much do they take? The fttp link in the first post gives me 630 files at about one giga per file.

Code: Select all

151G    ./3-6men
3.2T    ./7men_testing/4v3_pawnful         (ongloing)
2.4T    ./7men_testing/4v3_pawnless
2.3T    ./7men_testing/5v2_pawnful
660G    ./7men_testing/5v2_pawnless
117G    ./7men_testing/6v1_pawnful
87G     ./7men_testing/6v1_pawnless
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: 7-men Syzygy attempt

Post by Ozymandias »

noobpwnftw wrote: Mon Jul 02, 2018 6:55 am
Ozymandias wrote: Mon Jul 02, 2018 6:39 am
noobpwnftw wrote: Sun Jul 01, 2018 7:34 pmAll 5v2 pawnful tables are now built.
How much do they take? The fttp link in the first post gives me 630 files at about one giga per file.

Code: Select all

151G    ./3-6men
3.2T    ./7men_testing/4v3_pawnful         (ongloing)
2.4T    ./7men_testing/4v3_pawnless
2.3T    ./7men_testing/5v2_pawnful
660G    ./7men_testing/5v2_pawnless
117G    ./7men_testing/6v1_pawnful
87G     ./7men_testing/6v1_pawnless
And the first post link is still valid? I'm getting 333 items for 4v3_pawnful (less than 450GB).
noobpwnftw
Posts: 560
Joined: Sun Nov 08, 2015 11:10 pm

Re: 7-men Syzygy attempt

Post by noobpwnftw »

Ozymandias wrote: Mon Jul 02, 2018 8:26 am And the first post link is still valid? I'm getting 333 items for 4v3_pawnful (less than 450GB).
The link is valid, item numbers looks correct but not the size.
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: 7-men Syzygy attempt

Post by Ozymandias »

ImageI know, I tried to download one of the smaller ones, to see if the actual size differs from the reported one, but there's no progress downloading. Also, upon trying to stop it, it froze and I had to perform a hard reboot. I'm logged in as guest.
noobpwnftw
Posts: 560
Joined: Sun Nov 08, 2015 11:10 pm

Re: 7-men Syzygy attempt

Post by noobpwnftw »

You can try the mirrors or use an FTP tool to download them.
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: 7-men Syzygy attempt

Post by Ozymandias »

The out-of-the-box Mac tool was obviously being creative (and lazy):Image
Sesse
Posts: 300
Joined: Mon Apr 30, 2018 11:51 pm

Re: 7-men Syzygy attempt

Post by Sesse »

syzygy wrote: Sat May 05, 2018 2:31 am
Sesse wrote:My estimation was just wild extrapolation. People talked about 10 TB for WDL, and for the current generated 7-man TBs, DTZ files are about 2.6x the size of WDL.
The pawn tables will probably take the ratio down.
The current ratio for the built 4v3 tables is 1.203, so indeed.

I guess we are still hovering around the 20 TB mark for the total estimate, at least based on some very quick extrapolation.
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: 7-men Syzygy attempt

Post by Ozymandias »

Sesse wrote: Tue Jul 03, 2018 1:32 pmI guess we are still hovering around the 20 TB mark for the total estimate, at least based on some very quick extrapolation.
What I'm really wondering, is how big the SSD I place in front of the mechanical HDD will have to be. For 6-men, I use a 256MB drive, which has plenty of room to spare for the cache, even after housing the WDL tables. For 7-men, I'm guessing you'd need something closer to 2TB, rather than 1TB.
Sesse
Posts: 300
Joined: Mon Apr 30, 2018 11:51 pm

Re: 7-men Syzygy attempt

Post by Sesse »

You don't need cache for the DTZ tables; they're only looked up at the root, ie., nearly never.
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: 7-men Syzygy attempt

Post by Ozymandias »

Sesse wrote: Tue Jul 03, 2018 3:19 pm You don't need cache for the DTZ tables; they're only looked up at the root, ie., nearly never.
With tables like KQBPvKQR.rtbw and KQNPvKQR.rtbw close to 100GB each, I fear the cache will fill up to unprecedented levels, as soon as we begin to add the ones with Rook(s) and Pawn(s).