Verify integrity of Syzygy TB with MD5

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Nordlandia
Posts: 2821
Joined: Fri Sep 25, 2015 9:38 pm
Location: Sortland, Norway

Re: Verify integrity of Syzygy TB with MD5

Post by Nordlandia »

1/3 of all 7-piece tables did not pass. About 1000 out of 3022 did not pass.

Are you sure this is correct phhnguyen ?
kasinp
Posts: 251
Joined: Sat Dec 02, 2006 10:47 pm
Location: Toronto
Full name: Peter Kasinski

Re: Verify integrity of Syzygy TB with MD5

Post by kasinp »

Nordlandia wrote: Wed Dec 30, 2020 11:06 am 1/3 of all 7-piece tables did not pass. About 1000 out of 3022 did not pass.

Are you sure this is correct phhnguyen ?
I have found BanksiaGui a delightful piece of software. Author did a great job providing so many features in such an elegant package!

However, there indeed appears to be an issue with the Syzygy checker simply failing for any file > 2GB in size. This is why so many 7-men files fail the verification. I have since confirmed that *all* such files in my collection (63 of them) passed a manual MD5 verification using other methods.

Hopefully a subsequent (to 0.38 beta) version can address this issue; meanwhile folks may want to hold off before re-downloading these huge files :) .

Cheers,
Peter
User avatar
Nordlandia
Posts: 2821
Joined: Fri Sep 25, 2015 9:38 pm
Location: Sortland, Norway

Re: Verify integrity of Syzygy TB with MD5

Post by Nordlandia »

kasinp wrote: Sun Feb 07, 2021 3:45 pm
Nordlandia wrote: Wed Dec 30, 2020 11:06 am 1/3 of all 7-piece tables did not pass. About 1000 out of 3022 did not pass.

Are you sure this is correct phhnguyen ?
I have found BanksiaGui a delightful piece of software. Author did a great job providing so many features in such an elegant package!

However, there indeed appears to be an issue with the Syzygy checker simply failing for any file > 2GB in size. This is why so many 7-men files fail the verification. I have since confirmed that *all* such files in my collection (63 of them) passed a manual MD5 verification using other methods.

Hopefully a subsequent (to 0.38 beta) version can address this issue; meanwhile folks may want to hold off before re-downloading these huge files :) .

Cheers,
Peter
Thanks for acknowledge this. Having to re-download 7-piece syzygy is something i want to avoid. It did take about 1.5 - 2 months as each table have to be initiated manually. There is no automatic continuous function at least to my knowledge.
User avatar
Ajedrecista
Posts: 1969
Joined: Wed Jul 13, 2011 9:04 pm
Location: Madrid, Spain.

Re: Verify integrity of Syzygy TB with MD5.

Post by Ajedrecista »

Hello:
Nordlandia wrote: Sun Feb 07, 2021 7:52 pmThanks for acknowledge this. Having to re-download 7-piece syzygy is something i want to avoid. It did take about 1.5 - 2 months as each table have to be initiated manually. There is no automatic continuous function at least to my knowledge.
I downloaded the full set of 3, 4 and 5-man Syzygy TB eight days ago from https://tablebase.lichess.ovh/tables/standard/3-4-5/ using an own script of PowerShell (.ps1 file extension) in Windows 10; wget instruction was used, so it was automated. Around 938 MB in 15 minutes more less, circa 1 MB/s. I only had to run the script and wait until the download of the 290 files was finished.

Code: Select all

wget "https://tablebase.lichess.ovh/tables/standard/3-4-5/KPvK.rtbw" -o "C:\Users\Usuario\Desktop\Syzygy_3-4-5/KPvK.rtbw"
wget "https://tablebase.lichess.ovh/tables/standard/3-4-5/KPvK.rtbz" -o "C:\Users\Usuario\Desktop\Syzygy_3-4-5/KPvK.rtbz"
[...]
wget "https://tablebase.lichess.ovh/tables/standard/3-4-5/KQQQvK.rtbw" -o "C:\Users\Usuario\Desktop\Syzygy_3-4-5/KQQQvK.rtbw"
wget "https://tablebase.lichess.ovh/tables/standard/3-4-5/KQQQvK.rtbz" -o "C:\Users\Usuario\Desktop\Syzygy_3-4-5/KQQQvK.rtbz"
The folder where the files are going to be downloaded must exist before running the script.

Going on topic with the original post, I checked MD5 sums manually yesterday using the idea of other post of this thread: Get-FileHash of PowerShell, then some edit with Notepad++ and comparisons with Excel. It was not NASA level stuff but it is not user friendly.

Regards from Spain.

Ajedrecista.
User avatar
yurikvelo
Posts: 710
Joined: Sat Dec 06, 2014 1:53 pm

Re: Verify integrity of Syzygy TB with MD5

Post by yurikvelo »

Easiest way to verify integrity (and easiest way to download+verify in 1-click) is torrent:
http://oics.olympuschess.com/tracker/index.php

If you have full or partial set of files - torrent software will first verify hashes, and if there are missing or corrupted files/blocks will re-download them (no additional attention or clicks).

If you don't have anything yet - it will just download. It is really 1-click solution.
And it is the fastest possible solution (download speed can occupy any your ISP plan)
Jouni
Posts: 3286
Joined: Wed Mar 08, 2006 8:15 pm

Re: Verify integrity of Syzygy TB with MD5

Post by Jouni »

The easiest way to download is 1GB zip file. I don't remember where I got It. 15 seconds to download.
Jouni