Gaviota, bug fix release

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Gaviota, bug fix release

Post by michiguel »

Gaviota 0.74.12 has been released together with a new utility for TB builders (tbcheck 1.1).

http://sites.google.com/site/gaviotache ... e/releases

0.74.12 FINALLY! solved the problems to build Gaviota tablebases in Windows, with lower memory than 1 Gb, in both 32 and 64 bit systems. Thanks a lot to Gabor, Ray, and Volker who generated them in different systems. (win32, win64, Linux). Thanks to them, the generation for any other user will be very straightforward.

As a consequence of all this testing, I wrote tbcheck, which is an utility that checks if any of the files you generated is corrupted. You want to have this if you decide to generate the TBs.

Dann C. found two problems that were also fixed. In analysis mode now Gaviota ignores the book as it should, and an apparent communication problem with Arena. He also compiled a Win64 version.

If you downloaded any 0.74.xx version and did not experience any of these problems, maybe you can ignore this message :-). The strength is exactly the same and you can keep using that version.

Regarding TBs, now that the generation is correct the roadmap is
1) build a compressor for the tables (I do not believe is needed for performance but releasing > 30 Gb of the HD of testers will be a good thing)
2) Optimize for speed (generation, compression/decompression, & probing)
3) Probably release the code at this point
4) go for DTZ50
5) go for 6 pieces?

Just for the record v0.74.11 (unreleased) was used in the ACCA tournament using the TBs, who were critical to draw crafty in a BP vs R position with few seconds left in the clock 8-)

Miguel
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Gaviota, bug fix release

Post by michiguel »

SzG wrote:Now that I have generated all gtb's successfully on a notebook I had to find a way to transfer them to my desktop. As they occupy almost 40 GB's the first task was to compress them. It took more than 6 1/2 hours for 7-zip to do it (2.33 GHz machine, 2 cores)! The final size was slightly more than 4 GB's so I will probably write the compressed file to a DVD.

Miguel, what cache size do you recommend for the gtb's? Is 32 MB's a reasonable value?
Yes, 32 MB should be reasonable. I am using here 64 MB just because I can and I saw no problems. 32 should not make a significant difference. Just make sure that tb_probing_depth is set to 2 (default). If for some reason you see a big slow down (I doubt it), use 3.

You are the first one to try to compress them all and it is nice to know that it will be ~4 Gb. Did you use any special set up with 7z or just the default?

Miguel
PS: Remember to use tbcheck after you decompress them back in your Desktop.
Volker Pittlik
Posts: 628
Joined: Wed Mar 08, 2006 9:10 pm
Location: Murten / Morat, Switzerland
Full name: Volker Pittlik

Re: Gaviota, bug fix release

Post by Volker Pittlik »

michiguel wrote:
SzG wrote:Now that I have generated all gtb's successfully on a notebook I had to find a way to transfer them to my desktop. As they occupy almost 40 GB's ...
...Remember to use tbcheck after you decompress them back in your Desktop.
Two remarks from my side:
I have 145 files in the gtb folder and they occupy "only" 25GB. Filesystem here is ext3. Could that be a difference to NTFS (what I suppose Gabor is using)?
I'm going to bz2 them if the results are of any interest.

vp
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Gaviota, bug fix release

Post by michiguel »

Volker Pittlik wrote:
michiguel wrote:
SzG wrote:Now that I have generated all gtb's successfully on a notebook I had to find a way to transfer them to my desktop. As they occupy almost 40 GB's ...
...Remember to use tbcheck after you decompress them back in your Desktop.
Two remarks from my side:
I have 145 files in the gtb folder and they occupy "only" 25GB. Filesystem here is ext3. Could that be a difference to NTFS (what I suppose Gabor is using)?
I'm going to bz2 them if the results are of any interest.

vp
I have ext3/ext4 here and it is close to ~38.5 Gb. Do you have any sort of compression scheme? If the files pass the tbcheck it means that they are actually ~38.5 Gb total decompressed.

Miguel
Volker Pittlik
Posts: 628
Joined: Wed Mar 08, 2006 9:10 pm
Location: Murten / Morat, Switzerland
Full name: Volker Pittlik

Re: Gaviota, bug fix release

Post by Volker Pittlik »

michiguel wrote:...
I have ext3/ext4 here and it is close to ~38.5 Gb....
You are correct. I just misread the output.

BTW: A bz2 archive of all egtb takes 7.1 GBs here. I'll possibly try 7z later.

vp
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Gaviota, bug fix release

Post by michiguel »

SzG wrote:
michiguel wrote: PS: Remember to use tbcheck after you decompress them back in your Desktop.
Transfer to desktop via DVD successful. Tbcheck found everything OK. :D
8-)

I think you can sell that DVD to Graham... ;-)

Miguel
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: Gaviota, bug fix release

Post by Dr.Wael Deeb »

michiguel wrote:
SzG wrote:
michiguel wrote: PS: Remember to use tbcheck after you decompress them back in your Desktop.
Transfer to desktop via DVD successful. Tbcheck found everything OK. :D
8-)

I think you can sell that DVD to Graham... ;-)

Miguel
Don't forget to include VAT in the price....the guy has money,he'll pay :wink:
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….