Gaviota 0.74 released

[Dann Corbit]

5-men generation terminates with a "Lack of memory" error, cannot allocate memory, on my machine after about 11GB has been generated. Task manager shows it using 1.7GB of memory at that point. I'll try a different machine and see what happens

Do you have enough space in the hard drive?
My machine has 2 Gb of RAM and generates them well (in Linux).

Miguel

I guess that the problem is the 32 bit build. In 32 bit Windows, a process can address only 2 GB maximum no matter how much memory is available, and OS usage subtracts from that.

For instance, from here:
http://kb2.adobe.com/cps/320/320005.html

We find this:
"Photoshop CS2 is a 32-bit application. When it runs on a 32-bit operating system, such as Windows 2000, Windows XP Professional, and Mac OS v10.2.8, it can access the first 2 GB of RAM on the computer. The operating system uses some of this RAM, so the Photoshop Memory Usage preference displays only a maximum of 1.6 or 1.7 GB of total available RAM. If you are running Windows XP Professional with Service Pack 2, you can set the 3 GB switch in the boot.ini file, which allows Photoshop to use up to 3 GB of RAM."

The 64 bit build will fix that problem.

When the building stopped, which one was going to be generated? In other words, can you post a list (dir) of the files already generated. I can figure out which one was the one that caused problems. It may have been one with pawns.

Miguel

I don't think that there is any problem.

A 64 bit build is needed to use large memory to calculate the EGTB files.

I guess that the 64 bit executable I sent to you will build all of the EGTB files without any difficulty (I built the 4 man files in about one minute or so).

Important note to endgame tablebase builders:
Gaviota is expecting a folder called .\gtb to exist under the folder where Gaviota lives. This is where the tablebase files will be built. If the folder is missing, no endgame tablebase files will be generated. Instead, you will get millions of error messages.

You can change the name of the endgame tablebase location in file gaviota.ini.txt

[Dann Corbit]

Dann, that was my theory also. Gabor is currently generating them, I'm expecting him to have the same issue.

Here is a {preliminary} 64 bit Gaviota binary:
http://cap.connx.com/chess-engines/new- ... ta.exe.bz2

Now, it's just a bare binary, so you will need to download the whole package from Miguel's site first (I do not include any of the auxiliary files here). I guess that the binary will not function without the other things in the Gaviota package.

Also, that binary will only work on 64 bit windows machines with a 64 bit operating system. It will not function on 32 bit Windows versions.

Also, here is a copy of the pre-built 4 man files:
http://cap.connx.com/chess-engines/new-approach/gtb.7z

[gerold]

I like Gaviota's playing style. Thanks Miguel.

Best.

Gerold.

[beachknight]

Dann, that was my theory also. Gabor is currently generating them, I'm expecting him to have the same issue.

Here is a {preliminary} 64 bit Gaviota binary:
http://cap.connx.com/chess-engines/new- ... ta.exe.bz2

Now, it's just a bare binary, so you will need to download the whole package from Miguel's site first (I do not include any of the auxiliary files here). I guess that the binary will not function without the other things in the Gaviota package.

Also, that binary will only work on 64 bit windows machines with a 64 bit operating system. It will not function on 32 bit Windows versions.

Also, here is a copy of the pre-built 4 man files:
http://cap.connx.com/chess-engines/new-approach/gtb.7z

Still have problems with downloading of 7+ MB file.

Also with your gtb.7z, Dann. --> 404

Best,

[Dann Corbit]

Dann, that was my theory also. Gabor is currently generating them, I'm expecting him to have the same issue.

Here is a {preliminary} 64 bit Gaviota binary:
http://cap.connx.com/chess-engines/new- ... ta.exe.bz2

Now, it's just a bare binary, so you will need to download the whole package from Miguel's site first (I do not include any of the auxiliary files here). I guess that the binary will not function without the other things in the Gaviota package.

Also, that binary will only work on 64 bit windows machines with a 64 bit operating system. It will not function on 32 bit Windows versions.

Also, here is a copy of the pre-built 4 man files:
http://cap.connx.com/chess-engines/new-approach/gtb.7z

Still have problems with downloading of 7+ MB file.

Also with your gtb.7z, Dann. --> 404

Best,

Thanks, I did not have a mapping for file type of 7z.
It should work fine now (or, at least it does for me).
The tablebase archive file is 15 MB.

[Spock]

Dann, that was my theory also. Gabor is currently generating them, I'm expecting him to have the same issue.

Here is a {preliminary} 64 bit Gaviota binary:
http://cap.connx.com/chess-engines/new- ... ta.exe.bz2

Now, it's just a bare binary, so you will need to download the whole package from Miguel's site first (I do not include any of the auxiliary files here). I guess that the binary will not function without the other things in the Gaviota package.

Also, that binary will only work on 64 bit windows machines with a 64 bit operating system. It will not function on 32 bit Windows versions.

Also, here is a copy of the pre-built 4 man files:
http://cap.connx.com/chess-engines/new-approach/gtb.7z

Thanks - that works, except when it grew to using 5GB of memory and growing, I had to kill it

It proves however the theory that the 32-bit exe had hit the 2GB limit

[michiguel]

Dann, that was my theory also. Gabor is currently generating them, I'm expecting him to have the same issue.

Here is a {preliminary} 64 bit Gaviota binary:
http://cap.connx.com/chess-engines/new- ... ta.exe.bz2

Now, it's just a bare binary, so you will need to download the whole package from Miguel's site first (I do not include any of the auxiliary files here). I guess that the binary will not function without the other things in the Gaviota package.

Also, that binary will only work on 64 bit windows machines with a 64 bit operating system. It will not function on 32 bit Windows versions.

Also, here is a copy of the pre-built 4 man files:
http://cap.connx.com/chess-engines/new-approach/gtb.7z

Thanks - that works, except when it grew to using 5GB of memory and growing, I had to kill it

It proves however the theory that the 32-bit exe had hit the 2GB limit

Based on your previous information, I figured out what is going on.
The first time you must have generated 96 files, which totaled ~10.3 Gb.
At that point, gaviota starts generating kqrpk, which takes 1572864k of ram memory (~1.6 Gb). Those 1.6 may be too much if we consider that other files of the OS must be present. In addition, it may be worth it to set hashtables to a very low number during TB generation, because they will be occupying useless space. In the next release, I will have to silently disable hashtables internally while TBs are generated.

Did you set a big hashtable in the gaviota.ini.txt?

If you run the 64 bit version to continue generating files, I think I have an explanation why memory may start growing. It only shows when the generation *resumes*. I think I found a bug generated by a line that commented out. I guess that it you use the 64 bit version and you erase the files already generated it should work. That is too clumsy. I will fix this and the 64 bit version should work properly.

Thank you all for trying this, there is no other way for me to figure out and fix this problems. I develop on linux and it seems that the OS may be a bit smaller so the 1.6 GB squeeze in well into the 2 Gb RAM.

Miguel

[Spock]

OK, I will delete all the tb files and start clean with the x64 version, and also set hash values very small

[Spock]

Does tbgen 5 do both 4 and 5 men ? Or do you need to do tbgen 4 followed by tbgen 5 ?

[michiguel]

Does tbgen 5 do both 4 and 5 men ? Or do you need to do tbgen 4 followed by tbgen 5 ?

You can go ahead to tbgen 5 directly.

If the 4-pc are generated already, they will be recognized and skipped. Otherwise, they will be generated in order, so each TB that need dependents will have them when needed.

Miguel