Need Help compressing Gaviota Tablebases

[mhalstern]

Question for Miguel A. Ballicora.

I have Gaviota working with the uncompressed tablebases being recognized. I tested the fen example in a GUI and Gaviota regognizes Mate in 127. The Problem is I can't get them compressed. I am using the 64 bit version in this file:

gaviota_32_64_pgo.zip

I have this as gaviota.ini.txt:

;=========================
; parameters for Gaviota
;=========================

;-------------------------------------------------------
; name that Winboard will use for saving games into pgn
;-------------------------------------------------------

name = "Gaviota 0.74.12"

;------------------------------------------------------------
; hashmem --> is hash tables (transposition, refutation).
; ref_table --> is a special table for refutation moves,
; not clear what the best value is, but
; I would try double the hashmem or the same.
;
; learn_table --> holds information from learn.epd
; do not set it bigger than 1 M
; pawn_table --> information about pawn structure.
; keep it small, 1-4 M
; M is Megabytes, k kilobytes , b bytes
;-------------------------------------------------------------

hashmem = 64 M
ref_table = 32 M
learn_table = 1 M
pawn_table = 1 M

;----------------------------------------------
; log info. max_logs is number of files kept.
; After that number is reached, it will start
; to overwrite them
;----------------------------------------------

log = on
max_logs = 20

;-----------------------------------------------------------------------
; ponder can have three values, 0, 1, or 2 (recommended).
; 2: Pondering will be determined by the interface (winboard, etc.)
; 1: Ponder is on, hardwired, no matter what the interface wants
; 0: Ponder is off, hardwired, won't turn on even if the interface wants
;-----------------------------------------------------------------------

ponder = 2

;-------------
; book info
;-------------

book = off
book_file = "book2650.bin"
book_learn = on

;------------------------------------------------
; learning of positions when is out of book.
; learn = on --> will save what just learned,
; use_learned = on --> will use any previous stored
; information in the "learn_file"
; learn_file = "/properpath/whatevername.epd"
;------------------------------------------------

learn = on
use_learned = on
learn_file = "learn.epd"

;-------------------------------------------------------------------
; won't show every output detail in the first n plies of the search
;-------------------------------------------------------------------

quiet_level = 6

;---------------------------------------------------------------------------
; logs when the node/sec is lower than "alert_nps"
; it is useful to detect when the program slowed down because of the OS
; hardware problems, paging, etc.
;---------------------------------------------------------------------------

alert_nps = 10000

;-----------------------------------------------------------------
; Runs all the commands included in the file after initialization
; and before accepting commands from the user.
; Delete the command if you do not want to have an initial script
; or comment it out placing a semicolon before.
;-----------------------------------------------------------------

;script_file = "input.txt"

;-----------------------------
; Resign in hopeless position?
;-----------------------------

resign_mode = on

;------------------------------------------------------
; Should I kibitz info on computer tournaments online?
;------------------------------------------------------

kibitz = off

;---------------------------------
;
; Gaviota Tablebase parameters
;
;---------------------------------

use_tablebase = on
tb_probing_depth = 2
tb_pieces_used = 5
tb_cache = on
tb_cache_size = 64 M
tb_cache_slot_size = 8 k

tb_path_1 = "gtb/"
tb_path_2 = ""
tb_path_3 = ""
tb_path_4 = ""

;-------------------------------------------------------------------
; SAN support (Standard Algebraic Notation) (e.g. Nf3)
; on ==> will try to send and accept SAN moves if GUI supports it
; off ==> will use default coordinate notation (e.g. g1f3)
;
; Some GUIs (Arena, ChessGUI etc.) are NOT fully SAN compliant
; and send wrong SAN moves. Use SAN = off with those GUIs
; I believe it is pretty safe to leave this off
;-------------------------------------------------------------------

SAN = off

;------------------------------------------------------------
; PARALLEL SEARCH
; cores --> CPU Usage
; Gaviota will launch up a number of threads
; equal to this value
; Supported up to 16 cores
;------------------------------------------------------------

cores = 4

;-------
; end!
;-------



I am using gaviota in Fritz with a standard wb2uci scheme:

wb2uci.eng:

[ENGINE]
Name=gaviota64.exe
Author=Miguel A. Ballicora
Filename=Wb2Uci.exe

[OPTIONS]
Program=gaviota64.exe
Ponder=false

I had Fritz12 create a uci engine, pointing to wb2uci.exe.

The uncompressed tablebases (all verified with tbcheck) reside in a gtb subdirectory of the gaviota engine's directory.

Using Gaviota (I also tried versions where tbcp was suppossed to be built in) in console mode, it reports that tbcp is not a valid command.

Here is all of the console output for 2 versions:

Gaviota v0.74.41
Copyright (c) 2000-2009 Miguel A. Ballicora
There is NO WARRANTY of any kind

feature done=0
INITIALIZATION from gaviota.ini.txt...
name: "Gaviota 0.74.12"
hashmem: 64 M
ref_table: 32 M
learn_table: 1 M
pawn_table: 1 M
log: on
max_logs: 20
ponder: 2
book: off
book_file: "book2650.bin"
book_learn: on
learn: on
use_learned: on
learn_file: "learn.epd"
quiet_level: 6
alert_nps: 10000
resign_mode: on
kibitz: off
use_tablebase: on
tb_probing_depth: 2
tb_pieces_used: 5
tb_cache: on
tb_cache_size: 64 M
tb_cache_slot_size: 8 k
tb_path_1: "gtb/"
tb_path_2: ""
tb_path_3: ""
tb_path_4: ""
SAN: off
cores: 4

SAVED OPTIONS: No options saved or missing file saved.ini
Error trying to open log

HASH TABLES
A = 2097152 entries, 32 Mbytes.
B = 2097152 entries, 32 Mbytes.
Learning = 65536 entries, 1 Mbytes.
Refutation = 8388608 entries, 32 Mbytes.
Pawn = 16384 entries, 768 kbytes.
Material = 65536 entries, 512 kbytes.
--> Total RAM allocated = 100608 kbytes.
--> Learning... learn.epd
cannot open
telluser Cannot load learning file or file not specified in gaviota.ini.txt

Initialize Internal bitbases --> done

Initializing GTB supporting tables
Max kk idx: 462
Max pp idx: 576
Max aa idx: 2016
Max aaa idx: 41664
Max pp48 idx: 1128
Max ppp48 idx: 8648
Decode Scheme: 4
Compression initialization problems.


xboard/winboard mode
Position initialized.
tbcp gtb
Error {unknown command}: tbcp
TBCP
Error {unknown command}: TBCP


Gaviota v0.74.41
Copyright (c) 2000-2009 Miguel A. Ballicora
There is NO WARRANTY of any kind

feature done=0
INITIALIZATION from gaviota.ini.txt...
name: "Gaviota 0.74.12"
hashmem: 64 M
ref_table: 32 M
learn_table: 1 M
pawn_table: 1 M
log: on
max_logs: 20
ponder: 2
book: off
book_file: "book2650.bin"
book_learn: on
learn: on
use_learned: on
learn_file: "learn.epd"
quiet_level: 6
alert_nps: 10000
resign_mode: on
kibitz: off
use_tablebase: on
tb_probing_depth: 2
tb_pieces_used: 5
tb_cache: on
tb_cache_size: 64 M
tb_cache_slot_size: 8 k
tb_path_1: "gtb/"
tb_path_2: ""
tb_path_3: ""
tb_path_4: ""
SAN: off
cores: 4

SAVED OPTIONS: No options saved or missing file saved.ini
Error trying to open log

HASH TABLES
A = 2097152 entries, 32 Mbytes.
B = 2097152 entries, 32 Mbytes.
Learning = 65536 entries, 1 Mbytes.
Refutation = 8388608 entries, 32 Mbytes.
Pawn = 16384 entries, 768 kbytes.
Material = 65536 entries, 512 kbytes.
--> Total RAM allocated = 100608 kbytes.
--> Learning... learn.epd
cannot open
telluser Cannot load learning file or file not specified in gaviota.ini.txt

Initialize Internal bitbases --> done

Initializing GTB supporting tables
Max kk idx: 462
Max pp idx: 576
Max aa idx: 2016
Max aaa idx: 41664
Max pp48 idx: 1128
Max ppp48 idx: 8648
Decode Scheme: 4
Compression initialization problems.


xboard/winboard mode
Position initialized.
tbcp
Error {unknown command}: tbcp


If a stand alone tbcp program is available, please post a link. If not, please tell me what I am doing wrong.

Thanks

[michiguel]

Hi Marc,

This is the problem (my fault to make it confusing, sorry): You downloaded the 64 bit version, which was compiled by Dann Corbit and was a special release with only the engine. That zip do not have the stand alone tbcp.

Download the 32 bit package and you will find tbcp.exe there.
http://sites.google.com/site/gaviotache ... e/download

On the side, it is described what each package contain. You need the one that says:

" Windows 32 bits, Gaviota 0.74.41 + tbcheck 1.1 + small book + 3-pc tablebases + tbcp v0.0.33b "

So, tbcp is in 32 bits only, but I think that would be ok. I also observed that you may want to grab the gaviota.ini.txt that is in the 32 bit package too. You will need to set tb_decoding_scheme = 4 (or whatever scheme you choose, 4 will give you the smallest size) in the ini file.

Sorry about the confusion. I do not have a 64 bit compiler, and in my excitement to post things quickly, I did not wait for Dann to make each package exactly the same.

Let me know how it goes.

Miguel

Question for Miguel A. Ballicora.

I have Gaviota working with the uncompressed tablebases being recognized. I tested the fen example in a GUI and Gaviota regognizes Mate in 127. The Problem is I can't get them compressed. I am using the 64 bit version in this file:

gaviota_32_64_pgo.zip

I have this as gaviota.ini.txt:

;=========================
; parameters for Gaviota
;=========================

;-------------------------------------------------------
; name that Winboard will use for saving games into pgn
;-------------------------------------------------------

name = "Gaviota 0.74.12"

;------------------------------------------------------------
; hashmem --> is hash tables (transposition, refutation).
; ref_table --> is a special table for refutation moves,
; not clear what the best value is, but
; I would try double the hashmem or the same.
;
; learn_table --> holds information from learn.epd
; do not set it bigger than 1 M
; pawn_table --> information about pawn structure.
; keep it small, 1-4 M
; M is Megabytes, k kilobytes , b bytes
;-------------------------------------------------------------

hashmem = 64 M
ref_table = 32 M
learn_table = 1 M
pawn_table = 1 M

;----------------------------------------------
; log info. max_logs is number of files kept.
; After that number is reached, it will start
; to overwrite them
;----------------------------------------------

log = on
max_logs = 20

;-----------------------------------------------------------------------
; ponder can have three values, 0, 1, or 2 (recommended).
; 2: Pondering will be determined by the interface (winboard, etc.)
; 1: Ponder is on, hardwired, no matter what the interface wants
; 0: Ponder is off, hardwired, won't turn on even if the interface wants
;-----------------------------------------------------------------------

ponder = 2

;-------------
; book info
;-------------

book = off
book_file = "book2650.bin"
book_learn = on

;------------------------------------------------
; learning of positions when is out of book.
; learn = on --> will save what just learned,
; use_learned = on --> will use any previous stored
; information in the "learn_file"
; learn_file = "/properpath/whatevername.epd"
;------------------------------------------------

learn = on
use_learned = on
learn_file = "learn.epd"

;-------------------------------------------------------------------
; won't show every output detail in the first n plies of the search
;-------------------------------------------------------------------

quiet_level = 6

;---------------------------------------------------------------------------
; logs when the node/sec is lower than "alert_nps"
; it is useful to detect when the program slowed down because of the OS
; hardware problems, paging, etc.
;---------------------------------------------------------------------------

alert_nps = 10000

;-----------------------------------------------------------------
; Runs all the commands included in the file after initialization
; and before accepting commands from the user.
; Delete the command if you do not want to have an initial script
; or comment it out placing a semicolon before.
;-----------------------------------------------------------------

;script_file = "input.txt"

;-----------------------------
; Resign in hopeless position?
;-----------------------------

resign_mode = on

;------------------------------------------------------
; Should I kibitz info on computer tournaments online?
;------------------------------------------------------

kibitz = off

;---------------------------------
;
; Gaviota Tablebase parameters
;
;---------------------------------

use_tablebase = on
tb_probing_depth = 2
tb_pieces_used = 5
tb_cache = on
tb_cache_size = 64 M
tb_cache_slot_size = 8 k

tb_path_1 = "gtb/"
tb_path_2 = ""
tb_path_3 = ""
tb_path_4 = ""

;-------------------------------------------------------------------
; SAN support (Standard Algebraic Notation) (e.g. Nf3)
; on ==> will try to send and accept SAN moves if GUI supports it
; off ==> will use default coordinate notation (e.g. g1f3)
;
; Some GUIs (Arena, ChessGUI etc.) are NOT fully SAN compliant
; and send wrong SAN moves. Use SAN = off with those GUIs
; I believe it is pretty safe to leave this off
;-------------------------------------------------------------------

SAN = off

;------------------------------------------------------------
; PARALLEL SEARCH
; cores --> CPU Usage
; Gaviota will launch up a number of threads
; equal to this value
; Supported up to 16 cores
;------------------------------------------------------------

cores = 4

;-------
; end!
;-------



I am using gaviota in Fritz with a standard wb2uci scheme:

wb2uci.eng:

[ENGINE]
Name=gaviota64.exe
Author=Miguel A. Ballicora
Filename=Wb2Uci.exe

[OPTIONS]
Program=gaviota64.exe
Ponder=false

I had Fritz12 create a uci engine, pointing to wb2uci.exe.

The uncompressed tablebases (all verified with tbcheck) reside in a gtb subdirectory of the gaviota engine's directory.

Using Gaviota (I also tried versions where tbcp was suppossed to be built in) in console mode, it reports that tbcp is not a valid command.

Here is all of the console output for 2 versions:

Gaviota v0.74.41
Copyright (c) 2000-2009 Miguel A. Ballicora
There is NO WARRANTY of any kind

feature done=0
INITIALIZATION from gaviota.ini.txt...
name: "Gaviota 0.74.12"
hashmem: 64 M
ref_table: 32 M
learn_table: 1 M
pawn_table: 1 M
log: on
max_logs: 20
ponder: 2
book: off
book_file: "book2650.bin"
book_learn: on
learn: on
use_learned: on
learn_file: "learn.epd"
quiet_level: 6
alert_nps: 10000
resign_mode: on
kibitz: off
use_tablebase: on
tb_probing_depth: 2
tb_pieces_used: 5
tb_cache: on
tb_cache_size: 64 M
tb_cache_slot_size: 8 k
tb_path_1: "gtb/"
tb_path_2: ""
tb_path_3: ""
tb_path_4: ""
SAN: off
cores: 4

SAVED OPTIONS: No options saved or missing file saved.ini
Error trying to open log

HASH TABLES
A = 2097152 entries, 32 Mbytes.
B = 2097152 entries, 32 Mbytes.
Learning = 65536 entries, 1 Mbytes.
Refutation = 8388608 entries, 32 Mbytes.
Pawn = 16384 entries, 768 kbytes.
Material = 65536 entries, 512 kbytes.
--> Total RAM allocated = 100608 kbytes.
--> Learning... learn.epd
cannot open
telluser Cannot load learning file or file not specified in gaviota.ini.txt

Initialize Internal bitbases --> done

Initializing GTB supporting tables
Max kk idx: 462
Max pp idx: 576
Max aa idx: 2016
Max aaa idx: 41664
Max pp48 idx: 1128
Max ppp48 idx: 8648
Decode Scheme: 4
Compression initialization problems.


xboard/winboard mode
Position initialized.
tbcp gtb
Error {unknown command}: tbcp
TBCP
Error {unknown command}: TBCP


Gaviota v0.74.41
Copyright (c) 2000-2009 Miguel A. Ballicora
There is NO WARRANTY of any kind

feature done=0
INITIALIZATION from gaviota.ini.txt...
name: "Gaviota 0.74.12"
hashmem: 64 M
ref_table: 32 M
learn_table: 1 M
pawn_table: 1 M
log: on
max_logs: 20
ponder: 2
book: off
book_file: "book2650.bin"
book_learn: on
learn: on
use_learned: on
learn_file: "learn.epd"
quiet_level: 6
alert_nps: 10000
resign_mode: on
kibitz: off
use_tablebase: on
tb_probing_depth: 2
tb_pieces_used: 5
tb_cache: on
tb_cache_size: 64 M
tb_cache_slot_size: 8 k
tb_path_1: "gtb/"
tb_path_2: ""
tb_path_3: ""
tb_path_4: ""
SAN: off
cores: 4

SAVED OPTIONS: No options saved or missing file saved.ini
Error trying to open log

HASH TABLES
A = 2097152 entries, 32 Mbytes.
B = 2097152 entries, 32 Mbytes.
Learning = 65536 entries, 1 Mbytes.
Refutation = 8388608 entries, 32 Mbytes.
Pawn = 16384 entries, 768 kbytes.
Material = 65536 entries, 512 kbytes.
--> Total RAM allocated = 100608 kbytes.
--> Learning... learn.epd
cannot open
telluser Cannot load learning file or file not specified in gaviota.ini.txt

Initialize Internal bitbases --> done

Initializing GTB supporting tables
Max kk idx: 462
Max pp idx: 576
Max aa idx: 2016
Max aaa idx: 41664
Max pp48 idx: 1128
Max ppp48 idx: 8648
Decode Scheme: 4
Compression initialization problems.


xboard/winboard mode
Position initialized.
tbcp
Error {unknown command}: tbcp


If a stand alone tbcp program is available, please post a link. If not, please tell me what I am doing wrong.

Thanks

[michiguel]

Please also read this thread.
http://kirill-kryukov.com/chess/discuss ... f=6&t=4840

I realized I need to update the website with the instructions of how to compressed the files. Quickly, it is

tbcp -s4 <folder>

-s4 (scheme 4) is the default.

Miguel

Hi Marc,

This is the problem (my fault to make it confusing, sorry): You downloaded the 64 bit version, which was compiled by Dann Corbit and was a special release with only the engine. That zip do not have the stand alone tbcp.

Download the 32 bit package and you will find tbcp.exe there.
http://sites.google.com/site/gaviotache ... e/download

On the side, it is described what each package contain. You need the one that says:

" Windows 32 bits, Gaviota 0.74.41 + tbcheck 1.1 + small book + 3-pc tablebases + tbcp v0.0.33b "

So, tbcp is in 32 bits only, but I think that would be ok. I also observed that you may want to grab the gaviota.ini.txt that is in the 32 bit package too. You will need to set tb_decoding_scheme = 4 (or whatever scheme you choose, 4 will give you the smallest size) in the ini file.

Sorry about the confusion. I do not have a 64 bit compiler, and in my excitement to post things quickly, I did not wait for Dann to make each package exactly the same.

Let me know how it goes.

Miguel

Question for Miguel A. Ballicora.

I have Gaviota working with the uncompressed tablebases being recognized. I tested the fen example in a GUI and Gaviota regognizes Mate in 127. The Problem is I can't get them compressed. I am using the 64 bit version in this file:

gaviota_32_64_pgo.zip

I have this as gaviota.ini.txt:

;=========================
; parameters for Gaviota
;=========================

;-------------------------------------------------------
; name that Winboard will use for saving games into pgn
;-------------------------------------------------------

name = "Gaviota 0.74.12"

;------------------------------------------------------------
; hashmem --> is hash tables (transposition, refutation).
; ref_table --> is a special table for refutation moves,
; not clear what the best value is, but
; I would try double the hashmem or the same.
;
; learn_table --> holds information from learn.epd
; do not set it bigger than 1 M
; pawn_table --> information about pawn structure.
; keep it small, 1-4 M
; M is Megabytes, k kilobytes , b bytes
;-------------------------------------------------------------

hashmem = 64 M
ref_table = 32 M
learn_table = 1 M
pawn_table = 1 M

;----------------------------------------------
; log info. max_logs is number of files kept.
; After that number is reached, it will start
; to overwrite them
;----------------------------------------------

log = on
max_logs = 20

;-----------------------------------------------------------------------
; ponder can have three values, 0, 1, or 2 (recommended).
; 2: Pondering will be determined by the interface (winboard, etc.)
; 1: Ponder is on, hardwired, no matter what the interface wants
; 0: Ponder is off, hardwired, won't turn on even if the interface wants
;-----------------------------------------------------------------------

ponder = 2

;-------------
; book info
;-------------

book = off
book_file = "book2650.bin"
book_learn = on

;------------------------------------------------
; learning of positions when is out of book.
; learn = on --> will save what just learned,
; use_learned = on --> will use any previous stored
; information in the "learn_file"
; learn_file = "/properpath/whatevername.epd"
;------------------------------------------------

learn = on
use_learned = on
learn_file = "learn.epd"

;-------------------------------------------------------------------
; won't show every output detail in the first n plies of the search
;-------------------------------------------------------------------

quiet_level = 6

;---------------------------------------------------------------------------
; logs when the node/sec is lower than "alert_nps"
; it is useful to detect when the program slowed down because of the OS
; hardware problems, paging, etc.
;---------------------------------------------------------------------------

alert_nps = 10000

;-----------------------------------------------------------------
; Runs all the commands included in the file after initialization
; and before accepting commands from the user.
; Delete the command if you do not want to have an initial script
; or comment it out placing a semicolon before.
;-----------------------------------------------------------------

;script_file = "input.txt"

;-----------------------------
; Resign in hopeless position?
;-----------------------------

resign_mode = on

;------------------------------------------------------
; Should I kibitz info on computer tournaments online?
;------------------------------------------------------

kibitz = off

;---------------------------------
;
; Gaviota Tablebase parameters
;
;---------------------------------

use_tablebase = on
tb_probing_depth = 2
tb_pieces_used = 5
tb_cache = on
tb_cache_size = 64 M
tb_cache_slot_size = 8 k

tb_path_1 = "gtb/"
tb_path_2 = ""
tb_path_3 = ""
tb_path_4 = ""

;-------------------------------------------------------------------
; SAN support (Standard Algebraic Notation) (e.g. Nf3)
; on ==> will try to send and accept SAN moves if GUI supports it
; off ==> will use default coordinate notation (e.g. g1f3)
;
; Some GUIs (Arena, ChessGUI etc.) are NOT fully SAN compliant
; and send wrong SAN moves. Use SAN = off with those GUIs
; I believe it is pretty safe to leave this off
;-------------------------------------------------------------------

SAN = off

;------------------------------------------------------------
; PARALLEL SEARCH
; cores --> CPU Usage
; Gaviota will launch up a number of threads
; equal to this value
; Supported up to 16 cores
;------------------------------------------------------------

cores = 4

;-------
; end!
;-------



I am using gaviota in Fritz with a standard wb2uci scheme:

wb2uci.eng:

[ENGINE]
Name=gaviota64.exe
Author=Miguel A. Ballicora
Filename=Wb2Uci.exe

[OPTIONS]
Program=gaviota64.exe
Ponder=false

I had Fritz12 create a uci engine, pointing to wb2uci.exe.

The uncompressed tablebases (all verified with tbcheck) reside in a gtb subdirectory of the gaviota engine's directory.

Using Gaviota (I also tried versions where tbcp was suppossed to be built in) in console mode, it reports that tbcp is not a valid command.

Here is all of the console output for 2 versions:

Gaviota v0.74.41
Copyright (c) 2000-2009 Miguel A. Ballicora
There is NO WARRANTY of any kind

feature done=0
INITIALIZATION from gaviota.ini.txt...
name: "Gaviota 0.74.12"
hashmem: 64 M
ref_table: 32 M
learn_table: 1 M
pawn_table: 1 M
log: on
max_logs: 20
ponder: 2
book: off
book_file: "book2650.bin"
book_learn: on
learn: on
use_learned: on
learn_file: "learn.epd"
quiet_level: 6
alert_nps: 10000
resign_mode: on
kibitz: off
use_tablebase: on
tb_probing_depth: 2
tb_pieces_used: 5
tb_cache: on
tb_cache_size: 64 M
tb_cache_slot_size: 8 k
tb_path_1: "gtb/"
tb_path_2: ""
tb_path_3: ""
tb_path_4: ""
SAN: off
cores: 4

SAVED OPTIONS: No options saved or missing file saved.ini
Error trying to open log

HASH TABLES
A = 2097152 entries, 32 Mbytes.
B = 2097152 entries, 32 Mbytes.
Learning = 65536 entries, 1 Mbytes.
Refutation = 8388608 entries, 32 Mbytes.
Pawn = 16384 entries, 768 kbytes.
Material = 65536 entries, 512 kbytes.
--> Total RAM allocated = 100608 kbytes.
--> Learning... learn.epd
cannot open
telluser Cannot load learning file or file not specified in gaviota.ini.txt

Initialize Internal bitbases --> done

Initializing GTB supporting tables
Max kk idx: 462
Max pp idx: 576
Max aa idx: 2016
Max aaa idx: 41664
Max pp48 idx: 1128
Max ppp48 idx: 8648
Decode Scheme: 4
Compression initialization problems.


xboard/winboard mode
Position initialized.
tbcp gtb
Error {unknown command}: tbcp
TBCP
Error {unknown command}: TBCP


Gaviota v0.74.41
Copyright (c) 2000-2009 Miguel A. Ballicora
There is NO WARRANTY of any kind

feature done=0
INITIALIZATION from gaviota.ini.txt...
name: "Gaviota 0.74.12"
hashmem: 64 M
ref_table: 32 M
learn_table: 1 M
pawn_table: 1 M
log: on
max_logs: 20
ponder: 2
book: off
book_file: "book2650.bin"
book_learn: on
learn: on
use_learned: on
learn_file: "learn.epd"
quiet_level: 6
alert_nps: 10000
resign_mode: on
kibitz: off
use_tablebase: on
tb_probing_depth: 2
tb_pieces_used: 5
tb_cache: on
tb_cache_size: 64 M
tb_cache_slot_size: 8 k
tb_path_1: "gtb/"
tb_path_2: ""
tb_path_3: ""
tb_path_4: ""
SAN: off
cores: 4

SAVED OPTIONS: No options saved or missing file saved.ini
Error trying to open log

HASH TABLES
A = 2097152 entries, 32 Mbytes.
B = 2097152 entries, 32 Mbytes.
Learning = 65536 entries, 1 Mbytes.
Refutation = 8388608 entries, 32 Mbytes.
Pawn = 16384 entries, 768 kbytes.
Material = 65536 entries, 512 kbytes.
--> Total RAM allocated = 100608 kbytes.
--> Learning... learn.epd
cannot open
telluser Cannot load learning file or file not specified in gaviota.ini.txt

Initialize Internal bitbases --> done

Initializing GTB supporting tables
Max kk idx: 462
Max pp idx: 576
Max aa idx: 2016
Max aaa idx: 41664
Max pp48 idx: 1128
Max ppp48 idx: 8648
Decode Scheme: 4
Compression initialization problems.


xboard/winboard mode
Position initialized.
tbcp
Error {unknown command}: tbcp


If a stand alone tbcp program is available, please post a link. If not, please tell me what I am doing wrong.

Thanks

[mhalstern]

Got it - I ran it without the -s4 option, but it is working. It is creating files with a *.cp4 extensions.

I'll test the fen again, after they are uncompressed.

Thanks

[michiguel]

Got it - I ran it without the -s4 option, but it is working. It is creating files with a *.cp4 extensions.

That is good. Please be patient, it will take several hours.

I'll test the fen again, after they are uncompressed.

Before you do it, do not forget to adjust the gaviota.ini.txt file, with tb_compression = on and
tb_decoding_scheme = 4

Miguel

Thanks

[mhalstern]

All Finished.

On my (not overclocked) I7-920, the process took 7 hours and 41 minutes.

I'll verify the integrity later.

I deleted the uncompressed files, but left these files in the directory:

12/22/2009 10:26 PM 7,500 g345.sh1
12/22/2009 10:26 PM 6,340 g345.md5

Can I delete these 2?

I have pasted the directory contents, sorted by time, in the event that the time to compress has value to you:

Directory of C:\engines\gaviota\gtb

12/22/2009 10:26 PM 7,500 g345.sh1
12/22/2009 10:26 PM 6,340 g345.md5
01/21/2010 08:08 PM 9,443 kqk.gtb.cp4
01/21/2010 08:08 PM 10,824 krk.gtb.cp4
01/21/2010 08:08 PM 2,021 kbk.gtb.cp4
01/21/2010 08:08 PM 1,754 knk.gtb.cp4
01/21/2010 08:08 PM 27,435 kpk.gtb.cp4
01/21/2010 08:08 PM 617,561 kqkq.gtb.cp4
01/21/2010 08:08 PM 1,231,824 kqkr.gtb.cp4
01/21/2010 08:09 PM 935,406 kqkb.gtb.cp4
01/21/2010 08:09 PM 1,009,374 kqkn.gtb.cp4
01/21/2010 08:09 PM 419,236 krkr.gtb.cp4
01/21/2010 08:09 PM 344,119 krkb.gtb.cp4
01/21/2010 08:09 PM 560,328 krkn.gtb.cp4
01/21/2010 08:09 PM 149,440 kbkb.gtb.cp4
01/21/2010 08:09 PM 141,471 kbkn.gtb.cp4
01/21/2010 08:09 PM 143,603 knkn.gtb.cp4
01/21/2010 08:09 PM 206,837 kqqk.gtb.cp4
01/21/2010 08:09 PM 430,581 kqrk.gtb.cp4
01/21/2010 08:09 PM 489,692 kqbk.gtb.cp4
01/21/2010 08:09 PM 465,758 kqnk.gtb.cp4
01/21/2010 08:09 PM 227,504 krrk.gtb.cp4
01/21/2010 08:09 PM 581,672 krbk.gtb.cp4
01/21/2010 08:09 PM 603,726 krnk.gtb.cp4
01/21/2010 08:09 PM 303,495 kbbk.gtb.cp4
01/21/2010 08:09 PM 857,067 kbnk.gtb.cp4
01/21/2010 08:09 PM 56,090 knnk.gtb.cp4
01/21/2010 08:09 PM 2,534,453 kqkp.gtb.cp4
01/21/2010 08:10 PM 2,444,308 krkp.gtb.cp4
01/21/2010 08:10 PM 1,094,613 kbkp.gtb.cp4
01/21/2010 08:10 PM 1,501,930 knkp.gtb.cp4
01/21/2010 08:10 PM 1,849,665 kqpk.gtb.cp4
01/21/2010 08:10 PM 1,824,618 krpk.gtb.cp4
01/21/2010 08:10 PM 2,087,822 kbpk.gtb.cp4
01/21/2010 08:10 PM 1,954,563 knpk.gtb.cp4
01/21/2010 08:11 PM 666,277 kppk.gtb.cp4
01/21/2010 08:11 PM 1,606,640 kpkp.gtb.cp4
01/21/2010 08:11 PM 3,802,075 kqqqk.gtb.cp4
01/21/2010 08:12 PM 8,504,604 kqqrk.gtb.cp4
01/21/2010 08:14 PM 10,784,891 kqqbk.gtb.cp4
01/21/2010 08:15 PM 10,257,858 kqqnk.gtb.cp4
01/21/2010 08:17 PM 9,012,150 kqrrk.gtb.cp4
01/21/2010 08:19 PM 24,068,821 kqrbk.gtb.cp4
01/21/2010 08:22 PM 22,904,515 kqrnk.gtb.cp4
01/21/2010 08:23 PM 15,547,853 kqbbk.gtb.cp4
01/21/2010 08:26 PM 31,000,034 kqbnk.gtb.cp4
01/21/2010 08:28 PM 15,367,111 kqnnk.gtb.cp4
01/21/2010 08:28 PM 4,168,630 krrrk.gtb.cp4
01/21/2010 08:30 PM 11,310,892 krrbk.gtb.cp4
01/21/2010 08:31 PM 10,687,982 krrnk.gtb.cp4
01/21/2010 08:33 PM 16,734,219 krbbk.gtb.cp4
01/21/2010 08:36 PM 37,023,988 krbnk.gtb.cp4
01/21/2010 08:37 PM 17,419,874 krnnk.gtb.cp4
01/21/2010 08:38 PM 7,353,620 kbbbk.gtb.cp4
01/21/2010 08:39 PM 25,638,536 kbbnk.gtb.cp4
01/21/2010 08:40 PM 28,119,244 kbnnk.gtb.cp4
01/21/2010 08:41 PM 10,113,419 knnnk.gtb.cp4
01/21/2010 08:42 PM 21,615,243 kqqkq.gtb.cp4
01/21/2010 08:44 PM 19,190,996 kqqkr.gtb.cp4
01/21/2010 08:45 PM 18,058,764 kqqkb.gtb.cp4
01/21/2010 08:46 PM 17,119,451 kqqkn.gtb.cp4
01/21/2010 08:49 PM 57,415,121 kqrkq.gtb.cp4
01/21/2010 08:52 PM 39,870,381 kqrkr.gtb.cp4
01/21/2010 08:54 PM 41,933,911 kqrkb.gtb.cp4
01/21/2010 08:57 PM 39,469,141 kqrkn.gtb.cp4
01/21/2010 09:00 PM 30,197,814 kqbkq.gtb.cp4
01/21/2010 09:02 PM 49,955,378 kqbkr.gtb.cp4
01/21/2010 09:05 PM 41,440,737 kqbkb.gtb.cp4
01/21/2010 09:08 PM 45,084,625 kqbkn.gtb.cp4
01/21/2010 09:10 PM 31,359,950 kqnkq.gtb.cp4
01/21/2010 09:13 PM 53,676,261 kqnkr.gtb.cp4
01/21/2010 09:16 PM 45,937,197 kqnkb.gtb.cp4
01/21/2010 09:19 PM 46,781,895 kqnkn.gtb.cp4
01/21/2010 09:20 PM 24,012,034 krrkq.gtb.cp4
01/21/2010 09:21 PM 20,431,127 krrkr.gtb.cp4
01/21/2010 09:22 PM 26,654,894 krrkb.gtb.cp4
01/21/2010 09:24 PM 25,376,514 krrkn.gtb.cp4
01/21/2010 09:27 PM 59,286,729 krbkq.gtb.cp4
01/21/2010 09:30 PM 23,951,329 krbkr.gtb.cp4
01/21/2010 09:32 PM 62,363,666 krbkb.gtb.cp4
01/21/2010 09:35 PM 67,205,400 krbkn.gtb.cp4
01/21/2010 09:37 PM 69,215,729 krnkq.gtb.cp4
01/21/2010 09:40 PM 24,603,121 krnkr.gtb.cp4
01/21/2010 09:43 PM 69,397,529 krnkb.gtb.cp4
01/21/2010 09:45 PM 70,609,643 krnkn.gtb.cp4
01/21/2010 09:46 PM 37,187,304 kbbkq.gtb.cp4
01/21/2010 09:48 PM 9,424,018 kbbkr.gtb.cp4
01/21/2010 09:49 PM 8,762,771 kbbkb.gtb.cp4
01/21/2010 09:50 PM 30,017,962 kbbkn.gtb.cp4
01/21/2010 09:53 PM 92,201,005 kbnkq.gtb.cp4
01/21/2010 09:56 PM 26,476,632 kbnkr.gtb.cp4
01/21/2010 09:59 PM 23,728,728 kbnkb.gtb.cp4
01/21/2010 10:02 PM 31,685,961 kbnkn.gtb.cp4
01/21/2010 10:03 PM 38,974,514 knnkq.gtb.cp4
01/21/2010 10:04 PM 5,933,334 knnkr.gtb.cp4
01/21/2010 10:06 PM 3,689,841 knnkb.gtb.cp4
01/21/2010 10:07 PM 3,548,234 knnkn.gtb.cp4
01/21/2010 10:11 PM 49,725,325 kqqpk.gtb.cp4
01/21/2010 10:21 PM 85,451,203 kqrpk.gtb.cp4
01/21/2010 10:31 PM 102,115,880 kqbpk.gtb.cp4
01/21/2010 10:40 PM 94,922,527 kqnpk.gtb.cp4
01/21/2010 10:45 PM 46,362,375 krrpk.gtb.cp4
01/21/2010 10:54 PM 102,999,066 krbpk.gtb.cp4
01/21/2010 11:04 PM 100,073,540 krnpk.gtb.cp4
01/21/2010 11:08 PM 69,625,164 kbbpk.gtb.cp4
01/21/2010 11:18 PM 127,340,856 kbnpk.gtb.cp4
01/21/2010 11:23 PM 68,664,104 knnpk.gtb.cp4
01/21/2010 11:26 PM 40,113,772 kqppk.gtb.cp4
01/21/2010 11:30 PM 39,323,341 krppk.gtb.cp4
01/21/2010 11:34 PM 44,376,299 kbppk.gtb.cp4
01/21/2010 11:37 PM 40,522,473 knppk.gtb.cp4
01/21/2010 11:46 PM 156,161,690 kqpkq.gtb.cp4
01/21/2010 11:54 PM 188,221,647 kqpkr.gtb.cp4
01/22/2010 12:02 AM 162,109,732 kqpkb.gtb.cp4
01/22/2010 12:11 AM 165,133,783 kqpkn.gtb.cp4
01/22/2010 12:19 AM 234,414,083 krpkq.gtb.cp4
01/22/2010 12:27 AM 123,533,348 krpkr.gtb.cp4
01/22/2010 12:35 AM 194,644,644 krpkb.gtb.cp4
01/22/2010 12:43 AM 201,959,191 krpkn.gtb.cp4
01/22/2010 12:52 AM 181,597,754 kbpkq.gtb.cp4
01/22/2010 01:02 AM 96,607,830 kbpkr.gtb.cp4
01/22/2010 01:11 AM 83,522,523 kbpkb.gtb.cp4
01/22/2010 01:20 AM 129,280,017 kbpkn.gtb.cp4
01/22/2010 01:28 AM 205,393,117 knpkq.gtb.cp4
01/22/2010 01:38 AM 105,961,532 knpkr.gtb.cp4
01/22/2010 01:47 AM 87,294,217 knpkb.gtb.cp4
01/22/2010 01:56 AM 113,505,131 knpkn.gtb.cp4
01/22/2010 01:59 AM 57,273,994 kppkq.gtb.cp4
01/22/2010 02:02 AM 58,166,294 kppkr.gtb.cp4
01/22/2010 02:05 AM 38,324,186 kppkb.gtb.cp4
01/22/2010 02:08 AM 50,060,736 kppkn.gtb.cp4
01/22/2010 02:13 AM 55,203,373 kqqkp.gtb.cp4
01/22/2010 02:22 AM 103,285,447 kqrkp.gtb.cp4
01/22/2010 02:31 AM 118,234,402 kqbkp.gtb.cp4
01/22/2010 02:40 AM 118,263,804 kqnkp.gtb.cp4
01/22/2010 02:44 AM 59,530,982 krrkp.gtb.cp4
01/22/2010 02:53 AM 125,763,189 krbkp.gtb.cp4
01/22/2010 03:02 AM 131,156,350 krnkp.gtb.cp4
01/22/2010 03:06 AM 68,494,861 kbbkp.gtb.cp4
01/22/2010 03:15 AM 197,362,436 kbnkp.gtb.cp4
01/22/2010 03:18 AM 68,495,315 knnkp.gtb.cp4
01/22/2010 03:26 AM 108,959,741 kqpkp.gtb.cp4
01/22/2010 03:32 AM 109,248,629 krpkp.gtb.cp4
01/22/2010 03:39 AM 126,408,157 kbpkp.gtb.cp4
01/22/2010 03:45 AM 135,244,980 knpkp.gtb.cp4
01/22/2010 03:48 AM 45,457,739 kppkp.gtb.cp4
01/22/2010 03:49 AM 8,844,886 kpppk.gtb.cp4
01/22/2010 03:50 AM <DIR> .
01/22/2010 03:50 AM <DIR> ..
147 File(s) 7,025,805,855 bytes

[mhalstern]

Miguel,

This looks good as the fen position is still recognized correctly with the compressed databases. To make sure, is there a way to use tbgen to verify all of the compressed databases?

Thanks

[michiguel]

Miguel,

This looks good as the fen position is still recognized correctly with the compressed databases. To make sure, is there a way to use tbgen to verify all of the compressed databases?

Thanks

I am going to modify tbcheck real soon to verify the integrity of the compressed TBs. Meanwhile, if you run "tbtest 5" from the Gaviota console and the test passes, it strongly indicates that everything is right. It checks the longest mates for each side from every single file.

Miguel

[mhalstern]

I'll run the tbtest utulity later. In the meantime, it looks good. I tested a number of different 5 man fen positions. The output was always correct.

I am running a Gauntlet now. I'll post the results and games in the "Computer Chess Club: Tournaments and Matches" forum when it is completed, probably sometime before Tuesday.

Thanks for all of the help.

If you want me to test any positions or anything else, let me know.

Later