Scid error on CCRL pgn file imports

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
FlavusSnow
Posts: 89
Joined: Thu Apr 01, 2010 3:28 am
Location: Omaha, NE

Scid error on CCRL pgn file imports

Post by FlavusSnow » Wed Jan 25, 2012 3:17 pm

I've been getting an error saving to database when I try to import a CCRL sourced pgn. The error occurs at about 260,000 games and states exactly: "Error saving game in database." Also, after the error the index is corrupt. I've had no problems importing similarly sized pgn files from CEGT and have ensured that the problem files from CCRL are not corrupt and function well in other readers. I'm baffled. Any ideas? Has anyone else had this issue?

Adam Hair
Posts: 3201
Joined: Wed May 06, 2009 8:31 pm
Location: Fuquay-Varina, North Carolina

Re: Scid error on CCRL pgn file imports

Post by Adam Hair » Wed Jan 25, 2012 4:25 pm

FlavusSnow wrote:I've been getting an error saving to database when I try to import a CCRL sourced pgn. The error occurs at about 260,000 games and states exactly: "Error saving game in database." Also, after the error the index is corrupt. I've had no problems importing similarly sized pgn files from CEGT and have ensured that the problem files from CCRL are not corrupt and function well in other readers. I'm baffled. Any ideas? Has anyone else had this issue?
Actually, the problem occurs at the 262,144th game, which is 2^18 (as Kirill pointed out to me once).

FlavusSnow
Posts: 89
Joined: Thu Apr 01, 2010 3:28 am
Location: Omaha, NE

Re: Scid error on CCRL pgn file imports

Post by FlavusSnow » Wed Jan 25, 2012 4:58 pm

Why would I not then also get that error when importing a 900,000+ game pgn file sourced from CEGT? It seems to me that if it were an issue with the size of a variable at 2^18 then it would be repeatable regardless of pgn source so long as it surpassed the limit. Its odd that it only happens with CCRL files.

Adam Hair
Posts: 3201
Joined: Wed May 06, 2009 8:31 pm
Location: Fuquay-Varina, North Carolina

Re: Scid error on CCRL pgn file imports

Post by Adam Hair » Wed Jan 25, 2012 6:46 pm

FlavusSnow wrote:Why would I not then also get that error when importing a 900,000+ game pgn file sourced from CEGT? It seems to me that if it were an issue with the size of a variable at 2^18 then it would be repeatable regardless of pgn source so long as it surpassed the limit. Its odd that it only happens with CCRL files.
I have also never had a problem with CEGT pgns. Only CCRL pgns. And I can not determine why.

stevenaaus
Posts: 602
Joined: Wed Oct 13, 2010 7:44 am
Location: Australia
Contact:

Re: Scid error on CCRL pgn file imports

Post by stevenaaus » Wed Jan 25, 2012 7:49 pm

Does the problem occur with Scid vs. PC-4.6 ? I've made a few fixes to the parser. How does it go ?

stevenaaus
Posts: 602
Joined: Wed Oct 13, 2010 7:44 am
Location: Australia
Contact:

Re: Scid error on CCRL pgn file imports

Post by stevenaaus » Wed Jan 25, 2012 9:12 pm

Actually you'll have to use the latest snapshot
http://sourceforge.net/projects/scidvsp ... p/download
Overwrite scid.gui and scid.exe in scidvspc-4.6 with the files from this snapshot.
Or under linux, check out subversion with
svn co https://scidvspc.svn.sourceforge.net/svnroot/scidvspc

Adam Hair
Posts: 3201
Joined: Wed May 06, 2009 8:31 pm
Location: Fuquay-Varina, North Carolina

Re: Scid error on CCRL pgn file imports

Post by Adam Hair » Wed Jan 25, 2012 9:14 pm

stevenaaus wrote:Does the problem occur with Scid vs. PC-4.6 ? I've made a few fixes to the parser. How does it go ?
I tried Scid vs PC 4.6 earlier today and it still occurred. I have tried several modifications to the pgn but the error still occurs at the 262,144th game.

:?

EDIT: I have not tried the latest snapshot. Will do so now.

Adam Hair
Posts: 3201
Joined: Wed May 06, 2009 8:31 pm
Location: Fuquay-Varina, North Carolina

Re: Scid error on CCRL pgn file imports

Post by Adam Hair » Wed Jan 25, 2012 9:31 pm

The error still occurs.

stevenaaus
Posts: 602
Joined: Wed Oct 13, 2010 7:44 am
Location: Australia
Contact:

Re: Scid error on CCRL pgn file imports

Post by stevenaaus » Wed Jan 25, 2012 9:35 pm

If you can find the offending game PGN, please post it or email me.
Cheers

stevenaaus
Posts: 602
Joined: Wed Oct 13, 2010 7:44 am
Location: Australia
Contact:

Re: Scid error on CCRL pgn file imports

Post by stevenaaus » Wed Jan 25, 2012 9:59 pm

Adam Hair wrote:Actually, the problem occurs at the 262,144th game, which is 2^18 (as Kirill pointed out to me once).
Yes - this is interesting. Where is the download link ?
The fact that Scid can import more games than this means perhaps that the CCRL program may have something funny at this number.

Have you tried the pgnscid command line tool. It comes with scid and creates an si4 from the command line. It's more reliable for some reason.

Post Reply