WTB PGN parser test suite

markboylan · Post by **markboylan** » Wed Sep 30, 2009 5:14 am

Hi everyone!

I'm trying to make my parser as forgiving as possible and still be right (and fast). So, I'm looking for big PGN files with lots of poorly recorded games -- preferably generated by an assortment of different programs (or people).

If you have any large-ish (the bigger the better) PGN files that push the correctness envelope of the PGN input specification, or know where I can find any, please let me know.

Thanks!

Rémi Coulom · Post by **Rémi Coulom** » Wed Sep 30, 2009 2:46 pm

This is a conforming game record that I wrote to test my own parser:

Code: Select all

&#91;Event "This is an event with a \""&#93;
&#91;Site "This site has \\\\ xxx"&#93;
&#91;Date "1996.08.15"&#93;&#91;Round "-"&#93;&#91;White "White"&#93;&#91;Black "Black"&#93;
&#91;Result "1/2-1/2"&#93;&#91;SetUp "1"&#93;;I love comments
&#91;FEN "1nbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/1NBQKBNR w KQkq - "&#93;e4&#40;d4;comment
d5!!2.c4$50&#40;Nf3?)&#41;e5 Nf3&#123;Comment !&#125;Nc6 Nc3 Nf6 Bc4 Bc5 O-O O-O
% This is a line with an escape character !
@@@æææ &#123;unexpected characters are skipped&#125;
<> &#123;These symbols are reserved&#125;
1/2-1/2

Rémi

jdart · Post by **jdart** » Sat Oct 03, 2009 1:51 am

Unfortunately there is a plethora of badly recorded and/or mangled game data. You could start with

ftp://ftp.pitt.edu/group/student-activities/chess/PGN/

or there is Dann Corbit's huge PGN collection at:

http://cap.connx.com/

although I think most of those are not as bad.

If I remember right Rybka Aquarium has an interesting take on PGN in its database - most notably with a non-standard date format.

--Jon

Dann Corbit · Post by **Dann Corbit** » Sat Oct 03, 2009 4:26 am

Almost for sure, there's something in here to bust your parser:
http://cap.connx.com/chess-engines/new- ... ns.pgn.bz2

Everything in the file is valid, also. So you should be able to read it without any errors.

markboylan · Post by **markboylan** » Sun Oct 11, 2009 7:40 am

Thanks guys! These files helped.

Looks like I need to accept nested quotes :p

jshriver · Post by **jshriver** » Mon Oct 12, 2009 6:25 pm

Anyone know what the rules are considering unicode in PGN?

Noticed while looking at Dan's annotations.pgn it had some unicode characters in it.

WTB PGN parser test suite

WTB PGN parser test suite

Re: WTB PGN parser test suite

Re: WTB PGN parser test suite

Re: WTB PGN parser test suite

Re: WTB PGN parser test suite

Re: WTB PGN parser test suite