Popular opening books

Discussion of anything and everything relating to chess playing software and machines.

Moderators: Harvey Williamson, bob, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
Graham Banks
Posts: 34543
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: Popular opening books

Post by Graham Banks » Tue Aug 28, 2018 9:37 pm

Guenther wrote:
Tue Aug 28, 2018 9:15 am
Hmmm can you try this one below?
This is done with a little macro and yace epdtest utility which also creates valid pgn.
I noticed though that it does not produce the 'Setup' tag and still I could load it in all GUIs
I tested e.g. LucasChess, WB, etc.
(note that it is created from the popbooksmi-epd mentioned above)

http://rwbc-chess.de/Downloads/popbkm.zip

You can see that even the pgn generator from talkchess can read it :)
(I added the first three games from the pgn)
This means if ChessGUI cannot read it this time I am running out of ideas.
ChessGUI still can't produce a cgb book from this file.
Ferdy's explanation of how to use the epd2pgn tool in ChessGUI seems to be working, but it is going to take many hours before I report success.
gbanksnz at gmail.com

User avatar
Graham Banks
Posts: 34543
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: Popular opening books

Post by Graham Banks » Wed Aug 29, 2018 8:02 am

Graham Banks wrote:
Tue Aug 28, 2018 9:37 pm
Guenther wrote:
Tue Aug 28, 2018 9:15 am
Hmmm can you try this one below?
This is done with a little macro and yace epdtest utility which also creates valid pgn.
I noticed though that it does not produce the 'Setup' tag and still I could load it in all GUIs
I tested e.g. LucasChess, WB, etc.
(note that it is created from the popbooksmi-epd mentioned above)

http://rwbc-chess.de/Downloads/popbkm.zip

You can see that even the pgn generator from talkchess can read it :)
(I added the first three games from the pgn)
This means if ChessGUI cannot read it this time I am running out of ideas.
ChessGUI still can't produce a cgb book from this file.
Ferdy's explanation of how to use the epd2pgn tool in ChessGUI seems to be working, but it is going to take many hours before I report success.
After 7 hours, the conversion is 10% complete. :shock:
gbanksnz at gmail.com

Dann Corbit
Posts: 11627
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Popular opening books

Post by Dann Corbit » Wed Aug 29, 2018 4:39 pm

Graham Banks wrote:
Tue Aug 28, 2018 6:18 am
How can I convert from epd into pgn?
PGN file is attached. It has the suggested moves included so that the game elements look like this:

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[Setup "1"]
[FEN "r1q2rk1/pp2p1bp/3ppnp1/4n3/4P1P1/2N1BP2/PPPQB2P/2KR3R w - - 0 1"]

1. h4 *
Attachments
popbookspgn.7z
(55.05 KiB) Downloaded 55 times
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

Dann Corbit
Posts: 11627
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Popular opening books

Post by Dann Corbit » Wed Aug 29, 2018 4:43 pm

Dann Corbit wrote:
Wed Aug 29, 2018 4:39 pm
Graham Banks wrote:
Tue Aug 28, 2018 6:18 am
How can I convert from epd into pgn?
PGN file is attached. It has the suggested moves included so that the game elements look like this:

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[Setup "1"]
[FEN "r1q2rk1/pp2p1bp/3ppnp1/4n3/4P1P1/2N1BP2/PPPQB2P/2KR3R w - - 0 1"]

1. h4 *
The attached file has the games without any suggested moves, so the above would look like this:

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[Setup "1"]
[FEN "r1q2rk1/pp2p1bp/3ppnp1/4n3/4P1P1/2N1BP2/PPPQB2P/2KR3R w - - 0 1"]

1. *
Attachments
popbooks-no-bm.7z
(47.92 KiB) Downloaded 48 times
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

User avatar
Graham Banks
Posts: 34543
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: Popular opening books

Post by Graham Banks » Wed Aug 29, 2018 9:01 pm

Dann Corbit wrote:
Wed Aug 29, 2018 4:39 pm
Graham Banks wrote:
Tue Aug 28, 2018 6:18 am
How can I convert from epd into pgn?
PGN file is attached. It has the suggested moves included so that the game elements look like this:

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[Setup "1"]
[FEN "r1q2rk1/pp2p1bp/3ppnp1/4n3/4P1P1/2N1BP2/PPPQB2P/2KR3R w - - 0 1"]

1. h4 *
Thanks Dann. Much appreciated.
Sadly still no good for ChessGUI.

Meanwhile, after 18 hours, the epd2pgn conversion is at 31%.
Once finished, I'll report back and if successful, post the pgn file produced.
gbanksnz at gmail.com

User avatar
Werner Taelemans
Posts: 104
Joined: Mon Feb 03, 2014 10:57 am
Location: Belgium
Contact:

Re: Popular opening books

Post by Werner Taelemans » Thu Aug 30, 2018 4:53 pm

Graham Banks wrote:
Wed Aug 29, 2018 9:01 pm
Meanwhile, after 18 hours, the epd2pgn conversion is at 31%.
That's a lot of work. I have a console program that can do the job in ten minutes.
It works like this:

Code: Select all

epd2pgn -p Twic.pgn -e popbooks.epd -d 40
It failed to translate 1100 epd lines (from the 2834) though. I suppose Twic.pgn doesn't contain all the positions from popbooks.epd.
I'm a bit late here, but if you're interested, I'll put this program on my website during the weekend.

User avatar
Graham Banks
Posts: 34543
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: Popular opening books

Post by Graham Banks » Thu Aug 30, 2018 8:50 pm

Werner Taelemans wrote:
Thu Aug 30, 2018 4:53 pm
Graham Banks wrote:
Wed Aug 29, 2018 9:01 pm
Meanwhile, after 18 hours, the epd2pgn conversion is at 31%.
That's a lot of work. I have a console program that can do the job in ten minutes.
It works like this:

Code: Select all

epd2pgn -p Twic.pgn -e popbooks.epd -d 40
It failed to translate 1100 epd lines (from the 2834) though. I suppose Twic.pgn doesn't contain all the positions from popbooks.epd.
I'm a bit late here, but if you're interested, I'll put this program on my website during the weekend.
Thanks for the kind offer Werner.
The conversion is almost 70% complete now, so I may as well see it through and see what happens first.

Cheers,
Graham.
gbanksnz at gmail.com

Dann Corbit
Posts: 11627
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Popular opening books

Post by Dann Corbit » Fri Aug 31, 2018 12:01 am

Worst of all, about half of the terminal positions in popbooks.pgn are not good for contests (IMO) which is why I originally wrote the post.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

User avatar
Graham Banks
Posts: 34543
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: Popular opening books

Post by Graham Banks » Fri Aug 31, 2018 12:20 am

Dann Corbit wrote:
Fri Aug 31, 2018 12:01 am
Worst of all, about half of the terminal positions in popbooks.pgn are not good for contests (IMO) which is why I originally wrote the post.
Hi Dann,

I'm combining the Mi and Lo for a start.
I can always switch to the Lo on its own if need be.
gbanksnz at gmail.com

Dann Corbit
Posts: 11627
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Popular opening books

Post by Dann Corbit » Fri Aug 31, 2018 12:24 am

Graham Banks wrote:
Fri Aug 31, 2018 12:20 am
Dann Corbit wrote:
Fri Aug 31, 2018 12:01 am
Worst of all, about half of the terminal positions in popbooks.pgn are not good for contests (IMO) which is why I originally wrote the post.
Hi Dann,

I'm combining the Mi and Lo for a start.
I can always switch to the Lo on its own if need be.
If you switch to Lo on its own, I guess that you will get a huge percentage of draws.
I think the old fashioned goal of forming books from drawn games is a mistake.

I do not think that it measures accurately the difference in strength.
When given a giant pile of drawish positions, you end up with a giant pile of new draws.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

Post Reply