Popular opening books

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 41428
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Popular opening books

Post by Graham Banks »

Guenther wrote: Tue Aug 28, 2018 11:15 amHmmm can you try this one below?
This is done with a little macro and yace epdtest utility which also creates valid pgn.
I noticed though that it does not produce the 'Setup' tag and still I could load it in all GUIs
I tested e.g. LucasChess, WB, etc.
(note that it is created from the popbooksmi-epd mentioned above)

http://rwbc-chess.de/Downloads/popbkm.zip

You can see that even the pgn generator from talkchess can read it :)
(I added the first three games from the pgn)
This means if ChessGUI cannot read it this time I am running out of ideas.
ChessGUI still can't produce a cgb book from this file.
Ferdy's explanation of how to use the epd2pgn tool in ChessGUI seems to be working, but it is going to take many hours before I report success.
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 41428
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Popular opening books

Post by Graham Banks »

Graham Banks wrote: Tue Aug 28, 2018 11:37 pm
Guenther wrote: Tue Aug 28, 2018 11:15 amHmmm can you try this one below?
This is done with a little macro and yace epdtest utility which also creates valid pgn.
I noticed though that it does not produce the 'Setup' tag and still I could load it in all GUIs
I tested e.g. LucasChess, WB, etc.
(note that it is created from the popbooksmi-epd mentioned above)

http://rwbc-chess.de/Downloads/popbkm.zip

You can see that even the pgn generator from talkchess can read it :)
(I added the first three games from the pgn)
This means if ChessGUI cannot read it this time I am running out of ideas.
ChessGUI still can't produce a cgb book from this file.
Ferdy's explanation of how to use the epd2pgn tool in ChessGUI seems to be working, but it is going to take many hours before I report success.
After 7 hours, the conversion is 10% complete. :shock:
gbanksnz at gmail.com
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Popular opening books

Post by Dann Corbit »

Graham Banks wrote: Tue Aug 28, 2018 8:18 am How can I convert from epd into pgn?
PGN file is attached. It has the suggested moves included so that the game elements look like this:

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[Setup "1"]
[FEN "r1q2rk1/pp2p1bp/3ppnp1/4n3/4P1P1/2N1BP2/PPPQB2P/2KR3R w - - 0 1"]

1. h4 *
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Popular opening books

Post by Dann Corbit »

Dann Corbit wrote: Wed Aug 29, 2018 6:39 pm
Graham Banks wrote: Tue Aug 28, 2018 8:18 am How can I convert from epd into pgn?
PGN file is attached. It has the suggested moves included so that the game elements look like this:

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[Setup "1"]
[FEN "r1q2rk1/pp2p1bp/3ppnp1/4n3/4P1P1/2N1BP2/PPPQB2P/2KR3R w - - 0 1"]

1. h4 *
The attached file has the games without any suggested moves, so the above would look like this:

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[Setup "1"]
[FEN "r1q2rk1/pp2p1bp/3ppnp1/4n3/4P1P1/2N1BP2/PPPQB2P/2KR3R w - - 0 1"]

1. *
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Graham Banks
Posts: 41428
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Popular opening books

Post by Graham Banks »

Dann Corbit wrote: Wed Aug 29, 2018 6:39 pm
Graham Banks wrote: Tue Aug 28, 2018 8:18 am How can I convert from epd into pgn?
PGN file is attached. It has the suggested moves included so that the game elements look like this:

[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[Setup "1"]
[FEN "r1q2rk1/pp2p1bp/3ppnp1/4n3/4P1P1/2N1BP2/PPPQB2P/2KR3R w - - 0 1"]

1. h4 *
Thanks Dann. Much appreciated.
Sadly still no good for ChessGUI.

Meanwhile, after 18 hours, the epd2pgn conversion is at 31%.
Once finished, I'll report back and if successful, post the pgn file produced.
gbanksnz at gmail.com
User avatar
Werner Taelemans
Posts: 119
Joined: Mon Feb 03, 2014 11:57 am
Location: Belgium
Full name: Werner Taelemans

Re: Popular opening books

Post by Werner Taelemans »

Graham Banks wrote: Wed Aug 29, 2018 11:01 pm Meanwhile, after 18 hours, the epd2pgn conversion is at 31%.
That's a lot of work. I have a console program that can do the job in ten minutes.
It works like this:

Code: Select all

epd2pgn -p Twic.pgn -e popbooks.epd -d 40
It failed to translate 1100 epd lines (from the 2834) though. I suppose Twic.pgn doesn't contain all the positions from popbooks.epd.
I'm a bit late here, but if you're interested, I'll put this program on my website during the weekend.
User avatar
Graham Banks
Posts: 41428
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Popular opening books

Post by Graham Banks »

Werner Taelemans wrote: Thu Aug 30, 2018 6:53 pm
Graham Banks wrote: Wed Aug 29, 2018 11:01 pm Meanwhile, after 18 hours, the epd2pgn conversion is at 31%.
That's a lot of work. I have a console program that can do the job in ten minutes.
It works like this:

Code: Select all

epd2pgn -p Twic.pgn -e popbooks.epd -d 40
It failed to translate 1100 epd lines (from the 2834) though. I suppose Twic.pgn doesn't contain all the positions from popbooks.epd.
I'm a bit late here, but if you're interested, I'll put this program on my website during the weekend.
Thanks for the kind offer Werner.
The conversion is almost 70% complete now, so I may as well see it through and see what happens first.

Cheers,
Graham.
gbanksnz at gmail.com
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Popular opening books

Post by Dann Corbit »

Worst of all, about half of the terminal positions in popbooks.pgn are not good for contests (IMO) which is why I originally wrote the post.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Graham Banks
Posts: 41428
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Popular opening books

Post by Graham Banks »

Dann Corbit wrote: Fri Aug 31, 2018 2:01 am Worst of all, about half of the terminal positions in popbooks.pgn are not good for contests (IMO) which is why I originally wrote the post.
Hi Dann,

I'm combining the Mi and Lo for a start.
I can always switch to the Lo on its own if need be.
gbanksnz at gmail.com
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Popular opening books

Post by Dann Corbit »

Graham Banks wrote: Fri Aug 31, 2018 2:20 am
Dann Corbit wrote: Fri Aug 31, 2018 2:01 am Worst of all, about half of the terminal positions in popbooks.pgn are not good for contests (IMO) which is why I originally wrote the post.
Hi Dann,

I'm combining the Mi and Lo for a start.
I can always switch to the Lo on its own if need be.
If you switch to Lo on its own, I guess that you will get a huge percentage of draws.
I think the old fashioned goal of forming books from drawn games is a mistake.

I do not think that it measures accurately the difference in strength.
When given a giant pile of drawish positions, you end up with a giant pile of new draws.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.