Help creating Romichess Opening book

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Tony Thomas

Help creating Romichess Opening book

Post by Tony Thomas »

I have a pgn comprised of high quality human games (2700+) from Wael, I would like to make a book for Romichess but I do not know how.. I have send the pgn to Mike, but I do not know when he is going to respond. So if anyone knows how to make a book please post the instructions. I believe that the instructions were posted in Leo's Engine Details..

Thanks in advance
Tony
User avatar
Jim Ablett
Posts: 2445
Joined: Fri Jul 14, 2006 7:56 am
Location: London, England
Full name: Jim Ablett

Re: Help creating Romichess Opening book

Post by Jim Ablett »

Tony Thomas wrote:I have a pgn comprised of high quality human games (2700+) from Wael, I would like to make a book for Romichess but I do not know how.. I have send the pgn to Mike, but I do not know when he is going to respond. So if anyone knows how to make a book please post the instructions. I believe that the instructions were posted in Leo's Engine Details..

Thanks in advance
Tony
Hi Tony,

I think you are referring to the 'merge' command which will merge a pgn into the learn file.

Example (type in command from console): merge compGM.pgn

I think there may be a limit on the size of the pgn that it can accept, so
if it's a particularly massive pgn file you may have to split it into smaller parts before it is accepted.

Jim.
Tony Thomas

Re: Help creating Romichess Opening book

Post by Tony Thomas »

Jim Ablett wrote:
Tony Thomas wrote:I have a pgn comprised of high quality human games (2700+) from Wael, I would like to make a book for Romichess but I do not know how.. I have send the pgn to Mike, but I do not know when he is going to respond. So if anyone knows how to make a book please post the instructions. I believe that the instructions were posted in Leo's Engine Details..

Thanks in advance
Tony
Hi Tony,

I think you are referring to the 'merge' command which will merge a pgn into the learn file.

Example (type in command from console): merge compGM.pgn

I think there may be a limit on the size of the pgn that it can accept, so
if it's a particularly massive pgn file you may have to split it into smaller parts before it is accepted.

Jim.
Yes, I was talking about the merge command..thanks for the info.
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: Help creating Romichess Opening book

Post by Dr.Wael Deeb »

Jim Ablett wrote:
Tony Thomas wrote:I have a pgn comprised of high quality human games (2700+) from Wael, I would like to make a book for Romichess but I do not know how.. I have send the pgn to Mike, but I do not know when he is going to respond. So if anyone knows how to make a book please post the instructions. I believe that the instructions were posted in Leo's Engine Details..

Thanks in advance
Tony
Hi Tony,

I think you are referring to the 'merge' command which will merge a pgn into the learn file.

Example (type in command from console): merge compGM.pgn

I think there may be a limit on the size of the pgn that it can accept, so
if it's a particularly massive pgn file you may have to split it into smaller parts before it is accepted.

Jim.
Thanks master Jim for helping,the file is about 6 Mb is size so Tony won't have a problem composing the opening book....
I expect a lot from this new opening book,over the last two weeks I spent many and I mean many hours to collect,clean and optimize this pgn file....
Waiting eagerly for the test results from tony over the ICC server :D
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
Tony Thomas

Re: Help creating Romichess Opening book

Post by Tony Thomas »

Dr.Wael Deeb wrote:
Jim Ablett wrote:
Tony Thomas wrote:I have a pgn comprised of high quality human games (2700+) from Wael, I would like to make a book for Romichess but I do not know how.. I have send the pgn to Mike, but I do not know when he is going to respond. So if anyone knows how to make a book please post the instructions. I believe that the instructions were posted in Leo's Engine Details..

Thanks in advance
Tony
Hi Tony,

I think you are referring to the 'merge' command which will merge a pgn into the learn file.

Example (type in command from console): merge compGM.pgn

I think there may be a limit on the size of the pgn that it can accept, so
if it's a particularly massive pgn file you may have to split it into smaller parts before it is accepted.

Jim.
Thanks master Jim for helping,the file is about 6 Mb is size so Tony won't have a problem composing the opening book....
I expect a lot from this new opening book,over the last two weeks I spent many and I mean many hours to collect,clean and optimize this pgn file....
Waiting eagerly for the test results from tony over the ICC server :D
Wael, I think that Romi's book making tool is less than perfect..I am not using it on ICC yet, I am just running few trial matches at home and so far the results arent that great against the Oxygen book (polyglot format)..
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: Help creating Romichess Opening book

Post by Dr.Wael Deeb »

Tony Thomas wrote:
Dr.Wael Deeb wrote:
Jim Ablett wrote:
Tony Thomas wrote:I have a pgn comprised of high quality human games (2700+) from Wael, I would like to make a book for Romichess but I do not know how.. I have send the pgn to Mike, but I do not know when he is going to respond. So if anyone knows how to make a book please post the instructions. I believe that the instructions were posted in Leo's Engine Details..

Thanks in advance
Tony
Hi Tony,

I think you are referring to the 'merge' command which will merge a pgn into the learn file.

Example (type in command from console): merge compGM.pgn

I think there may be a limit on the size of the pgn that it can accept, so
if it's a particularly massive pgn file you may have to split it into smaller parts before it is accepted.

Jim.
Thanks master Jim for helping,the file is about 6 Mb is size so Tony won't have a problem composing the opening book....
I expect a lot from this new opening book,over the last two weeks I spent many and I mean many hours to collect,clean and optimize this pgn file....
Waiting eagerly for the test results from tony over the ICC server :D
Wael, I think that Romi's book making tool is less than perfect..I am not using it on ICC yet, I am just running few trial matches at home and so far the results arent that great against the Oxygen book (polyglot format)..
Can you post some games Tony to see how my new opening book cope with Oxygen's one :D
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: Help creating Romichess Opening book

Post by Dr.Wael Deeb »

BTW,it's not a big deal to filter out the Mega Database 2007,which I have,and send you a pgn which will in the worst case cope with Oxygen's opening book if not killing it....I can do it in less than one hour :!:

It's just that I am begining to think that Oxygen as a chess engine is definitely stronger than Romichess....
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
Michael Sherwin
Posts: 3196
Joined: Fri May 26, 2006 3:00 am
Location: WY, USA
Full name: Michael Sherwin

Re: Help creating Romichess Opening book

Post by Michael Sherwin »

Tony Thomas wrote:I have a pgn comprised of high quality human games (2700+) from Wael, I would like to make a book for Romichess but I do not know how.. I have send the pgn to Mike, but I do not know when he is going to respond. So if anyone knows how to make a book please post the instructions. I believe that the instructions were posted in Leo's Engine Details..

Thanks in advance
Tony
Start with a fresh learn file

Enter 'book 2'

Enter 'merge book.pgn'

That will give Romi a 'hard wired' book

To extend the 'hard wired' book with a 'soft wired' book

Enter 'book 1'

Enter 'merge extended.pgn'

I have merged enormous.pgn from Robert Hyatt as a type 1 soft book with no problems, ~1.5 million games.

Romi will use the HARD book blindly with out thinking, so be careful. When out of the HARD book Romi will use the SOFT book.
If you are on a sidewalk and the covid goes beep beep
Just step aside or you might have a bit of heat
Covid covid runs through the town all day
Can the people ever change their ways
Sherwin the covid's after you
Sherwin if it catches you you're through
Tony Thomas

Re: Help creating Romichess Opening book

Post by Tony Thomas »

Dr.Wael Deeb wrote:
Tony Thomas wrote:
Dr.Wael Deeb wrote:
Jim Ablett wrote:
Tony Thomas wrote:I have a pgn comprised of high quality human games (2700+) from Wael, I would like to make a book for Romichess but I do not know how.. I have send the pgn to Mike, but I do not know when he is going to respond. So if anyone knows how to make a book please post the instructions. I believe that the instructions were posted in Leo's Engine Details..

Thanks in advance
Tony
Hi Tony,

I think you are referring to the 'merge' command which will merge a pgn into the learn file.

Example (type in command from console): merge compGM.pgn

I think there may be a limit on the size of the pgn that it can accept, so
if it's a particularly massive pgn file you may have to split it into smaller parts before it is accepted.

Jim.
Thanks master Jim for helping,the file is about 6 Mb is size so Tony won't have a problem composing the opening book....
I expect a lot from this new opening book,over the last two weeks I spent many and I mean many hours to collect,clean and optimize this pgn file....
Waiting eagerly for the test results from tony over the ICC server :D
Wael, I think that Romi's book making tool is less than perfect..I am not using it on ICC yet, I am just running few trial matches at home and so far the results arent that great against the Oxygen book (polyglot format)..
Can you post some games Tony to see how my new opening book cope with Oxygen's one :D
Wael, from reading Mike's post, I didnt make the book properly. I just renamed your pgn to A.pgn and typed the command "merge a.pgn" and it made a small book..Here are the results..

Book Match

Code: Select all

Rank Engine Score Ro Ro S-B 
1 RomiChessP3k RG 18.5/30 · ·· ·· ·· ·· ·· ·· ·· ·· ·· ·· ·· ·· 1=01=011==1011=0011010111=1=10  212.75  
2 RomiChessP3k WB 11.5/30 0=10=100==0100=1100101000=0=01 · ·· ·· ·· ·· ·· ·· ·· ·· ·· ·· ·· ··  212.75  
30 games played / Tournament finished
Tournament start: 2008.06.17, 05:32:03
Latest update: 2008.06.17, 09:45:15
Site/ Country: Atlanta, Ga, United States
Level: Blitz 1/1
Hardware: Intel(R) Celeron(R) CPU 2.80GHz with 239 MB Memory
Operating system: Microsoft Windows XP Home Edition Service Pack 2 (Build 2600)
PGN-File: Book Match.pgn
Table created with: Arena 1.1
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: Help creating Romichess Opening book

Post by Dr.Wael Deeb »

Tony Thomas wrote:
Dr.Wael Deeb wrote:
Tony Thomas wrote:
Dr.Wael Deeb wrote:
Jim Ablett wrote:
Tony Thomas wrote:I have a pgn comprised of high quality human games (2700+) from Wael, I would like to make a book for Romichess but I do not know how.. I have send the pgn to Mike, but I do not know when he is going to respond. So if anyone knows how to make a book please post the instructions. I believe that the instructions were posted in Leo's Engine Details..

Thanks in advance
Tony
Hi Tony,

I think you are referring to the 'merge' command which will merge a pgn into the learn file.

Example (type in command from console): merge compGM.pgn

I think there may be a limit on the size of the pgn that it can accept, so
if it's a particularly massive pgn file you may have to split it into smaller parts before it is accepted.

Jim.
Thanks master Jim for helping,the file is about 6 Mb is size so Tony won't have a problem composing the opening book....
I expect a lot from this new opening book,over the last two weeks I spent many and I mean many hours to collect,clean and optimize this pgn file....
Waiting eagerly for the test results from tony over the ICC server :D
Wael, I think that Romi's book making tool is less than perfect..I am not using it on ICC yet, I am just running few trial matches at home and so far the results arent that great against the Oxygen book (polyglot format)..
Can you post some games Tony to see how my new opening book cope with Oxygen's one :D
Wael, from reading Mike's post, I didnt make the book properly. I just renamed your pgn to A.pgn and typed the command "merge a.pgn" and it made a small book..Here are the results..

Book Match

Code: Select all

Rank Engine Score Ro Ro S-B 
1 RomiChessP3k RG 18.5/30 · ·· ·· ·· ·· ·· ·· ·· ·· ·· ·· ·· ·· 1=01=011==1011=0011010111=1=10  212.75  
2 RomiChessP3k WB 11.5/30 0=10=100==0100=1100101000=0=01 · ·· ·· ·· ·· ·· ·· ·· ·· ·· ·· ·· ··  212.75  
30 games played / Tournament finished
Tournament start: 2008.06.17, 05:32:03
Latest update: 2008.06.17, 09:45:15
Site/ Country: Atlanta, Ga, United States
Level: Blitz 1/1
Hardware: Intel(R) Celeron(R) CPU 2.80GHz with 239 MB Memory
Operating system: Microsoft Windows XP Home Edition Service Pack 2 (Build 2600)
PGN-File: Book Match.pgn
Table created with: Arena 1.1
I see Tony,the best approach would be to deliver the new pgn to Michael as soon as possible,so you can run some test matchs before the world rapid championship....
I am on a standby mode for any material needed for creating the new book....
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….