Dann Corbit wrote: ↑Fri Feb 14, 2020 5:13 pm
Further complications:
All the data systems are different.
TCEC is different, and basically every other engine conte.
Furthermore, sometimes the data is from white's perspective and sometimes for the side to move as far as scores go. And there are dozens of different ways to indicate a book move
About the red, here is compilation what I have seen through the years and how to recognize a book move:
Phase Won Games (numbers) Late Endgame Match
Overview MIDG END1 END2 END3 QUEEN ROOK LIGHT PAWN Score
Stockfish_11-64 0 0 0 1 0 0 0 1 1.0 / 1 (100.0%)
Stockfish_11x2-64 0 0 0 0 0 0 0 0 0.0 / 1 (0.0%)
Phase Won games % Late Endgame Match
Overview MIDG END1 END2 END3 QUEEN ROOK LIGHT PAWN Score
Stockfish_11-64 0.0 0.0 0.0 100% 0.0 0.0 0.0 100% 1.0 / 1 (100.0%)
Stockfish_11x2-64 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 / 1 (0.0%)
Depths MIDG END1 END2 END3 BOOK TIME
Stockfish_11-64 16.3 19.0 17.7 25.1 3.0 (moves) 0:20
Stockfish_11x2-64 14.8 17.0 15.9 21.3 3.0 (moves) 0:09
Suspect opening lines overview (1.00)
Bad opening line for Stockfish_11x2-64 in game 1, start score -1.07, game lost.
rnbqkb1r/ppp1p1pp/3p1n2/5P2/3P4/2N5/PPP2PPP/R1BQKBNR b KQkq - sm Bxf5; acd 16; ce -1.07; acs 0.9s;
1. Book moves (3.0) correct.
2. Length names flexible, press F4 to change the length.
3. Opening is reported as suspect.
On detecting suspect book moves I made a firm choice, first move < margin and game lost -> suspect.
In the game in question black recovers from the -1.07 and thus the opening is not suspect, secondly people play matches with opening books and engines may fall back into the book again with a score of 0.00 and things get complicated.
I think a programmer / book editor just want to know his book or opening set contains bad scores.
90% of coding is debugging, the other 10% is writing bugs.
Rebel wrote: ↑Wed Feb 19, 2020 5:23 pm
About creating your own PGN format: :roll:
Dann Corbit wrote: ↑Fri Feb 14, 2020 5:13 pm
Further complications:
All the data systems are different.
TCEC is different, and basically every other engine conte.
Furthermore, sometimes the data is from white's perspective and sometimes for the side to move as far as scores go. And there are dozens of different ways to indicate a book move
About the red, here is compilation what I have seen through the years and how to recognize a book move:
47. h6 {+M19/33 0.44s} Kb3 {-M20/28 0.21s, White wins by adjudication} 1-0
Anyway, in the upcoming update (tonight I hope) your PGN format will work as well :wink:
Thanks, I am sorry I forgot about the line with the final termination comment, because I didn't know it was relevant for your book moves parsing.
My afterwards used script (not the different compilation of cutechess), not only removes the unnecessary 's' (some tools I use don't like that for parsing!), but also separates the last move comment from the termination comment, because I find that concatenation ugly.
BTW the XB/WB source contains code for recognizing book moves up to 2006 IIRC, because I once persuaded Alessandro Scotti to add a pgn tag, which saves the bookout eval in the header. The tag looks like this
Phase Won Games (numbers) Late Endgame Match
Overview MIDG END1 END2 END3 QUEEN ROOK LIGHT PAWN Score
Stockfish_11-64 0 0 0 1 0 0 0 1 1.0 / 1 (100.0%)
Stockfish_11x2-64 0 0 0 0 0 0 0 0 0.0 / 1 (0.0%)
Phase Won games % Late Endgame Match
Overview MIDG END1 END2 END3 QUEEN ROOK LIGHT PAWN Score
Stockfish_11-64 0.0 0.0 0.0 100% 0.0 0.0 0.0 100% 1.0 / 1 (100.0%)
Stockfish_11x2-64 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 / 1 (0.0%)
Depths MIDG END1 END2 END3 BOOK TIME
Stockfish_11-64 16.3 19.0 17.7 25.1 3.0 (moves) 0:20
Stockfish_11x2-64 14.8 17.0 15.9 21.3 3.0 (moves) 0:09
Suspect opening lines overview (1.00)
Bad opening line for Stockfish_11x2-64 in game 1, start score -1.07, game lost.
rnbqkb1r/ppp1p1pp/3p1n2/5P2/3P4/2N5/PPP2PPP/R1BQKBNR b KQkq - sm Bxf5; acd 16; ce -1.07; acs 0.9s;
1. Book moves (3.0) correct.
2. Length names flexible, press F4 to change the length.
3. Opening is reported as suspect.
On detecting suspect book moves I made a firm choice, first move < margin and game lost -> suspect.
In the game in question black recovers from the -1.07 and thus the opening is not suspect, secondly people play matches with opening books and engines may fall back into the book again with a score of 0.00 and things get complicated.
I think a programmer / book editor just want to know his book or opening set contains bad scores.
Thanks, all well, except the time sum, may be a rounding error? It still would be nice to have here also 1 or 2 digit precision.
Note that a lot of people do ultrafast tests and this tool can also check irregularities in game files of other people.
The diff here is already >10% from real numbers. Below is a calculation of the same game (rounded to 2 digits in time sum).
TCEC has book moves like this:
{book, mb=+0+0+0+0+0,} sign can be - or + and each 0 can be any number from 0-9
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit wrote: ↑Wed Feb 19, 2020 10:22 pm
TCEC has book moves like this:
{book, mb=+0+0+0+0+0,} sign can be - or + and each 0 can be any number from 0-9
Is there a tool that converts TCEC PGN to normal (say Arena / Cutechess / Chessbase) PGN?
I once had, then they changed the format again, I gave up
90% of coding is debugging, the other 10% is writing bugs.
I am not aware of any, but Les Fernandez wrote a tool that will read it and write out the opening book moves and the analyzed moves as EPD records.
He uses vb.net and regular expressions to parse it.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Your PGN must have a 3 digit precision, it explains the 0.24s difference for black.
Hope you are satisfied with the result, after all we are not talking about the 100 meter sprint.
Thanks that should be sufficient. Yes, Black had a few 3 digit moves, which is also the default in offficial cutechess for
all moves below 100ms (as shown in the source snipped before).