Hi everybody. This is my very first post on talkchess. I was just curious if anybody else has noticed problems with the way Arena selects moves from its opening books. I've been running an Arena book tournament with 14 different books and examined the games and moves selected by arena. I noticed that Arena, in many instances, played moves where the criteria for that particular move was not met. For example, the settings for a certain book that I created required that:
a. minimum of 3 games have been played
b. minimum of 3 wins
c. white winning percentage = 50%
d. black winning percentage = 38%
e. priority bar = 2
f. moves bar = 10
g. winning percentage = 4
the move played did not meet many of the criteria above and the probability, therefore, was confirmed to be zero so the move should not have been selected and yet it was selected and played by Arena. I noticed this with many of the other books as well. Will Arena select a move if ANY of the criteria is met. I was under the impression that ALL criteria must be met for any move to be selected and played. Has anybody else taken the time to examine the moves selected by Arena from its opening books and noticed this behavior. I am using Arena 1.1 and am about to try the 2.0 version. Thanks, in advance for any and all responses and help.
Problems With Arena
Moderator: Ras
-
Graham Banks
- Posts: 44846
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Problems With Arena
My understanding is that the authors of the various opening books usually specify which settings that the user should use.
Cheers,
Graham.
PS - could you please reduce of size of your avatar?
Cheers,
Graham.
PS - could you please reduce of size of your avatar?
gbanksnz at gmail.com
-
David Schumaker
Re: Problems With Arena
Yes, I understand. I tested several books with the default settings. Some of the books were quite strong and performed well but even those books had moves played that should not have been played because the move in question did not meet the criteria in the book settings. The books that did well in my tournament did well partly because they were constructed from very high quality games. Therefore, for these books, even if a move was played that should not have been played it was still a good quality move so it did not effect the book's performance too much relative to the other book's performances. Still, this is very frustrating. I would like for Arena to select moves based on the book settings without making any mistakes. I've got the feeling that most people have assumed all along that Arena has always selected moves according to the book settings without error. This is simply not the case. I have discovered several errors in move selection by Arena regardless of which book was used. I would like to encourage others to run a test and see for themselves. Perhaps play 50 to 100 games at extremely fast time controls so that the tournament finishes fast. Then go back and examine the moves selected by Arena to the criteria set in the book settings. You will be quite surprised to discover that Arena does not always obey the book settings and therefore in many instances is selecting the wrong move. Again, thanks for any responses.
P.S Sorry about the size of the avatar. Is that better?
P.S Sorry about the size of the avatar. Is that better?
-
Graham Banks
- Posts: 44846
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Problems With Arena
Hi David,David Schumaker wrote:Yes, I understand. I tested several books with the default settings. Some of the books were quite strong and performed well but even those books had moves played that should not have been played because the move in question did not meet the criteria in the book settings. The books that did well in my tournament did well partly because they were constructed from very high quality games. Therefore, for these books, even if a move was played that should not have been played it was still a good quality move so it did not effect the book's performance too much relative to the other book's performances. Still, this is very frustrating. I would like for Arena to select moves based on the book settings without making any mistakes. I've got the feeling that most people have assumed all along that Arena has always selected moves according to the book settings without error. This is simply not the case. I have discovered several errors in move selection by Arena regardless of which book was used. I would like to encourage others to run a test and see for themselves. Perhaps play 50 to 100 games at extremely fast time controls so that the tournament finishes fast. Then go back and examine the moves selected by Arena to the criteria set in the book settings. You will be quite surprised to discover that Arena does not always obey the book settings and therefore in many instances is selecting the wrong move. Again, thanks for any responses.
P.S Sorry about the size of the avatar. Is that better?
have you let the Arena people know of your concerns? I'm not sure whether or not they have their new forum up and running, but you could send Christopher Conkie a pm here (he's currently one of the CTF mods).
Cheers,
Graham.
PS - your avatar is much better. I was saving you from getting a hard time from others over its size.
gbanksnz at gmail.com
-
David Schumaker
Re: Problems With Arena
Thanks for the advice Graham. But perhaps it would be best if you would PM him and alert him to this thread. It would be nice if others could run a quick test as described in my previous post so that everything I have said could be confirmed. I think for those people who spend a lot of time and effort in constructing high quality books this thread would be of high interest as well. If this is a problem with Arena, hopefully it will be fixed because it is a nice chess gui that handles both wb and uci engines. I wish somebody would add this feature to winboard so that it would not require the use of adaptors. Maybe that will be fixed soon as well.
-
Dr.Wael Deeb
- Posts: 9773
- Joined: Wed Mar 08, 2006 8:44 pm
- Location: Amman,Jordan
Re: Problems With Arena
Hi,David Schumaker wrote:Yes, I understand. I tested several books with the default settings. Some of the books were quite strong and performed well but even those books had moves played that should not have been played because the move in question did not meet the criteria in the book settings. The books that did well in my tournament did well partly because they were constructed from very high quality games. Therefore, for these books, even if a move was played that should not have been played it was still a good quality move so it did not effect the book's performance too much relative to the other book's performances. Still, this is very frustrating. I would like for Arena to select moves based on the book settings without making any mistakes. I've got the feeling that most people have assumed all along that Arena has always selected moves according to the book settings without error. This is simply not the case. I have discovered several errors in move selection by Arena regardless of which book was used. I would like to encourage others to run a test and see for themselves. Perhaps play 50 to 100 games at extremely fast time controls so that the tournament finishes fast. Then go back and examine the moves selected by Arena to the criteria set in the book settings. You will be quite surprised to discover that Arena does not always obey the book settings and therefore in many instances is selecting the wrong move. Again, thanks for any responses.
P.S Sorry about the size of the avatar. Is that better?
Making an Arena opening book is a nightmare as I always stated before....
You have to edit and tune the opening book manualy,anyone telling you otherwise is simply lying....
I've been tweaking and tunning my q8.abk for more than three years now and I've edited more than 3000 opening lines manualy and I am still working on it....I've played over 2500 games with this opening book with bookless engines in my tournaments and I had exactly 3 games with bad opening line....
Unfortunately it's still private and certainly I will release it someday when the gap between it and the public .abk books is quite large
Dr.D
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
-
David Schumaker
Arena Errors With Book Move Selection
Here is some evidence that Arena does not play the right book moves. I checked approximately 13 games played with Mike Scheidl's Balanced-14 book and found that 5 of the games were played with book move selection errors. Please note that I only checked 13 games of almost 300 games played. There are several errors in move selection by Arena 1.1 regardless of which book is used. Arena does not adhere strictly to the individual book settings. In many instances it just chooses to play a move that should not be played at all.
Here are the default settings for Mike Scheidl's Balanced-14 book:
Minimal Number Of Games: 2
Minimal Number Of Wins: 0
White Win Percentage: 50
Black Win Percentage: 33
Priority Slider Bar = 5
Number Of Games Slider Bar = 9
Win Percentage Slider Bar = 2
View the following games in Arena with Balanced-14 as the Main Book so you can see the book settings and move selection.
Example #1:
In the first example at move number 4 the number of games played becomes 1 and therefore the book should stop but it continues on to move number 7.
[Event "Arena Opening Book Tournament"]
[White "Balanced-14"]
[Black "Thinker Book"]
[Result "1/2-1/2"]
[ECO "D20"]
[Opening "QGA"]
[Time "20:50:36"]
[Variation "3.e4"]
[TimeControl "60+1"]
[Termination "normal"]
[PlyCount "200"]
[WhiteType "program"]
[BlackType "program"]
1.d4 d5 2.c4 dxc4 3.e4 b5 {+0.16/8 5} 4.a4 c6 {-0.06/7 2} 5.b3 e5 {+0.63/7 2}
6.axb5 cxb5 {+0.33/7 2} 7.bxc4 Bb4+ {+0.54/8 4} 8.Bd2 {-0.27/10 3} Qxd4 {+0.55/10 2}
9.Bxb4 {-0.27/9} Qxa1 {+0.64/11 9} 10.cxb5 {-0.27/10 2} Be6 {+0.69/10 5} 11.Nf3
{-0.36/9 3} Nd7 {+0.69/11 2} 12.Be2 {-0.64/9 2} Rc8 {+0.90/9 1} 13.O-O {-0.77/9 1} Qb2
{+0.97/10 2} 14.Bd6 {-0.28/10 11} f6 {+0.60/9 6} 15.Ba3 {-0.03/9} Qc2 {+0.60/9 7} 16.Qd6
{+0.06/11 10} Kf7 {+0.14/8 1} 17.Nbd2 {+0.06/11 4} Qa2 {+0.05/8 1} 18.Nh4 {+0.02/11 10}
g6 {0.00/9 2} 19.h3 {+0.02/11 7} Rc2 {+0.05/8 1} 20.Bb4 {+0.22/10 5} Kg7 {-0.13/8
2} 21.Bg4 {+0.73/9 1} Kf7 {-0.31/9 2} 22.Bd1 {+0.62/8 1} Rb2 {-0.22/10 3} 23.f4
{+0.35/9 2} exf4 {-0.22/10 1} 24.Rxf4 {+0.35/9 2} a5 {-0.25/10 2} 25.bxa6 {+0.39/9 1}
Rxb4 {-0.25/9} 26.Qxb4 {+0.32/10 2} Qxa6 {-0.25/9} 27.Nhf3 {+0.32/9 2} Qb6+ {-0.17/9
1} 28.Qxb6 {+0.35/10 1} Nxb6 {-0.17/8} 29.e5 {+0.27/10 2} Nd7 {-0.17/8 1} 30.Ng5+
{+0.47/9 1} Ke7 {-0.38/10 2} 31.Nxe6 {+0.50/9} Kxe6 {-0.42/11 1} 32.Bb3+ {+0.54/9} Ke7
{-0.42/10} 33.Nf3 {+0.46/10} Nxe5 {-0.35/11 1} 34.Nxe5 {+0.50/11} fxe5 {-0.35/10} 35.Rf7+
{+0.57/12 1} Ke8 {-0.35/10} 36.Rb7 {+0.50/12} Kf8 {-0.35/9} 37.Kf2 {+0.52/13 1} Ne7
{-0.44/10} 38.Kf3 {+0.56/13 1} h5 {-0.47/11 2} 39.Ke4 {+0.54/12 1} Rh6 {-0.45/11} 40.Rb6
{+0.54/10 1} Kg7 {-0.41/11} 41.Kxe5 {+0.54/10} g5 {-0.41/11} 42.Rb7 {+0.49/11 1} Kf8
{-0.41/11} 43.Rb5 {+0.44/11 1} Kg7 {-0.38/11 2} 44.Ke4 {+0.44/10} Rg6 {-0.32/10} 45.Rb7
{+0.42/10 1} Kf8 {-0.37/10} 46.Rb8+ {+0.42/10 1} Kg7 {-0.37/8} 47.Rb5 {+0.42/11 1} Kh6
{-0.31/11 1} 48.Rb7 {+0.45/11 1} Rg7 {-0.33/10} 49.Rb6+ {+0.46/11 1} Rg6 {-0.40/13 1}
50.Be6 {+0.45/11 1} g4 {-0.39/14 1} 51.h4 {+0.44/12} Rf6 {-0.38/13 1} 52.Ke5
{+0.45/12} Rf8 {-0.35/13 1} 53.Bf5+ {+0.44/11} Kg7 {-0.35/11} 54.Be4 {+0.45/12} Re8
{-0.36/12} 55.Kf4 {+0.48/12} Rc8 {-0.38/11} 56.g3 {+0.45/12 1} Rc5 {-0.35/13 1} 57.Re6
{+0.43/12} Rc7 {-0.35/13 1} 58.Ke3 {+0.40/12 1} Rd7 {-0.34/11 1} 59.Re5 {+0.41/12} Kh6
{-0.33/12} 60.Rc5 {+0.41/12} Ra7 {-0.33/12 1} 61.Rb5 {+0.40/12 1} Ra3+ {-0.33/12} 62.Bd3
{+0.40/12 1} Ra6 {-0.33/12} 63.Re5 {+0.40/12 1} Ra7 {-0.32/12 1} 64.Rg5 {+0.40/11 1} Ra1
{-0.32/13 1} 65.Be4 {+0.40/13 1} Re1+ {-0.33/14 1} 66.Kd4 {+0.40/13} Rc1 {-0.33/14 1}
67.Rb5 {+0.40/13 1} Rd1+ {-0.33/14 1} 68.Ke5 {+0.40/13} Ng6+ {-0.33/14 1} 69.Kf6
{+0.40/13} Rd6+ {-0.33/14 1} 70.Kf5 {+0.40/14 1} Ra6 {-0.33/14} 71.Rc5 {+0.41/13 1} Ne7+
{-0.33/14} 72.Kf4 {+0.41/13} Rb6 {-0.33/12 1} 73.Rc7 {+0.45/13} Re6 {-0.33/13} 74.Rb7
{+0.41/14 1} Ng6+ {-0.34/14} 75.Ke3 {+0.41/15} Ne7 {-0.34/14} 76.Ra7 {+0.42/15} Nd5+
{-0.34/14} 77.Kd4 {+0.41/13} Ne7 {-0.33/15 1} 78.Rc7 {+0.41/14 1} Kg7 {-0.33/15 1} 79.Rc5
{+0.41/14 1} Kh6 {-0.33/14} 80.Rc1 {+0.40/13} Rb6 {-0.33/14} 81.Rc7 {+0.40/13} Re6
{-0.33/15} 82.Rb7 {+0.40/12 1} Nc6+ {-0.26/12} 83.Kd3 {+0.40/14} Ne7 {-0.30/13} 84.Rb8
{+0.40/14 1} Re5 {-0.23/12} 85.Ke3 {+0.40/11 1} Kg7 {-0.20/12 1} 86.Kf4 {+0.33/12 1} Rc5
{-0.19/12 1} 87.Rd8 {+0.29/12} Ng6+ {-0.20/12} 88.Ke3 {+0.27/12} Ne7 {-0.15/12 1} 89.Bd3
{+0.25/11 1} Kf6 {-0.13/12 1} 90.Kd4 {+0.22/11 1} Ra5 {-0.12/12} 91.Rh8 {+0.21/11} Nf5+
{-0.12/12 1} 92.Bxf5 {+0.21/9} Rxf5 {-0.12/15} 93.Rh6+ {+0.20/14 1} Kg7 {-0.10/15} 94.Ke4
{+0.03/14 1} Rb5 {-0.10/15} 95.Rd6 {+0.03/15 1} Rb3 {0.00/15} 96.Kf4 {+0.03/14} Rb4+
{0.00/16} 97.Ke3 {0.00/15} Rb3+ {0.00/17} 98.Rd3 {0.00/17 1} Rxd3+ {0.00/19} 99.Kxd3
{0.00/26 1} Kf6 {0.00/24} 100.Kd4 {0.00/25} Kf5 {0.00/26 1} {½-½ Arena Adjudication} 1/2-1/2
Example #2:
In the second example at move 4 the number of games played is 2 and winning percentage is 100% for Nb1c3 and should have been played by arena from book yet it was not played, rather the engine analyzed the position and decided to play it after thinking about it.
[Event "Arena Opening Book Tournament"]
[White "Balanced-14"]
[Black "D-grafen-v02__asb"]
[Result "1/2-1/2"]
[ECO "B12"]
[Opening "Caro-Kann"]
[Time "14:35:32"]
[Variation "Maroczy (Fantasy) Variation, 3...e6"]
[TimeControl "60+1"]
[Termination "normal"]
[PlyCount "125"]
[WhiteType "program"]
[BlackType "program"]
1.e4 c6 2.d4 d5 3.f3 e6 4.Nc3 {+0.19/8 4} Nf6 {+0.09/8 7} 5.e5 {+0.23/9 2} Nfd7
{+0.22/9 1} 6.f4 {+0.07/9 1} c5 {+0.15/9 2} 7.Nf3 {+0.30/9 4} Be7 {-0.04/8 2} 8.Be2
{+0.35/9 2} Nc6 {-0.02/9 2} 9.O-O {+0.24/9 3} cxd4 {+0.06/10 2} 10.Nb5 {+0.17/10 1} Qb6
{+0.03/10 3} 11.Nbxd4 {+0.21/10 3} Nc5 {+0.02/10 2} 12.Rb1 {+0.22/10 4} O-O {-0.01/10 6}
13.Nxc6 {+0.22/10 2} Qxc6 {+0.06/10 2} 14.Be3 {+0.22/10 1} h6 {+0.01/10 2} 15.Rc1
{+0.25/10 2} Rd8 {-0.01/10 2} 16.c3 {+0.22/10 3} Ne4 {-0.02/10 2} 17.Nd4 {+0.33/10 2} Qb6
{-0.14/8 1} 18.b4 {+0.28/10 2} a5 {-0.08/8 1} 19.Nf5 {+0.33/10 1} Qc7 {-0.12/10 1}
20.Nxe7+ {+0.33/11 2} Qxe7 {-0.12/9} 21.Qa4 {+0.33/11 2} Qc7 {-0.20/10 5} 22.Qb3
{+0.46/9 4} axb4 {-0.27/9 2} 23.cxb4 {+0.46/7} Qd7 {-0.20/10 4} 24.Rfe1 {+0.39/9 1} Qa4
{-0.16/10 2} 25.Bb6 {+0.35/10 1} Rf8 {-0.34/11 1} 26.Rc2 {+0.36/11 2} Bd7 {-0.22/11 2}
27.Rc7 {+0.39/10 1} Rfc8 {-0.25/11 6} 28.Qxa4 {+0.58/9 1} Bxa4 {-0.25/10} 29.Rxb7
{+0.58/10 1} Rc2 {-0.25/11 5} 30.a3 {+0.58/10} Nc3 {-0.39/10 3} 31.Bd3 {+0.67/9 1} Rd2
{-0.28/10} 32.Bf1 {+0.57/10 1} d4 {-0.37/10 2} 33.Bc5 {+0.57/9 1} Rc8 {-0.37/9 2} 34.g3
{+0.53/10 1} Bc6 {-0.14/9 1} 35.Re7 {+0.30/10 3} Bd5 {-0.30/9 2} 36.Rd7 {+0.30/9 5} Ne4
{0.00/9 1} 37.Rxe4 {0.00/9 3} Bxe4 {0.00/10} 38.Rxd4 {0.00/11} Rxd4 {0.00/12} 39.Bxd4
{0.00/10} Ra8 {+0.20/12 1} 40.Bb2 {-0.28/12 1} Rd8 {+0.34/12} 41.Kf2 {-0.11/12 3} Rd2+
{+0.34/11 1} 42.Ke3 {-0.28/10} Rxb2 {+0.28/11} 43.Kxe4 {-0.28/9} Rb3 {+0.20/11} 44.b5
{0.00/11} Rxa3 {+0.26/12} 45.Bc4 {-0.10/11 1} Ra1 {+0.29/12} 46.Kd4 {-0.21/12 1} Kf8
{+0.27/13 1} 47.b6 {-0.21/13 1} Ke7 {+0.30/13 1} 48.Kc5 {-0.30/12 2} Kd8 {+0.36/12 1}
49.f5 {-0.28/11 1} Kd7 {+0.37/11} 50.fxe6+ {-0.29/11 1} fxe6 {+0.37/9} 51.Bb5+
{-0.29/11 2} Kc8 {+0.49/12 1} 52.h4 {-0.42/12 1} Rc1+ {+0.48/12 1} 53.Kd6 {-0.32/13 1}
Kb7 {+0.22/11 1} 54.Kxe6 {-0.32/11 1} Kxb6 {+0.43/10} 55.Ba4 {-0.17/12 1} Ra1
{+0.48/10 1} 56.Kf7 {0.00/11} Rxa4 {0.00/10} 57.e6 {0.00/9} Ra3 {0.00/12} 58.e7 {0.00/8}
Rf3+ {0.00/15} 59.Kg8 {0.00/15} Re3 {0.00/13} 60.Kf8 {0.00/16} Rf3+ {0.00/17} 61.Kg8
{0.00/19} Re3 {0.00/13} 62.Kf8 {0.00/19} Rf3+ {0.00/19 1} 63.Kg8 {0.00/21} {3-fold
repetition} 1/2-1/2
Example #3:
At move number 4 d4xe5 has a winning % of 29 and probability of 0 therefore this move should not be played yet it was played by Arena from book. At move 5 the winning percentage is 29 and probability is 0 and again the move was played. At move 6 the winning percentage was 27 and probability 0, again this move should not have been played. At move 7 the book winning percentage is 18 and probability is 0 and yet again this move was played from book and should not have. Arena finally gets off book on move 8 having played several moves from book that should not have been played.
[Event "Arena Opening Book Tournament"]
[White "D-corbit-v02__superbook"]
[Black "Balanced-14"]
[Result "1-0"]
[ECO "B07"]
[Opening "Pirc"]
[Time "23:24:07"]
[Variation "3.Nc3 e5 Queen Swap"]
[TimeControl "60+1"]
[Termination "normal"]
[PlyCount "144"]
[WhiteType "program"]
[BlackType "program"]
1.e4 d6 2.d4 Nf6 3.Nc3 e5 4.dxe5 dxe5 5.Qxd8+ Kxd8 6.Bc4 Ke8 7.Nf3 {+0.89/9 4}
Bd6 8.Be3 {+0.86/9 1} h6 {-0.64/8 3} 9.a3 {+0.78/9 4} a6 {-0.43/10 7} 10.O-O-O
{+0.67/9 2} Nc6 {-0.36/10 4} 11.Kb1 {+0.59/9 5} b5 {-0.33/10 3} 12.Ba2 {+0.58/9 1} Kf8
{-0.29/9 1} 13.Nd5 {+0.67/9 5} Ng4 {-0.50/10 2} 14.h3 {+0.66/10 4} Nxe3 {-0.54/10 1}
15.Nxe3 {+0.66/9} Rb8 {-0.48/11 4} 16.Nf5 {+0.65/10 4} Bxf5 {-0.51/11 1} 17.exf5
{+0.65/9} f6 {-0.43/11 9} 18.g4 {+0.67/10 2} Rd8 {-0.42/10 2} 19.c3 {+0.60/9 2} Ke8
{-0.44/10 2} 20.Nd2 {+0.56/9 1} Be7 {-0.38/10 1} 21.Kc2 {+0.58/10 1} h5 {-0.41/10 2}
22.Rdg1 {+0.57/10 2} Na5 {-0.24/9 2} 23.b4 {+0.47/9 2} Nb7 {-0.21/9 2} 24.Ne4 {+0.26/10
9} Nd6 {-0.19/9 1} 25.f3 {+0.29/10 1} Nxe4 {-0.17/9 1} 26.fxe4 {+0.34/12 3} hxg4
{-0.14/10} 27.Rxg4 {+0.33/12 1} Bf8 {-0.20/11 1} 28.Bd5 {+0.33/12 1} Kd7 {-0.22/11 1}
29.Bb7 {+0.33/12 1} Rb8 {-0.21/11 1} 30.Rd1+ {+0.33/11} Ke7 {-0.21/10} 31.Bc6
{+0.37/12 1} Rb6 {-0.23/12 1} 32.Rd7+ {+0.37/12} Ke8 {-0.23/11} 33.Rd6+ {+0.37/13 2} Kf7
{-0.22/13 1} 34.Bd5+ {+0.36/14 4} Ke7 {-0.24/13 1} 35.Rxb6 {+0.36/13} cxb6 {-0.24/12}
36.h4 {+0.43/14 3} Kd6 {-0.30/11 1} 37.Bb7 {+0.43/13} a5 {-0.31/13 1} 38.Bd5
{+0.43/13} Rh7 {-0.31/13 1} 39.Kb3 {+0.43/13 3} Kc7 {-0.39/13 3} 40.Bf7 {+0.49/12 1} Kd8
{-0.39/11 1} 41.h5 {+0.47/12 1} a4+ {-0.38/10 1} 42.Kc2 {+0.55/12} Bd6 {-0.67/12 2}
43.Kd3 {+0.74/12 1} Ke7 {-0.63/12 2} 44.Bd5 {+0.81/11 1} Kd7 {-0.63/13 5} 45.c4
{+0.80/11} Rxh5 {-0.63/13 1} 46.Rxg7+ {+0.74/11} Be7 {-0.62/13 1} 47.Rg3 {+0.68/12 1} Bf8
{-0.56/12 1} 48.cxb5 {+0.68/11} Ke7 {-0.51/13 2} 49.Kc3 {+0.71/12 1} Rh2 {-0.48/13}
50.Rd3 {+0.71/12} Bh6 {-0.55/12} 51.Bc6 {+0.73/11} Bc1 {-0.64/12 3} 52.Rd7+ {+0.69/9}
Kf8 {-0.64/10} 53.Rb7 {+0.78/11 1} Bb2+ {-1.19/10 3} 54.Kd3 {+0.78/10 2} Bxa3
{-0.73/10 1} 55.Rxb6 {+0.88/9} Bxb4 {-0.73/10 2} 56.Rb8+ {+1.02/9} Kg7 {-0.85/10 1} 57.b6
{+1.05/9} Rd2+ {-1.04/10 1} 58.Kc4 {+1.08/9} Bd6 {-1.26/11 1} 59.Rd8 {+1.22/9} Rc2+
{-1.16/9 1} 60.Kd5 {+1.22/7} Be7 {-1.20/10} 61.Rc8 {+1.38/11 1} Rd2+ {-1.20/11} 62.Ke6
{+1.78/12 2} Bc5 {-1.20/10} 63.Rc7+ {+1.91/11 1} Kf8 {-1.58/10 1} 64.Rf7+ {+1.91/9} Kg8
{-1.58/8} 65.Rxf6 {+1.91/9} Bxb6 {-1.60/11 1} 66.Bxa4 {+1.91/10} Bd4 {-1.60/11 1} 67.Rg6+
{+2.49/10 2} Kf8 {-1.84/10 1} 68.f6 {+3.74/9} Rh2 {-2.93/9 1} 69.Rg7 {+4.27/9 1} Rb2
{-2.93/10 1} 70.Rh7 {+4.67/10 2} Kg8 {-4.20/8 1} 71.f7+ {+4.95/10 1} Kxh7 {-4.28/8}
72.f8=Q {+4.95/9} Rb6+ {-4.28/9 1} {Black resigns} 1-0
Example #4:
Here the balanced-14 book says e6xd5 for move number 7 and the settings say number of moves 2, and winning percentage = 100%, and probability = 1600, therefore this move should be played, but instead it came off book and played Nxd5
[Event "Arena Opening Book Tournament"]
[White "Arena Opening Variety Book 1.20"]
[Black "Balanced-14"]
[Result "1/2-1/2"]
[ECO "E12"]
[Opening "Queen's Indian"]
[Time "00:33:17"]
[Variation "Petrosian, 5.Nc3 d5 6.Bg5 Be7"]
[TimeControl "60+1"]
[Termination "normal"]
[PlyCount "116"]
[WhiteType "program"]
[BlackType "program"]
1.d4 Nf6 2.c4 e6 3.Nf3 b6 4.a3 Bb7 5.Nc3 d5 6.Bg5 Be7 7.cxd5 Nxd5 {-0.04/10 6}
8.Qa4+ {+0.37/9 3} Nd7 {+0.03/11 3} 9.Bxe7 {+0.13/9 2} Qxe7 {-0.06/12 5} 10.Rc1
{+0.35/10 8} Nxc3 {-0.06/11 7} 11.Rxc3 {+0.35/11 2} c6 {-0.05/11 4} 12.e3 {+0.30/11 4}
O-O {-0.05/11 5} 13.Ba6 {+0.30/11 4} Bxa6 {-0.05/11 1} 14.Qxa6 {+0.37/7} c5
{-0.06/11 2} 15.O-O {+0.30/9 3} e5 {-0.05/10 1} 16.Qc4 {+0.25/9 8} Rac8 {0.00/10 2}
17.Rfc1 {+0.13/9 2} e4 {+0.07/8 1} 18.Ne1 {+0.16/10 5} Rcb8 {+0.09/8 1} 19.Qb5 {+0.16/8
1} Rfd8 {+0.05/8 2} 20.b4 {+0.03/8 1} cxd4 {+0.17/9 1} 21.exd4 {+0.03/9 1} Qd6
{+0.26/9 1} 22.R3c4 {+0.13/10 4} Qf4 {+0.26/10 2} 23.R1c2 {+0.08/9 2} Nf8 {+0.22/9}
24.a4 {+0.03/10 3} e3 {+0.14/9 3} 25.g3 {+0.08/9 1} exf2+ {+0.41/9 3} 26.Rxf2
{+0.08/8} Qe4 {+0.40/10} 27.Nf3 {+0.08/9} Ne6 {+0.53/10 3} 28.Qe5 {0.00/8} Qxe5 {+0.44/10
1} 29.dxe5 {-0.37/9 1} Rd1+ {+0.53/11 2} 30.Rf1 {-0.25/10 2} Rd3 {+0.54/11} 31.Nh4
{-0.46/9 1} g6 {+0.62/11 1} 32.Ng2 {-0.59/9 1} g5 {+0.62/11 2} 33.Ne1 {-0.46/10 1} Ra3
{+0.61/11 3} 34.b5 {-0.41/10 1} Re3 {+0.68/12 4} 35.Nf3 {-0.53/10 1} Rd8 {+0.63/11 1}
36.h4 {-0.48/10 1} h6 {+0.70/10 1} 37.Kg2 {-0.58/9 2} Rdd3 {+0.70/10 2} 38.hxg5
{-0.58/9 1} Nxg5 {+0.61/10 1} 39.Nxg5 {-0.52/10 1} Rexg3+ {+0.54/9 2} 40.Kh2 {-0.33/10
2} hxg5 {+0.44/9 1} 41.Rc7 {-0.30/9} Rgh3+ {+0.38/10 1} 42.Kg2 {-0.16/10 1} Rdg3+
{+0.38/10 2} 43.Kf2 {-0.16/9} Rgc3 {+0.38/11 1} 44.Rxa7 {0.00/10 1} Rhf3+ {+0.02/10 1}
45.Kg2 {0.00/12} Rfg3+ {0.00/11 1} 46.Kh2 {0.00/12 1} Rgh3+ {0.00/11 1} 47.Kg2
{0.00/12} Rcg3+ {0.00/11} 48.Kf2 {0.00/10} Rgc3 {0.00/12 1} 49.Kg2 {0.00/12} Rcg3+
{0.00/13} 50.Kf2 {0.00/10} Rga3 {0.00/11 1} 51.Kg2 {0.00/11} Rhg3+ {+0.08/10} 52.Kh2
{0.00/11} Rge3 {+0.03/10} 53.Rfxf7 {0.00/11 1} Ra2+ {0.00/10} 54.Kg1 {0.00/9} Re1+
{0.00/12} 55.Rf1 {0.00/9} Ree2 {0.00/13} 56.Rff7 {0.00/13 1} Re1+ {0.00/14} 57.Rf1
{0.00/9} Ree2 {0.00/15} 58.Rff7 {0.00/14} Re1+ {0.00/15} {3-fold repetition} 1/2-1/2
Example #5:
Here the balanced-14 book says at move number 2 that Nb1c3 should not be played (winning % = 37 and probability is 0) and yet the move is played from book. On move 3 the book says Ng1f3 (winning % = 16 and probability is 0) should not be played and again it is played from book. On move 4 h2h3 (winning % = 16 and probability is 0) again this move should not be played and it is still played from book. The next move, on move number 5 Qd1xf3 (winning % = 16 and probability is 0) is played and yet again this move should not be played from book. Finally, arena gets off book on move 6 but it should have been off book on move 2.
[Event "Arena Opening Book Tournament"]
[White "Balanced-14"]
[Black "My book 15"]
[Result "0-1"]
[ECO "B11"]
[Opening "Caro-Kann"]
[Time "13:39:38"]
[Variation "Two Knights, 3...Bg4 4.h3 Bxf3 5.Qxf3 Nf6"]
[TimeControl "60+1"]
[Termination "normal"]
[PlyCount "131"]
[WhiteType "program"]
[BlackType "program"]
1.e4 c6 2.Nc3 d5 3.Nf3 Bg4 4.h3 Bxf3 5.Qxf3 Nf6 6.Be2 {+0.42/9 8} e6 {-0.09/9 3}
7.e5 {+0.39/9 2} Nfd7 {-0.09/7} 8.Qg3 {+0.30/10 5} c5 {0.00/10 4} 9.b3 {+0.23/9 2}
Nc6 {+0.19/9 2} 10.f4 {-0.01/10 8} Nd4 {+0.24/10 2} 11.O-O {-0.06/10 2} Nxc2
{+0.41/10 5} 12.Rb1 {-0.14/10 1} Nd4 {+0.49/10 5} 13.Bd3 {-0.23/10 4} Qa5 {+0.55/10 4}
14.Ne2 {-0.28/9 8} Nxe2+ {+0.60/10 3} 15.Bxe2 {-0.25/7} g6 {+0.61/11 5} 16.a3 {-0.32/9
1} Be7 {+0.57/9 2} 17.Qd3 {-0.38/9 2} O-O {+0.73/9 1} 18.Bb2 {-0.45/10 3} Nb6
{+0.60/8 1} 19.Qe3 {-0.39/9 1} d4 {+0.67/9 2} 20.Qd3 {-0.43/10} Nd5 {+0.60/10 1} 21.g3
{-0.41/10 1} Rfd8 {+0.64/10 3} 22.Bf3 {-0.42/8 1} Rac8 {+0.66/10 1} 23.Be4 {-0.42/9 1} b5
{+0.69/9 3} 24.Rfc1 {-0.52/8 3} c4 {+1.24/8 1} 25.bxc4 {-1.18/8 2} bxc4 {+1.25/10 2}
26.Rxc4 {-1.19/9} Rxc4 {+1.25/9} 27.Qxc4 {-1.19/8} Qxd2 {+1.25/9} 28.Qd3 {-1.18/10 2}
Qxd3 {+1.21/10 1} 29.Bxd3 {-1.18/9} Nc3 {+1.21/11} 30.Rc1 {-1.14/11 1} Na4 {+1.29/11
1} 31.Rb1 {-1.24/12 2} Nxb2 {+1.28/11 1} 32.Rxb2 {-1.24/10} Bxa3 {+1.36/12 2}
33.Ra2 {-1.23/12 1} Bc5 {+1.40/12 1} 34.Kf2 {-1.20/12 1} Rb8 {+1.37/12 2} 35.Rc2
{-1.17/11 1} Bb4 {+1.33/12 1} 36.Rc6 {-1.31/11 2} a5 {+1.41/10 1} 37.Bc2 {-1.56/11 3} Bc3
{+1.67/10 2} 38.Kf3 {-1.49/10 1} Rb2 {+1.60/10 1} 39.Ba4 {-1.55/10} Rb1 {+1.60/10 2}
40.Rc8+ {-1.45/8 1} Kg7 {+1.60/8} 41.Be8 {-1.41/9} Be1 {+1.43/9 3} 42.Rc7 {-1.49/10 2}
d3 {+2.14/8 1} 43.Rxf7+ {-1.90/10 1} Kg8 {+2.14/7} 44.Re7 {-1.90/10} d2 {+2.14/9}
45.Ba4 {-2.06/11 1} Ra1 {+1.99/10 1} 46.Bc2 {-2.06/11 1} d1=Q+ {+1.99/10} 47.Bxd1
{-2.06/10} Rxd1 {+2.03/12 2} 48.Rxe6 {-1.90/12 1} Bb4 {+2.12/12 2} 49.Re8+ {-2.07/11 1}
Kf7 {+2.10/12 3} 50.Rh8 {-1.99/11} Kg7 {+2.30/11 1} 51.Ra8 {-1.99/11} Rd3+
{+2.12/11} 52.Kf2 {-2.00/11} Kf7 {+2.52/11 3} 53.Ra6 {-2.00/10 1} Rb3 {+2.46/11 1} 54.h4
{-2.36/8 1} Bc5+ {+2.60/9} 55.Kg2 {-2.42/10 1} Bb6 {+2.86/10 1} 56.h5 {-2.75/10 1} gxh5
{+2.90/11} 57.Kh3 {-2.75/10 1} Kg6 {+3.26/11 1} 58.Ra8 {-2.72/10 1} Bf2 {+3.20/11} 59.f5+
{-2.72/10 1} Kg5 {+3.20/11 1} 60.Rg8+ {-2.90/11 1} Kh6 {+3.60/11 2} 61.e6 {-3.52/8} Bxg3
{+4.05/10} 62.Kg2 {-3.80/9 1} h4 {+4.18/10 1} 63.f6 {-3.99/10 1} h3+ {+4.32/11 1} 64.Kxh3
{-4.04/11} Be5+ {+4.40/12 1} 65.Kg4 {-4.04/11 1} Rg3+ {+7.60/11 1} 66.Kf5 {-4.04/8}
{White resigns} 0-1
Has anybody else examined some of their games to see if they can find errors as well. I hope Arena 2.x does not make the same mistakes. Then what is the point of making Arena books if they are not even played correctly by Arena.
Here are the default settings for Mike Scheidl's Balanced-14 book:
Minimal Number Of Games: 2
Minimal Number Of Wins: 0
White Win Percentage: 50
Black Win Percentage: 33
Priority Slider Bar = 5
Number Of Games Slider Bar = 9
Win Percentage Slider Bar = 2
View the following games in Arena with Balanced-14 as the Main Book so you can see the book settings and move selection.
Example #1:
In the first example at move number 4 the number of games played becomes 1 and therefore the book should stop but it continues on to move number 7.
[Event "Arena Opening Book Tournament"]
[White "Balanced-14"]
[Black "Thinker Book"]
[Result "1/2-1/2"]
[ECO "D20"]
[Opening "QGA"]
[Time "20:50:36"]
[Variation "3.e4"]
[TimeControl "60+1"]
[Termination "normal"]
[PlyCount "200"]
[WhiteType "program"]
[BlackType "program"]
1.d4 d5 2.c4 dxc4 3.e4 b5 {+0.16/8 5} 4.a4 c6 {-0.06/7 2} 5.b3 e5 {+0.63/7 2}
6.axb5 cxb5 {+0.33/7 2} 7.bxc4 Bb4+ {+0.54/8 4} 8.Bd2 {-0.27/10 3} Qxd4 {+0.55/10 2}
9.Bxb4 {-0.27/9} Qxa1 {+0.64/11 9} 10.cxb5 {-0.27/10 2} Be6 {+0.69/10 5} 11.Nf3
{-0.36/9 3} Nd7 {+0.69/11 2} 12.Be2 {-0.64/9 2} Rc8 {+0.90/9 1} 13.O-O {-0.77/9 1} Qb2
{+0.97/10 2} 14.Bd6 {-0.28/10 11} f6 {+0.60/9 6} 15.Ba3 {-0.03/9} Qc2 {+0.60/9 7} 16.Qd6
{+0.06/11 10} Kf7 {+0.14/8 1} 17.Nbd2 {+0.06/11 4} Qa2 {+0.05/8 1} 18.Nh4 {+0.02/11 10}
g6 {0.00/9 2} 19.h3 {+0.02/11 7} Rc2 {+0.05/8 1} 20.Bb4 {+0.22/10 5} Kg7 {-0.13/8
2} 21.Bg4 {+0.73/9 1} Kf7 {-0.31/9 2} 22.Bd1 {+0.62/8 1} Rb2 {-0.22/10 3} 23.f4
{+0.35/9 2} exf4 {-0.22/10 1} 24.Rxf4 {+0.35/9 2} a5 {-0.25/10 2} 25.bxa6 {+0.39/9 1}
Rxb4 {-0.25/9} 26.Qxb4 {+0.32/10 2} Qxa6 {-0.25/9} 27.Nhf3 {+0.32/9 2} Qb6+ {-0.17/9
1} 28.Qxb6 {+0.35/10 1} Nxb6 {-0.17/8} 29.e5 {+0.27/10 2} Nd7 {-0.17/8 1} 30.Ng5+
{+0.47/9 1} Ke7 {-0.38/10 2} 31.Nxe6 {+0.50/9} Kxe6 {-0.42/11 1} 32.Bb3+ {+0.54/9} Ke7
{-0.42/10} 33.Nf3 {+0.46/10} Nxe5 {-0.35/11 1} 34.Nxe5 {+0.50/11} fxe5 {-0.35/10} 35.Rf7+
{+0.57/12 1} Ke8 {-0.35/10} 36.Rb7 {+0.50/12} Kf8 {-0.35/9} 37.Kf2 {+0.52/13 1} Ne7
{-0.44/10} 38.Kf3 {+0.56/13 1} h5 {-0.47/11 2} 39.Ke4 {+0.54/12 1} Rh6 {-0.45/11} 40.Rb6
{+0.54/10 1} Kg7 {-0.41/11} 41.Kxe5 {+0.54/10} g5 {-0.41/11} 42.Rb7 {+0.49/11 1} Kf8
{-0.41/11} 43.Rb5 {+0.44/11 1} Kg7 {-0.38/11 2} 44.Ke4 {+0.44/10} Rg6 {-0.32/10} 45.Rb7
{+0.42/10 1} Kf8 {-0.37/10} 46.Rb8+ {+0.42/10 1} Kg7 {-0.37/8} 47.Rb5 {+0.42/11 1} Kh6
{-0.31/11 1} 48.Rb7 {+0.45/11 1} Rg7 {-0.33/10} 49.Rb6+ {+0.46/11 1} Rg6 {-0.40/13 1}
50.Be6 {+0.45/11 1} g4 {-0.39/14 1} 51.h4 {+0.44/12} Rf6 {-0.38/13 1} 52.Ke5
{+0.45/12} Rf8 {-0.35/13 1} 53.Bf5+ {+0.44/11} Kg7 {-0.35/11} 54.Be4 {+0.45/12} Re8
{-0.36/12} 55.Kf4 {+0.48/12} Rc8 {-0.38/11} 56.g3 {+0.45/12 1} Rc5 {-0.35/13 1} 57.Re6
{+0.43/12} Rc7 {-0.35/13 1} 58.Ke3 {+0.40/12 1} Rd7 {-0.34/11 1} 59.Re5 {+0.41/12} Kh6
{-0.33/12} 60.Rc5 {+0.41/12} Ra7 {-0.33/12 1} 61.Rb5 {+0.40/12 1} Ra3+ {-0.33/12} 62.Bd3
{+0.40/12 1} Ra6 {-0.33/12} 63.Re5 {+0.40/12 1} Ra7 {-0.32/12 1} 64.Rg5 {+0.40/11 1} Ra1
{-0.32/13 1} 65.Be4 {+0.40/13 1} Re1+ {-0.33/14 1} 66.Kd4 {+0.40/13} Rc1 {-0.33/14 1}
67.Rb5 {+0.40/13 1} Rd1+ {-0.33/14 1} 68.Ke5 {+0.40/13} Ng6+ {-0.33/14 1} 69.Kf6
{+0.40/13} Rd6+ {-0.33/14 1} 70.Kf5 {+0.40/14 1} Ra6 {-0.33/14} 71.Rc5 {+0.41/13 1} Ne7+
{-0.33/14} 72.Kf4 {+0.41/13} Rb6 {-0.33/12 1} 73.Rc7 {+0.45/13} Re6 {-0.33/13} 74.Rb7
{+0.41/14 1} Ng6+ {-0.34/14} 75.Ke3 {+0.41/15} Ne7 {-0.34/14} 76.Ra7 {+0.42/15} Nd5+
{-0.34/14} 77.Kd4 {+0.41/13} Ne7 {-0.33/15 1} 78.Rc7 {+0.41/14 1} Kg7 {-0.33/15 1} 79.Rc5
{+0.41/14 1} Kh6 {-0.33/14} 80.Rc1 {+0.40/13} Rb6 {-0.33/14} 81.Rc7 {+0.40/13} Re6
{-0.33/15} 82.Rb7 {+0.40/12 1} Nc6+ {-0.26/12} 83.Kd3 {+0.40/14} Ne7 {-0.30/13} 84.Rb8
{+0.40/14 1} Re5 {-0.23/12} 85.Ke3 {+0.40/11 1} Kg7 {-0.20/12 1} 86.Kf4 {+0.33/12 1} Rc5
{-0.19/12 1} 87.Rd8 {+0.29/12} Ng6+ {-0.20/12} 88.Ke3 {+0.27/12} Ne7 {-0.15/12 1} 89.Bd3
{+0.25/11 1} Kf6 {-0.13/12 1} 90.Kd4 {+0.22/11 1} Ra5 {-0.12/12} 91.Rh8 {+0.21/11} Nf5+
{-0.12/12 1} 92.Bxf5 {+0.21/9} Rxf5 {-0.12/15} 93.Rh6+ {+0.20/14 1} Kg7 {-0.10/15} 94.Ke4
{+0.03/14 1} Rb5 {-0.10/15} 95.Rd6 {+0.03/15 1} Rb3 {0.00/15} 96.Kf4 {+0.03/14} Rb4+
{0.00/16} 97.Ke3 {0.00/15} Rb3+ {0.00/17} 98.Rd3 {0.00/17 1} Rxd3+ {0.00/19} 99.Kxd3
{0.00/26 1} Kf6 {0.00/24} 100.Kd4 {0.00/25} Kf5 {0.00/26 1} {½-½ Arena Adjudication} 1/2-1/2
Example #2:
In the second example at move 4 the number of games played is 2 and winning percentage is 100% for Nb1c3 and should have been played by arena from book yet it was not played, rather the engine analyzed the position and decided to play it after thinking about it.
[Event "Arena Opening Book Tournament"]
[White "Balanced-14"]
[Black "D-grafen-v02__asb"]
[Result "1/2-1/2"]
[ECO "B12"]
[Opening "Caro-Kann"]
[Time "14:35:32"]
[Variation "Maroczy (Fantasy) Variation, 3...e6"]
[TimeControl "60+1"]
[Termination "normal"]
[PlyCount "125"]
[WhiteType "program"]
[BlackType "program"]
1.e4 c6 2.d4 d5 3.f3 e6 4.Nc3 {+0.19/8 4} Nf6 {+0.09/8 7} 5.e5 {+0.23/9 2} Nfd7
{+0.22/9 1} 6.f4 {+0.07/9 1} c5 {+0.15/9 2} 7.Nf3 {+0.30/9 4} Be7 {-0.04/8 2} 8.Be2
{+0.35/9 2} Nc6 {-0.02/9 2} 9.O-O {+0.24/9 3} cxd4 {+0.06/10 2} 10.Nb5 {+0.17/10 1} Qb6
{+0.03/10 3} 11.Nbxd4 {+0.21/10 3} Nc5 {+0.02/10 2} 12.Rb1 {+0.22/10 4} O-O {-0.01/10 6}
13.Nxc6 {+0.22/10 2} Qxc6 {+0.06/10 2} 14.Be3 {+0.22/10 1} h6 {+0.01/10 2} 15.Rc1
{+0.25/10 2} Rd8 {-0.01/10 2} 16.c3 {+0.22/10 3} Ne4 {-0.02/10 2} 17.Nd4 {+0.33/10 2} Qb6
{-0.14/8 1} 18.b4 {+0.28/10 2} a5 {-0.08/8 1} 19.Nf5 {+0.33/10 1} Qc7 {-0.12/10 1}
20.Nxe7+ {+0.33/11 2} Qxe7 {-0.12/9} 21.Qa4 {+0.33/11 2} Qc7 {-0.20/10 5} 22.Qb3
{+0.46/9 4} axb4 {-0.27/9 2} 23.cxb4 {+0.46/7} Qd7 {-0.20/10 4} 24.Rfe1 {+0.39/9 1} Qa4
{-0.16/10 2} 25.Bb6 {+0.35/10 1} Rf8 {-0.34/11 1} 26.Rc2 {+0.36/11 2} Bd7 {-0.22/11 2}
27.Rc7 {+0.39/10 1} Rfc8 {-0.25/11 6} 28.Qxa4 {+0.58/9 1} Bxa4 {-0.25/10} 29.Rxb7
{+0.58/10 1} Rc2 {-0.25/11 5} 30.a3 {+0.58/10} Nc3 {-0.39/10 3} 31.Bd3 {+0.67/9 1} Rd2
{-0.28/10} 32.Bf1 {+0.57/10 1} d4 {-0.37/10 2} 33.Bc5 {+0.57/9 1} Rc8 {-0.37/9 2} 34.g3
{+0.53/10 1} Bc6 {-0.14/9 1} 35.Re7 {+0.30/10 3} Bd5 {-0.30/9 2} 36.Rd7 {+0.30/9 5} Ne4
{0.00/9 1} 37.Rxe4 {0.00/9 3} Bxe4 {0.00/10} 38.Rxd4 {0.00/11} Rxd4 {0.00/12} 39.Bxd4
{0.00/10} Ra8 {+0.20/12 1} 40.Bb2 {-0.28/12 1} Rd8 {+0.34/12} 41.Kf2 {-0.11/12 3} Rd2+
{+0.34/11 1} 42.Ke3 {-0.28/10} Rxb2 {+0.28/11} 43.Kxe4 {-0.28/9} Rb3 {+0.20/11} 44.b5
{0.00/11} Rxa3 {+0.26/12} 45.Bc4 {-0.10/11 1} Ra1 {+0.29/12} 46.Kd4 {-0.21/12 1} Kf8
{+0.27/13 1} 47.b6 {-0.21/13 1} Ke7 {+0.30/13 1} 48.Kc5 {-0.30/12 2} Kd8 {+0.36/12 1}
49.f5 {-0.28/11 1} Kd7 {+0.37/11} 50.fxe6+ {-0.29/11 1} fxe6 {+0.37/9} 51.Bb5+
{-0.29/11 2} Kc8 {+0.49/12 1} 52.h4 {-0.42/12 1} Rc1+ {+0.48/12 1} 53.Kd6 {-0.32/13 1}
Kb7 {+0.22/11 1} 54.Kxe6 {-0.32/11 1} Kxb6 {+0.43/10} 55.Ba4 {-0.17/12 1} Ra1
{+0.48/10 1} 56.Kf7 {0.00/11} Rxa4 {0.00/10} 57.e6 {0.00/9} Ra3 {0.00/12} 58.e7 {0.00/8}
Rf3+ {0.00/15} 59.Kg8 {0.00/15} Re3 {0.00/13} 60.Kf8 {0.00/16} Rf3+ {0.00/17} 61.Kg8
{0.00/19} Re3 {0.00/13} 62.Kf8 {0.00/19} Rf3+ {0.00/19 1} 63.Kg8 {0.00/21} {3-fold
repetition} 1/2-1/2
Example #3:
At move number 4 d4xe5 has a winning % of 29 and probability of 0 therefore this move should not be played yet it was played by Arena from book. At move 5 the winning percentage is 29 and probability is 0 and again the move was played. At move 6 the winning percentage was 27 and probability 0, again this move should not have been played. At move 7 the book winning percentage is 18 and probability is 0 and yet again this move was played from book and should not have. Arena finally gets off book on move 8 having played several moves from book that should not have been played.
[Event "Arena Opening Book Tournament"]
[White "D-corbit-v02__superbook"]
[Black "Balanced-14"]
[Result "1-0"]
[ECO "B07"]
[Opening "Pirc"]
[Time "23:24:07"]
[Variation "3.Nc3 e5 Queen Swap"]
[TimeControl "60+1"]
[Termination "normal"]
[PlyCount "144"]
[WhiteType "program"]
[BlackType "program"]
1.e4 d6 2.d4 Nf6 3.Nc3 e5 4.dxe5 dxe5 5.Qxd8+ Kxd8 6.Bc4 Ke8 7.Nf3 {+0.89/9 4}
Bd6 8.Be3 {+0.86/9 1} h6 {-0.64/8 3} 9.a3 {+0.78/9 4} a6 {-0.43/10 7} 10.O-O-O
{+0.67/9 2} Nc6 {-0.36/10 4} 11.Kb1 {+0.59/9 5} b5 {-0.33/10 3} 12.Ba2 {+0.58/9 1} Kf8
{-0.29/9 1} 13.Nd5 {+0.67/9 5} Ng4 {-0.50/10 2} 14.h3 {+0.66/10 4} Nxe3 {-0.54/10 1}
15.Nxe3 {+0.66/9} Rb8 {-0.48/11 4} 16.Nf5 {+0.65/10 4} Bxf5 {-0.51/11 1} 17.exf5
{+0.65/9} f6 {-0.43/11 9} 18.g4 {+0.67/10 2} Rd8 {-0.42/10 2} 19.c3 {+0.60/9 2} Ke8
{-0.44/10 2} 20.Nd2 {+0.56/9 1} Be7 {-0.38/10 1} 21.Kc2 {+0.58/10 1} h5 {-0.41/10 2}
22.Rdg1 {+0.57/10 2} Na5 {-0.24/9 2} 23.b4 {+0.47/9 2} Nb7 {-0.21/9 2} 24.Ne4 {+0.26/10
9} Nd6 {-0.19/9 1} 25.f3 {+0.29/10 1} Nxe4 {-0.17/9 1} 26.fxe4 {+0.34/12 3} hxg4
{-0.14/10} 27.Rxg4 {+0.33/12 1} Bf8 {-0.20/11 1} 28.Bd5 {+0.33/12 1} Kd7 {-0.22/11 1}
29.Bb7 {+0.33/12 1} Rb8 {-0.21/11 1} 30.Rd1+ {+0.33/11} Ke7 {-0.21/10} 31.Bc6
{+0.37/12 1} Rb6 {-0.23/12 1} 32.Rd7+ {+0.37/12} Ke8 {-0.23/11} 33.Rd6+ {+0.37/13 2} Kf7
{-0.22/13 1} 34.Bd5+ {+0.36/14 4} Ke7 {-0.24/13 1} 35.Rxb6 {+0.36/13} cxb6 {-0.24/12}
36.h4 {+0.43/14 3} Kd6 {-0.30/11 1} 37.Bb7 {+0.43/13} a5 {-0.31/13 1} 38.Bd5
{+0.43/13} Rh7 {-0.31/13 1} 39.Kb3 {+0.43/13 3} Kc7 {-0.39/13 3} 40.Bf7 {+0.49/12 1} Kd8
{-0.39/11 1} 41.h5 {+0.47/12 1} a4+ {-0.38/10 1} 42.Kc2 {+0.55/12} Bd6 {-0.67/12 2}
43.Kd3 {+0.74/12 1} Ke7 {-0.63/12 2} 44.Bd5 {+0.81/11 1} Kd7 {-0.63/13 5} 45.c4
{+0.80/11} Rxh5 {-0.63/13 1} 46.Rxg7+ {+0.74/11} Be7 {-0.62/13 1} 47.Rg3 {+0.68/12 1} Bf8
{-0.56/12 1} 48.cxb5 {+0.68/11} Ke7 {-0.51/13 2} 49.Kc3 {+0.71/12 1} Rh2 {-0.48/13}
50.Rd3 {+0.71/12} Bh6 {-0.55/12} 51.Bc6 {+0.73/11} Bc1 {-0.64/12 3} 52.Rd7+ {+0.69/9}
Kf8 {-0.64/10} 53.Rb7 {+0.78/11 1} Bb2+ {-1.19/10 3} 54.Kd3 {+0.78/10 2} Bxa3
{-0.73/10 1} 55.Rxb6 {+0.88/9} Bxb4 {-0.73/10 2} 56.Rb8+ {+1.02/9} Kg7 {-0.85/10 1} 57.b6
{+1.05/9} Rd2+ {-1.04/10 1} 58.Kc4 {+1.08/9} Bd6 {-1.26/11 1} 59.Rd8 {+1.22/9} Rc2+
{-1.16/9 1} 60.Kd5 {+1.22/7} Be7 {-1.20/10} 61.Rc8 {+1.38/11 1} Rd2+ {-1.20/11} 62.Ke6
{+1.78/12 2} Bc5 {-1.20/10} 63.Rc7+ {+1.91/11 1} Kf8 {-1.58/10 1} 64.Rf7+ {+1.91/9} Kg8
{-1.58/8} 65.Rxf6 {+1.91/9} Bxb6 {-1.60/11 1} 66.Bxa4 {+1.91/10} Bd4 {-1.60/11 1} 67.Rg6+
{+2.49/10 2} Kf8 {-1.84/10 1} 68.f6 {+3.74/9} Rh2 {-2.93/9 1} 69.Rg7 {+4.27/9 1} Rb2
{-2.93/10 1} 70.Rh7 {+4.67/10 2} Kg8 {-4.20/8 1} 71.f7+ {+4.95/10 1} Kxh7 {-4.28/8}
72.f8=Q {+4.95/9} Rb6+ {-4.28/9 1} {Black resigns} 1-0
Example #4:
Here the balanced-14 book says e6xd5 for move number 7 and the settings say number of moves 2, and winning percentage = 100%, and probability = 1600, therefore this move should be played, but instead it came off book and played Nxd5
[Event "Arena Opening Book Tournament"]
[White "Arena Opening Variety Book 1.20"]
[Black "Balanced-14"]
[Result "1/2-1/2"]
[ECO "E12"]
[Opening "Queen's Indian"]
[Time "00:33:17"]
[Variation "Petrosian, 5.Nc3 d5 6.Bg5 Be7"]
[TimeControl "60+1"]
[Termination "normal"]
[PlyCount "116"]
[WhiteType "program"]
[BlackType "program"]
1.d4 Nf6 2.c4 e6 3.Nf3 b6 4.a3 Bb7 5.Nc3 d5 6.Bg5 Be7 7.cxd5 Nxd5 {-0.04/10 6}
8.Qa4+ {+0.37/9 3} Nd7 {+0.03/11 3} 9.Bxe7 {+0.13/9 2} Qxe7 {-0.06/12 5} 10.Rc1
{+0.35/10 8} Nxc3 {-0.06/11 7} 11.Rxc3 {+0.35/11 2} c6 {-0.05/11 4} 12.e3 {+0.30/11 4}
O-O {-0.05/11 5} 13.Ba6 {+0.30/11 4} Bxa6 {-0.05/11 1} 14.Qxa6 {+0.37/7} c5
{-0.06/11 2} 15.O-O {+0.30/9 3} e5 {-0.05/10 1} 16.Qc4 {+0.25/9 8} Rac8 {0.00/10 2}
17.Rfc1 {+0.13/9 2} e4 {+0.07/8 1} 18.Ne1 {+0.16/10 5} Rcb8 {+0.09/8 1} 19.Qb5 {+0.16/8
1} Rfd8 {+0.05/8 2} 20.b4 {+0.03/8 1} cxd4 {+0.17/9 1} 21.exd4 {+0.03/9 1} Qd6
{+0.26/9 1} 22.R3c4 {+0.13/10 4} Qf4 {+0.26/10 2} 23.R1c2 {+0.08/9 2} Nf8 {+0.22/9}
24.a4 {+0.03/10 3} e3 {+0.14/9 3} 25.g3 {+0.08/9 1} exf2+ {+0.41/9 3} 26.Rxf2
{+0.08/8} Qe4 {+0.40/10} 27.Nf3 {+0.08/9} Ne6 {+0.53/10 3} 28.Qe5 {0.00/8} Qxe5 {+0.44/10
1} 29.dxe5 {-0.37/9 1} Rd1+ {+0.53/11 2} 30.Rf1 {-0.25/10 2} Rd3 {+0.54/11} 31.Nh4
{-0.46/9 1} g6 {+0.62/11 1} 32.Ng2 {-0.59/9 1} g5 {+0.62/11 2} 33.Ne1 {-0.46/10 1} Ra3
{+0.61/11 3} 34.b5 {-0.41/10 1} Re3 {+0.68/12 4} 35.Nf3 {-0.53/10 1} Rd8 {+0.63/11 1}
36.h4 {-0.48/10 1} h6 {+0.70/10 1} 37.Kg2 {-0.58/9 2} Rdd3 {+0.70/10 2} 38.hxg5
{-0.58/9 1} Nxg5 {+0.61/10 1} 39.Nxg5 {-0.52/10 1} Rexg3+ {+0.54/9 2} 40.Kh2 {-0.33/10
2} hxg5 {+0.44/9 1} 41.Rc7 {-0.30/9} Rgh3+ {+0.38/10 1} 42.Kg2 {-0.16/10 1} Rdg3+
{+0.38/10 2} 43.Kf2 {-0.16/9} Rgc3 {+0.38/11 1} 44.Rxa7 {0.00/10 1} Rhf3+ {+0.02/10 1}
45.Kg2 {0.00/12} Rfg3+ {0.00/11 1} 46.Kh2 {0.00/12 1} Rgh3+ {0.00/11 1} 47.Kg2
{0.00/12} Rcg3+ {0.00/11} 48.Kf2 {0.00/10} Rgc3 {0.00/12 1} 49.Kg2 {0.00/12} Rcg3+
{0.00/13} 50.Kf2 {0.00/10} Rga3 {0.00/11 1} 51.Kg2 {0.00/11} Rhg3+ {+0.08/10} 52.Kh2
{0.00/11} Rge3 {+0.03/10} 53.Rfxf7 {0.00/11 1} Ra2+ {0.00/10} 54.Kg1 {0.00/9} Re1+
{0.00/12} 55.Rf1 {0.00/9} Ree2 {0.00/13} 56.Rff7 {0.00/13 1} Re1+ {0.00/14} 57.Rf1
{0.00/9} Ree2 {0.00/15} 58.Rff7 {0.00/14} Re1+ {0.00/15} {3-fold repetition} 1/2-1/2
Example #5:
Here the balanced-14 book says at move number 2 that Nb1c3 should not be played (winning % = 37 and probability is 0) and yet the move is played from book. On move 3 the book says Ng1f3 (winning % = 16 and probability is 0) should not be played and again it is played from book. On move 4 h2h3 (winning % = 16 and probability is 0) again this move should not be played and it is still played from book. The next move, on move number 5 Qd1xf3 (winning % = 16 and probability is 0) is played and yet again this move should not be played from book. Finally, arena gets off book on move 6 but it should have been off book on move 2.
[Event "Arena Opening Book Tournament"]
[White "Balanced-14"]
[Black "My book 15"]
[Result "0-1"]
[ECO "B11"]
[Opening "Caro-Kann"]
[Time "13:39:38"]
[Variation "Two Knights, 3...Bg4 4.h3 Bxf3 5.Qxf3 Nf6"]
[TimeControl "60+1"]
[Termination "normal"]
[PlyCount "131"]
[WhiteType "program"]
[BlackType "program"]
1.e4 c6 2.Nc3 d5 3.Nf3 Bg4 4.h3 Bxf3 5.Qxf3 Nf6 6.Be2 {+0.42/9 8} e6 {-0.09/9 3}
7.e5 {+0.39/9 2} Nfd7 {-0.09/7} 8.Qg3 {+0.30/10 5} c5 {0.00/10 4} 9.b3 {+0.23/9 2}
Nc6 {+0.19/9 2} 10.f4 {-0.01/10 8} Nd4 {+0.24/10 2} 11.O-O {-0.06/10 2} Nxc2
{+0.41/10 5} 12.Rb1 {-0.14/10 1} Nd4 {+0.49/10 5} 13.Bd3 {-0.23/10 4} Qa5 {+0.55/10 4}
14.Ne2 {-0.28/9 8} Nxe2+ {+0.60/10 3} 15.Bxe2 {-0.25/7} g6 {+0.61/11 5} 16.a3 {-0.32/9
1} Be7 {+0.57/9 2} 17.Qd3 {-0.38/9 2} O-O {+0.73/9 1} 18.Bb2 {-0.45/10 3} Nb6
{+0.60/8 1} 19.Qe3 {-0.39/9 1} d4 {+0.67/9 2} 20.Qd3 {-0.43/10} Nd5 {+0.60/10 1} 21.g3
{-0.41/10 1} Rfd8 {+0.64/10 3} 22.Bf3 {-0.42/8 1} Rac8 {+0.66/10 1} 23.Be4 {-0.42/9 1} b5
{+0.69/9 3} 24.Rfc1 {-0.52/8 3} c4 {+1.24/8 1} 25.bxc4 {-1.18/8 2} bxc4 {+1.25/10 2}
26.Rxc4 {-1.19/9} Rxc4 {+1.25/9} 27.Qxc4 {-1.19/8} Qxd2 {+1.25/9} 28.Qd3 {-1.18/10 2}
Qxd3 {+1.21/10 1} 29.Bxd3 {-1.18/9} Nc3 {+1.21/11} 30.Rc1 {-1.14/11 1} Na4 {+1.29/11
1} 31.Rb1 {-1.24/12 2} Nxb2 {+1.28/11 1} 32.Rxb2 {-1.24/10} Bxa3 {+1.36/12 2}
33.Ra2 {-1.23/12 1} Bc5 {+1.40/12 1} 34.Kf2 {-1.20/12 1} Rb8 {+1.37/12 2} 35.Rc2
{-1.17/11 1} Bb4 {+1.33/12 1} 36.Rc6 {-1.31/11 2} a5 {+1.41/10 1} 37.Bc2 {-1.56/11 3} Bc3
{+1.67/10 2} 38.Kf3 {-1.49/10 1} Rb2 {+1.60/10 1} 39.Ba4 {-1.55/10} Rb1 {+1.60/10 2}
40.Rc8+ {-1.45/8 1} Kg7 {+1.60/8} 41.Be8 {-1.41/9} Be1 {+1.43/9 3} 42.Rc7 {-1.49/10 2}
d3 {+2.14/8 1} 43.Rxf7+ {-1.90/10 1} Kg8 {+2.14/7} 44.Re7 {-1.90/10} d2 {+2.14/9}
45.Ba4 {-2.06/11 1} Ra1 {+1.99/10 1} 46.Bc2 {-2.06/11 1} d1=Q+ {+1.99/10} 47.Bxd1
{-2.06/10} Rxd1 {+2.03/12 2} 48.Rxe6 {-1.90/12 1} Bb4 {+2.12/12 2} 49.Re8+ {-2.07/11 1}
Kf7 {+2.10/12 3} 50.Rh8 {-1.99/11} Kg7 {+2.30/11 1} 51.Ra8 {-1.99/11} Rd3+
{+2.12/11} 52.Kf2 {-2.00/11} Kf7 {+2.52/11 3} 53.Ra6 {-2.00/10 1} Rb3 {+2.46/11 1} 54.h4
{-2.36/8 1} Bc5+ {+2.60/9} 55.Kg2 {-2.42/10 1} Bb6 {+2.86/10 1} 56.h5 {-2.75/10 1} gxh5
{+2.90/11} 57.Kh3 {-2.75/10 1} Kg6 {+3.26/11 1} 58.Ra8 {-2.72/10 1} Bf2 {+3.20/11} 59.f5+
{-2.72/10 1} Kg5 {+3.20/11 1} 60.Rg8+ {-2.90/11 1} Kh6 {+3.60/11 2} 61.e6 {-3.52/8} Bxg3
{+4.05/10} 62.Kg2 {-3.80/9 1} h4 {+4.18/10 1} 63.f6 {-3.99/10 1} h3+ {+4.32/11 1} 64.Kxh3
{-4.04/11} Be5+ {+4.40/12 1} 65.Kg4 {-4.04/11 1} Rg3+ {+7.60/11 1} 66.Kf5 {-4.04/8}
{White resigns} 0-1
Has anybody else examined some of their games to see if they can find errors as well. I hope Arena 2.x does not make the same mistakes. Then what is the point of making Arena books if they are not even played correctly by Arena.
-
David Schumaker
Re: Problems With Arena
Thanks for the information Wael. What really frustrates me though, is that Arena is making many mistakes in selecting the book moves. It selects moves that should not be played. There is really no point in trying to make a strong Arena book if Arena will not even use it correctly. Right now it seems the only way to overcome this problem is to try to build a high quality book with nothing but drawn games so that regardless of what move is made the end position will still be somewhat neutral. Maybe in Arena 2.x these book move selection problems have been fixed. Maybe somebody out there knows.
-
David Schumaker
Re: Problems With Arena
Here is what the Arena help file says regarding book move selectoin:
The problem is that in many instances one of the three conditions mentioned above is not met and yet the move is still played by Arena regardless of what the priority is set to. Arena is, very often, simply selecting the wrong move while it is still in book. I also noticed that Arena will often play a move with 0 priority as well.Under Minimal conditions to play the move you set which conditions must be met to play a move.
· Minimal number of games: In the book there must be so many games with the move at least
· Minimal won games: In the book there must be so many won games with the move at least
· Win percentage white/black: With the move the given percentage of won games must have been reached
If one of these three conditions failes, the move will not be played.