Test suites

[velmarin]

Here are two suites for endgame and middlegame.
Positions very hard, ready for high-performance engines.

http://chessengine.blogspot.it/p/hardte ... imits.html

[Henk]

Actually I want a set of test positions that resemble an average game. So if my engine scores better it means that ELO of my engine has improved. I don't know if such a test set already exists.

[Vinvin]

Actually I want a set of test positions that resemble an average game. So if my engine scores better it means that ELO of my engine has improved. I don't know if such a test set already exists.

https://chessprogramming.wikispaces.com/Test-Positions

[Henk]

Yes but which one represents an average game. I use win at chess. But I think it contains too much tactical or mate in N positions.

It would be a pity if you spent years on tuning your engine to solve a particular test suite but it only made your engine play worse ELO wise.

[Dann Corbit]

Yes but which one represents an average game. I use win at chess. But I think it contains too much tactical or mate in N positions.

It would be a pity if you spent years on tuning your engine to solve a particular test suite but it only made your engine play worse ELO wise.

Most chess positions in real games are quiet positions.

In general, tuning your chess program to a test suite is a good way to start and get a functional evaluation set. But it will not produce results as good as tuning to game play.

It is sort of like linear programming, where you can find a feasible solution, but it won't be an optimal solution by using test sets.

[Dann Corbit]

Rather than finding the best values for evaluation parameters, what test sets are good for is to define features that are missing or incorrectly programmed in your evaluation.

IOW, a test set that looks for open files is good to use to check your open file evaluation.
Same for other features.

[BBauer]

I had a look at position 14 in mid.epd
[d]6k1/2R5/8/4N1Kp/8/7r/8/8 b - -
6k1/2R5/8/4N1Kp/8/7r/8/8 b - - acd 31; acs 16; bm Rg3+; c0 "white pieces=3 black pieces=3"; c1 "material balance: 2,5"; c3 "Rg3+"; c4 "(Adorjan_EofCE3) #1117a draw"; ce -40; id "Holmes Endgame Pos. 0885"; pm Rg3+; pv Rg3+ Kh4 Rg7 Rc1 Rg2 Nf3 Rg4+ Kh3 Kg7 Rc7+ Kf6 Rc6+ Kf5 Nh4+ Kg5 Rc5+ Kf6 Rf5+ Ke6 Ra5 Kf6 Nf3 Rc4 Ra3 Kf5 Ne1 Re4 Nc2 Kg5 Ne3 Re5 Rc3 Ra5 Kg3 Ra4 Rc5+ Kg6 Nd5 Ra3+ Kf4 Ra4+ Kf3;

Better is 1.Kf8 with a score of 0.00
This example shows how erroneous testsets are.
Kind regards
Bernhard

[Dann Corbit]

I had a look at position 14 in mid.epd
[d]6k1/2R5/8/4N1Kp/8/7r/8/8 b - -
6k1/2R5/8/4N1Kp/8/7r/8/8 b - - acd 31; acs 16; bm Rg3+; c0 "white pieces=3 black pieces=3"; c1 "material balance: 2,5"; c3 "Rg3+"; c4 "(Adorjan_EofCE3) #1117a draw"; ce -40; id "Holmes Endgame Pos. 0885"; pm Rg3+; pv Rg3+ Kh4 Rg7 Rc1 Rg2 Nf3 Rg4+ Kh3 Kg7 Rc7+ Kf6 Rc6+ Kf5 Nh4+ Kg5 Rc5+ Kf6 Rf5+ Ke6 Ra5 Kf6 Nf3 Rc4 Ra3 Kf5 Ne1 Re4 Nc2 Kg5 Ne3 Re5 Rc3 Ra5 Kg3 Ra4 Rc5+ Kg6 Nd5 Ra3+ Kf4 Ra4+ Kf3;

Better is 1.Kf8 with a score of 0.00
This example shows how erroneous testsets are.
Kind regards
Bernhard

And even conclusions about erroneous conclusions can be wrong. In this case, both answers were right and both answers were wrong.

Using the latest bleeding edge stockfish with the full 6 man Syzygy tablebase files on SSD, I analyzed the position with MPV 6, and found that there are exactly two legal moves, both of which draw. So your answer was right, my answer was right and your answer was wrong (incomplete) and my answer was wrong (incomplete).

It also shows how far state of the art analysis has come.

FEN: 6k1/2R5/8/4N1Kp/8/7r/8/8 b - - 0 1

Stockfish-mingw:mpv:6:
---------------------------------------------------------------------------
---------------------------------------------------------------------------
---------------------------------------------------------------------------
---------------------------------------------------------------------------
1/2 00:00 167,083 1,687,707 0.00 Kf8
1/2 00:00 167,083 1,687,707 0.00 Rg3+ Kh4
---------------------------------------------------------------------------
.
.
.
.
2/4 00:00 515,167 3,653,666 0.00 Rg3+ Kxh5 Rh3+ Kg4
2/4 00:00 515,167 3,653,666 0.00 Kf8 Ra7
---------------------------------------------------------------------------
.
.
.
.
3/5 00:00 777,844 4,394,598 0.00 Rg3+ Kxh5 Kf8 Ra7
3/5 00:00 777,844 4,394,598 0.00 Kf8 Kf5 Ke8
---------------------------------------------------------------------------
.
.
.
.
4/5 00:00 1,129,340 4,997,079 0.00 Rg3+ Kxh5 Kf8 Ra7 Re3
4/5 00:00 1,129,340 4,997,079 0.00 Kf8 Kf6 Kg8 Kg6
---------------------------------------------------------------------------
.
.
.
.
5/7 00:00 1,237,649 5,114,252 0.00 Rg3+ Kxh5 Rg1 Nc4 Rg7 Rc8+ Kf7
5/7 00:00 1,237,649 5,114,252 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5
---------------------------------------------------------------------------
.
.
.
.
6/7 00:00 1,540,774 5,425,260 0.00 Kf8 Kf6 Kg8 Rc8+ Kh7 Rc1 Rg3
6/7 00:00 1,540,774 5,425,260 0.00 Rg3+ Kxh5 Kf8 Nc4 Rd3 Rc6 Ke8
---------------------------------------------------------------------------
.
.
.
.
7/9 00:00 1,785,276 5,631,785 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rd7 Ke8 Rh7
7/9 00:00 1,785,276 5,631,785 0.00 Rg3+ Kxh5 Kf8 Ng6+ Ke8 Nf4 Rg1 Ra7 Rd1
---------------------------------------------------------------------------
.
.
.
.
8/10 00:00 1,908,006 5,695,540 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rd7 Ke8 Rh7 Kd8
8/10 00:00 1,908,006 5,695,540 0.00 Rg3+ Kh6 Kf8 Ng6+ Ke8 Kxh5 Rg1 Nf4 Re1 Ra7
---------------------------------------------------------------------------
.
.
.
.
9/16 00:00 2,071,313 5,818,294 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rd7 Ke8 Rh7 Kd8 Kg5
9/16 00:00 2,071,313 5,818,294 0.00 Rg3+ Kh6 Kf8 Ng6+ Ke8 Kxh5 Rd3 Re7+ Kd8 Ra7 Rd7 Ra1 Rc7 Nf4 Rc5+ Kg6
---------------------------------------------------------------------------
.
.
.
.
10/16 00:00 2,331,810 5,963,708 0.00 Rg3+ Kxh5 Rg2 Ng4 Rg1 Ne3 Kf8 Nf5 Ra1 Kg4 Rg1+ Kf3
10/16 00:00 2,331,810 5,963,708 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg1 Ra3 Rh1 Ra6+ Kf5 Kg7 Rxh5 Ra5 Rg5+ Kh6 Rg6+ Kh5
---------------------------------------------------------------------------
.
.
.
.
11/17 00:00 2,487,526 6,023,065 0.00 Rg3+ Kxh5 Rg2 Ra7 Rg1 Nf3 Rg7 Ra6 Rh7+ Kg4 Rd7 Ng5 Kf8
11/17 00:00 2,487,526 6,023,065 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg1 Ra3 Rh1 Ra6+ Kf5 Ra5 Rxh5 Ke7 Rh7+ Kd6 Rd7+ Kc5
---------------------------------------------------------------------------
.
.
.
.
12/23 00:00 2,696,514 6,114,544 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Ra7 Kg8 Ra1 Re3 Rh1 Re2 Rxh5 Rf2+ Ke7 Rg2 Kd6 Kg7 Kc5 Rc2+ Kd5
12/23 00:00 2,696,514 6,114,544 0.00 Rg3+ Kxh5 Rg2 Ra7 Rg3 Kh6 Kf8 Ng6+ Ke8 Nf4 Rg4 Nd5 Rg3 Nf6+ Kd8 Rd7+ Kc8 Rd2 Rg1
---------------------------------------------------------------------------
.
.
.
.
13/24 00:00 2,844,082 6,169,375 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Ra7 Kg8 Ra1 Re3 Rh1 Rg3 Rh2 Rg1 Rxh5
13/24 00:00 2,844,082 6,169,375 0.00 Rg3+ Kxh5 Rg2 Ra7 Rg3 Kh6 Kf8 Ng6+ Ke8 Kh5 Rg1 Nf4 Kd8 Ne6+ Kc8 Kh4 Re1 Re7 Rh1+ Kg4
---------------------------------------------------------------------------
.
.
.
.
14/24 00:00 3,237,526 6,335,667 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Ra7 Kg8 Ra1 Re3 Rh1 Re2 Rxh5 Rf2+ Ke7 Rg2 Kd6
14/24 00:00 3,237,526 6,335,667 0.00 Rg3+ Kxh5 Rg2 Ra7 Rg3 Kh6 Kf8 Ng6+ Ke8 Kh5 Kd8 Nf4 Kc8 Kh4 Rg1 Ne6 Re1 Re7
---------------------------------------------------------------------------
.
.
.
.
15/24 00:00 3,671,703 6,487,107 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Ra7 Kg8 Ra1 Re3 Rh1 Rg3 Rh2 Rg1 Rxh5 Rg3 Rh4
15/24 00:00 3,671,703 6,487,107 0.00 Rg3+ Kxh5 Rg1 Ra7 Kf8 Ng6+ Ke8 Nf4 Kd8 Kh4 Ke8 Rc7 Re1 Kg5 Re7 Rc2 Kd7
---------------------------------------------------------------------------
.
.
.
.
16/24 00:00 4,051,941 6,588,521 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Ra7 Kg8 Ra1 Re3 Rh1 Ra3 Rxh5 Ra6+ Ke7 Kg7 Rh2 Ra7+ Ke6 Ra6+ Kf5
16/24 00:00 4,051,941 6,588,521 0.00 Rg3+ Kxh5 Kf8 Ng6+ Ke8 Nf4 Rg1 Ra7 Kf8 Ne6+ Ke8 Nd4 Rd1 Nf5 Rg1 Kh4 Kf8 Nd4 Rd1
---------------------------------------------------------------------------
.
.
.
.
17/30 00:01 7,212,372 7,234,074 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Ra7 Kg8 Ra1 Rb3 Ra8+ Kh7 Ra7+ Kg8 Rg7+ Kf8 Rh7 Rb6+ Kf5 Rb5 Rxh5 Kg7 Rh1
17/30 00:01 7,212,372 7,234,074 0.00 Rg3+ Kxh5 Kf8 Ng6+ Ke8 Nf4 Rg1 Ra7 Kf8 Kh4 Ke8 Rc7 Re1 Kg5 Re7 Rc2 Kd7 Kf5 Rf7+ Ke5
---------------------------------------------------------------------------
.
.
.
.
18/36 00:01 10,229,572 7,445,103 0.00 Rg3+ Kxh5 Kf8 Ng4 Rf3 Kg6 Ke8 Ne5 Kd8 Ra7 Rf1 Rd7+ Kc8 Rh7 Rf8 Kg5 Rf1 Ra7 Kb8 Re7
18/36 00:01 10,229,572 7,445,103 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Ra7 Kg8 Ra1 Rb3 Ra8+ Kh7 Ra7+ Kg8 Rg7+ Kf8 Rh7 Rb6+ Kf5 Rb5 Rxh5 Ke7 Rh6 Rb1 Re6+ Kd8 Rd6+ Kc8 Kf6 Rf1+ Ke7 Rf5 Re6 Kc7
---------------------------------------------------------------------------
.
.
.
.
19/40 00:01 12,581,080 7,556,204 0.00 Rg3+ Kxh5 Kf8 Ng4 Rf3 Kg6 Ke8 Ra7 Rf1 Nf6+ Kd8 Kg5 Rf2 Rd7+ Kc8 Rh7 Rf1 Nd5 Kd8 Ne3 Rf3 Nf5 Rf1 Rh8+ Kd7
19/40 00:01 12,581,080 7,556,204 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Ra7 Kg8 Ra1 Rb3 Ra8+ Kh7 Ra7+ Kg8 Kg6 Kf8 Nd7+ Ke8 Nf6+ Kd8 Kxh5 Rb4 Kg6 Rb5 Ne4 Re5 Ng5 Kc8 Ra1 Re2 Kf5 Rf2+ Ke4
---------------------------------------------------------------------------
.
.
.
.
20/40 00:01 13,534,431 7,586,564 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Ra7 Rf3 Nf6 Rf2 Rh7 Rf1 Nd5 Ke8 Nf4 Re1 Kf6 Rf1 Kf5 Kd8
20/40 00:01 13,534,431 7,586,564 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Ra7 Kg8 Ra1 Rb3 Ra8+ Kh7 Ra7+ Kg8 Kg6 Kf8 Nd7+ Ke8 Nf6+ Kd8 Nxh5 Kc8 Nf4 Rb7 Ra1 Kc7 Kf5 Kc6 Ke6 Rb5 Rc1+ Rc5 Rd1 Kc7 Rd7+ Kc6
---------------------------------------------------------------------------
.
.
.
.
21/40 00:04 34,596,747 7,816,707 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Ra7 Rf3 Rh7 Kc8 Kg6 Kd8 Nf6 Rf1 Kg5 Rf2 Ra7 Rf3 Ng4 Kc8 Rh7
21/40 00:04 34,596,747 7,816,707 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Ra7 Kg8 Ra1 Rb3 Ra8+ Kh7 Ra7+ Kg8 Kg6 Kf8 Nd7+ Ke8 Nf6+ Kd8 Nxh5 Kc8 Nf4 Rb7 Ra1 Kd7 Kf6 Rb6+ Ke5 Rb8 Kd5 Rb5+ Kc4 Rg5 Ra6 Ke7
---------------------------------------------------------------------------
.
.
.
.
22/40 00:04 37,396,304 7,861,321 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 Ra3 Rxh5 Ra6+ Kf5 Kg7 Rh1 Rf6+ Kg5 Re6 Re1 Re8 Kf5 Rf8+ Ke6 Kh6 Rh1+ Kg5 Rg1+ Kh5 Nd7 Ra8 Ne5 Ra5
22/40 00:04 37,396,304 7,861,321 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Ra7 Rf3 Rh7 Kc8 Kg6 Kd8 Nf6 Rf1 Kg5 Rf2 Ra7 Rf3 Ng4 Kc8 Rh7 Kd8
---------------------------------------------------------------------------
.
.
.
.
23/40 00:04 38,071,383 7,862,739 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 Ra3 Rxh5 Ra6+ Kf5 Kg7 Rh1 Rf6+ Kg5 Re6 Ng4 Ra6 Kf5 Ra7 Ne5 Ra5 Rc1 Ra6 Rc7+ Kf8 Rb7 Kg8
23/40 00:04 38,071,383 7,862,739 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Ra7 Rf3 Rh7 Kc8 Kg6 Kd8 Nf6 Rf1 Kg5 Rf2 Ra7 Rf3 Nd5 Rd3 Nf4 Rd1 Rh7
---------------------------------------------------------------------------
.
.
.
.
24/40 00:05 39,550,187 7,869,117 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 Ra3 Rxh5 Ra6+ Kf5 Kg7 Rh1 Rf6+ Kg5 Re6 Ng4 Ra6 Kf5 Ra7 Ne5 Ra5 Rc1 Ra6 Rc7+ Kf8 Rb7 Kg8 Ke4
24/40 00:05 39,550,187 7,869,117 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Ra7 Rf3 Rh7 Ke8 Kg6 Kd8 Nf6 Rf1 Kg5 Rf2 Ra7 Rf3 Kg6 Rf1 Rh7 Kc8 Kg5 Rf2
---------------------------------------------------------------------------
.
.
.
.
25/40 00:05 43,392,971 7,915,536 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 Ra3 Rxh5 Ra6+ Kf5 Kg7 Rh1 Rf6+ Kg5 Re6 Ng4 Rg6+ Kf5 Ra6 Rd1 Ra5+ Ne5 Ra6 Rd7+ Kg8 Rc7 Kf8 Rb7 Kg8 Nd7 Ra1
25/40 00:05 43,392,971 7,915,536 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Ra7 Rf3 Rh7 Ke8 Kg6 Kd8 Nf6 Rf1 Kg5 Rf2 Ra7 Rf3 Kg6 Rf1 Rh7 Rf3 Nd5 Rf1 Ne3
---------------------------------------------------------------------------
.
.
.
.
26/40 00:08 65,882,945 8,115,662 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 Ra3 Rxh5 Ra6+ Kf5 Kg7 Rh1 Rf6+ Kg5 Re6 Ng4 Rg6+ Kf5 Ra6 Rd1 Ra5+ Ne5 Ra6 Rd7+ Kg8 Rc7 Kf8 Rb7 Kg8 Rb8+ Kh7 Kg5 Ra5 Rb7+ Kg8
26/40 00:08 65,882,945 8,115,662 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Ra7 Rf3 Rh7 Ke8 Ne5 Rf2 Ra7 Rf1 Ng6 Kd8 Rh7 Kc8 Ne5 Rf2 Kg4 Kd8 Ng6 Kc8 Nf4 Rb2
---------------------------------------------------------------------------
.
.
.
.
27/40 00:10 88,334,475 8,192,012 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 Ra3 Rxh5 Ra6+ Kf5 Kg7 Rh1 Rf6+ Ke4 Re6 Rf1 Re8 Rf7+ Kg8 Ra7 Rf8 Kd5 Rd8+ Ke6 Rd1 Rb7 Re1 Kd6 Kf8 Rf7+ Kg8 Ra7 Rf1 Kd5
27/40 00:10 88,334,475 8,192,012 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Ra7 Rf3 Rh7 Rf1 Ne5 Kc8 Ra7 Rb1 Nc4 Kb8 Rd7 Rb7 Rd1 Rb5+ Kf6 Kc7 Ne5 Rb6+ Ke7 Rh6 Ng4 Rh3 Ke6 Kb6 Rb1+ Kc6 Ne5+ Kc7
---------------------------------------------------------------------------
.
.
.
.
28/40 00:12 104,722,967 8,249,150 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 Ra3 Rxh5 Ra6+ Kf5 Kg7 Rh1 Rf6+ Ke4 Re6 Rf1 Re8 Rf7+ Kg8 Ra7 Rf8 Kd5 Rd8+ Ke6 Rd1 Rb7 Re1 Kf5 Kf8 Ng6+ Kg8 Ra7 Rf1+ Nf4 Kf8
28/40 00:12 104,722,967 8,249,150 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Ra7 Rf3 Rh7 Rf1 Ne5 Kc8 Ra7 Rb1 Nc4 Kb8 Rh7 Rb7 Rh1 Rb4 Ne3 Kb7 Kf5 Kc6 Ke5 Rb5+ Kd4 Kd7 Rh7+ Ke6
---------------------------------------------------------------------------
.
.
.
.
29/46 00:43 372,650,879 8,530,993 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 Rb3 Rxh5 Rb6+ Kf5 Ke7 Rh7+ Kd8 Ke4 Rb4+ Kd5 Rb1 Nd3 Rd1 Ke4 Ke8 Ne5 Re1+ Kd5 Kd8 Ke6 Kc8 Rg7 Kd8 Rd7+ Kc8 Ra7 Kb8 Rg7 Kc8
29/46 00:43 372,650,879 8,530,993 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Rh7 Rc3 Nf6 Rf3 Ra7 Rf2 Nd5 Kc8 Rh7 Rd2 Nb6+ Kd8 Kf5 Rd6 Nc4 Rc6 Ne5 Rc7 Rh1 Ke7 Rd1 Rc8 Rd7+ Ke8 Ra7
---------------------------------------------------------------------------
.
.
.
.
30/49 00:57 495,002,727 8,624,492 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 Rb3 Rxh5 Rb6+ Kf5 Ke8 Rh8+ Ke7 Rh7+ Kd8 Ke4 Rb4+ Kd5 Rb1 Nc6+ Kc8 Ke6 Re1+ Ne5 Kd8 Rf7 Rd1 Re7 Re1 Rh7 Kc8 Kd5 Rd1+ Kc4 Rc1+ Kd4 Rd1+ Nd3 Kd8 Ke4 Ke8 Ne5
30/49 00:57 495,002,727 8,624,492 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Rh7 Rc3 Nf6 Rf3 Kg6 Rf2 Ne4 Rf1 Nc5 Ke8 Ra7 Rf3 Nd7 Rf1 Ne5 Kd8 Rd7+ Kc8 Rh7 Rf8 Kg5 Rf2 Nd3 Rd2 Nf4
---------------------------------------------------------------------------
.
.
.
.
31/52 01:57 1,016,764,916 8,620,158 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 h4 Rg4 Rh1 Ke6 Re1 Rxh4 Kg7 Rg4+ Kh6 Rg8 Kh5 Kf5 Rf1+ Ke4 Re1+ Kd5 Rc1 Rg6 Rd1+ Ke6 Re1 Rg8 Kh4 Kd6 Rd1+ Kc5 Rc1+ Kb4 Kh5 Nf3 Rb1+ Kc5 Rc1+ Kd5 Ra1 Rg5+ Kh6
31/52 01:57 1,016,764,916 8,620,158 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Rh7 Rc3 Nf6 Rf3 Kg6 Rf2 Ne4 Rf1 Nc5 Ke8 Ra7 Rf3 Nd7 Rf1 Ne5 Kd8 Rd7+ Kc8 Rh7 Rf2 Nc4 Kd8 Ne3 Kc8 Nd5 Kd8 Rh8+ Kd7
---------------------------------------------------------------------------
.
.
.
.
32/52 02:05 1,081,680,137 8,597,181 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 h4 Rg4 Rh1 Ke6 Re1 Rxh4 Kg7 Rg4+ Kh6 Rg8 Kh5 Kf5 Rf1+ Ke4 Re1+ Kd5 Rc1 Rg6 Rd1+ Ke6 Re1 Rg7 Kh4 Kd6 Rd1+ Kc5 Kh5 Nf3 Kh6 Rg3 Kh5 Rg2 Rc1+ Kd5 Rd1+ Ke4
32/52 02:05 1,081,680,137 8,597,181 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Rh7 Rc3 Nf6 Rf3 Kg6 Rf2 Ne4 Rf1 Nc5 Ke8 Ra7 Rf3 Ne4 Rf1 Ng5 Kd8 Ne6+ Kc8 Rc7+ Kb8 Rd7 Rf3 Nc5 Kc8 Rh7 Rf1 Ra7 Rg1+ Kf6 Rf1+ Ke6
---------------------------------------------------------------------------
.
.
.
.
33/52 02:15 1,158,454,099 8,568,067 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 h4 Rg4 Rh1 Ke6 Re1 Rxh4 Kg7 Rg4+ Kh6 Rg8 Kh5 Kf5 Rf1+ Ke4 Re1+ Kd5 Rc1 Rg6 Rd1+ Ke6 Re1 Rg7 Kh4 Kf5 Rf1+ Ke4 Re1+ Kf4 Rf1+ Nf3+ Kh5 Rg8 Ra1 Rg3 Rb1 Ne5 Rf1+ Ke4 Ra1 Rh3+ Kg5
33/52 02:15 1,158,454,099 8,568,067 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Rh7 Rc3 Nf6 Rf3 Kg6 Rf2 Ne4 Rf1 Nc5 Ke8 Ra7 Rf3 Ne4 Rf1 Ng5 Kd8 Ne6+ Kc8 Rc7+ Kb8 Rd7 Rf3 Nc5 Kc8 Rh7 Rf1 Ra7 Rg1+ Kf6 Rf1+ Ke6 Re1+ Kf5
---------------------------------------------------------------------------
.
.
.
.
34/52 02:24 1,233,943,663 8,554,142 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 h4 Rg4 Rh1 Ke6 Re1 Rxh4 Kg7 Rg4+ Kh6 Rg8 Kh5 Kf5 Rf1+ Ke4 Re1+ Kd5 Rc1 Rg6 Rd1+ Ke6 Re1 Rg7 Kh4 Kf5 Rf1+ Ke4 Re1+ Kf4 Rf1+ Nf3+ Kh5 Ke4 Kh6 Rg8 Kh7 Rg2 Ra1 Rh2+ Kg6 Ne5+ Kg5 Rg2+ Kh5
34/52 02:24 1,233,943,663 8,554,142 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Rh7 Rc3 Nf6 Rf3 Kg6 Rf2 Ne4 Rf1 Nc5 Ke8 Ra7 Rf3 Ne4 Rf1 Ng5 Kd8 Ne6+ Kc8 Rc7+ Kb8 Rd7 Rf3 Nc5 Kc8 Rh7 Rf1 Ra7 Kb8 Rb7+ Kc8 Rh7 Kd8
---------------------------------------------------------------------------
.
.
.
.
35/52 02:54 1,471,276,075 8,450,510 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 h4 Rg4 Rh1 Ke6 Re1 Rxh4 Kg7 Rg4+ Kh6 Rg8 Kh5 Kf5 Rf1+ Ke4 Re1+ Kd5 Rc1 Rg6 Rd1+ Ke6 Re1 Rg7 Kh4 Kf5 Rf1+ Ke4 Re1+ Kf4 Rf1+ Nf3+ Kh5 Ke4 Kh6 Rg8 Ra1 Rg2 Ra5 Nd4 Kh5 Rg7 Ra4
35/52 02:54 1,471,276,075 8,450,510 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Rh7 Rc3 Nf6 Rf3 Kg6 Rf2 Ne4 Rf1 Nc5 Ke8 Ra7 Rf3 Ne4 Rf1 Ng5 Kd8 Ne6+ Kc8 Rc7+ Kb8 Rd7 Rf3 Kg5 Rf1 Rh7 Kc8 Kg4 Kb8 Nd4 Rd1 Nc6+ Kc8 Na7+ Kb8
---------------------------------------------------------------------------
.
.
.
.
36/52 03:24 1,712,661,595 8,357,300 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 h4 Rg4 Rh1 Ke6 Re1 Rxh4 Kg7 Rg4+ Kh6 Rg8 Kh5 Kf5 Rf1+ Ke4 Re1+ Kd5 Rc1 Rg6 Rd1+ Ke6 Re1 Rg7 Kh4 Kf5 Rf1+ Ke4 Re1+ Kf4 Rf1+ Nf3+ Kh5 Ke4 Ra1 Ne5 Rb1 Kd5 Rd1+ Kc5 Rc1+ Kd4 Rf1 Kc4 Rf4+ Kc5
36/52 03:24 1,712,661,595 8,357,300 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Kd8 Rh7 Rc3 Nf6 Rf3 Kg6 Rf2 Ne4 Rf1 Nc5 Ke8 Ra7 Rf3 Ne4 Rf1 Ng5 Kd8 Ne6+ Kc8 Rc7+ Kb8 Rd7 Rf3 Kg5 Rf1 Rh7 Ra1 Kf4 Ra7 Rh1 Kb7 Ke4 Ra4+ Kd5 Ra5+ Nc5+ Kb6 Rh6+ Kc7
---------------------------------------------------------------------------
.
.
.
.
37/55 11:12 5,209,022,245 7,751,451 0.00 Kf8 Kf6 Kg8 Rg7+ Kf8 Rg5 h4 Rg4 Rh1 Ke6 Re1 Rxh4 Kg7 Rg4+ Kh6 Rg8 Rf1 Ng4+ Kh5 Ne3 Ra1 Kf5 Ra5+ Ke4 Ra4+ Ke5 Ra5+ Nd5 Kh4 Kd4 Kh5 Nf4+ Kh4 Ne6 Ra4+ Kd5 Ra1 Nd4 Rd1 Kc4 Kh5 Nf3 Ra1 Kc5 Ra5+ Kb4
37/55 11:12 5,209,022,245 7,751,451 0.00 Rg3+ Kxh5 Kf8 Ng4 Ke8 Kg5 Rf3 Ne5 Kd8 Rh7 Rf1 Ng4 Kc8 Nf6 Kb8 Nd5 Rd1 Rd7 Rf1 Kg4 Kc8 Rh7 Kb8 Ne3 Ra1 Kf3 Ra7 Rh6 Re7 Kf4 Kc8 Rh1 Rd7 Ke5 Kc7 Nd5+ Kc6 Rc1+ Kb5 Rb1+ Kc6

[BBauer]

Hi Dann,
position 14 and 15 are wrong.
Pos 14:
6k1/2R5/8/4N1Kp/8/7r/8/8 b - - bm Rg3+;
should read:
6k1/2R5/8/4N1Kp/8/7r/8/8 b - - bm Kf8 Rg3+;

and pos 15
6KR/3k4/P2r4/8/1p6/8/P7/4n3 w - - bm a3;
should read:
6KR/3k4/P2r4/8/1p6/8/P7/4n3 w - - bm a3 Rh4;

otherwise a program may solve the position but may not report the best move.

You are not wrong - you are as always right.
Kind regards
Bernhard

[Dann Corbit]

Hi Dann,
position 14 and 15 are wrong.
Pos 14:
6k1/2R5/8/4N1Kp/8/7r/8/8 b - - bm Rg3+;
should read:
6k1/2R5/8/4N1Kp/8/7r/8/8 b - - bm Kf8 Rg3+;

and pos 15
6KR/3k4/P2r4/8/1p6/8/P7/4n3 w - - bm a3;
should read:
6KR/3k4/P2r4/8/1p6/8/P7/4n3 w - - bm a3 Rh4;

otherwise a program may solve the position but may not report the best move.

You are not wrong - you are as always right.
Kind regards
Bernhard

Your previous post showed me something interesting. So I am reanalyzing all of the positions on multi-pv right now.