"Poor Fish": very hard test suite

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

"Poor Fish": very hard test suite

Post by mcostalba »

Indeed it is a small subset of the Arasan test suite, all credits go to Jon Dart.

I have just filtered out of the first 100 or so positions of the test suite the ones that seem impossible to find for SF (and also for other engines). I only extracted position from human games because those from engine games have been already found by some engine, indeed the engine that played the game: -)

I have verified solution is correct because when I forced the solution Stockfish suddenly saw the light.

Here we go:

Code: Select all

r2q3r/1p1bbQ2/4p1Bk/3pP3/1n1P1P1p/pP6/Pn4PP/R1B1R1K1 w - - bm g4; id "arasan19.10"; c0 "Fier-Ryan, Sabadell op 2009";
rn1q1rk1/2pbb3/pn2p3/1p1pPpp1/3P4/1PNBBN2/P1P1Q1PP/R4R1K w - - bm Nxg5; id "arasan19.16"; c0 "Dann Corbit, CCC 2015";
r5n1/p1p1q2k/4b2p/3pB3/3PP1pP/8/PPPQ2P1/5RK1 w - - bm Qf4; id "arasan19.23"; c0 "Shulman-Marciano, Ubeda 1997";
rn1qr1k1/1p2bppp/p3p3/3pP3/P2P1B2/2RB1Q1P/1P3PP1/R5K1 w - - bm Bxh7+; id "arasan19.42"; c0 "Polugaevsky-Torre, London 1984";
1n3rk1/3rbppp/p2p4/4pP2/Ppq1P3/1N2B3/1PP3PP/R2Q1R1K w - - bm f6; id "arasan19.44"; c0 "Kuzmin-Groszpeter, Kusadasi 1990";
Top
tpoppins
Posts: 919
Joined: Tue Nov 24, 2015 9:11 pm
Location: upstate

Re: "Poor Fish": very hard test suite

Post by tpoppins »

Current SF finds 1.g4 in the first position in MultiPV=2 at d=31 and a mate in 18 shortly thereafter. Or is this test supposed to be MultiPV=1-only?

Code: Select all

>> position fen r2q3r/1p1bbQ2/4p1Bk/3pP3/1n1P1P1p/pP6/Pn4PP/R1B1R1K1 w - - 0 0
>> go infinite
 <...>
<< info depth 31 seldepth 69 multipv 1 score cp 342 nodes 784604354 nps 14157422 hashfull 602 tbhits 430 time 55420 pv g6e4 d7e8 f4f5 e7g5 f7e6 h6g7 f5f6 g7f8 e6g4 d5e4 c1g5 e8h5 g5h6 h8h6 g4g7 f8e8 e1e4 h6g6 f6f7 e8d7 f7f8n d7c6 f8g6 b2d3 g6f4 d3f4 e4f4 b4d5 a1f1 d5f4 f1f4 c6b6 g7h6 b6a7 h6h5 a8c8 e5e6 d8c7 h5c5 c7c5 d4c5 c8c5 f4e4 c5c8 g1f2 a7b6 f2e3 c8g8 e6e7 g8e8 e3f4 b6c7 f4f5 c7d7
<< info depth 30 seldepth 69 multipv 2 score cp 0 nodes 784604354 nps 14157422 hashfull 602 tbhits 430 time 55420 pv g6d3 d7e8 f4f5 e7g5 f7e6 h6h7 f5f6 b2d3 e6f5 e8g6 f5g5 d8f8 c1d2 d3e1 a1e1 b4d3 e1e2 a8c8 g5h4 h7g8 h4g4 g8f7 g4d7 f7g8 d7g4
 <...>
<< info depth 31 seldepth 69 multipv 1 score cp 1705 nodes 1639416554 nps 14641961 hashfull 895 tbhits 20348 time 111967 pv g2g4 h4g3 h2h4 b4a2 a1a2 e7h4 f4f5 h4g5 g1g2 g5c1 g6h7 d7e8 e1h1 h6g5 f7g7 g5f4 g7g3 f4e4 h1c1 d8a5 b3b4 a5c5 b4c5 h8h7 c1e1 e4d4 g3e3 d4c4 e1c1 c4b5 e3b3 b5c6 b3b6 c6d7 b6b7 d7d8 b7a8 d8e7 a8a7 e7d8 a7h7 b2c4 f5e6 e8c6 g2f3 d5d4 f3f4
<< info depth 31 seldepth 69 multipv 2 score cp 342 upperbound nodes 1639416554 nps 14641961 hashfull 895 tbhits 20348 time 111967 pv g6e4 d7e8 f4f5 e7g5 f7e6 h6g7 f5f6 g7f8 e6g4 d5e4 c1g5 e8h5 g5h6 h8h6 g4g7 f8e8 e1e4 h6g6 f6f7 e8d7 f7f8n d7c6 f8g6 b2d3 g6f4 d3f4 e4f4 b4d5 a1f1 d5f4 f1f4 c6b6 g7h6 b6a7 h6h5 a8c8 e5e6 d8c7 h5c5 c7c5 d4c5 c8c5 f4e4 c5c8 g1f2 a7b6 f2e3 c8g8 e6e7 g8e8 e3f4 b6c7 f4f5 c7d7
 <...>
<< info depth 32 seldepth 69 multipv 1 score mate 20 nodes 1807893232 nps 14767112 hashfull 918 tbhits 26084 time 122427 pv g2g4 h4g3 h2h4 b4a2 a1a2 e7h4 f4f5 h4g5 g1g2 g5c1 g6h7 d7e8 e1h1 h6g5 f7g7 g5f4 g7g3 f4e4 h1c1 h8g8 h7g8 d8a5 a2b2 e8h5 b2f2 e4d4 f2f4 d4e5 f4f3 e5f6 g3h4 f6g7 h4e7 g7g8 f3g3 h5g4 g3g4 g8h8 e7g7
<< info depth 31 seldepth 69 multipv 2 score cp 342 nodes 1807893232 nps 14767112 hashfull 918 tbhits 26084 time 122427 pv g6e4 d7e8 f4f5 e7g5 f7e6 h6g7 f5f6 g7f8 e6g4 d5e4 c1g5 e8h5 g5h6 h8h6 g4g7 f8e8 e1e4 h6g6 f6f7 e8d7 f7f8n d7c6 f8g6 b2d3 g6f4 d3f4 e4f4 b4d5 a1f1 d5f4 f1f4 c6b6 g7h6 b6a7 h6h5 a8c8 e5e6 d8c7 h5c5 c7c5 d4c5 c8c5 f4e4 c5c8 g1f2 a7b6 f2e3 c8g8 e6e7 g8e8 e3f4 b6c7 f4f5 c7d7
 <...>
<< info depth 35 seldepth 79 multipv 1 score mate 18 nodes 2220093805 nps 14880384 hashfull 953 tbhits 30285 time 149196 pv g2g4 h4g3 h2h4 a8c8 g6c2 d7e8 f4f5 e7g5 c1g5 d8g5 h4g5 h6g5 f7g7 g5f4 g7h8 b4c2 h8h4 f4f3 e1f1 f3e2 h4g3 b2d3 a1d1 c2e1 f1e1 d3e1 d1e1 e2d2 g3e3 d2c2 e1c1 c2b2 e3d2 c8c2 d2c2
<< info depth 34 seldepth 79 multipv 2 score cp 378 nodes 2220093805 nps 14880384 hashfull 953 tbhits 30285 time 149196 pv g6e4 d7e8 f4f5 e7g5 f7e6 h6g7 f5f6 g7f8 e6g4 d5e4 c1g5 e8h5 g5h6 h8h6 g4g7 f8e8 e1e4 h6g6 f6f7 e8d7 f7f8n d7c6 f8g6 b2d3 g6f4 d3f4 e4f4 b4d5 a1f1 d5f4 f1f4 c6b6 g7h6 b6a7 h6h5 a8c8 e5e6 c8c1 g1f2 d8c7 f4e4 c7h2 h5a5 a7b8 a5e5 h2e5 e4e5 c1c8 e5h5 c8f8 f2e3 b8c7 h5d5 c7c8 d5d7 f8g8 d7f7 c8d8 d4d5 g8g5 e3d4 g5g2 d5d6 g2d2 d4e5 d2e2 e5f5 e2f2 f5g4 f2g2 g4h3
Top
mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

Re: "Poor Fish": very hard test suite

Post by mcostalba »

I am working out all the Arasan test suite now, but I have found this position that if correct it is really one of the most difficult of the world :-)

4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - - bm f4; id "arasan19.189"; c0 "Šachová skladba 2011-12, 1st Prize";

[D]4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - -

In particular there is very little difference between the best move and the second one, so it is really difficult to tell if the study is correct.
Top
Thomas Zipproth
Posts: 59
Joined: Sat Jan 01, 2011 5:33 pm

Re: "Poor Fish": very hard test suite

Post by Thomas Zipproth »

That problems reminded me to my old hash browser function, where you can can at least see why the solution was not found.

For example with:
rn1q1rk1/2pbb3/pn2p3/1p1pPpp1/3P4/1PNBBN2/P1P1Q1PP/R4R1K w - - bm Nxg5; id "arasan19.16"; c0 "Dann Corbit, CCC 2015";
after: Nf3xg5 Be7xg5 Rf1f3 Bg5xe3 Rf3g3 Kg8h7

SF does not even consider Qe2h5 which would be mate in 3, most likely because of material pruning,
because only moves taking the bishop on e3 are considered, here is the output:

Code: Select all

setoption name Hash value 16384
position fen rn1q1rk1/2pbb3/pn2p3/1p1pPpp1/3P4/1PNBBN2/P1P1Q1PP/R4R1K w - 
go depth 30
browse

Moves&#58;
Nr.    Move   Bound  Depth  Value    Eval   ttmove
 1&#58;    a2a3    B_LO   16    -132     -258    g5g4
 2&#58;    g2g3    B_LO   22    -294     -209    b5b4
 3&#58;    h2h3    B_LO   24    -281     -255   rf8f7
 4&#58;    b3b4    B_LO   15    -474     -106    g5g4
 5&#58;    a2a4    B_LO   23    -281     -279    b5a4
 6&#58;    g2g4   &#58;B_EX   29    -490      -93    f5f4
 7&#58;    h2h4    B_LO   29    -490     -192    g5g4
 8&#58;   Nc3b1    B_LO   14    -486      -98    f5f4
 9&#58;   Nc3d1    B_LO   16    -263     -134    g5g4
10&#58;   Nc3a4    B_LO   14     -97      -68    b5a4
11&#58;   Nc3e4    B_LO    1     603     -200    f5e4
12&#58;   Nc3b5    B_LO   18    -277     -289    a6b5
13&#58;   Nc3d5    B_LO    4     -20     -441    e6d5
14&#58;   Nf3e1    B_LO   20    -422      -85   bd7e8
15&#58;   Nf3g1    B_LO   22    -299     -122   bd7e8
16&#58;   Nf3d2    B_LO   19    -281     -178   qd8e8
17&#58;   Nf3h4    B_LO    4     537       14    g5h4
18&#58;   Nf3g5    B_LO   26    -460     -701   be7g5
19&#58;   Bd3c4    B_LO   13    -153      -16    d5c4
20&#58;   Bd3e4    B_LO   14    -279      -64    f5e4
21&#58;   Bd3b5    B_LO   17     -99     -450    a6b5
22&#58;   Bd3f5    B_LO    4     130     -502    e6f5
23&#58;   Be3c1    B_LO   18    -296     -182    b5b4
24&#58;   Be3g1    B_LO   15    -490     -169    g5g4
25&#58;   Be3d2    B_LO   16    -132     -224    b5b4
26&#58;   Be3f2    B_LO   15    -473     -192    b5b4
27&#58;   Be3f4    B_LO   16     -76      -83    g5f4
28&#58;   Be3g5    B_LO   17    -132     -713   be7g5
29&#58;   Ra1b1    B_LO   15    -132     -211    b5b4
30&#58;   Ra1c1    B_LO   15    -201     -205    b5b4
31&#58;   Ra1d1    B_LO   15    -490     -225    b5b4
32&#58;   Ra1e1    B_LO   28    -490     -225    b5b4
33&#58;   Rf1b1    B_LO   13    -132     -169    b5b4
34&#58;   Rf1c1    B_LO   13    -423     -163    b5b4
35&#58;   Rf1d1    B_LO   14    -487     -183    b5b4
36&#58;   Rf1e1    B_LO   26    -490     -183    b5b4
37&#58;   Rf1g1    B_LO   15    -474     -163    b5b4
38&#58;   Rf1f2    B_LO   15    -463     -170    b5b4
39&#58;   Qe2d1    B_LO   15    -473     -191    b5b4
40&#58;   Qe2e1    B_LO   23    -490     -200   rf8f7
41&#58;   Qe2d2    B_LO   24    -490     -196    g5g4
42&#58;   Qe2f2    B_LO   25    -490     -197   rf8f7
43&#58;   Kh1g1    B_LO   16    -132     -211    b5b4
Move nr., enter = one move back, r = leave&#58; 18

Moves&#58;Nf3g5
Nr.    Move   Bound  Depth  Value    Eval   ttmove
 1&#58;    b5b4    B_LO    7     609      637   Qe2h5
 2&#58;    f5f4    B_NO   -6    ----      734    &#40;none&#41;
 3&#58;    a6a5    B_NO   -6    ----      725    &#40;none&#41;
 4&#58;    c7c6    B_NO   -6    ----      762    &#40;none&#41;
 5&#58;    c7c5    B_NO   -6    ----      636    &#40;none&#41;
 6&#58;   nb8c6    B_LO    5     528      570   Qe2h5
 7&#58;   nb6a4  --
 8&#58;   nb6c4  --
 9&#58;   nb6c8    B_NO   -6    ----      809    &#40;none&#41;
10&#58;   bd7c6    B_NO   -6    ----      755    &#40;none&#41;
11&#58;   bd7c8    B_NO   -6    ----      782    &#40;none&#41;
12&#58;   bd7e8    B_NO   -6    ----      810    &#40;none&#41;
13&#58;   be7a3    B_NO   -6    ----      808    &#40;none&#41;
14&#58;   be7b4    B_NO   -6    ----      722    &#40;none&#41;
15&#58;   be7c5  --
16&#58;   be7g5    B_NO   25     290     -381   Qe2h5
17&#58;   be7d6  --
18&#58;   be7f6  --
19&#58;   ra8a7    B_NO   -6    ----      737    &#40;none&#41;
20&#58;   rf8f6  --
21&#58;   rf8f7    B_NO   -6    ----      809    &#40;none&#41;
22&#58;   rf8e8    B_NO   -6    ----      832    &#40;none&#41;
23&#58;   qd8c8    B_NO   -6    ----      744    &#40;none&#41;
24&#58;   qd8e8    B_NO   -6    ----      716    &#40;none&#41;
25&#58;   kg8h8    B_NO   -6    ----     1076    &#40;none&#41;
26&#58;   kg8g7    B_NO   -6    ----     1185    &#40;none&#41;
Move nr., enter = one move back, r = leave&#58; 16

Moves&#58;Nf3g5 be7g5
Nr.    Move   Bound  Depth  Value    Eval   ttmove
 1&#58;    a2a3    B_LO    8    -219      373   bg5e3
 2&#58;    g2g3    B_LO    7     -58      343   bg5e3
 3&#58;    h2h3    B_LO    7      -9      423   bg5e3
 4&#58;    b3b4    B_LO    6    -241      485   bg5e3
 5&#58;    a2a4    B_LO    5       0      338    b5a4
 6&#58;    g2g4    B_LO   19    -275      516    f5f4
 7&#58;    h2h4    B_LO    4     637      404   bg5e3
 8&#58;   Nc3b1    B_LO    7    -187      514   bg5e3
 9&#58;   Nc3d1    B_LO    8      94      476   bg5e3
10&#58;   Nc3a4    B_LO    6     120      549    b5a4
11&#58;   Nc3e4    B_LO    4     432      399    f5e4
12&#58;   Nc3b5    B_LO   12     -33      324    a6b5
13&#58;   Nc3d5    B_LO   13    -240      206    e6d5
14&#58;   Bd3c4    B_LO    7     252      594    d5c4
15&#58;   Bd3e4    B_LO    9    -279      553    f5e4
16&#58;   Bd3b5    B_LO   12     122      156    a6b5
17&#58;   Bd3f5    B_LO    4     254      130    e6f5
18&#58;   Be3c1    B_LO    7     117      438   bg5c1
19&#58;   Be3g1    B_LO    5    -287      473   bg5h4
20&#58;   Be3d2    B_LO    9     -55      398   bg5d2
21&#58;   Be3f2    B_LO    6    -223      403   bd7e8
22&#58;   Be3f4    B_LO    8     101      329   bg5f4
23&#58;   Be3g5    B_LO   19     -99     -797   qd8g5
24&#58;   Ra1b1    B_LO    7    -285      406   bg5e3
25&#58;   Ra1c1    B_LO    8    -164      412   bg5e3
26&#58;   Ra1d1    B_LO    7    -191      392   bg5e3
27&#58;   Ra1e1    B_LO    7     123      392   bg5e3
28&#58;   Rf1b1    B_LO    7    -256      457   bg5e3
29&#58;   Rf1c1    B_LO    8    -249      463   bg5e3
30&#58;   Rf1d1    B_LO    5    -248      443   bg5e3
31&#58;   Rf1e1    B_NO   -6    ----      443    &#40;none&#41;
32&#58;   Rf1g1    B_LO   11    -247      463   bg5e3
33&#58;   Rf1f2    B_LO    8    -137      435   bg5e3
34&#58;   Rf1f3    B_LO   20    -290      441   bg5h4
35&#58;   Rf1f4    B_LO    7    -142      431   bg5f4
36&#58;   Rf1f5    B_LO    4     950      -14    e6f5
37&#58;   Qe2d1    B_LO    8     -78      489   bg5e3
38&#58;   Qe2e1    B_NO   -6    ----      388    &#40;none&#41;
39&#58;   Qe2d2    B_LO    6      84      473   bg5e3
40&#58;   Qe2f2    B_LO    5     203      427   bg5e3
41&#58;   Qe2f3    B_NO   -6    ----      458    &#40;none&#41;
42&#58;   Qe2g4    B_NO   -6    ----      408    &#40;none&#41;
43&#58;   Qe2h5    B_LO   24    -290     -303   bg5e3
44&#58;   Kh1g1    B_LO    8    -200      382   bg5e3
Move nr., enter = one move back, r = leave&#58; 34

Moves&#58;Nf3g5 be7g5 Rf1f3
Nr.    Move   Bound  Depth  Value    Eval   ttmove
 1&#58;    b5b4    B_LO    6     298     -536   Rf3g3
 2&#58;    f5f4    B_NO    9     221     -394    &#40;none&#41;
 3&#58;    a6a5  --
 4&#58;    c7c6  --
 5&#58;    c7c5  --
 6&#58;   nb8c6    B_LO    6     165     -572   Rf3g3
 7&#58;   nb6a4  --
 8&#58;   nb6c4  --
 9&#58;   nb6c8  --
10&#58;   bd7c6  --
11&#58;   bd7c8  --
12&#58;   bd7e8    B_LO    6     499     -376   Be3g5
13&#58;   bg5e3    B_LO   16     116    -1439   Rf3g3
14&#58;   bg5f4  --
15&#58;   bg5h4    B_NO   19     290     -276    &#40;none&#41;
16&#58;   bg5f6  --
17&#58;   bg5h6  --
18&#58;   bg5e7    B_LO    2     539      -99   Rf3g3
19&#58;   ra8a7  --
20&#58;   rf8f6  --
21&#58;   rf8f7    B_LO    6     200     -414   Be3g5
22&#58;   rf8e8  --
23&#58;   qd8f6  --
24&#58;   qd8e7    B_LO    6     280     -432   Be3g5
25&#58;   qd8c8  --
26&#58;   qd8e8  --
27&#58;   kg8f7  --
28&#58;   kg8g7  --
29&#58;   kg8h7  --
30&#58;   kg8h8    B_LO    6     371     -354   Be3g5
Move nr., enter = one move back, r = leave&#58; 13

Moves&#58;Nf3g5 be7g5 Rf1f3 bg5e3
Nr.    Move   Bound  Depth  Value    Eval   ttmove
 1&#58;    a2a3  --
 2&#58;    g2g3  --
 3&#58;    h2h3  --
 4&#58;    b3b4  --
 5&#58;    a2a4  --
 6&#58;    g2g4  --
 7&#58;    h2h4    B_NO   -6    ----     1702    &#40;none&#41;
 8&#58;   Nc3b1  --
 9&#58;   Nc3d1  --
10&#58;   Nc3a4  --
11&#58;   Nc3e4  --
12&#58;   Nc3b5  --
13&#58;   Nc3d5  --
14&#58;   Bd3c4  --
15&#58;   Bd3e4  --
16&#58;   Bd3b5  --
17&#58;   Bd3f5  --
18&#58;   Ra1b1  --
19&#58;   Ra1c1  --
20&#58;   Ra1d1  --
21&#58;   Ra1e1    B_NO   -6    ----     1450    &#40;none&#41;
22&#58;   Ra1f1  --
23&#58;   Ra1g1  --
24&#58;   Rf3f1    B_LO    6    1176     1487   be3d4
25&#58;   Rf3f2  --
26&#58;   Rf3e3    B_LO   14    -260      443   rf8f7
27&#58;   Rf3g3    B_NO   16    -116     ----    &#40;none&#41;
28&#58;   Rf3h3  --
29&#58;   Rf3f4  --
30&#58;   Rf3f5    B_NO   -6    ----     1073    &#40;none&#41;
31&#58;   Qe2d1    B_NO   -6    ----     1474    &#40;none&#41;
32&#58;   Qe2e1    B_NO   -6    ----     1459    &#40;none&#41;
33&#58;   Qe2f1  --
34&#58;   Qe2d2    B_LO    4    3709     1578   be3d2
35&#58;   Qe2f2  --
36&#58;   Qe2e3    B_LO   14    -260      182   kg8f7
Move nr., enter = one move back, r = leave&#58; 27

Moves&#58;Nf3g5 be7g5 Rf1f3 bg5e3 Rf3g3
Nr.    Move   Bound  Depth  Value    Eval   ttmove
 1&#58;   kg8f7    B_LO   15     903     -603   Qe2h5
 2&#58;   kg8h7    B_NO   -6    ----      171    &#40;none&#41;
 3&#58;   kg8h8    B_LO   11   31997     -399   Qe2h5
 4&#58;   be3g5    B_LO   13     261    -1270   Qe2h5
 5&#58;   qd8g5    B_LO   13     116    -1391   Rg3g5
Move nr., enter = one move back, r = leave&#58; 2

Moves&#58;Nf3g5 be7g5 Rf1f3 bg5e3 Rf3g3 kg8h7
Nr.    Move   Bound  Depth  Value    Eval   ttmove
 1&#58;    a2a3  --
 2&#58;    h2h3  --
 3&#58;    b3b4  --
 4&#58;    a2a4  --
 5&#58;    h2h4  --
 6&#58;   Nc3b1  --
 7&#58;   Nc3d1  --
 8&#58;   Nc3a4  --
 9&#58;   Nc3e4  --
10&#58;   Nc3b5  --
11&#58;   Nc3d5  --
12&#58;   Bd3c4  --
13&#58;   Bd3e4  --
14&#58;   Bd3b5  --
15&#58;   Bd3f5  --
16&#58;   Ra1b1  --
17&#58;   Ra1c1  --
18&#58;   Ra1d1  --
19&#58;   Ra1e1  --
20&#58;   Ra1f1  --
21&#58;   Ra1g1  --
22&#58;   Rg3e3    B_NO    7    -319     -254   qd8e8
23&#58;   Rg3f3  --
24&#58;   Rg3h3  --
25&#58;   Rg3g4  --
26&#58;   Rg3g5  --
27&#58;   Rg3g6  --
28&#58;   Rg3g7  --
29&#58;   Rg3g8  --
30&#58;   Qe2d1  --
31&#58;   Qe2e1  --
32&#58;   Qe2f1  --
33&#58;   Qe2d2  --
34&#58;   Qe2f2  --
35&#58;   Qe2e3    B_NO    6    -462     -642    &#40;none&#41;
36&#58;   Qe2f3  --
37&#58;   Qe2g4  --
38&#58;   Qe2h5  --                      
Move nr., enter = one move back, r = leave&#58;
Top
mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

Re: "Poor Fish": very hard test suite

Post by mcostalba »

tpoppins wrote:Or is this test supposed to be MultiPV=1-only?
Actually multi pv gives even more help to these already super strong engines, anyhow I have removed the position you found from the list and here is the final one (some of them are very difficult to find even with multi pv):

Code: Select all

rn1q1rk1/2pbb3/pn2p3/1p1pPpp1/3P4/1PNBBN2/P1P1Q1PP/R4R1K w - - bm Nxg5; id "arasan19.16"; c0 "Dann Corbit, CCC 2015";
r5n1/p1p1q2k/4b2p/3pB3/3PP1pP/8/PPPQ2P1/5RK1 w - - bm Qf4; id "arasan19.23"; c0 "Shulman-Marciano, Ubeda 1997";
rn1qr1k1/1p2bppp/p3p3/3pP3/P2P1B2/2RB1Q1P/1P3PP1/R5K1 w - - bm Bxh7+; id "arasan19.42"; c0 "Polugaevsky-Torre, London 1984";
1n3rk1/3rbppp/p2p4/4pP2/Ppq1P3/1N2B3/1PP3PP/R2Q1R1K w - - bm f6; id "arasan19.44"; c0 "Kuzmin-Groszpeter, Kusadasi 1990";
8/5p2/3p2p1/1bk4p/p2pBNnP/P5P1/1P3P2/4K3 b - - bm d3; id "arasan19.115"; c0 "Bondarevsky-Petrosian, Soviet ch-19 Moscow 1951";
8/4nk2/1p3p2/1r1p2pp/1P1R1N1P/6P1/3KPP2/8 w - - bm Nd3; id "arasan19.116"; c0 "Grandelius-Raznikov, EU Youth Chess Ch B18, Albena 2011";
3r1r1k/pp5p/4b1pb/6q1/3P4/4p1BP/PP2Q1PK/3RRB2 b - - bm Qxg3+; id "arasan19.137"; c0 "Apicella-Lautier, Clichy 2001";
r3k3/1p4p1/1Bb1Bp1p/P1p1bP1P/2Pp2P1/3P4/5K2/4R3 w - - bm g5; id "arasan19.154"; c0 "Nakamura-Giri, FIDE Grand Prix, London 2012";
1r1rb1k1/5ppp/4p3/1p1p3P/1q2P2Q/pN3P2/PPP4P/1K1R2R1 w - - bm Rxg7+; id "arasan19.155"; c0 "Vescovi-Gschwendtner, Groningen op 1994 &#40;Aemis Test Suite #30&#41;";
r1bq1rk1/pp2bppp/1n2p3/3pP3/8/2RBBN2/PP2QPPP/2R3K1 w - - bm Bxh7+; id "arasan19.157"; c0 "Trent-Deslandes, Cap d'Agde CCAS op 2008";
r1b2rk1/1pq1nppp/pbn1p3/8/3N4/3BBN2/PPP1QPPP/3R1RK1 w - - bm Bxh7+; id "arasan19.159"; c0 "Leu-Muck, DDR-ch H137 corr 1973";
8/4bBpp/3p4/P6P/2PN2p1/3k1b2/P7/6K1 w - - bm h6; id "arasan19.188"; c0 "Timman, 1c Corus &#123;m&#125; 2008";
r1b3r1/5p1k/p1n2P1p/P1qpp1P1/1p1p4/3P2Q1/BPPB2P1/R4RK1 w - - bm Kf2; id "arasan19.179"; c0 "Efremov-Fischer, Danube/4 ICCF 2012";
4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - - bm f4; id "arasan19.189"; c0 "Šachová skladba 2011-12, 1st Prize";
The last 2 are special, the last one perhaps or is not correct or is super hard, the one before the last:

[D] r1b3r1/5p1k/p1n2P1p/P1qpp1P1/1p1p4/3P2Q1/BPPB2P1/R4RK1 w - -

Is the one I like most :-)
Top
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: "Poor Fish": very hard test suite

Post by beram »

mcostalba wrote:
tpoppins wrote:Or is this test supposed to be MultiPV=1-only?
Actually multi pv gives even more help to these already super strong engines, anyhow I have removed the position you found from the list and here is the final one (some of them are very difficult to find even with multi pv):

Code: Select all

rn1q1rk1/2pbb3/pn2p3/1p1pPpp1/3P4/1PNBBN2/P1P1Q1PP/R4R1K w - - bm Nxg5; id "arasan19.16"; c0 "Dann Corbit, CCC 2015";
r5n1/p1p1q2k/4b2p/3pB3/3PP1pP/8/PPPQ2P1/5RK1 w - - bm Qf4; id "arasan19.23"; c0 "Shulman-Marciano, Ubeda 1997";
rn1qr1k1/1p2bppp/p3p3/3pP3/P2P1B2/2RB1Q1P/1P3PP1/R5K1 w - - bm Bxh7+; id "arasan19.42"; c0 "Polugaevsky-Torre, London 1984";
1n3rk1/3rbppp/p2p4/4pP2/Ppq1P3/1N2B3/1PP3PP/R2Q1R1K w - - bm f6; id "arasan19.44"; c0 "Kuzmin-Groszpeter, Kusadasi 1990";
8/5p2/3p2p1/1bk4p/p2pBNnP/P5P1/1P3P2/4K3 b - - bm d3; id "arasan19.115"; c0 "Bondarevsky-Petrosian, Soviet ch-19 Moscow 1951";
8/4nk2/1p3p2/1r1p2pp/1P1R1N1P/6P1/3KPP2/8 w - - bm Nd3; id "arasan19.116"; c0 "Grandelius-Raznikov, EU Youth Chess Ch B18, Albena 2011";
3r1r1k/pp5p/4b1pb/6q1/3P4/4p1BP/PP2Q1PK/3RRB2 b - - bm Qxg3+; id "arasan19.137"; c0 "Apicella-Lautier, Clichy 2001";
r3k3/1p4p1/1Bb1Bp1p/P1p1bP1P/2Pp2P1/3P4/5K2/4R3 w - - bm g5; id "arasan19.154"; c0 "Nakamura-Giri, FIDE Grand Prix, London 2012";
1r1rb1k1/5ppp/4p3/1p1p3P/1q2P2Q/pN3P2/PPP4P/1K1R2R1 w - - bm Rxg7+; id "arasan19.155"; c0 "Vescovi-Gschwendtner, Groningen op 1994 &#40;Aemis Test Suite #30&#41;";
r1bq1rk1/pp2bppp/1n2p3/3pP3/8/2RBBN2/PP2QPPP/2R3K1 w - - bm Bxh7+; id "arasan19.157"; c0 "Trent-Deslandes, Cap d'Agde CCAS op 2008";
r1b2rk1/1pq1nppp/pbn1p3/8/3N4/3BBN2/PPP1QPPP/3R1RK1 w - - bm Bxh7+; id "arasan19.159"; c0 "Leu-Muck, DDR-ch H137 corr 1973";
8/4bBpp/3p4/P6P/2PN2p1/3k1b2/P7/6K1 w - - bm h6; id "arasan19.188"; c0 "Timman, 1c Corus &#123;m&#125; 2008";
r1b3r1/5p1k/p1n2P1p/P1qpp1P1/1p1p4/3P2Q1/BPPB2P1/R4RK1 w - - bm Kf2; id "arasan19.179"; c0 "Efremov-Fischer, Danube/4 ICCF 2012";
4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - - bm f4; id "arasan19.189"; c0 "Šachová skladba 2011-12, 1st Prize";
The last 2 are special, the last one perhaps or is not correct or is super hard, the one before the last:

r1b3r1/5p1k/p1n2P1p/P1qpp1P1/1p1p4/3P2Q1/BPPB2P1/R4RK1 w - -

Is the one I like most :-)
Hi Marco,
latest SF 220916 finds solution Kf2 at depth 26

76: poorfish fav Marco
[d] r1b3r1/5p1k/p1n2P1p/P1qpp1P1/1p1p4/3P2Q1/BPPB2P1/R4RK1 w - - 0 1

Analysis by Stockfish 220916 64:

1.Bb3 Be6
+/= (0.65 --) Depth: 20/36 00:00:03 11489kN
1.Bb3 Be6 2.Rae1 Rg6 3.Ba4 Rc8 4.Rf2 Qxa5 5.Bxc6 Rxc6 6.Qxe5 Qc5 7.Rc1 a5 8.g3 Qd6 9.Qxd6 Rxd6 10.Rh2 Rc6
+/= (0.56) Depth: 20/36 00:00:03 13973kN
1.Bb3 Be6 2.Rae1 Rac8 3.Rf2 Rg6 4.Ba4 Qxa5 5.Bxc6 Rxc6 6.Qxe5 Qc5 7.Rc1 a5 8.g3 Qd6 9.Qxd6 Rxd6 10.Rh2 Rc6 11.Kg2 Kg8 12.Rxh6
+/= (0.53) Depth: 21/36 00:00:04 17276kN
1.Bb3
+/= (0.60 !) Depth: 22/37 00:00:04 21969kN
1.Bb3
+/= (0.68 !) Depth: 22/37 00:00:05 26091kN
1.Bb3 Be6
+/= (0.60 --) Depth: 22/37 00:00:05 27374kN
1.Bb3
+/= (0.69 !) Depth: 22/37 00:00:06 28475kN
1.Bb3 Rg6 2.Ba4 Be6 3.Rae1 Rc8 4.Bxc6 Rxc6 5.Rxe5 Qxa5 6.Qe1 Qb6 7.Bxb4 Qb8 8.c4 dxc4 9.Qe4 cxd3 10.Bd2 Rc2 11.Rxe6 fxe6 12.Qxd3 Rxb2 13.Bf4 Qf8 14.Qxd4
+/- (0.79) Depth: 22/37 00:00:06 32775kN
1.Bb3
+/- (0.87 !) Depth: 23/38 00:00:07 39815kN
1.Bb3
+/- (0.94 !) Depth: 23/38 00:00:08 43948kN
1.Bb3
+/- (1.05 !) Depth: 23/38 00:00:09 48458kN
1.Bb3
+/- (1.20 !) Depth: 23/38 00:00:09 50689kN
1.Bb3
+- (1.41 !) Depth: 23/38 00:00:10 54806kN
1.Bb3 Rg6
+/- (1.24 --) Depth: 23/47 00:00:10 55751kN
1.Bb3 Rg6 2.Kf2 e4 3.Bf4 Nxa5 4.Bd6 Qb5 5.Ba4 e3+ 6.Ke2 Rxg5 7.Bxb5 Rxg3 8.Bxg3 Bg4+ 9.Ke1 axb5 10.Bc7 Rc8 11.Rf4 h5 12.Bxa5 Rxc2 13.Bxb4 Rxg2 14.Kf1 Rxb2 15.Bc5 Rd2 16.Ke1
+/- (1.01) Depth: 23/47 00:00:10 56567kN
1.Bb3 Rg6
+/- (0.94 --) Depth: 24/47 00:00:11 60644kN
1.Bb3 Rg6
+/- (0.87 --) Depth: 24/47 00:00:11 63519kN
1.Bb3 Rg6
+/- (0.76 --) Depth: 24/47 00:00:12 68820kN
1.Bb3
+/- (0.85 !) Depth: 24/47 00:00:25 138mN
1.Bb3
+/- (1.06 !) Depth: 24/47 00:00:28 155mN
1.Bb3 Rg6 2.Kf2 e4 3.Bf4 e3+ 4.Ke2 Nxa5 5.Bd6 Qb5 6.Ba4 Rxg5 7.Bxb5 Rxg3 8.Bxg3 Bg4+ 9.Ke1 axb5 10.Rf4 h5 11.Kf1 Ra6 12.Be1 Kg6 13.Bxb4 Nc6 14.Rxa6 Nxb4 15.Ra1 Bf5 16.Ra5 Nxc2 17.Rxf5 Kxf5 18.Rxb5 Kxf6 19.Rxd5
+/- (1.16) Depth: 24/47 00:00:29 163mN
1.Bb3 Rg6
+/- (1.09 --) Depth: 25/47 00:00:30 168mN
1.Bb3 Rg6
+/- (1.02 --) Depth: 25/47 00:00:30 168mN
1.Bb3 Rg6
+/- (0.91 --) Depth: 25/47 00:00:31 169mN
1.Bb3
+/- (1.00 !) Depth: 25/47 00:00:31 171mN
1.Bb3 Rg6
+/- (0.87 --) Depth: 25/47 00:00:31 171mN
1.Bb3 Rg6 2.Rae1 Bd7 3.Rf2 Rag8 4.Ba4 Nb8 5.Bxd7 Nxd7 6.Qh3 Rd8 7.Qf3 Kg8 8.gxh6 Kh7 9.Qf5 Qxc2 10.Bxb4 Qc7 11.Be7 Rdg8 12.g4 Qxa5 13.Ref1 Qb5 14.Rg2 Nc5
+/= (0.70) Depth: 25/47 00:00:46 256mN
1.Bb3
+/- (0.77 !) Depth: 26/47 00:00:51 283mN
1.Bb3
+/- (0.84 !) Depth: 26/47 00:00:52 289mN
1.Kf2
+/- (0.95 !) Depth: 26/47 00:00:53 295mN
1.Kf2
+/- (1.10 !) Depth: 26/47 00:00:53 295mN
1.Kf2
+/- (1.31 !) Depth: 26/47 00:00:54 300mN
1.Kf2
+- (1.60 !) Depth: 26/47 00:00:55 307mN
1.Kf2
+- (1.97 !) Depth: 26/47 00:00:59 327mN
1.Kf2 Rg6
+- (1.67 --) Depth: 26/47 00:01:01 343mN
1.Kf2 Qxc2 2.Ke1 b3 3.Rh1 Rg6 4.Rh4 Nb4 5.Bb1 Qc5 6.Qh2 Qf8 7.Qxe5 Be6 8.Kf2 Qb8 9.Qxd4 Nc2 10.Bxc2 bxc2 11.Rc1 Qc7 12.Bf4 Qc6 13.Be3 Kg8 14.Rh5 Qc7 15.Qh4 Qe5 16.Rxh6 Qf5+ 17.Ke2 Rxh6 18.Qxh6 Qh7 19.Qxh7+ Kxh7 20.Rxc2 Rc8 21.Rd2 Kg6 22.b4 Bg4+ 23.Kf2
+- (1.75) Depth: 26/51 00:01:07 375mN
1.Kf2 Qxc2
+- (1.68 --) Depth: 27/51 00:01:08 383mN
1.Kf2
+- (1.75 !) Depth: 27/51 00:01:09 388mN
1.Kf2
+- (1.86 !) Depth: 27/51 00:01:14 419mN
1.Kf2
+- (2.01 !) Depth: 27/51 00:01:16 431mN
1.Kf2 Rg6 2.Rh1 Bf5 3.Bb3 Rh8 4.Rh4 Kg8 5.Rah1 e4 6.Kf1 e3 7.Be1 Nxa5 8.Bxd5 Nc6 9.Qf3 Bd7 10.Rxh6 Rhxh6 11.Rxh6 Rxg5 12.Rh5 Qxd5 13.Qxd5 Rxd5 14.Rxd5 Be8 15.Ke2 Kh7
+- (2.14) Depth: 27/56 00:01:23 472mN
1.Kf2
+- (2.21 !) Depth: 28/56 00:01:32 521mN
1.Kf2 Rg6 2.Rh1 Bf5 3.Bb3 Rh8 4.Rh4 e4 5.dxe4 dxe4 6.Bxf7 e3+ 7.Kf1 Qe5 8.Bxg6+ Kxg6 9.Qxe5 Nxe5 10.Bxb4 Bxc2 11.f7 Bd3+ 12.Kg1 Nxf7 13.Rxd4 Bb5 14.Re4 e2 15.gxh6 Kf5 16.Re7 Ng5 17.Rc1 Rxh6 18.Rc5+ Kf6 19.Rc8 Ne6
+- (2.18) Depth: 28/56 00:01:37 552mN
1.Kf2 Rg6
+- (2.11 --) Depth: 29/56 00:01:40 574mN

(Bram Mourik, AMD X6 1090T 3200 Mhz (Fritzmark 23,1 6x) 25.09.2016)
Top
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: "Poor Fish": very hard test suite

Post by Vinvin »

Bd1 is completely winning too :

FEN: 4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - - 0 1

Code: Select all

Stockfish_160922_x64_modern_fast&#58;
...
 42/66	01&#58;45	 1 393 842k	13 195k	+1,17	1.Kd7 Bd2 2.Ke6 h5 3.Kf5 Kf7 4.a4 Ke7 5.f4 h4 6.Kg4 Kf6 7.Bd3 h3 8.Kxh3 Bxf4 9.Kg4 Bd2 10.f4 Be1 11.Kf3 Bd2 12.Ke4 Ke6 13.Bf1 Bc3 14.Bh3+ Kd6 15.Kf5 Bd2 16.Bg2 Be3 17.Kg4 Bd2 18.Kg5 Ke6 19.Bf3 Kf7 20.Bg4 Ke7 21.Bd1 Kd6 22.Bf3 Ke6 23.Be4
 42/66	01&#58;45	 1 393 842k	13 195k	+4,26	1.f4 Bf6 2.Bd1 Kg7 3.Bh5 Bb2 4.Ke7 Bc1 5.f5 Bb2 6.a4 Bf6+ 7.Kd6 Bc3 8.Ke6 Bb4 9.f6+ Kf8 10.f4 Bc3 11.Kd6 Ba5 12.Kc7 Kg8 13.Kd7 Kf8 14.Kc6 Kg8 15.Kb7 Kf8 16.Kc8 Bd2 17.Kc7 Ba5 18.Kd6 Bc3 19.Ke6 Ba5 20.Kd7 Bd2 21.Kc8 Bxf4 22.Kb7 Be3 23.Kc6 Bf2 24.Bd1 Be3 25.Kxb6 c4+ 26.Kc6 c3 27.b6
 42/66	01&#58;45	 1 393 842k	13 195k	+5,20	1.Bd1 Bd2 2.f4 Kg7 3.Kd7 Ba5 4.Bg4 Kg6 5.Ke6 Be1 6.f5+ Kg7 7.a4 Kg8 8.Bh5 Kf8 9.Kd7 Bc3 10.Kc6 Ba5 11.f6 Kg8 12.Kd7 Kf8 13.f4 Bc3 14.Kc6 Ba5 15.Kc7 Kg8 16.Kd7 Kf8 17.Kc6 Kg8 18.Kc7 Kf8 19.f7 Ke7 20.f5 Kf8 21.Kc6 Bb4 22.Kxb6 c4 23.bxc4 Bc3 24.Kc6 Ba5 25.b6 Be1 26.c5 Bf2 27.b7
---------------------------------------------------------------------------
 43/86	11&#58;42	 10 029 231k	14 272k	+1,18	1.Kd7 Bd2 2.Ke6 h5 3.Kf5 Kf7 4.a4 Ke7 5.f4 h4 6.Kg4 Kf6 7.f5 Be1 8.Kxh4 Bxf2+ 9.Kg4 Be1 10.Kf4 Bd2+ 11.Ke4 Ke7 12.Kd5 Kf6 13.Bd3 Ba5 14.Kc6 Kg5 15.Kc7 Kf6 16.Kd7 Be1 17.Kc6 Ba5 18.Kc7 Ke5 19.Kd7 Kf6 20.Kd6 Bd2 21.Bb1 Bc3 22.Kc6 Ba5 23.Kd5 Bd2 24.Bc2 Be1 25.Ke4 Bd2
 43/86	11&#58;42	 10 029 231k	14 272k	+7,95	1.f4 Bf6 2.Bd1 Kg7 3.Bh5 Bc3 4.Ke7 Ba5 5.Ke6 Be1 6.Kd6 Bb4 7.Kd7 Be1 8.Bg4 Bxf2 9.Kc6 Kg6 10.f5+ Kf6 11.a3 Kf7 12.Bd1 Ke7 13.f6+ Kxf6 14.a4 Ke6 15.Kxb6 c4+ 16.Kb7 c3 17.a5 h5 18.b6 h4 19.a6 h3 20.a7 h2 21.Bf3 c2 22.a8Q c1Q 23.Qe8+ Kf6 24.Qf8+ Ke5 25.Qg7+ Kf5 26.Qf7+ Kg5 27.Qe7+ Kf4 28.Qe4+ Kg5 29.Qe5+ Kg6 30.Be4+ Kf7 31.Qf5+ Ke8 32.Qe6+ Kf8 33.Qf6+ Kg8 34.Qxf2 Qg1 35.Bd5+ Kh7 36.Qf5+ Kh6 37.Qf4+ Kg6 38.Be4+ Kh5 39.Kc6
 43/86	11&#58;42	 10 029 231k	14 272k	+11,52	1.Bd1 Bh4 2.a4 Bg5 3.a5 bxa5 4.Be2 Bf4 5.Kd7 Kg7 6.Kc6 Kf7 7.b6 Ke7 8.Bd3 Kd8 9.Bf5 Bb8 10.Kxc5 Be5 11.Kd5 Bg7 12.Kc6 h5 13.b7 Be5 14.Bg4 Ke7 15.Bxh5 Kd8 16.Bg4 Bc7 17.Kc5 Ke8 18.Bh3 Kd8 19.Kb5 Ke8 20.Ka6 Bb8 21.Kxa5 Kf7 22.Bg4 Kf6 23.f4 Kf7 24.Kb6 Kf8 25.Kc6 Ke7 26.Bh5 Kd8 27.f5 Ke7 28.f6+ Kf8 29.Kd7 Ba7 30.Kc8 Bxf2 31.b8R Kg8 32.Kb7+ Kh7
---------------------------------------------------------------------------
 44/86	19&#58;07	 16 336 591k	14 236k	+1,18	1.Kd7 Bd2 2.Ke6 h5 3.Kf5 Kf7 4.a4 Ke7 5.f4 h4 6.Kg4 Kf6 7.f5 Be1 8.Kxh4 Bxf2+ 9.Kg4 Be1 10.Kf4 Bd2+ 11.Ke4 Ke7 12.Kd5 Kf6 13.Bd3 Ba5 14.Kc6 Kg5 15.Kc7 Kf6 16.Kd7 Be1 17.Kc6 Ba5 18.Kc7 Ke5 19.Kd7 Kf6 20.Bc2 Bd2 21.Kc7 Ba5 22.Kc6 Kg5 23.Kd7 Kf6 24.Bb1 Bd2 25.Kd6 Bc3
 44/86	19&#58;07	 16 336 591k	14 236k	+12,72	1.f4 Bf6 2.Bd1 Kg7 3.Bh5 Bc3 4.Ke7 Ba5 5.Ke6 Bd2 6.Kd6 Bb4 7.Kd7 Bc3 8.Bg4 Kg6 9.Kc6 Bd4 10.a4 h5 11.a5 c4 12.a6 hxg4 13.a7 cxb3 14.a8Q b2 15.Qe8+ Kg7 16.Qd7+ Kf8 17.Qf5+ Ke7 18.Qh7+ Kf6 19.Kd5 Bc3 20.Kc4 Ba5 21.Qh8+ Kg6 22.Qxb2 Kf7 23.Qe2 g3 24.fxg3 Kf6 25.Qe5+ Kf7 26.Qf5+ Ke7 27.Qg6 Kd7 28.f5 Ke7 29.f6+ Ke6 30.f7+ Ke7
 44/86	19&#58;07	 16 336 591k	14 236k	+14,30	1.Bd1 Bh4 2.a4 Bg5 3.a5 bxa5 4.Be2 Bf4 5.Kd7 Kg7 6.Kc6 Kf7 7.b6 Ke7 8.Bd3 Bd6 9.Bf5 h5 10.Kd5 Bh2 11.Kxc5 Kd8 12.Kc6 Bg1 13.b7 Bh2 14.Bg4 Bc7 15.Bxh5 Be5 16.Bg4 Bc7 17.Kb5 Ke7 18.Bh5 Ke6 19.Kc6 Bf4 20.Bg4+ Ke7 21.Kb6 Bb8 22.f4 Kd6 23.Bh5 Ke6 24.Kxa5 Kf6 25.Ka6 Kg7 26.Kb6 Kh8 27.f5 Kg7 28.Kc6 Kf6 29.Kd7 Kg5 30.Kc8 Kh4 31.Kxb8 Kh3 32.f6 Kg2 33.Ka7
mcostalba wrote:I am working out all the Arasan test suite now, but I have found this position that if correct it is really one of the most difficult of the world :-)

4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - - bm f4; id "arasan19.189"; c0 "Šachová skladba 2011-12, 1st Prize";

[D]4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - -

In particular there is very little difference between the best move and the second one, so it is really difficult to tell if the study is correct.
Top
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: "Poor Fish": very hard test suite

Post by Vinvin »

Bd1 is a transposition, f4 has to be found anyway.
Vinvin wrote:Bd1 is completely winning too :

FEN: 4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - - 0 1

Code: Select all

Stockfish_160922_x64_modern_fast&#58;
...
 42/66	01&#58;45	 1 393 842k	13 195k	+1,17	1.Kd7 Bd2 2.Ke6 h5 3.Kf5 Kf7 4.a4 Ke7 5.f4 h4 6.Kg4 Kf6 7.Bd3 h3 8.Kxh3 Bxf4 9.Kg4 Bd2 10.f4 Be1 11.Kf3 Bd2 12.Ke4 Ke6 13.Bf1 Bc3 14.Bh3+ Kd6 15.Kf5 Bd2 16.Bg2 Be3 17.Kg4 Bd2 18.Kg5 Ke6 19.Bf3 Kf7 20.Bg4 Ke7 21.Bd1 Kd6 22.Bf3 Ke6 23.Be4
 42/66	01&#58;45	 1 393 842k	13 195k	+4,26	1.f4 Bf6 2.Bd1 Kg7 3.Bh5 Bb2 4.Ke7 Bc1 5.f5 Bb2 6.a4 Bf6+ 7.Kd6 Bc3 8.Ke6 Bb4 9.f6+ Kf8 10.f4 Bc3 11.Kd6 Ba5 12.Kc7 Kg8 13.Kd7 Kf8 14.Kc6 Kg8 15.Kb7 Kf8 16.Kc8 Bd2 17.Kc7 Ba5 18.Kd6 Bc3 19.Ke6 Ba5 20.Kd7 Bd2 21.Kc8 Bxf4 22.Kb7 Be3 23.Kc6 Bf2 24.Bd1 Be3 25.Kxb6 c4+ 26.Kc6 c3 27.b6
 42/66	01&#58;45	 1 393 842k	13 195k	+5,20	1.Bd1 Bd2 2.f4 Kg7 3.Kd7 Ba5 4.Bg4 Kg6 5.Ke6 Be1 6.f5+ Kg7 7.a4 Kg8 8.Bh5 Kf8 9.Kd7 Bc3 10.Kc6 Ba5 11.f6 Kg8 12.Kd7 Kf8 13.f4 Bc3 14.Kc6 Ba5 15.Kc7 Kg8 16.Kd7 Kf8 17.Kc6 Kg8 18.Kc7 Kf8 19.f7 Ke7 20.f5 Kf8 21.Kc6 Bb4 22.Kxb6 c4 23.bxc4 Bc3 24.Kc6 Ba5 25.b6 Be1 26.c5 Bf2 27.b7
---------------------------------------------------------------------------
 43/86	11&#58;42	 10 029 231k	14 272k	+1,18	1.Kd7 Bd2 2.Ke6 h5 3.Kf5 Kf7 4.a4 Ke7 5.f4 h4 6.Kg4 Kf6 7.f5 Be1 8.Kxh4 Bxf2+ 9.Kg4 Be1 10.Kf4 Bd2+ 11.Ke4 Ke7 12.Kd5 Kf6 13.Bd3 Ba5 14.Kc6 Kg5 15.Kc7 Kf6 16.Kd7 Be1 17.Kc6 Ba5 18.Kc7 Ke5 19.Kd7 Kf6 20.Kd6 Bd2 21.Bb1 Bc3 22.Kc6 Ba5 23.Kd5 Bd2 24.Bc2 Be1 25.Ke4 Bd2
 43/86	11&#58;42	 10 029 231k	14 272k	+7,95	1.f4 Bf6 2.Bd1 Kg7 3.Bh5 Bc3 4.Ke7 Ba5 5.Ke6 Be1 6.Kd6 Bb4 7.Kd7 Be1 8.Bg4 Bxf2 9.Kc6 Kg6 10.f5+ Kf6 11.a3 Kf7 12.Bd1 Ke7 13.f6+ Kxf6 14.a4 Ke6 15.Kxb6 c4+ 16.Kb7 c3 17.a5 h5 18.b6 h4 19.a6 h3 20.a7 h2 21.Bf3 c2 22.a8Q c1Q 23.Qe8+ Kf6 24.Qf8+ Ke5 25.Qg7+ Kf5 26.Qf7+ Kg5 27.Qe7+ Kf4 28.Qe4+ Kg5 29.Qe5+ Kg6 30.Be4+ Kf7 31.Qf5+ Ke8 32.Qe6+ Kf8 33.Qf6+ Kg8 34.Qxf2 Qg1 35.Bd5+ Kh7 36.Qf5+ Kh6 37.Qf4+ Kg6 38.Be4+ Kh5 39.Kc6
 43/86	11&#58;42	 10 029 231k	14 272k	+11,52	1.Bd1 Bh4 2.a4 Bg5 3.a5 bxa5 4.Be2 Bf4 5.Kd7 Kg7 6.Kc6 Kf7 7.b6 Ke7 8.Bd3 Kd8 9.Bf5 Bb8 10.Kxc5 Be5 11.Kd5 Bg7 12.Kc6 h5 13.b7 Be5 14.Bg4 Ke7 15.Bxh5 Kd8 16.Bg4 Bc7 17.Kc5 Ke8 18.Bh3 Kd8 19.Kb5 Ke8 20.Ka6 Bb8 21.Kxa5 Kf7 22.Bg4 Kf6 23.f4 Kf7 24.Kb6 Kf8 25.Kc6 Ke7 26.Bh5 Kd8 27.f5 Ke7 28.f6+ Kf8 29.Kd7 Ba7 30.Kc8 Bxf2 31.b8R Kg8 32.Kb7+ Kh7
---------------------------------------------------------------------------
 44/86	19&#58;07	 16 336 591k	14 236k	+1,18	1.Kd7 Bd2 2.Ke6 h5 3.Kf5 Kf7 4.a4 Ke7 5.f4 h4 6.Kg4 Kf6 7.f5 Be1 8.Kxh4 Bxf2+ 9.Kg4 Be1 10.Kf4 Bd2+ 11.Ke4 Ke7 12.Kd5 Kf6 13.Bd3 Ba5 14.Kc6 Kg5 15.Kc7 Kf6 16.Kd7 Be1 17.Kc6 Ba5 18.Kc7 Ke5 19.Kd7 Kf6 20.Bc2 Bd2 21.Kc7 Ba5 22.Kc6 Kg5 23.Kd7 Kf6 24.Bb1 Bd2 25.Kd6 Bc3
 44/86	19&#58;07	 16 336 591k	14 236k	+12,72	1.f4 Bf6 2.Bd1 Kg7 3.Bh5 Bc3 4.Ke7 Ba5 5.Ke6 Bd2 6.Kd6 Bb4 7.Kd7 Bc3 8.Bg4 Kg6 9.Kc6 Bd4 10.a4 h5 11.a5 c4 12.a6 hxg4 13.a7 cxb3 14.a8Q b2 15.Qe8+ Kg7 16.Qd7+ Kf8 17.Qf5+ Ke7 18.Qh7+ Kf6 19.Kd5 Bc3 20.Kc4 Ba5 21.Qh8+ Kg6 22.Qxb2 Kf7 23.Qe2 g3 24.fxg3 Kf6 25.Qe5+ Kf7 26.Qf5+ Ke7 27.Qg6 Kd7 28.f5 Ke7 29.f6+ Ke6 30.f7+ Ke7
 44/86	19&#58;07	 16 336 591k	14 236k	+14,30	1.Bd1 Bh4 2.a4 Bg5 3.a5 bxa5 4.Be2 Bf4 5.Kd7 Kg7 6.Kc6 Kf7 7.b6 Ke7 8.Bd3 Bd6 9.Bf5 h5 10.Kd5 Bh2 11.Kxc5 Kd8 12.Kc6 Bg1 13.b7 Bh2 14.Bg4 Bc7 15.Bxh5 Be5 16.Bg4 Bc7 17.Kb5 Ke7 18.Bh5 Ke6 19.Kc6 Bf4 20.Bg4+ Ke7 21.Kb6 Bb8 22.f4 Kd6 23.Bh5 Ke6 24.Kxa5 Kf6 25.Ka6 Kg7 26.Kb6 Kh8 27.f5 Kg7 28.Kc6 Kf6 29.Kd7 Kg5 30.Kc8 Kh4 31.Kxb8 Kh3 32.f6 Kg2 33.Ka7
mcostalba wrote:I am working out all the Arasan test suite now, but I have found this position that if correct it is really one of the most difficult of the world :-)

4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - - bm f4; id "arasan19.189"; c0 "Šachová skladba 2011-12, 1st Prize";

[D]4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - -

In particular there is very little difference between the best move and the second one, so it is really difficult to tell if the study is correct.
Top
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: "Poor Fish": very hard test suite

Post by Vinvin »

You can use my "hard set" too : http://www.talkchess.com/forum/viewtopic.php?t=60573

A lot of results for a previous version here : http://www.talkchess.com/forum/viewtopi ... 464#673464

I've very often seen this phenomenon with Stockfish too.
... when I forced the solution Stockfish suddenly saw the light.
The reason is probably too much pruning in a not clear position.
mcostalba wrote:Indeed it is a small subset of the Arasan test suite, all credits go to Jon Dart.

I have just filtered out of the first 100 or so positions of the test suite the ones that seem impossible to find for SF (and also for other engines). I only extracted position from human games because those from engine games have been already found by some engine, indeed the engine that played the game: -)

I have verified solution is correct because when I forced the solution Stockfish suddenly saw the light.

Here we go:

Code: Select all

r2q3r/1p1bbQ2/4p1Bk/3pP3/1n1P1P1p/pP6/Pn4PP/R1B1R1K1 w - - bm g4; id "arasan19.10"; c0 "Fier-Ryan, Sabadell op 2009";
rn1q1rk1/2pbb3/pn2p3/1p1pPpp1/3P4/1PNBBN2/P1P1Q1PP/R4R1K w - - bm Nxg5; id "arasan19.16"; c0 "Dann Corbit, CCC 2015";
r5n1/p1p1q2k/4b2p/3pB3/3PP1pP/8/PPPQ2P1/5RK1 w - - bm Qf4; id "arasan19.23"; c0 "Shulman-Marciano, Ubeda 1997";
rn1qr1k1/1p2bppp/p3p3/3pP3/P2P1B2/2RB1Q1P/1P3PP1/R5K1 w - - bm Bxh7+; id "arasan19.42"; c0 "Polugaevsky-Torre, London 1984";
1n3rk1/3rbppp/p2p4/4pP2/Ppq1P3/1N2B3/1PP3PP/R2Q1R1K w - - bm f6; id "arasan19.44"; c0 "Kuzmin-Groszpeter, Kusadasi 1990";
Top
Joerg Oster
Posts: 937
Joined: Fri Mar 10, 2006 4:29 pm
Location: Germany

Re: "Poor Fish": very hard test suite

Post by Joerg Oster »

Actually, the 2nd position seems not to be too difficult.
[d]r5n1/p1p1q2k/4b2p/3pB3/3PP1pP/8/PPPQ2P1/5RK1 w - -

1 Thread, 512 MB Hash: (Qd2-f4 was found after about 1 minute.)

Code: Select all

info depth 37 seldepth 66 multipv 1 score cp 564 upperbound nodes 418666456 nps 1495018 hashfull 999 tbhits 0 time 280041 pv d2f4 c7c6
info depth 37 currmove d2f4 currmovenumber 1
info depth 37 seldepth 66 multipv 1 score cp 571 lowerbound nodes 424155663 nps 1494653 hashfull 999 tbhits 0 time 283782 pv d2f4
info depth 37 currmove d2f4 currmovenumber 1
info nodes 449146665 time 300000
bestmove d2f4 ponder c7c6
Jörg Oster
Top

Return to “Computer Chess Club: General Topics”