Mate Test Suite

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

BBauer
Posts: 658
Joined: Wed Mar 08, 2006 8:58 pm

Re: Mate Test Suite

Post by BBauer »

Is that what you want?

Code: Select all

PolyGlot 2.0.1 by Fabien Letouzey.

EngineName=Stockfish 270415 64 POPCNT

[Search parameters: MaxDepth=127   MaxTime=10.0   DepthDelta=5   MinDepth=12   MinTime=0.1]

 1:                 --    0 score= +0.00    pv [D=19, T=   3.22s, N=  8008k] =Nb5 Rxc5 Kb3 h2 Bf3+ c6 Kxb4 g4 Nc7+ Kb8 Ne6 Rxc4+ Kxc4 gxf3 Rd8+ Kb7 Rd7+ Kb8
 2:                 --    0 score= +0.51    pv [D= 5, T=   0.00s, N=     1k] =Kg4 Be7 d4+ exd4 Kxf4 Bg5+ Ke4 Bc1 Bd5 Bg5 Kf5 Be7 Bf7 Bg5 Be6 Be7 Kg4 Bd8 Kg3 Bg5
 Kf3 Be7 Kf2 Bg5 Kg3 Be7 Bf7 Bf6 Bc4 Bg5 Kg4 Bf6 Bd5 Bg5 Kg3 Bd8 Kf4 Bf6 Bg8 Be7 Bf7 Bd8 Kg4 Be7
 3:                 --    0 score= +0.00    pv [D= 9, T=   0.01s, N=    16k] =Bd5 Rh3 Rxb4 Rxg3 Ra4 h5 Rxa3 h4 Ra8 Kf4 Kf6 Rg1 Rh8 g5 Be6 Ra1 Rh5 Ra6 Rh7 g4 Rxh
4 Kxf3 Kxf5
 4:                 OK    1 score= +0.00    pv [D=14, T=   0.09s, N=    87k] =Rb1 c4 Ke4 c3 bxc3 h4 Rd1 h3 Re1 Qe5+ Kxe5 h2 Nxh2 Kxh2
 5:                 --    1 score= -2.48    pv [D=21, T=   4.01s, N= 12097k] =Bc5+
 6:                 OK    2 score= +2.74    pv [D=14, T=   0.45s, N=   884k] =Bxf6 Bxf6 Be6 Bg7 Qh4 Bxe6 Nxe6+ Kg8 Rxd8 Rxd8 Qxe7 Bd4+ Nxd4 Rxd4 f5 Qc5 Qe8+ Qf8
 Qxg6+ Qg7 Qe8+ Kh7 Kg2 Rd2+ Rf2 Rxf2+ Kxf2 Qc3 Qf7+ Kh8
 7:                 --    2 score=+99.79    pv [D= 7, T=   0.01s, N=     6k] =Qf7+ Kb6 Qxg6 axb4 axb4 Qf8 Qg7 Qxg7 hxg7 d5 Bf5 Kc6 g8=Q Kc7 Bc8 e4 Qe6 Kb8 Qd7 e
3 Qb7#
 8:                 --    2 score= +1.75    pv [D=25, T=   4.18s, N= 11876k] =Rxc7

score=2/8 [averages on correct positions: depth=14.0 time=0.27 nodes=486107]
Or do you want to show how good you are?

Kind regards
Bernhard
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Mate Test Suite

Post by zullil »

jhellis3 wrote:Sigh, so much OT and fail..

How hard is it to either:

A) post a single-threaded 512MB Hash result from a chess engine (preferably not stockfish but whatever)

or

B) not post
You've chosen the wrong venue for a controlled experiment. :wink:
Ferdy
Posts: 4856
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Mate Test Suite

Post by Ferdy »

I make a custom epd with bm in LAN found in c0, so script can be run easily verifying the best move especially for uci engines.

Sample result from Deuterium at 2 minutes/pos.

Code: Select all

Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
Physical Cores: 4
Hyper-Threading: ON
Hash: 128, Threads: 1, Time: 120s/pos
Test file: joseph_ellis_mates.epd
id name Deuterium v2015.1.35.135, TotalPos: 17, Correct: 2 (11.76%)

Pos  Correct  Enginebm   epd
 1        0       f4e5   8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - - bm Kc1; dm 5; id "je 1"; c0 "b1c1;
 2        0       h3g3   8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - - bm Kh5; dm 5; id "je 2"; c0 "h4h5";
 3        0       g3f2   qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - - bm Bh4; dm 5; id "je 3"; c0 "g3h4";
 4        0       e3d2   1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
 5        0       c8d6   n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - - bm Rh1; dm 6; id "je 5"; c0 "h5h1";
 6        0       f4a4   1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - - bm Nd7; dm 6; id "je 6"; c0 "b8d7";
 7        0       e5b2   5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - - bm Ra8; dm 6; id "je 7"; c0 "f8a8";
 8        0       a2a5   3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - - bm b4; dm 7; id "je 8"; c0 "b2b4";
 9        0       f3d3   4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - - bm Rf2 Ke1; dm 11; id "je 9"; c0 "f3f2 f1e1";
10        0       a6d6   n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - - bm Qc8; dm 13; id "je 10"; c0 "a6c8";
11        0       f7e6   8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - - bm Rd3; dm 16; id "je 11"; c0 "e3d3";
12        1       b5c6   1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - - bm bxc6; dm 17; id "je 12"; c0 "b5c6";
13        0       d5e4   8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - - bm Ke6; dm 20; id "je 13"; c0 "d5e6";
14        0       d4e5   8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - - bm Bh8; dm 21; id "je 14"; c0 "d4h8";
15        1       b8a7   1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - - bm Ba7; dm 22; id "je 15"; c0 "b8a7";
16        0       c6d7   1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - - bm Bb5 Kd5; dm 27; id "je 16"; c0 "c4b5 c6d5";
17        0       d1d5   4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - - bm Rd8; dm 29; id "je 17"; c0 "d1d8";
The epd.

Code: Select all

8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - - bm Kc1; dm 5; id "je 1"; c0 "b1c1;
8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - - bm Kh5; dm 5; id "je 2"; c0 "h4h5";
qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - - bm Bh4; dm 5; id "je 3"; c0 "g3h4";
1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - - bm Rh1; dm 6; id "je 5"; c0 "h5h1";
1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - - bm Nd7; dm 6; id "je 6"; c0 "b8d7";
5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - - bm Ra8; dm 6; id "je 7"; c0 "f8a8";
3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - - bm b4; dm 7; id "je 8"; c0 "b2b4";
4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - - bm Rf2 Ke1; dm 11; id "je 9"; c0 "f3f2 f1e1";
n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - - bm Qc8; dm 13; id "je 10"; c0 "a6c8";
8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - - bm Rd3; dm 16; id "je 11"; c0 "e3d3";
1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - - bm bxc6; dm 17; id "je 12"; c0 "b5c6";
8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - - bm Ke6; dm 20; id "je 13"; c0 "d5e6";
8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - - bm Bh8; dm 21; id "je 14"; c0 "d4h8";
1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - - bm Ba7; dm 22; id "je 15"; c0 "b8a7";
1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - - bm Bb5 Kd5; dm 27; id "je 16"; c0 "c4b5 c6d5";
4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - - bm Rd8; dm 29; id "je 17"; c0 "d1d8";
I am curious were you able to verify the distance to mate of these positions?
jhellis3
Posts: 548
Joined: Sat Aug 17, 2013 12:36 am

Re: Mate Test Suite

Post by jhellis3 »

Thanks for the feedback.
I am curious were you able to verify the distance to mate of these positions?
Yes, all except the very last position anyway. I know it is at least mate in 29, but I am not certain there is not a quicker solution.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Mate Test Suite

Post by zullil »

Ferdy wrote: The epd.

Code: Select all

8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - - bm Kc1; dm 5; id "je 1"; c0 "b1c1;
8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - - bm Kh5; dm 5; id "je 2"; c0 "h4h5";
qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - - bm Bh4; dm 5; id "je 3"; c0 "g3h4";
1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - - bm Rh1; dm 6; id "je 5"; c0 "h5h1";
1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - - bm Nd7; dm 6; id "je 6"; c0 "b8d7";
5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - - bm Ra8; dm 6; id "je 7"; c0 "f8a8";
3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - - bm b4; dm 7; id "je 8"; c0 "b2b4";
4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - - bm Rf2 Ke1; dm 11; id "je 9"; c0 "f3f2 f1e1";
n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - - bm Qc8; dm 13; id "je 10"; c0 "a6c8";
8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - - bm Rd3; dm 16; id "je 11"; c0 "e3d3";
1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - - bm bxc6; dm 17; id "je 12"; c0 "b5c6";
8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - - bm Ke6; dm 20; id "je 13"; c0 "d5e6";
8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - - bm Bh8; dm 21; id "je 14"; c0 "d4h8";
1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - - bm Ba7; dm 22; id "je 15"; c0 "b8a7";
1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - - bm Bb5 Kd5; dm 27; id "je 16"; c0 "c4b5 c6d5";
4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - - bm Rd8; dm 29; id "je 17"; c0 "d1d8";
Thanks, but please note that finding the best move is not equivalent to solving the position, since the OP is requiring minimal mates. For example, Stockfish will quickly find Kh5 for the second position, but with mate-in-8. Until it finds mate-in-5, the OP does not consider the position solved. Or so I understand.
Ferdy
Posts: 4856
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Mate Test Suite

Post by Ferdy »

zullil wrote:
Ferdy wrote: The epd.

Code: Select all

8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - - bm Kc1; dm 5; id "je 1"; c0 "b1c1;
8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - - bm Kh5; dm 5; id "je 2"; c0 "h4h5";
qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - - bm Bh4; dm 5; id "je 3"; c0 "g3h4";
1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - - bm Rh1; dm 6; id "je 5"; c0 "h5h1";
1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - - bm Nd7; dm 6; id "je 6"; c0 "b8d7";
5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - - bm Ra8; dm 6; id "je 7"; c0 "f8a8";
3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - - bm b4; dm 7; id "je 8"; c0 "b2b4";
4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - - bm Rf2 Ke1; dm 11; id "je 9"; c0 "f3f2 f1e1";
n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - - bm Qc8; dm 13; id "je 10"; c0 "a6c8";
8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - - bm Rd3; dm 16; id "je 11"; c0 "e3d3";
1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - - bm bxc6; dm 17; id "je 12"; c0 "b5c6";
8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - - bm Ke6; dm 20; id "je 13"; c0 "d5e6";
8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - - bm Bh8; dm 21; id "je 14"; c0 "d4h8";
1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - - bm Ba7; dm 22; id "je 15"; c0 "b8a7";
1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - - bm Bb5 Kd5; dm 27; id "je 16"; c0 "c4b5 c6d5";
4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - - bm Rd8; dm 29; id "je 17"; c0 "d1d8";
Thanks, but please note that finding the best move is not equivalent to solving the position, since the OP is requiring minimal mates. For example, Stockfish will quickly find Kh5 for the second position, but with mate-in-8. Until it finds mate-in-5, the OP does not consider the position solved. Or so I understand.
From his first post he was just curious how the engine would perform. From initial tries these are difficult positions, even the bm is difficult to hit.

Here is sf6 at 5s/pos. There must be something in these positions :).

Code: Select all

Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
Physical Cores: 4
Hyper-Threading: ON
Hash: 128, Threads: 1, Time: 5s/pos
Test file: joseph_ellis_mates.epd
id name Stockfish 6 64 POPCNT, TotalPos: 17, Correct: 2 (11.76%)

Pos  Correct  Enginebm   epd
 1        0       f4e5   8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - - bm Kc1; dm 5; id "je 1"; c0 "b1c1;
 2        1       h4h5   8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - - bm Kh5; dm 5; id "je 2"; c0 "h4h5";
 3        0       b5a6   qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - - bm Bh4; dm 5; id "je 3"; c0 "g3h4";
 4        0       e3d2   1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
 5        0       c8d6   n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - - bm Rh1; dm 6; id "je 5"; c0 "h5h1";
 6        0       f4a4   1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - - bm Nd7; dm 6; id "je 6"; c0 "b8d7";
 7        0       e5b2   5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - - bm Ra8; dm 6; id "je 7"; c0 "f8a8";
 8        0       a2a5   3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - - bm b4; dm 7; id "je 8"; c0 "b2b4";
 9        0       f3d3   4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - - bm Rf2 Ke1; dm 11; id "je 9"; c0 "f3f2 f1e1";
10        0       a6d6   n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - - bm Qc8; dm 13; id "je 10"; c0 "a6c8";
11        0       f7e6   8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - - bm Rd3; dm 16; id "je 11"; c0 "e3d3";
12        0       f3d1   1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - - bm bxc6; dm 17; id "je 12"; c0 "b5c6";
13        0       d5d4   8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - - bm Ke6; dm 20; id "je 13"; c0 "d5e6";
14        0       d4e5   8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - - bm Bh8; dm 21; id "je 14"; c0 "d4h8";
15        1       b8a7   1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - - bm Ba7; dm 22; id "je 15"; c0 "b8a7";
16        0       c4a2   1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - - bm Bb5 Kd5; dm 27; id "je 16"; c0 "c4b5 c6d5";
17        0       d1d5   4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - - bm Rd8; dm 29; id "je 17"; c0 "d1d8";
Henk
Posts: 7261
Joined: Mon May 27, 2013 10:31 am

Re: Mate Test Suite

Post by Henk »

An engine can only solve these positions if it has really good zugzwang detection. But I understood that that doesn't exist.
BBauer
Posts: 658
Joined: Wed Mar 08, 2006 8:58 pm

Re: Mate Test Suite

Post by BBauer »

This is a 1 min run, 1 thread, 512 mb hash.

Code: Select all

PolyGlot 2.0.1 by Fabien Letouzey.

EngineName=Stockfish 270415 64 POPCNT

[Search parameters: MaxDepth=127   MaxTime=60.0   DepthDelta=5   MinDepth=12   MinTime=0.1]

 1: "je 1"          --    0 score=+16.04    pv [D= 1, T=   0.00s, N=     0k] =fxe5
 2: "je 2"          OK    1 score=+99.85    pv [D=21, T=   2.54s, N=  1665k] =Kh5 Ba2 Qe3+ Kf5 Ng7+ Kf6 Qg5+ Kf7 Be8+ Kf8 Qf6+ Kg8 Bf7+ Kh7 Qh6#
 3: "je 3"          --    1 score=+10.72    pv [D=24, T=  15.65s, N= 11879k] =bxa6
 4: "je 4"          --    1 score=+16.03    pv [D=10, T=   0.07s, N=    46k] =Bd2
 5: "je 5"          --    1 score= +5.43    pv [D=11, T=   0.01s, N=     6k] =Nd6
 6: "je 6"          --    1 score=+16.61    pv [D= 1, T=   0.00s, N=     0k] =Rxa4
 7: "je 7"          --    1 score=+99.73    pv [D=24, T=  39.21s, N= 28675k] =h6 b1=Q h7 Qe1 h8=Q Qxf2 Ng3+ Kh2 Ne4+ Nf4+ Kxf7 Rg4 Nxf2 Kg3 Nxg4 Kxf3 exf4+ Ke2
Re3+ Kd1 Rd8+ Kc2 Re2+ Kc1 Re1+ Kc2 Ne3#
 8: "je 8"          --    1 score= +5.94    pv [D= 1, T=   0.00s, N=     0k] =Rxa5 Rxa5 Rc7 b4 Bxa5 Na2 Bxg4 c3 bxc3 bxc3 dxc3 e3 fxe3 Nxc3 exf4 exf4 Bb4+ Kd5 R
d7+ Ke4 Re7+ Kd5 Bf3+ Kc4 Bd6 Nd5 Re5 Ne3 Rc5+ Kb4 Rc7+ Ka5 Bxf4 b6 c3
 9: "je 9"          --    1 score=+123.49    pv [D=20, T=   7.19s, N=  6350k] =Rf8+ Rxf8+ Nxf8 Kd8 Bxd7 e5 Ne6+ Ke7 Nxc7
10: "je 10"         --    1 score= +0.00    pv [D= 2, T=   0.00s, N=     0k] =Qd6+ Kg8 gxh7+ Kh8 Bxa5 Qc8 Bd2 Nb6 Qxb6 Qf8 Kg5 Kxh7
11: "je 11"         --    1 score= +0.00    pv [D= 2, T=   0.00s, N=     0k] =g3
12: "je 12"         --    1 score=-10.83    pv [D=20, T=  20.65s, N= 15718k] =Qd1 Qf8
13: "je 13"         --    1 score= +0.00    pv [D= 5, T=   0.00s, N=     0k] =Kd4 Bc5+ Kxc5 b4+ Kc4 Re5 a3 a5 axb4 axb4 Nxc3+ Ka5 Ra1+ Kb6 Kxb4 Re2 Nd4 Bxg4 Nd1
 Bd7 Kc3 g4 Nxe2 fxe2 Kxd2 exd1=R+ Kxd1 g6 Kd2 Kc5 Kc3 Bf5 Ra5+ Kd6 Kd4 g3 Ra6+ Kc7 fxg3 fxg3 Ke3 Kb7 Rxg6
14: "je 14"         --    1 score= +8.99    pv [D= 4, T=   0.00s, N=     0k] =Bf6
15: "je 15"         OK    2 score= +1.79    pv [D= 8, T=   0.01s, N=     3k] =Ba7 Ke5 Bd4+ Kf5 Bc5 Ke5 Bd6+ Kf5 Nd7 Ke6 Nc5+ Rxc5+ Kxc5 f5 c4 Nh8 Bg8 Ng6 Kc6 Ne
5+ Bxe5 Kxe5 c5 Bg6 Kb5
16: "je 16"         --    2 score= +0.00    pv [D= 3, T=   0.00s, N=     0k] =Ba2 Qg8 Bb3 Qh8 Ba2
17: "je 17"         --    2 score= +0.00    pv [D=10, T=   0.02s, N=    15k] =Rd5 c3 Rxf5 Rc8 Rxc5 Ke8 Kc2 Kd7 Ra5 Kxc7 Rxa6 Kb7 Ra4 Kb6 Rf4 Kb5 Rd4 Rc6 a4+ Ka5
 Rf4 Rc8 Rg4 Rc6 Rf4

score=2/17 [averages on correct positions: depth=14.5 time=1.27 nodes=834375]
So what?
bernhard
jhellis3
Posts: 548
Joined: Sat Aug 17, 2013 12:36 am

Re: Mate Test Suite

Post by jhellis3 »

From his first post he was just curious how the engine would perform. From initial tries these are difficult positions, even the bm is difficult to hit.
Ideally, I would like to know if the actual mate was resolved. However, given that we are now dozens of posts into the thread, and yours are the only ones remotely close to what I had in mind... I'll take what I can get.
Ferdy
Posts: 4856
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Mate Test Suite

Post by Ferdy »

jhellis3 wrote:Thanks for the feedback.
I am curious were you able to verify the distance to mate of these positions?
Yes, all except the very last position anyway. I know it is at least mate in 29, but I am not certain there is not a quicker solution.
Now at 3min/pos, one bm more is found.

Code: Select all

Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
Physical Cores: 4
Hyper-Threading: ON
Hash: 128, Threads: 1, Time: 180s/pos
Test file: joseph_ellis_mates.epd
id name Deuterium v2015.1.35.135, TotalPos: 17, Correct: 3 (17.65%)

Pos  Correct  Enginebm   epd
 1        0       f4e5   8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - - bm Kc1; dm 5; id "je 1"; c0 "b1c1;
 2        1       h4h5   8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - - bm Kh5; dm 5; id "je 2"; c0 "h4h5";
 3        0       g3f2   qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - - bm Bh4; dm 5; id "je 3"; c0 "g3h4";
 4        0       e3d2   1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
 5        0       c8d6   n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - - bm Rh1; dm 6; id "je 5"; c0 "h5h1";
 6        0       f4a4   1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - - bm Nd7; dm 6; id "je 6"; c0 "b8d7";
 7        0       e5b2   5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - - bm Ra8; dm 6; id "je 7"; c0 "f8a8";
 8        0       a2a5   3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - - bm b4; dm 7; id "je 8"; c0 "b2b4";
 9        0       f3d3   4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - - bm Rf2 Ke1; dm 11; id "je 9"; c0 "f3f2 f1e1";
10        0       a6d6   n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - - bm Qc8; dm 13; id "je 10"; c0 "a6c8";
11        0       f7e6   8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - - bm Rd3; dm 16; id "je 11"; c0 "e3d3";
12        1       b5c6   1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - - bm bxc6; dm 17; id "je 12"; c0 "b5c6";
13        0       d5e4   8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - - bm Ke6; dm 20; id "je 13"; c0 "d5e6";
14        0       d4e5   8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - - bm Bh8; dm 21; id "je 14"; c0 "d4h8";
15        1       b8a7   1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - - bm Ba7; dm 22; id "je 15"; c0 "b8a7";
16        0       c6d7   1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - - bm Bb5 Kd5; dm 27; id "je 16"; c0 "c4b5 c6d5";
17        0       d1d5   4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - - bm Rd8; dm 29; id "je 17"; c0 "d1d8";