Mate Test Suite

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Ferdy
Posts: 4856
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Mate Test Suite

Post by Ferdy »

jhellis3 wrote:
From his first post he was just curious how the engine would perform. From initial tries these are difficult positions, even the bm is difficult to hit.
Ideally, I would like to know if the actual mate was resolved. However, given that we are now dozens of posts into the thread, and yours are the only ones remotely close to what I had in mind... I'll take what I can get.
One engine that I found to be good at solving mate position from Dan mate positions is Cheng and it indeed performed well here.

Code: Select all

Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
Physical Cores: 4
Hyper-Threading: ON
Hash: 128, Threads: 1, Time: 5s/pos
Test file: joseph_ellis_mates.epd
id name cheng4 0.38, TotalPos: 17, Correct: 5 (29.41%)

Pos  Correct  Enginebm   epd
 1        0       f4e5   8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - - bm Kc1; dm 5; id "je 1"; c0 "b1c1;
 2        0       h3g3   8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - - bm Kh5; dm 5; id "je 2"; c0 "h4h5";
 3        0       g3f2   qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - - bm Bh4; dm 5; id "je 3"; c0 "g3h4";
 4        1       b8c8   1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
 5        1       h5h1   n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - - bm Rh1; dm 6; id "je 5"; c0 "h5h1";
 6        0       f4a4   1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - - bm Nd7; dm 6; id "je 6"; c0 "b8d7";
 7        0       e5b2   5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - - bm Ra8; dm 6; id "je 7"; c0 "f8a8";
 8        0       a2a5   3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - - bm b4; dm 7; id "je 8"; c0 "b2b4";
 9        0       f3f5   4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - - bm Rf2 Ke1; dm 11; id "je 9"; c0 "f3f2 f1e1";
10        1       a6c8   n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - - bm Qc8; dm 13; id "je 10"; c0 "a6c8";
11        0       f1e2   8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - - bm Rd3; dm 16; id "je 11"; c0 "e3d3";
12        0       f3d1   1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - - bm bxc6; dm 17; id "je 12"; c0 "b5c6";
13        0       d5e4   8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - - bm Ke6; dm 20; id "je 13"; c0 "d5e6";
14        1       d4h8   8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - - bm Bh8; dm 21; id "je 14"; c0 "d4h8";
15        1       b8a7   1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - - bm Ba7; dm 22; id "je 15"; c0 "b8a7";
16        0       c4d5   1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - - bm Bb5 Kd5; dm 27; id "je 16"; c0 "c4b5 c6d5";
17        0       d1d5   4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - - bm Rd8; dm 29; id "je 17"; c0 "d1d8";
Checking at the log, one position with mate reported. This is only at 5s, this engine has a potential to solve some of these positions.

Code: Select all

1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
Solution: b8c8
>> isready
<< readyok
>> ucinewgame
>> position fen 1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - 0 1
2015-05-10T03:12:41.914000 >> go movetime 5000
2015-05-10T03:12:45.084000 << info depth 17 seldepth 35 time 2761 nodes 4001395 nps 1449255 multipv 1 score mate 6 pv b8c8 g2h3 g3g4 h3g4 c8b8 g4f3 e3d2 e2e1q d2e1 f3c6 e1a5
2015-05-10T03:12:45.086000 << info depth 18 seldepth 35 time 3158 nodes 4988153 nps 1579529 multipv 1 score mate 6 pv b8c8 g2h3 g3g4 h3g4 c8b8 g4f3 e3d2 e2e1q d2e1 f3c6 e1a5
2015-05-10T03:12:45.287000 << info depth 19 seldepth 35 time 3360 nodes 5480048 nps 1630966 multipv 1 score mate 6 pv b8c8 g2h3 g3g4 h3g4 c8b8 g4f3 e3d2 e2e1q d2e1 f3c6 e1a5
2015-05-10T03:12:45.485000 << info depth 20 seldepth 35 time 3558 nodes 5985838 nps 1682360 multipv 1 score mate 6 pv b8c8 g2h3 g3g4 h3g4 c8b8 g4f3 e3d2 e2e1q d2e1 f3c6 e1a5
2015-05-10T03:12:45.722000 << info depth 21 seldepth 35 time 3795 nodes 6499848 nps 1712739 multipv 1 score mate 6 pv b8c8 g2h3 g3g4 h3g4 c8b8 g4f3 e3d2 e2e1q d2e1 f3c6 e1a5
2015-05-10T03:12:45.950000 << info depth 22 seldepth 35 time 4023 nodes 7036553 nps 1749081 multipv 1 score mate 6 pv b8c8 g2h3 g3g4 h3g4 c8b8 g4f3 e3d2 e2e1q d2e1 f3c6 e1a5
2015-05-10T03:12:46.139000 << info depth 23 seldepth 35 time 4212 nodes 7566870 nps 1796502 multipv 1 score mate 6 pv b8c8 g2h3 g3g4 h3g4 c8b8 g4f3 e3d2 e2e1q d2e1 f3c6 e1a5
2015-05-10T03:12:46.368000 << info depth 24 seldepth 35 time 4440 nodes 8114295 nps 1827543 multipv 1 score mate 6 pv b8c8 g2h3 g3g4 h3g4 c8b8 g4f3 e3d2 e2e1q d2e1 f3c6 e1a5
2015-05-10T03:12:46.579000 << info depth 25 seldepth 35 time 4651 nodes 8666200 nps 1863298 multipv 1 score mate 6 pv b8c8 g2h3 g3g4 h3g4 c8b8 g4f3 e3d2 e2e1q d2e1 f3c6 e1a5
2015-05-10T03:12:46.816000 << info depth 26 seldepth 35 time 4889 nodes 9220207 nps 1885908 multipv 1 score mate 6 pv b8c8 g2h3 g3g4 h3g4 c8b8 g4f3 e3d2 e2e1q d2e1 f3c6 e1a5
2015-05-10T03:12:46.927000 << bestmove b8c8 ponder g2h3
Best move is correct!!
jhellis3
Posts: 548
Joined: Sat Aug 17, 2013 12:36 am

Re: Mate Test Suite

Post by jhellis3 »

Thanks, this is exactly what I'm looking for :).
BBauer
Posts: 658
Joined: Wed Mar 08, 2006 8:58 pm

Re: Mate Test Suite

Post by BBauer »

Here is a better test position
[d]rk6/p1r3p1/P3B1K1/1p2B3/8/8/8/8 w - - 0 1
It is #5 but there is only 1 winning move. So you have to find it to get the point.
My SF gives

Code: Select all

FEN: rk6/p1r3p1/P3B1K1/1p2B3/8/8/8/8 w - - 0 1

St-mod-15-05-09:
 8/10	00:00	 889	222k	+0,06	Le6-d5 b5-b4 Le5xc7+ Kb8xc7 Ld5xa8 Kc7-b6 La8-d5 Kb6xa6 Ld5-c4+ Ka6-b6
...
 50/15	00:30	 72.140k	2.342k	 0,00	Le6-d5 b5-b4 Ld5xa8 Kb8xa8 Le5xc7 b4-b3 Lc7-e5 b3-b2 Le5xb2
 51/15	00:36	 86.271k	2.353k	 0,00	Le6-d5 b5-b4 Ld5xa8 Kb8xa8 Le5xc7 b4-b3 Lc7-e5 b3-b2 Le5xb2
 52/15	00:41	 97.273k	2.353k	 0,00	Le6-d5 b5-b4 Ld5xa8 Kb8xa8 Le5xc7 b4-b3 Lc7-e5 b3-b2 Le5xb2
 53/15	00:46	 109.284k	2.374k	 0,00	Le6-d5 b5-b4 Ld5xa8 Kb8xa8 Le5xc7 b4-b3 Lc7-e5 b3-b2 Le5xb2
 54/15+	00:57	 137.426k	2.395k	+0,06	Le6-d7
 54/15+	00:57	 137.536k	2.395k	+0,12	Le6-d7
 54/15+	00:57	 137.809k	2.394k	+120,79	Le6-d7
 54/15	00:57	 137.889k	2.394k	+M5	Le6-d7 b5-b4 Kg6-f7 b4-b3 Kf7-e8 b3-b2 Ke8-d8 b2-b1D Le5xc7+
Kind regards
Bernhard
jhellis3
Posts: 548
Joined: Sat Aug 17, 2013 12:36 am

Re: Mate Test Suite

Post by jhellis3 »

Unfortunately, it has absolutely zero to do with this thread. Could a mod please remove these types of posts?
BBauer
Posts: 658
Joined: Wed Mar 08, 2006 8:58 pm

Re: Mate Test Suite

Post by BBauer »

You've chosen the wrong venue for a controlled experiment. Wink
+1
Bernhard
Ferdy
Posts: 4856
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Mate Test Suite

Post by Ferdy »

jhellis3 wrote:Thanks, this is exactly what I'm looking for :).
Tried the other engines, Fire one of the best I tried in evaluating drawn positions correctly that appears to be winning, like fortress. Spark the crazy attacker. And Hiarcs a positional engine. These are just quick tests.

Code: Select all

Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
Physical Cores: 4
Hyper-Threading: ON
Hash: 128, Threads: 1, Time: 5s/pos
Test file: joseph_ellis_mates.epd
id name Fire 4 x64, TotalPos: 17, Correct: 2 (11.76%)

Pos  Correct  Enginebm   epd
 1        0       f4e5   8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - - bm Kc1; dm 5; id "je 1"; c0 "b1c1;
 2        1       h4h5   8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - - bm Kh5; dm 5; id "je 2"; c0 "h4h5";
 3        0       b5a6   qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - - bm Bh4; dm 5; id "je 3"; c0 "g3h4";
 4        0       b8a8   1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
 5        0       f6h6   n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - - bm Rh1; dm 6; id "je 5"; c0 "h5h1";
 6        0       f4a4   1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - - bm Nd7; dm 6; id "je 6"; c0 "b8d7";
 7        0       e5b2   5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - - bm Ra8; dm 6; id "je 7"; c0 "f8a8";
 8        0       a2a5   3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - - bm b4; dm 7; id "je 8"; c0 "b2b4";
 9        0       f3d3   4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - - bm Rf2 Ke1; dm 11; id "je 9"; c0 "f3f2 f1e1";
10        0       a6d6   n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - - bm Qc8; dm 13; id "je 10"; c0 "a6c8";
11        0       f7e6   8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - - bm Rd3; dm 16; id "je 11"; c0 "e3d3";
12        0       f3g4   1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - - bm bxc6; dm 17; id "je 12"; c0 "b5c6";
13        0       d5e4   8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - - bm Ke6; dm 20; id "je 13"; c0 "d5e6";
14        0       d4e5   8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - - bm Bh8; dm 21; id "je 14"; c0 "d4h8";
15        1       b8a7   1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - - bm Ba7; dm 22; id "je 15"; c0 "b8a7";
16        0       c4d5   1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - - bm Bb5 Kd5; dm 27; id "je 16"; c0 "c4b5 c6d5";
17        0       d1d5   4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - - bm Rd8; dm 29; id "je 17"; c0 "d1d8";

Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
Physical Cores: 4
Hyper-Threading: ON
Hash: 128, Threads: 1, Time: 5s/pos
Test file: joseph_ellis_mates.epd
id name spark-1.0, TotalPos: 17, Correct: 2 (11.76%)

Pos  Correct  Enginebm   epd
 1        0       f4e5   8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - - bm Kc1; dm 5; id "je 1"; c0 "b1c1;
 2        1       h4h5   8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - - bm Kh5; dm 5; id "je 2"; c0 "h4h5";
 3        0       b5a6   qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - - bm Bh4; dm 5; id "je 3"; c0 "g3h4";
 4        0       e3d2   1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
 5        0       c8d6   n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - - bm Rh1; dm 6; id "je 5"; c0 "h5h1";
 6        0       f4a4   1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - - bm Nd7; dm 6; id "je 6"; c0 "b8d7";
 7        0      c7c8Q   5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - - bm Ra8; dm 6; id "je 7"; c0 "f8a8";
 8        0       a2a5   3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - - bm b4; dm 7; id "je 8"; c0 "b2b4";
 9        0       c6b5   4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - - bm Rf2 Ke1; dm 11; id "je 9"; c0 "f3f2 f1e1";
10        0       a6d6   n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - - bm Qc8; dm 13; id "je 10"; c0 "a6c8";
11        0       f7e6   8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - - bm Rd3; dm 16; id "je 11"; c0 "e3d3";
12        0       f3d1   1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - - bm bxc6; dm 17; id "je 12"; c0 "b5c6";
13        0       d5d4   8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - - bm Ke6; dm 20; id "je 13"; c0 "d5e6";
14        0       d4e5   8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - - bm Bh8; dm 21; id "je 14"; c0 "d4h8";
15        1       b8a7   1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - - bm Ba7; dm 22; id "je 15"; c0 "b8a7";
16        0       c4b3   1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - - bm Bb5 Kd5; dm 27; id "je 16"; c0 "c4b5 c6d5";
17        0       d1d5   4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - - bm Rd8; dm 29; id "je 17"; c0 "d1d8";

Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
Physical Cores: 4
Hyper-Threading: ON
Hash: 128, Threads: 1, Time: 10s/pos
Test file: joseph_ellis_mates.epd
id name HIARCS 14 WCSC, TotalPos: 17, Correct: 3 (17.65%)

Pos  Correct  Enginebm   epd
 1        0       f4e5   8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - - bm Kc1; dm 5; id "je 1"; c0 "b1c1;
 2        0       h4g5   8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - - bm Kh5; dm 5; id "je 2"; c0 "h4h5";
 3        1       g3h4   qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - - bm Bh4; dm 5; id "je 3"; c0 "g3h4";
 4        1       b8c8   1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - - bm Kc8; dm 6; id "je 4"; c0 "b8c8";
 5        0       c8d6   n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - - bm Rh1; dm 6; id "je 5"; c0 "h5h1";
 6        0       f4a4   1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - - bm Nd7; dm 6; id "je 6"; c0 "b8d7";
 7        0       e5b2   5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - - bm Ra8; dm 6; id "je 7"; c0 "f8a8";
 8        0       a2a5   3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - - bm b4; dm 7; id "je 8"; c0 "b2b4";
 9        0       f3d3   4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - - bm Rf2 Ke1; dm 11; id "je 9"; c0 "f3f2 f1e1";
10        0       a6d6   n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - - bm Qc8; dm 13; id "je 10"; c0 "a6c8";
11        0       g2g3   8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - - bm Rd3; dm 16; id "je 11"; c0 "e3d3";
12        0       f3d1   1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - - bm bxc6; dm 17; id "je 12"; c0 "b5c6";
13        0       d5e4   8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - - bm Ke6; dm 20; id "je 13"; c0 "d5e6";
14        0       d4f6   8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - - bm Bh8; dm 21; id "je 14"; c0 "d4h8";
15        1       b8a7   1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - - bm Ba7; dm 22; id "je 15"; c0 "b8a7";
16        0       c6d7   1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - - bm Bb5 Kd5; dm 27; id "je 16"; c0 "c4b5 c6d5";
17        0       d1d5   4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - - bm Rd8; dm 29; id "je 17"; c0 "d1d8";
Dann Corbit
Posts: 12870
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Mate Test Suite

Post by Dann Corbit »

Henk wrote:
Dann Corbit wrote:I should mention that it is time for the great lesson of Fabian, the inventor of the chess engine Fruit.
Fabian wrote (at the time) the best evaluation in the world. By far.
That is not the great lesson of Fabian.
Fabian wrote (at the time) the best search in the world. By far.
That is not the great lesson of Fabian.

The great lesson of Fabian is to be very, very, very, painfully correct. You will see part of the effort in his beautiful use of asserts. The aim for correctness is the great lesson of Fabian.

It goes far beyond computer chess. In fact, I think it applies to everything.
One more poem about Fabian and he will never lock your threads anymore. Or is it another Fabian.
That's the Fabian all right. He will still lock my threads when I become a whinging twit, which I am wont to do from time to time.
Dann Corbit
Posts: 12870
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Mate Test Suite

Post by Dann Corbit »

lech wrote:
Dann Corbit wrote:
Henk wrote:Only after disabling null move Skipper is able to solve the first position. Yet another argument to remove null move from Skipper. Not much of the search will be left over that can be completely trusted: PVS /alpha beta, TT perhaps. The only allowed bug is a too shallow search. But better one bug than sixty.
You can tune your chess engine to solve strange edge cases.
Then it plays 500 Elo lower.
...
Sting SF 5 is worse than based (parent) Stockfish 2.1.1 only 9 points of ELO (CEGT, CCRL).
I think Stockfish 6 with my ideas can play with the similar ELO. :D
But the mechanical programmers like only mechanical solutions.
You can ignore me only! :lol:
You are doing it the right way. Furthermore, what you are doing is extremely useful to me personally. When I have a position (perhaps 20 moves from the starting point of chess) I almost always know what the best move is. Sometimes Stockfish or Komodo or Houdini will find it immediately and stick to it for a few plies. But sometimes not. In those cases, I need an engine like Sting to give me the mechanical answer. (Your word mechanical brought this to my mind).

I have stated before that there are at least two good goals for a chess engine:
1. To play the strongest chess possible
2. To produce the best analysis possible
An engine which has achieved 1 may or may not have achieved 2 and vice versa. In either case, I want the capability for both things.

It is also nice if an engine can:
3. Solve crazy tactical puzzles and mates (Leonid, Abillo)
etc.

I really like what you are doing with Sting. I think that in order for an engine to remain extremely useful for analysis it will have to retain a lot of its strategic strength. And you seem to have accomplished that.

There are two ways to make a great chess engine. One way is with a massive team (Stockfish). Another way is with clever insights and fresh ideas by an individual (Fabian, Meyer-Kahlen).

An engine does not have to be a world beater for me to like it (though that certainly would not hurt!). I love Olithink, for instance. I am wild about some engines just because I really like the authors (Gaviotta -Ballicora, Komodo - Dailey, etc.). I like Golem because it plays so quirky. I probably play 1/3 of my games against Golem because it is such a hoot. It plays weird human-like moves and also does not crash or do other dumb annoying things.
Dann Corbit
Posts: 12870
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Mate Test Suite

Post by Dann Corbit »

Henk wrote:An engine can only solve these positions if it has really good zugzwang detection. But I understood that that doesn't exist.
I already had mechanical solutions to all of them in my chess database.

All of them but two are already in the ChestUCI database (though it is possible that I put one or two of them in my copy).

So there is some chess engine that can solve each and every one of them. There may not be a single engine that can solve them all though.

Houdini and Critter are especially good at solving this kind of problems.

If you want to watch the mechanical solutions unfold, then get ChestUCI and lookup all the positions in the database. In each of those positions, the database has the parameters needed to solve them. For the two missing problems, try Stockfish, Houdini and Komodo at an hour and I guess that you will see them all solved.
F. Bluemers
Posts: 880
Joined: Thu Mar 09, 2006 11:21 pm
Location: Nederland

Re: Mate Test Suite

Post by F. Bluemers »

Dirty got a couple of the shorter mates.
No table- or bit-bases.

Code: Select all

8/2Nb4/pp6/4rp1p/1Pp1pPkP/PpPpR3/1B1P2N1/1K6 w - -   Kc1 
	21 1621 1595 37334266 fxe5 Bc6 Ne6 f4 Nexf4 Kf5 e6 Ke5 Rg3 Kd6 Rg5 b5 Rxh5 Ke7 Ne3 Kd6 Rh6 Be8 Rh7 Ke5 Ned5
	21 31991 2526 68033401 Kc1 Bc6 Kd1 Bd5 Ke1 Bf7 Kf2 Be8 Rg3#
	21 31991 2600 70770014 Kc1 Bc6 Kd1 Bd5 Ke1 Bf7 Kf2 Be8 Rg3#
8/8/2B1N3/3rp3/4k2K/7Q/2r3Pn/1b1N4 w - -      Kh5 
	failed:
	16 31985 12718 468030505 Kg5 Rxg2+ Qxg2+ Nf3+ Kf6 Kd3 Ba4 e4 Qf1+ Kd2 Qf2+ Kd3 Qe3+ Kc4 Qc3#
qb6/3N2p1/r2p4/pP1k2p1/1pp3R1/6BB/2P1P3/2N1K3 w - -     Bh4 
	16 924 1192 33895840 Bf2 Ke6 Rxg5+ Kf7 Bg2 Ra7 Bxa8 Rxd7 b6 a4 Bd4 Re7 Bxg7 Ke6 Bc6 b3 Bxa4
	16 31991 2829 84550008 Bh4 gxh4 Nb3 cxb3 c4+ bxc3 Ra4 g6 e4#
	16 31991 3328 103199539 Bh4 gxh4 Nb3 cxb3 c4+ bxc3 Ra4 g6 e4#
1K1N1b2/RPp1pr2/1kP5/2p5/P7/4B1P1/4p1b1/6n1 w - -    Kc8 
	13 1410 28 620217 Bd2 e1=Q Bxe1 c4 Nxf7 Bg7 Ka8 Kxc6 b8=Q Kd7+ Rb7 Ke6 Nd8+ Kf6 Bc3+ Kg6
	13 31989 60 1695111 Kc8 Bh3+ g4 Bxg4+ Kb8 Bf3 Bd2 e1=Q Bxe1 Bxc6 Ba5#
n1N3br/2p1Bpkr/1pP2R1b/pP1p1PpR/Pp4P1/1P6/1K1P4/8 w - -    Rh1
	11 193 7 80712 Nd6 cxd6 Rxd6 f6 Bxf6+ Kf8 Bxh8 Rxh8 Kc2 Bg7 Rxh8 Bxh8 Rd8+ Ke7
	11 229 9 130765 Rh1 d4 Re1 d3 Nd6 cxd6 Rxd6 f6 Bxf6+ Kf8 Bxh8 Rxh8 Rd8+ Kf7 Rxa8 Bg7+ Kc1
	11 229 15 265407 Rh1 d4 Re1 d3 Nd6 cxd6 Rxd6 f6 Bxf6+ Kf8 Bxh8 Rxh8 Rd8+ Kf7 Rxa8 Bg7+ Kc1
	12 229 18 337323 Rh1 d4 Re1 d3 Nd6 cxd6 Rxd6 f6 Bxf6+ Kf8 Bxh8 Rxh8 Rd8+ Kf7 Rxa8 Bg7+ Kc1
	13 31985 34 832408 Rh1 d4 Rc1 d3 Nd6 cxd6 c7 Nxc7 Rxc7 d5 Rxb6 d4 Bf6+ Kf8 Rb8#
	---snipped-----
	19 31989 626 21922371 Rh1 d4 Ra1 d3 Ra3 bxa3+ Ka1 a2 Ba3 Kxf6 Bb2#
1N1K1b1r/P3pPp1/4k1P1/rp1pB1RN/q4RP1/8/p2pB1p1/1b6 w - -    Nd7 
	15 1344 1548 41422906 Rxa4 Rxh5 Rxa5 Rxg5 Bh2 Kf6 a8=Q Kxg6 Ke8 Re5 Nd7 Rxe2 Nxf8+ Kh6 Ra6+ g6 Qxd5
	15 31989 11506 424069358 Nd7 g1=Q Bc7 a1=Q Bf3 d1=Q Rd4 Qa1xd4 Nc5+ Qxc5 Re5#
	15 31989 13493 490377288 Nd7 g1=Q Bc7 a1=Q Bf3 d1=Q Rd4 Qa1xd4 Nc5+ Qxc5 Re5#
5R2/2P2pK1/2P2P2/1Pp1BP1P/b6p/1p1RPB2/1p2NPn1/6rk w - -    Ra8 
	16 31987 1087 42928019 c8=Q Ra1 Bb8 b1=Q Qc7 Qg1 Nxg1 Kxg1 Qh2+ Kxf2 Qxg2+ Ke1 Qg1#
	16 31989 3240 128071563 Ra8 Bxb5 c8=Q Ba6 Qxa6 b1=Q Qc4 h3 Qg4 Qxd3 Qxh3#
	16 31989 3242 128103141 Ra8 Bxb5 c8=Q Ba6 Qxa6 b1=Q Qc4 h3 Qg4 Qxd3 Qxh3#
3K4/1p1B4/bB1k4/rpR1p3/2ppppp1/8/RPPPPP2/r1n5 w - -    b4 
	failed:
	18 582 4368 118052171 Rc7 e3 Rxa5 Rxa5 Bxa5 Na2 fxe3 dxe3 Bxg4 exd2 Bxd2 b4 Rd7+ Kc5 Re7 Kd5 Bf3+ Kd6 Rd7+ Ke6
4k1r1/2pnp3/2B1N3/8/8/5R2/6P1/5K2 w - -    Rf2 or Ke1 
	failed:
	22 1035 3195 86845137 Bb5 c5 Nxc5 e5 Nxd7 Ke7 Nxe5 Rg5 Nc6+ Ke6 Bc4+ Kd7 Nd4 Kd6 Rf4 Rc5 Nb5+ Kc6 Rf6+ Kd7 Rf7+ 
n2Bqk2/5p1p/Q4KP1/p7/8/8/8/8 w - -    Qc8 
	failed:
	23 81 14478 389912961 Qd6+ Kg8 gxh7+ Kh8 Bxa5 Qc8 Bd2 Nb6 Qxb6 Qg4 Qb8+ Kxh7 Qh2
8/5K2/3p3p/3p3P/pp1P4/rkb1R3/p1p3P1/n1B2B2 w - -    Rd3 
	failed:
	28 0 12660 334029985 g4
1kn5/p2p4/P1pP1p1q/1PP2P1P/5p2/4rQp1/K7/5B2 w - -    bxc6 
	failed:
	19 -1083 9003 204904214 Qd1 Qg7 Qc2 cxb5 Kb2 Qg8 h6 f3 c6 Nxd6 cxd7 Qf8 Qc1 g2 Bxb5 f2 d8=B Nxb5 Qxe3 f1=Q h7
8/6p1/p7/rp1K2p1/kb3pP1/2p2p1b/P1Np1P2/3N2R1 w - -    Ke6 
	failed:
	30 0 10226 274407061 Kc6 Bg2 Kd5 Bh3
8/7p/6pP/5pP1/3BpP2/p1KpP3/pn1N4/k7 w - -    Bh8
	failed:no mate score at all: 
	27 412 4176 125002011 Be5 Nd1+ Kb3+ Nb2 Bd6 Nc4 Nxc4 Kb1 Be5 Kc1 Kxa2 d2 Nxd2
	27 989 5978 177901945 Bh8 Nd1+ Kc4+ Nb2+ Kd4 Nd1 Kd5+ Nb2 Ke5 Nc4+ Ke6+ Nb2 Kf6
	---snip---
	28 1136 7612 227179836 Bh8 Nd1+ Kc4+ Nb2+ Kd4 Nd1 Kd5+ Nb2 Ke5 Nc4+ Ke6+ Nb2 Kf6
 		Nd1 Kf7+ Nb2 Kg7 Nd1 Kxh7+ Nb2 Kg7 Nd1 Kxg6+ Nb2 Kf6 Nd1 h7 Kb2 Kxf5+ Kc1 Nb3+
		Kc2 Ba1 Kxb3 h8=Q Kc2 Qa8 Kd2 Kxe4 Nxe3
1B3N2/5p1B/2K2pn1/5krb/4p1p1/4P1P1/2P1PP2/8 w - -    Ba7 
	failed:
	28 405 15656 415249440 Kc7 Ke5 Bxg6 Bxg6 c4 Rh5 Kd7+ Kf5 c5 Rh8 Nxg6 fxg6 Bd6 Rh7+
1k3b1q/pP2p1p1/P1K1P1Pp/7P/2B5/8/8/8 w - -    Bb5 or Kd5 
	failed:
	48 0 13911 354254443 Bd5 Qg8 Bc4 Qh8
4rk2/2P2p2/p4P2/2p2b2/2p5/8/P7/2KR4 w - -    Rd8
	failed:
	31 0 14265 354341387 Rd5 Bc8 Rd8 c3 Kc2 Bf5+ Kxc3 Be6 Kd2 a5 a4 Bc8 Kc3 Be6 Kc2 Bc8 Kc3


Best
Fonzy