Test suite for Stockfish

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Andre
Posts: 98
Joined: Thu Jul 23, 2009 5:40 am

Test suite for Stockfish

Post by Andre »

[D] rk1b4/p2p2p1/1P6/2R2P2/8/2K5/8/5B2 w - - [/D]

Strangely here, latest releases of Stockfish (+zysygy) don't find Rc8+ in less than a minute.
If you play the move then the engine will immediately see its strength though.
Earlier release (14/01/2014) spotted the move.

[D] k2N4/1qpK1p2/1p6/1P4p1/1P4P1/8/8/8 w - - [/D]

Same here with Nc6 (Stockfish likes Nxb7 with 0.00)

Any reason why?
BeyondCritics
Posts: 396
Joined: Sat May 05, 2012 2:48 pm
Full name: Oliver Roese

Re: Test suite for Stockfish

Post by BeyondCritics »

[D] rk1b4/p2p2p1/1P6/2R2P2/8/2K5/8/5B2 w - -
My copy of stockfish detects Rc8 on depth 15. I don't have any problem with that.

[D] k2N4/1qpK1p2/1p6/1P4p1/1P4P1/8/8/8 w - -
Whoops. Nc6 is not detected, not even on depth 48 or so.
But when i try this move for myself it detects its usefulness quick as a flash.
Therefore this is really notable, i think.
Andre
Posts: 98
Joined: Thu Jul 23, 2009 5:40 am

Re: Test suite for Stockfish

Post by Andre »

Which version did you use?
BeyondCritics
Posts: 396
Joined: Sat May 05, 2012 2:48 pm
Full name: Oliver Roese

Re: Test suite for Stockfish

Post by BeyondCritics »

I used the system stockfish of my ubuntu 14.04 installation:
Stockfish 09-06-13 64bit by Tord Romstad, Marco Costalba and Joona Kiiski

[d]k2N4/1qpK1p2/1p6/1P4p1/1P4P1/8/8/8 w - -


1 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
2 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
3 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
4 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
5 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
6 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
7 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
8 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
9 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
10 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
11 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
12 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
13 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
14 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
15 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
16 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
17 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
18 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.00)
19 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
20 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
21 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
22 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
23 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
24 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
25 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
26 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
27 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
28 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
29 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
30 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
31 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.01)
32 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (0.46)
33 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Kb8 13.Dh8+ (2.21)
34 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 13.Dc6 Kb8 14.De8+ Ka7 15.Dc6 (4.67)
35 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 13.Dc6 Kb8 14.De8+ Ka7 15.Dc6 (4.88)
36 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 13.Dc6 Kb8 14.De8+ Ka7 15.Kd8 Kb8 16.Ke7+ (6.97)
37 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 13.Dc6 Kb8 14.De8+ Ka7 15.Kd8 Kb8 16.Ke7+ (10.37)
38 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 13.Dc6 Kb8 14.De8+ Ka7 15.Kd8 Kb8 16.Ke7+ (15.34)
39 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 13.Dc6 Kb8 14.De8+ Ka7 15.Kd8 Kb8 16.Ke7+ (22.71)
40 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 (34.56)
41 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 13.Da1+ (45.40)
42 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 13.Da1+ (60.56)
43 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 13.Da1+ (97.36)
44 +0.00 1.Sxb7 Kxb7 2.Ke7 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Df3+ Kb8 8.Df8+ Ka7 9.Df6 Dg4 10.Da1+ Kb8 11.Dh8+ Kb7 12.Dh1+ Ka7 13.Da1+ (130.00)
45 +0.08 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 (190.45)
45 +0.16 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (200.76)
45 +0.28 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (266.62)
45 +0.46 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (268.87)
45 +0.73 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (273.25)
45 +1.14 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (278.86)
45 +1.75 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (286.51)
45 +2.67 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (288.26)
45 +4.04 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (289.02)
45 +6.09 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (289.62)
45 +9.16 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (290.88)
45 +13.77 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (293.36)
45 +20.69 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (298.64)
45 +31.06 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (301.57)
45 +46.61 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (302.36)
45 +69.93 1.Sc6 f6 2.Kd8 f5 3.gxf5 g4 4.f6 g3 5.f7 g2 6.f8=D g1=D 7.Kd7+ (303.62)
Spliffjiffer
Posts: 416
Joined: Thu Aug 02, 2012 7:48 pm
Location: Germany

Re: Test suite for Stockfish

Post by Spliffjiffer »

Here a position with similar behavior although SF was never (afaik) be able to solve it :-(
[D]1R6/pPk1r3/2p5/K7/8/2B1b3/8/8 w - - 0 1
bm Ka6 draw
Wahrheiten sind Illusionen von denen wir aber vergessen haben dass sie welche sind.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Test suite for Stockfish

Post by zullil »

Andre wrote:
[D] k2N4/1qpK1p2/1p6/1P4p1/1P4P1/8/8/8 w - - [/D]

Same here with Nc6 (Stockfish likes Nxb7 with 0.00)

Any reason why?
This failure is related to null-move pruning. The latest Stockfish with null move search disabled finds the move almost instantly:

Code: Select all

Stockfish 210514 64 SSE4.2 by Tord Romstad, Marco Costalba and Joona Kiiski
setoption name Hash value 256
position fen k2N4/1qpK1p2/1p6/1P4p1/1P4P1/8/8/8 w - -
isready
readyok
go infinite
info depth 1 seldepth 1 score cp -96 nodes 16 nps 8000 time 2 multipv 1 pv d8b7 a8b7
info depth 2 seldepth 2 score cp -96 nodes 33 nps 16500 time 2 multipv 1 pv d8b7 a8b7
info depth 3 seldepth 3 score cp -103 nodes 55 nps 27500 time 2 multipv 1 pv d8b7 a8b7 d7e7
info depth 4 seldepth 4 score cp -31 nodes 118 nps 59000 time 2 multipv 1 pv d8b7 a8b7 d7e7 c7c6 b5c6 b7c6 e7f7
info depth 5 seldepth 6 score cp -31 nodes 200 nps 66666 time 3 multipv 1 pv d8b7 a8b7 d7e7 c7c6 b5c6 b7c6 e7f7
info depth 6 seldepth 7 score cp -31 nodes 331 nps 110333 time 3 multipv 1 pv d8b7 a8b7 d7e7 c7c6 b5c6 b7c6 e7f7
info depth 7 seldepth 8 score cp -29 nodes 543 nps 135750 time 4 multipv 1 pv d8b7 a8b7 d7e7 c7c6 b5c6 b7c6 e7f7 c6b5
info depth 8 seldepth 9 score cp -18 nodes 1063 nps 177166 time 6 multipv 1 pv d8b7 a8b7 d7e7 c7c5 b5c6 b7c6 e7f7 c6b5 f7f6
info depth 9 seldepth 11 score cp 28 nodes 2276 nps 227600 time 10 multipv 1 pv d8b7 a8b7 d7e7 c7c5 b5c6 b7c6 e7f7 c6b5 f7f6 b5b4 f6g5
info depth 10 seldepth 12 score cp -3 nodes 4918 nps 245900 time 20 multipv 1 pv d8b7 a8b7 d7e7 f7f5 g4f5 g5g4 f5f6 g4g3 f6f7 g3g2 f7f8q g2g1q f8f3 b7c8
info depth 11 seldepth 19 score cp 0 nodes 11866 nps 282523 time 42 multipv 1 pv d8b7 a8b7 d7e7 f7f5 g4f5 g5g4 f5f6 g4g3 f6f7 g3g2 f7f8q g2g1q f8f3 b7b8 f3f8 b8b7
info depth 12 seldepth 19 score cp 0 nodes 12444 nps 276533 time 45 multipv 1 pv d8b7 a8b7 d7e7 f7f5 g4f5 g5g4 f5f6 g4g3 f6f7 g3g2 f7f8q g2g1q f8f3 b7b8 f3f8 b8b7
info depth 13 seldepth 19 score cp 0 nodes 28978 nps 413971 time 70 multipv 1 pv d8b7 a8b7 d7e7 f7f5 g4f5 g5g4 f5f6 g4g3 f6f7 g3g2 f7f8q g2g1q f8f3 b7b8 f3f8 b8b7
info depth 14 seldepth 19 score cp 0 nodes 163214 nps 1046243 time 156 multipv 1 pv d8b7 a8b7 d7e7 f7f5 g4f5 g5g4 f5f6 g4g3 f6f7 g3g2 f7f8q g2g1q f8f3 b7b8 f3f8 b8b7
info depth 15 seldepth 19 score cp 0 nodes 283305 nps 1395591 time 203 multipv 1 pv d8b7 a8b7 d7e7 f7f5 g4f5 g5g4 f5f6 g4g3 f6f7 g3g2 f7f8q g2g1q f8f3 b7b8 f3f8 b8b7
info depth 16 seldepth 19 score cp 0 nodes 292050 nps 1358372 time 215 multipv 1 pv d8b7 a8b7 d7e7 f7f5 g4f5 g5g4 f5f6 g4g3 f6f7 g3g2 f7f8q g2g1q f8f3 b7b8 f3f8 b8b7
info depth 17 seldepth 28 score cp 0 nodes 625675 nps 2099580 time 298 multipv 1 pv d8b7 a8b7 d7e7 f7f5 g4f5 g5g4 f5f6 g4g3 f6f7 g3g2 f7f8q g2g1q f8f3 b7b8 f3f8 b8b7
info depth 18 seldepth 28 score cp 198 nodes 794893 nps 1687670 time 471 multipv 1 pv d8c6 b7b8 c6b8 a8b8 d7e7 b8b7 e7f7 c7c6 b5c6 b7c6 f7f6 c6b5 f6g5 b5b4 g5f6 b4c5 g4g5 b6b5 g5g6 c5d5 g6g7
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Test suite for Stockfish

Post by zullil »

Spliffjiffer wrote:Here a position with similar behavior although SF was never (afaik) be able to solve it :-(
[D]1R6/pPk1r3/2p5/K7/8/2B1b3/8/8 w - - 0 1
bm Ka6 draw
Current version of Stockfish solves this---if null-move pruning is disabled:

Code: Select all

info depth 32 seldepth 52 score cp -186 lowerbound nodes 1514770946 nps 23996751 time 63124 multipv 1 pv a5a6 c7b8
info depth 32 currmove a5a6 currmovenumber 1
info depth 32 seldepth 52 score cp -179 lowerbound nodes 1530712484 nps 24030777 time 63698 multipv 1 pv a5a6 c7b8
info depth 32 currmove a5a6 currmovenumber 1
info depth 32 seldepth 52 score cp -170 lowerbound nodes 1540974185 nps 24048412 time 64078 multipv 1 pv a5a6 c7b8
info depth 32 currmove a5a6 currmovenumber 1
info depth 32 seldepth 52 score cp -156 lowerbound nodes 1552989885 nps 24070272 time 64519 multipv 1 pv a5a6 c7b8
info depth 32 currmove a5a6 currmovenumber 1
info depth 32 seldepth 52 score cp -135 lowerbound nodes 1566396711 nps 24087293 time 65030 multipv 1 pv a5a6 c7b8 c3e5 e7c7 e5g3 e3d4 g3d6 d4c5 d6e5 c5d4 e5f4 c6c5 f4c7
info depth 32 currmove a5a6 currmovenumber 1
info depth 32 seldepth 52 score cp -104 lowerbound nodes 1585744838 nps 24122928 time 65736 multipv 1 pv a5a6 c7b8 c3e5 e7c7 e5g3 e3d4 g3d6 d4c5 d6e5 c5d4 e5f4 c6c5
info depth 32 currmove a5a6 currmovenumber 1
info depth 32 seldepth 52 score cp -57 lowerbound nodes 1615848579 nps 24174874 time 66840 multipv 1 pv a5a6 c7b8 c3e5 e7c7 e5g3 e3d4 g3d6
info depth 32 currmove a5a6 currmovenumber 1
info depth 32 currmove a5b4 currmovenumber 7
info depth 32 seldepth 52 score cp 0 nodes 1675151078 nps 24275792 time 69005 multipv 1 pv a5a6 c7b8 c3e5 e7c7 e5g3 e3d4 g3d6 d4c5 d6e5 c5g1 e5g3 g1d4
info depth 33 currmove a5a6 currmovenumber 1
info depth 33 currmove c3d4 currmovenumber 8
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Test suite for Stockfish

Post by zullil »

Andre wrote:[D] rk1b4/p2p2p1/1P6/2R2P2/8/2K5/8/5B2 w - - [/D]

Strangely here, latest releases of Stockfish (+zysygy) don't find Rc8+ in less than a minute.
If you play the move then the engine will immediately see its strength though.
Earlier release (14/01/2014) spotted the move.

Any reason why?
Latest Stockfish with null-move pruning disabled:

Code: Select all

info depth 32 seldepth 49 score cp -42 lowerbound nodes 2988933189 nps 25992531 time 114992 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3d6 e4d4 d6b4 d4d5 b4e7 d5c4 e7d6 c4d4
info depth 32 currmove c5c8 currmovenumber 1
info depth 32 seldepth 49 score cp -36 lowerbound nodes 2992460807 nps 25986598 time 115154 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5
info depth 32 currmove c5c8 currmovenumber 1
info depth 32 seldepth 49 score cp -27 lowerbound nodes 2998903892 nps 25986134 time 115404 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4
info depth 32 currmove c5c8 currmovenumber 1
info depth 32 seldepth 49 score cp -13 lowerbound nodes 3000035736 nps 25975010 time 115497 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4 e4d5 h4g3
info depth 32 currmove c5c8 currmovenumber 1
info depth 32 currmove c5a5 currmovenumber 20
info depth 32 currmove c5e5 currmovenumber 26
info depth 32 seldepth 49 score cp 0 nodes 3121170607 nps 26066231 time 119740 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4 e4d5 h4g3
info depth 33 currmove c5c8 currmovenumber 1
info depth 33 currmove f5f6 currmovenumber 14
info depth 33 currmove f1a6 currmovenumber 22
info depth 33 seldepth 49 score cp 0 nodes 3426417867 nps 26235971 time 130600 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4 e4d5 h4g3
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 seldepth 49 score cp 6 lowerbound nodes 3497638692 nps 26249483 time 133246 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 seldepth 49 score cp 12 lowerbound nodes 3501559668 nps 26228518 time 133502 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4 f5f6 h4f6 e4f5 f6e7 f5g6 e7f6 g6f7 f6c3
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 seldepth 49 score cp 21 lowerbound nodes 3503941299 nps 26204941 time 133713 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 seldepth 49 score cp 35 lowerbound nodes 3506678521 nps 26171781 time 133987 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4 f5f6 h4f6 e4f5 f6e7 f5g6 e7f6 g6f7 f6c3 f7e8 d7d6
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 seldepth 49 score cp 56 lowerbound nodes 3513248652 nps 26110518 time 134553 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 seldepth 49 score cp 87 lowerbound nodes 3525862736 nps 26078866 time 135200 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4 f5f6 h4f6 e4f5 f6e7
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 seldepth 49 score cp 134 lowerbound nodes 3528275556 nps 26060474 time 135388 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4 f5f6 h4f6 e4f5 f6e7
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 seldepth 49 score cp 205 lowerbound nodes 3534845934 nps 26032860 time 135784 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4 f5f6 h4f6 e4f5 f6e7
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 seldepth 49 score cp 310 lowerbound nodes 3575134869 nps 25996821 time 137522 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4 f5f6 h4f6 e4f5 f6e7 f5g6 e7f6 g6f7 f6c3
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 seldepth 49 score cp 467 lowerbound nodes 3840405769 nps 26078020 time 147266 multipv 1 pv c5c8 b8c8 f1a6 c8b8 b6b7 d8f6 c3c4 f6e5 c4d5 e5g3 d5e4 g3h4 f5f6 h4f6 e4f5 f6e7 f5g6 e7f6 g6f7 b8c7
info depth 34 currmove c5c8 currmovenumber 1
info depth 34 currmove b6a7 currmovenumber 2
info depth 34 seldepth 55 score cp 653 nodes 6278715979 nps 26306881 time 238672 multipv 1 pv c5c8 b8b7 f1g2 b7b6 c8a8 d8g5 c3d4 a7a5 g2e4 b6c7 d4d5 a5a4 e4d3 c7b7 a8a4 b7c7 a4a7
info depth 35 currmove c5c8 currmovenumber 1
info depth 35 seldepth 55 score cp 659 lowerbound nodes 6301862179 nps 26234803 time 240210 multipv 1 pv c5c8 b8b7 f1g2 b7b6 c8a8 d8g5 c3d4
info depth 35 currmove c5c8 currmovenumber 1
info depth 35 seldepth 55 score cp 665 lowerbound nodes 6338823660 nps 26179206 time 242132 multipv 1 pv c5c8 b8b7 f1g2 b7b6 c8a8 d8g5 c3d4 a7a5 g2e4
info depth 35 currmove c5c8 currmovenumber 1
info depth 35 seldepth 55 score cp 674 lowerbound nodes 6379692238 nps 26134497 time 244110 multipv 1 pv c5c8 b8b7 f1g2 b7b6 c8a8 d8g5 c3d4 a7a5 g2e4 b6c7 d4d5
info depth 35 currmove c5c8 currmovenumber 1
info depth 35 currmove c3c4 currmovenumber 9
info depth 35 currmove c3b2 currmovenumber 25
info depth 35 seldepth 55 score cp 679 nodes 6522824247 nps 26061690 time 250284 multipv 1 pv c5c8 b8b7 f1g2 b7b6 c8a8 d8g5 c3d4 a7a5 g2e4 b6c7 d4d5 a5a4 e4d3 a4a3 a8a3 c7d8 a3b3 d8e7 b3b7 g5f6 d5e4
info depth 36 currmove c5c8 currmovenumber 1
info depth 36 seldepth 56 score cp 686 lowerbound nodes 6663940580 nps 26026849 time 256041 multipv 1 pv c5c8 b8b7 f1g2 b7b6 c8a8 d8g5 c3d4
info depth 36 currmove c5c8 currmovenumber 1
info depth 36 seldepth 56 score cp 692 lowerbound nodes 6714140260 nps 25974367 time 258491 multipv 1 pv c5c8 b8b7 f1g2 b7b6 c8a8 d8g5 c3d4 a7a5 g2e4
info depth 36 currmove c5c8 currmovenumber 1
info depth 36 seldepth 56 score cp 701 lowerbound nodes 6787405975 nps 25911668 time 261944 multipv 1 pv c5c8 b8b7 f1g2 b7b6 c8a8 d8g5 c3d4 a7a5 g2e4 b6c7 d4d5
info depth 36 currmove c5c8 currmovenumber 1
info depth 36 seldepth 56 score cp 715 lowerbound nodes 6816886248 nps 25839842 time 263813 multipv 1 pv c5c8 b8b7 f1g2 b7b6 c8a8 d8g5 c3d4 a7a5 g2e4 b6c7 d4d5 g5h6 e4d3 h6d2 d3b5 d7d6 a8e8 d2c3 b5a4 c3b2 e8e7 c7d8 e7d7 d8c8 d7a7 b2e5
voyagerOne
Posts: 154
Joined: Tue May 17, 2011 8:12 pm

Re: Test suite for Stockfish

Post by voyagerOne »

Maybe an idea is for SF to run a very quick search with null-move pruning disabled...then switch null-move pruning back on.

That way it won't miss these type of positions.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Test suite for Stockfish

Post by zullil »

voyagerOne wrote:Maybe an idea is for SF to run a very quick search with null-move pruning disabled...then switch null-move pruning back on.

That way it won't miss these type of positions.
I think Uri Blass experimented quite a bit with how/when to best utilize null-move pruning. Perhaps he will reply and elaborate.