A tactical crash of Stockfish

[Eduard]

Tactical crash of Stockfish (asmFish, but its the same)!

A few minutes ago I watched the following game. Stockfish crashed in few moves! How is that possible? Unfortunately, it is so.

[Event "5 min, rated"]
[Site "Engine Room"]
[Date "2018.11.28"]
[Round "?"]
[White "EmadHawdyII, asmFishWCP_2018-11-18"]
[Black "Visoki Decani, Lc0 v0.19.0 11248"]
[Result "0-1"]
[ECO "B12"]
[WhiteElo "2509"]
[BlackElo "2414"]
[Annotator "0.85;0.55"]
[PlyCount "66"]
[EventDate "2018.11.28"]
[EventType "blitz"]
[TimeControl "300"]

1. d4 {B 0} c6 {B 0} 2. e4 {B 0} d5 {B 0} 3. e5 {B 0} Bf5 {B 0} 4. Nf3 {B 0} e6
{B 0} 5. Be2 {B 0} h5 {B 0} 6. O-O {B 0} Be7 {B 0} 7. Nbd2 {B 0} a5 {0.55/9 6}
8. a4 {0.85/24 20} Nh6 {0.51/13 1} 9. Ne1 {0.90/24 7 (Nb3)} Nd7 {0.49/12 5 (c5)
} 10. Bxh5 {0.85/25 17 (c3)} Qc7 {0.16/13 6} 11. h3 {0.25/25 30 (Nb3)} O-O-O {
0.19/27 1} 12. Nb3 {0.35/23 3} f6 {0.20/27 1} 13. Bd2 {0.39/24 17} fxe5 {
0.17/27 0 (b6)} 14. Bxa5 {0.96/21 2 (dxe5)} b6 {-0.26/17 10} 15. Bd2 {0.47/29
21 (Bc3)} e4 {-0.20/23 6} 16. a5 {0.51/26 9} b5 {-0.18/35 0} 17. a6 {0.36/27 6}
Kb8 {-0.31/22 1} 18. Ba5 {0.33/24 6} Qd6 {-0.35/18 0 (Cb6)} 19. Qd2 {1.09/22 5
(Bxd8)} Rc8 {-0.89/15 14 (Cg8)} 20. Nc5 {0.00/26 19 (c3)} Nxc5 {-0.24/18 2} 21.
Bb4 {0.00/25 3} Qc7 {-0.20/18 4 (Cg8)} 22. dxc5 {0.00/27 2 (Bxc5)} Ka8 {
-1.60/13 15 (Cg8)} 23. Ra3 {-0.34/25 24} Bf6 {-1.62/11 1 (Cg8)} 24. Bc3 {
0.00/22 12 (c4)} e5 {-1.81/13 13 (Axc3)} 25. Ba5 {0.00/20 3} Qe7 {-2.01/16 7
(Dd7)} 26. Bb6 {-0.38/24 18 (c4)} Bg5 {-3.77/12 12 (Cf7)} 27. Qd1 {0.27/19 1}
Bf4 {-3.87/13 4 (d4)} 28. Be2 {-1.79/22 7 (b4)} Be6 {-4.39/10 9 (Cf7)} 29. Bh5
{-3.36/24 14 (c4)} g5 {-5.47/11 9 (Dg5)} 30. Ba5 {-2.61/20 5 (f3)} g4 {-7.60/
11 9 (Dxc5)} 31. g3 {-6.95/22 10 (c4)} Qg5 {-9.39/11 6} 32. h4 {-7.71/23 0
(gxf4)} Qxh5 {-13.48/10 8} 33. Ng2 {-8.12/24 0} Nf5 {-14.14/10 4 EmadHawdyII,
asmFishWCP_2018-11-1 abbandona (Lag: Av=0.52s, max=1.9s)} 0-1

Unfortunately Stockfish is blind in its King-Attack. His pawn in the a-line is poor? Stockfish has nothing, and Lc0 has all! The eval of Lc0 (-2) is right, of Stockfish is simply wrong.

EmadHawdyII,a - Visoki Decani,L 0-1, 5 min, rated blitz 2018
[d]k1r4r/2q3p1/P1p2b1n/1pPppb1B/4p3/R1B4P/1PPQ1PP1/4NRK1 w - - 0 1

Analysis by Stockfish 271118 64 POPCNT:

25.La5 De7 26.Le2 Dxc5 27.b4 De7 28.Lxb5 cxb5 29.Dxd5+ Ka7 30.Dxb5 Le6 31.Lb6+ Ka8 32.Lc5 Dd7 33.De2 Sf5 34.Dxe4+ Ld5 35.Td3 Sd4 36.De3 Df7 37.f4 Sf5 38.Dd2 Lc6 39.fxe5 Lxe5 40.De2 The8 41.Te3 De6 42.Txe5 Dxe5 43.Dxe5 Txe5 44.g4 Sh4 45.Kf2 Kb8 46.Sd3
-/+ (-0.83 --) Tiefe: 31/56 00:03:47 534MN, tb=186
25.La5 De7 26.Le2 Dxc5 27.b4 De7 28.Lxb5 cxb5 29.Dxd5+ Ka7 30.Dxb5 Le6 31.Lb6+ Ka8 32.Lc5 Dd7 33.De2 Sf5 34.Dxe4+ Ld5 35.Td3 Sd4 36.De3 Df7 37.f4 Sf5 38.Dd2 Lc6 39.fxe5 Lxe5 40.De2 The8 41.Te3 De6 42.Txe5 Dxe5 43.Dxe5 Txe5 44.g4 Sh4 45.Kf2 Kb8 46.Sd3
-/+ (-0.74 ++) Tiefe: 31/56 00:04:00 563MN, tb=187
25.La5 De7 26.Le2 Dxc5 27.b4 De7 28.Lxb5 cxb5 29.Dxd5+ Ka7 30.Dxb5 Le6 31.Lb6+ Ka8 32.Lc5 Dd7 33.De2 Sf5 34.Dxe4+ Ld5 35.Td3 Sd4 36.De3 Df7 37.f4 Sf5 38.Dd2 Lc6 39.fxe5 Lxe5 40.De2 The8 41.Te3 De6 42.Txe5 Dxe5 43.Dxe5 Txe5 44.g4 Sh4 45.Kf2 Kb8 46.Sd3
=/+ (-0.53 ++) Tiefe: 31/56 00:04:01 566MN, tb=187

After few minutes.

[Dann Corbit]

Stockfish crashes for me all the time.

If you analyze a few thousand positions at 36 plies, it will crash for you too.
Sometimes it is endgame positions, sometimes opening positions, sometimes tactical positions, sometimes quiet positions.

It will definitely crash if there are defects in the input positions. But it also crashes when the positions are fine.
It's rare enough that I don't worry much about it.

But if you run a big collection of machines using SF to analyze with benchmark verses a collection of files, some of the machines will have a core dump sitting there in the morning.

[MikeGL]

[deleted] double post

[MikeGL]

Tactical crash of Stockfish (asmFish, but its the same)!

A few minutes ago I watched the following game. Stockfish crashed in few moves! How is that possible? Unfortunately, it is so.

[Event "5 min, rated"]
[Site "Engine Room"]
[Date "2018.11.28"]
[Round "?"]
[White "EmadHawdyII, asmFishWCP_2018-11-18"]
[Black "Visoki Decani, Lc0 v0.19.0 11248"]
[Result "0-1"]
[ECO "B12"]
[WhiteElo "2509"]
[BlackElo "2414"]
[Annotator "0.85;0.55"]
[PlyCount "66"]
[EventDate "2018.11.28"]
[EventType "blitz"]
[TimeControl "300"]

1. d4 {B 0} c6 {B 0} 2. e4 {B 0} d5 {B 0} 3. e5 {B 0} Bf5 {B 0} 4. Nf3 {B 0} e6
{B 0} 5. Be2 {B 0} h5 {B 0} 6. O-O {B 0} Be7 {B 0} 7. Nbd2 {B 0} a5 {0.55/9 6}
8. a4 {0.85/24 20} Nh6 {0.51/13 1} 9. Ne1 {0.90/24 7 (Nb3)} Nd7 {0.49/12 5 (c5)
} 10. Bxh5 {0.85/25 17 (c3)} Qc7 {0.16/13 6} 11. h3 {0.25/25 30 (Nb3)} O-O-O {
0.19/27 1} 12. Nb3 {0.35/23 3} f6 {0.20/27 1} 13. Bd2 {0.39/24 17} fxe5 {
0.17/27 0 (b6)} 14. Bxa5 {0.96/21 2 (dxe5)} b6 {-0.26/17 10} 15. Bd2 {0.47/29
21 (Bc3)} e4 {-0.20/23 6} 16. a5 {0.51/26 9} b5 {-0.18/35 0} 17. a6 {0.36/27 6}
Kb8 {-0.31/22 1} 18. Ba5 {0.33/24 6} Qd6 {-0.35/18 0 (Cb6)} 19. Qd2 {1.09/22 5
(Bxd8)} Rc8 {-0.89/15 14 (Cg8)} 20. Nc5 {0.00/26 19 (c3)} Nxc5 {-0.24/18 2} 21.
Bb4 {0.00/25 3} Qc7 {-0.20/18 4 (Cg8)} 22. dxc5 {0.00/27 2 (Bxc5)} Ka8 {
-1.60/13 15 (Cg8)} 23. Ra3 {-0.34/25 24} Bf6 {-1.62/11 1 (Cg8)} 24. Bc3 {
0.00/22 12 (c4)} e5 {-1.81/13 13 (Axc3)} 25. Ba5 {0.00/20 3} Qe7 {-2.01/16 7
(Dd7)} 26. Bb6 {-0.38/24 18 (c4)} Bg5 {-3.77/12 12 (Cf7)} 27. Qd1 {0.27/19 1}
Bf4 {-3.87/13 4 (d4)} 28. Be2 {-1.79/22 7 (b4)} Be6 {-4.39/10 9 (Cf7)} 29. Bh5
{-3.36/24 14 (c4)} g5 {-5.47/11 9 (Dg5)} 30. Ba5 {-2.61/20 5 (f3)} g4 {-7.60/
11 9 (Dxc5)} 31. g3 {-6.95/22 10 (c4)} Qg5 {-9.39/11 6} 32. h4 {-7.71/23 0
(gxf4)} Qxh5 {-13.48/10 8} 33. Ng2 {-8.12/24 0} Nf5 {-14.14/10 4 EmadHawdyII,
asmFishWCP_2018-11-1 abbandona (Lag: Av=0.52s, max=1.9s)} 0-1

[d]k1r4r/8/P1p1b3/BpPppn1q/4pbpP/R5P1/1PP2PN1/3Q1RK1 w - - 2 34

Final position looks amazing, central control at its finest.
I think already mentioned in other threads here, Lc0 is deadly in blitz, but SF10 still has the mojo and can defeat Lc0 at matches with longer time controls. Deep positional moves discovered by Lc0 in just seconds can also be seen by SF at higher depths, but it requires some minutes.
Didn't know a silent Caro-Kann can be brutal and end up like this.

[jdart]

I have also seen this kind of thing. When LC0 is good, it's very good, and once in a while it finds something that the deep searchers just miss. But it doesn't do it all the time, and once in a while it shows a blind spot, too.

--Jon

[shrapnel]

I have also seen this kind of thing. When LC0 is good, it's very good, and once in a while it finds something that the deep searchers just miss. But it doesn't do it all the time, and once in a while it shows a blind spot, too.

--Jon

That's the problem in a nutshell....no CONSISTENCY.
Once this problem is solved, Stockfish/Komodo are History.

[Uri Blass]

I have also seen this kind of thing. When LC0 is good, it's very good, and once in a while it finds something that the deep searchers just miss. But it doesn't do it all the time, and once in a while it shows a blind spot, too.

--Jon

That's the problem in a nutshell....no CONSISTENCY.
Once this problem is solved, Stockfish/Komodo are History.

Stockfish is going to continue to improve.
I do not know if it is going to lose the first place but even if it is going to lose the first place it is going to continue to improve.

There are people who want to understand and if they do not understand how LC0 works because it has too many numbers then they may be interested more in stockfish because the source of it is smaller.

[Jouni]

I don't remember SF to crash in years. GUIs like Arena and Chessbase crash occasionally, but no SF! But I don't test illegal FENs.

[corres]

I have also seen this kind of thing. When LC0 is good, it's very good, and once in a while it finds something that the deep searchers just miss. But it doesn't do it all the time, and once in a while it shows a blind spot, too.
--Jon

If you think about LC0 as an engine with huge book (NN) you can understand the incident.
What is in its book perfectly LC0 plays it fast and well.
What is imperfect in its book (mainly endgame positions) LC0 plays badly.
The play of AB engines (like Stockfish) are less determined but they need time (and powerful PC) to solve the position well.

[elcabesa]

I really don't understand what you are talking about.
Is stockfish crashing? Please fill a bug report.
Is stockfish not solving some position? It happens.