Test position: Find the draw!

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

metax
Posts: 344
Joined: Wed Sep 23, 2009 5:56 pm
Location: Germany

Test position: Find the draw!

Post by metax »

The following position is obviously a dead draw. Engines have problems with this kind of positions.
Following test: Let your favourite engine search for, say, 30 seconds (less on fast hardware), but not longer. Which engine has the score with the smallest difference to a draw (0.00)? Is there an engine that even scores the position as a draw?

[d]r3kb2/8/1p1p1p1p/p1p1p1p1/P1P1P1P1/1P1P1P1P/8/2B1KB2 w q -

Here is the result of some engines on my Core 2 Duo, ordered worst to best:
  • Stockfish 1.6.3 JA: Depth 24, Score -2.38
  • Twisted Logic 20100131x: Depth 25/37, Score -1.90
  • Shredder Classic 3: Depth 16/27, Score -1.90
  • AnMon 5.60: Depth 17, Score -1.89
  • Spike 1.2: Depth 18, Score -1.71
  • SOS 5.1: Depth 19/30, Score -1.66
  • Hermann 2.4: Depth 17/34, Score -1.62
  • Rybka 2.2n2: Depth 22(+3), Score -1.24
  • ProDeo 1.5: Depth 17, Score -1.23
  • ChessMind 0.72: Depth 11/27, Score -0.84
I hope that there is some intelligent engine that can see the draw.
Terry McCracken
Posts: 16465
Joined: Wed Aug 01, 2007 4:16 am
Location: Canada

Re: Test position: Find the draw!

Post by Terry McCracken »

metax wrote:The following position is obviously a dead draw. Engines have problems with this kind of positions.
Following test: Let your favourite engine search for, say, 30 seconds (less on fast hardware), but not longer. Which engine has the score with the smallest difference to a draw (0.00)? Is there an engine that even scores the position as a draw?

[d]r3kb2/8/1p1p1p1p/p1p1p1p1/P1P1P1P1/1P1P1P1P/8/2B1KB2 w q -

Here is the result of some engines on my Core 2 Duo, ordered worst to best:
  • Stockfish 1.6.3 JA: Depth 24, Score -2.38
  • Twisted Logic 20100131x: Depth 25/37, Score -1.90
  • Shredder Classic 3: Depth 16/27, Score -1.90
  • AnMon 5.60: Depth 17, Score -1.89
  • Spike 1.2: Depth 18, Score -1.71
  • SOS 5.1: Depth 19/30, Score -1.66
  • Hermann 2.4: Depth 17/34, Score -1.62
  • Rybka 2.2n2: Depth 22(+3), Score -1.24
  • ProDeo 1.5: Depth 17, Score -1.23
  • ChessMind 0.72: Depth 11/27, Score -0.84
I hope that there is some intelligent engine that can see the draw.
Typical blocked position where all or at least most can't see the draw statically or through a quick search. This needs to change and it would help engines avoid such positions.

This would of course hurt Pablo's enjoyment of locking up computer positions to force a draw or win on time. :)
Terry McCracken
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Test position: Find the draw!

Post by zullil »

Terry McCracken wrote: This would of course hurt Pablo's enjoyment of locking up computer positions to force a draw or win on time. :)
Yes, but think how happy it would make the rest of us. And besides, Pablo really needs to find a new source of enjoyment after all these years. :wink:
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Test position: Find the draw!

Post by zullil »

Code: Select all

Crafty v23.2 (8 cpus)

White(1): setboard r3kb2/8/1p1p1p1p/p1p1p1p1/P1P1P1P1/1P1P1P1P/8/2B1KB2 w q -
White(1): st 15
search time set to 15.00.
White(1): display stats
display statistics at end of each search.
White(1): display

       +---+---+---+---+---+---+---+---+
    8  |<R>| . |   | . |<K>|<B>|   | . |
       +---+---+---+---+---+---+---+---+
    7  | . |   | . |   | . |   | . |   |
       +---+---+---+---+---+---+---+---+
    6  |   |<P>|   |<P>|   |<P>|   |<P>|
       +---+---+---+---+---+---+---+---+
    5  |<P>|   |<P>|   |<P>|   |<P>|   |
       +---+---+---+---+---+---+---+---+
    4  |-P-| . |-P-| . |-P-| . |-P-| . |
       +---+---+---+---+---+---+---+---+
    3  | . |-P-| . |-P-| . |-P-| . |-P-|
       +---+---+---+---+---+---+---+---+
    2  |   | . |   | . |   | . |   | . |
       +---+---+---+---+---+---+---+---+
    1  | . |   |-B-|   |-K-|-B-| . |   |
       +---+---+---+---+---+---+---+---+
         a   b   c   d   e   f   g   h

White(1): go
              time limit 15.00 (+0.00) (15.00)
              depth   time  score   variation (1)
starting thread 1
starting thread 2
starting thread 3
starting thread 4
starting thread 5
starting thread 6
starting thread 7
               11     0.05  -1.32   1. Kd2 Kd7 2. Be2 Bg7 3. Kc2 Kc6 4.
                                    Kc3 Rh8 5. Be3 h5 6. gxh5 <HT> (s=2)
               11->   0.06  -1.32   1. Kd2 Kd7 2. Be2 Bg7 3. Kc2 Kc6 4.
                                    Kc3 Rh8 5. Be3 h5 6. gxh5 <HT> (s=3)
               12     0.06  -1.34   1. Kd2 Kd7 2. Be2 Kc6 3. Kc2 Be7 4.
                                    Be3 Rc8 5. Kd2 Rh8 6. Kc3 h5 7. gxh5
                                    <HT> (s=2)
               12->   0.07  -1.34   1. Kd2 Kd7 2. Be2 Kc6 3. Kc2 Be7 4.
                                    Be3 Rc8 5. Kd2 Rh8 6. Kc3 h5 7. gxh5
                                    Rxh5 <HT>
               13     0.09  -1.42   1. Kd2 Kd7 2. Be2 Kc6 3. Ke3 Bg7 4.
                                    Bb2 Rh8 5. Bf1 h5 6. Bg2 h4 7. Bc3
                                    <HT>
               13->   0.15  -1.42   1. Kd2 Kd7 2. Be2 Kc6 3. Ke3 Bg7 4.
                                    Bb2 Rh8 5. Bf1 h5 6. Bg2 h4 7. Bc3
                                    <HT> (s=4)
               14     0.17  -1.41   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bb2 h5 5. Bf1 Kc7 6. gxh5 Kc6 7. Bg2
                                    Rxh5 (s=3)
               14->   0.18  -1.41   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bb2 h5 5. Bf1 Kc7 6. gxh5 Kc6 7. Bg2
                                    Rxh5
               15     0.23  -1.42   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bb2 h5 5. Bf1 Kc7 6. Bg2 Kc6 7. Bf1
                                    h4 <HT>
               15->   0.34  -1.42   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bb2 h5 5. Bf1 Kc7 6. Bg2 Kc6 7. Bf1
                                    h4 <HT> (s=2)
               16     0.41  -1.42   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bb2 h5 5. Bf1 Kc7 6. Bg2 Kc6 7. Bf1
                                    hxg4 8. fxg4 Re8 9. Bc3 Rh8 <HT>
               16->   0.51  -1.42   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bb2 h5 5. Bf1 Kc7 6. Bg2 Kc6 7. Bf1
                                    hxg4 8. fxg4 Re8 9. Bc3 Rh8 <HT> (s=3)
               17     0.69  -1.44   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bf1 h5 5. Bg2 Kc6 6. Bd2 Rh6 7. Bc3
                                    Rh7 8. Bd2 Rh8 9. gxh5 Rxh5 10. d4
                                    exd4+ 11. Kd3 Bh6 <HT> (s=2)
               17->   0.96  -1.44   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bf1 h5 5. Bg2 Kc6 6. Bd2 Rh6 7. Bc3
                                    Rh7 8. Bd2 Rh8 9. gxh5 Rxh5 10. d4
                                    exd4+ 11. Kd3 Bh6 <HT> (s=2)
               18     1.83  -1.44   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bf1 h5 5. Bg2 Kc6 6. Bd2 Rh6 7. Bc3
                                    Rh7 8. Bd2 Rh8 9. gxh5 Rxh5
               18->   2.00  -1.44   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bf1 h5 5. Bg2 Kc6 6. Bd2 Rh6 7. Bc3
                                    Rh7 8. Bd2 Rh8 9. gxh5 Rxh5
               19     3.02  -1.48   1. Kd2 Kd7 2. Be2 Bg7 3. Ke3 Rh8 4.
                                    Bf1 h5 5. Ba3 Kc6 6. Bb2 Rb8 7. Bc3
                                    h4 8. Be2 Rh8 <HT>
               19     5.78  -1.47   1. Kf2 Kd7 2. Bg2 Be7 3. Bd2 Rh8 4.
                                    Kg3 Bd8 5. Bc3 Kc6 6. Bd2 Be7 7. Bc3
                                    Rd8 8. Kf2 Ra8 9. Be1 Rb8 10. Bc3
               19->   6.45  -1.47   1. Kf2 Kd7 2. Bg2 Be7 3. Bd2 Rh8 4.
                                    Kg3 Bd8 5. Bc3 Kc6 6. Bd2 Be7 7. Bc3
                                    Rd8 8. Kf2 Ra8 9. Be1 Rb8 10. Bc3 (s=9)
               20     7.60  -1.48   1. Kf2 Kd7 2. Bg2 Be7 3. Bd2 Rh8 4.
                                    Kg3 Kc7 5. Bc3 Kc6 6. Kf2 Bf8 7. Ba1
                                    Bg7 8. Bc3 h5 9. Ke3 h4 10. Bf1 Re8
                                    11. Be2 Rh8 12. Bd2 <HT> (s=8)
               20->   8.45  -1.48   1. Kf2 Kd7 2. Bg2 Be7 3. Bd2 Rh8 4.
                                    Kg3 Kc7 5. Bc3 Kc6 6. Kf2 Bf8 7. Ba1
                                    Bg7 8. Bc3 h5 9. Ke3 h4 10. Bf1 Re8
                                    11. Be2 Rh8 12. Bd2 <HT>
               21    12.01  -1.47   1. Kf2 Kd7 2. Bg2 Be7 3. Bd2 Rh8 4.
                                    Kg3 Kc7 5. Bc3 Kc6 6. Bd2 Rg8 7. Be3
                                    Rd8 8. Bd2 Rg8 <HT>
               21->  13.66  -1.47   1. Kf2 Kd7 2. Bg2 Be7 3. Bd2 Rh8 4.
                                    Kg3 Kc7 5. Bc3 Kc6 6. Bd2 Rg8 7. Be3
                                    Rd8 8. Bd2 Rg8 <HT>
              time=15.19  mat=-1  n=270307558  fh=94%  nps=17.8M      
              extensions=4.7M qchecks=5.9M reduced=41.5M pruned=69.3M
              predicted=0  evals=109.7M  50move=0  EGTBprobes=0  hits=0
              SMP->  splits=40317  aborts=3229  data=32/1024  elap=15.19
terminating SMP processes.
White(1): Kf2
              time used:  15.19
Terry McCracken
Posts: 16465
Joined: Wed Aug 01, 2007 4:16 am
Location: Canada

Re: Test position: Find the draw!

Post by Terry McCracken »

zullil wrote:
Terry McCracken wrote: This would of course hurt Pablo's enjoyment of locking up computer positions to force a draw or win on time. :)
Yes, but think how happy it would make the rest of us. And besides, Pablo really needs to find a new source of enjoyment after all these years. :wink:
:lol:

Agreed!
Terry McCracken
Marc MP

Re: Test position: Find the draw!

Post by Marc MP »

metax wrote:The following position is obviously a dead draw. Engines have problems with this kind of positions.
Following test: Let your favourite engine search for, say, 30 seconds (less on fast hardware), but not longer. Which engine has the score with the smallest difference to a draw (0.00)? Is there an engine that even scores the position as a draw?

[d]r3kb2/8/1p1p1p1p/p1p1p1p1/P1P1P1P1/1P1P1P1P/8/2B1KB2 w q -

Here is the result of some engines on my Core 2 Duo, ordered worst to best:
  • Stockfish 1.6.3 JA: Depth 24, Score -2.38
  • Twisted Logic 20100131x: Depth 25/37, Score -1.90
  • Shredder Classic 3: Depth 16/27, Score -1.90
  • AnMon 5.60: Depth 17, Score -1.89
  • Spike 1.2: Depth 18, Score -1.71
  • SOS 5.1: Depth 19/30, Score -1.66
  • Hermann 2.4: Depth 17/34, Score -1.62
  • Rybka 2.2n2: Depth 22(+3), Score -1.24
  • ProDeo 1.5: Depth 17, Score -1.23
  • ChessMind 0.72: Depth 11/27, Score -0.84
I hope that there is some intelligent engine that can see the draw.
I think the engine Falcon by Omid Tabibi would find it: http://www.omiddavid.com/pubs/blockage2.pdf

Not a weak engine by the way (but private): http://www.chessgames.com/perl/chessplayer?pid=29489
swami
Posts: 6659
Joined: Thu Mar 09, 2006 4:21 am

Re: Test position: Find the draw!

Post by swami »

metax wrote:Here is the result of some engines on my Core 2 Duo, ordered worst to best:
  • Stockfish 1.6.3 JA: Depth 24, Score -2.38
  • Twisted Logic 20100131x: Depth 25/37, Score -1.90
  • Shredder Classic 3: Depth 16/27, Score -1.90
  • AnMon 5.60: Depth 17, Score -1.89
  • Spike 1.2: Depth 18, Score -1.71
  • SOS 5.1: Depth 19/30, Score -1.66
  • Hermann 2.4: Depth 17/34, Score -1.62
  • Rybka 2.2n2: Depth 22(+3), Score -1.24
  • ProDeo 1.5: Depth 17, Score -1.23
  • ChessMind 0.72: Depth 11/27, Score -0.84
I hope that there is some intelligent engine that can see the draw.
Good evaluation results.

Chessmind appears to evaluate the best. Are you the author of this engine?
Edmund
Posts: 670
Joined: Mon Dec 03, 2007 3:01 pm
Location: Barcelona, Spain

Re: Test position: Find the draw!

Post by Edmund »

Marc MP wrote:I think the engine Falcon by Omid Tabibi would find it: http://www.omiddavid.com/pubs/blockage2.pdf

Not a weak engine by the way (but private): http://www.chessgames.com/perl/chessplayer?pid=29489
I think Falcon (according to the article) only deals with king pawn endgames. The pieces in the current position are a complicating factor.
Marc MP

Re: Test position: Find the draw!

Post by Marc MP »

Edmund wrote:
Marc MP wrote:I think the engine Falcon by Omid Tabibi would find it: http://www.omiddavid.com/pubs/blockage2.pdf

Not a weak engine by the way (but private): http://www.chessgames.com/perl/chessplayer?pid=29489
I think Falcon (according to the article) only deals with king pawn endgames. The pieces in the current position are a complicating factor.
I'm sorry I "read" the article in one minute or so....

Do you think it would implementable in a chess engine without too much loss in time checking the conditions (say with extra pieces)?

You're a programmer if I'm not wrong? (if so you got to answer! :wink: )
Edmund
Posts: 670
Joined: Mon Dec 03, 2007 3:01 pm
Location: Barcelona, Spain

Re: Test position: Find the draw!

Post by Edmund »

Marc MP wrote:I'm sorry I "read" the article in one minute or so....

Do you think it would implementable in a chess engine without too much loss in time checking the conditions (say with extra pieces)?

You're a programmer if I'm not wrong? (if so you got to answer! :wink: )
In this position, if you just shuffle the pieces around a little and place the black rook and king to support the h5 push and the white mobile pieces further away, then this position will probably be won for black.

Or in other combinations it may be possible that a piece would be sacrificed to create a dangerous passer.

The more possibilites one side has, the harder it becomes to generalize.

In my opinion the first problems with pieces to be approached should be with opposite colored bishops. eg in this position, if either side only had the bishop on the same square color as its pawns, the position would become trivial (knights, rooks and queens are more complicated). There are many more of these type of positions, where the stronger side can't do anything because of a wrong colored bishop.