All 1001 testpositions from Fred Reinfeld re-re-visited

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
Eelco de Groot
Posts: 4681
Joined: Sun Mar 12, 2006 2:40 am
Full name:   Eelco de Groot

All 1001 testpositions from Fred Reinfeld re-re-visited

Post by Eelco de Groot »

As given by John Wesley Cleveland, this is originally an 1993 edition of this suite so I take it there may be some errors in the test, also known as WCSAC and tested extensively by Steven Edwards in 1993 and later if you search the forum archives. This testing was later done at much longer times than what Rainbow Serpent was allowed on my old Athlon. The accompanying notes say that some wrong solutions were removed after checking by SPECTOR, Edward's program, but this was in 1993, so I don't know how many inaccuracies remain in this version. I know there are known cooks and wrong solutions to this test but the majority appeared to be okay. Some undoubtedly too hard to find under the conditions, I used a twelve ply fixed depth search with an experimental Rainbow Serpent. I now noticed that Shredder GUI allows you to skip a position if it takes too long, I had to use it several times probably because I was using some experimental adaptive null move scheme, and sometimes the twelve plies was too much to wait indefinitely, I had not calculated on doing 1001 positions :o But no outright crashes, that was good. Here is the solution matrix.

Code: Select all


  Fred Reinfeld: 1001 winning chess sacrifices and combinations,
  Melvin Powers Wilshire book company (third printing copyright 1955)
  ISBN = 0-87980-111-5

Right until now: 853 of 1001

         1   2   3   4   5   6   7   8   9  10  11  12  13  14  15  16  17  18  19  20
 -------------------------------------------------------------------------------------
   0 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -   0   -   0   0
  20 |   0   6   0   1   2   0   -   0   0   0   0  40   0   0   0   0   -   5   -   -
  40 |   0   -   -   0   0   0   1   0   0   0   0   0   -   -   0   0   9   0   0   0
  60 |   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   1   0   -
  80 |   0   -   0   1   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0
 100 |   0   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   -   0
 120 |   0   1   0   0   0   0   -   0   0   0   0   0   -   0   0   0   0   0   0   0
 140 |   0   0   0   0   -   0   -   -   0   1   0   0   8   0   0   0   -   -   0   0
 160 |   0   -   0   0   0   0   0   0   -   -   0   0   0   0   0   0   0   0   0   -
 180 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 200 |   4   0   0   0   0   0   0   0   0   2   0   0   0   0   0   -   0   0   0   0
 220 |   -   0   0   0   0   -   0   0   0   0   0   0   0   -   0   1   0   0   0   0
 240 |   2   0   -   -   0   0   -   1   0   0   0   0   -   0   0   0   0   0   0   0
 260 |   -   0   0   0   -   -   0   0   0   0   0   0   0   0   -   0   0   -   0   0
 280 |   0   0   -   0   0   0   1   0   -   0   0   0   0   0   0   -   0   0   0   -
 300 |   0   0   0   5   0   0   0   0   -   0   0   0   0   0   -   0   0   0   0   -
 320 |   0   0   0   0   0   0   -   0   0   0   2   3   0   0   0   0   0   0   0   0
 340 |   -   0   0   0   -   -   0   0   -   0   -   0   0   0   0   0   0   0   0   0
 360 |   0   0   0   0   0   0   -   0   0   0   -   0   3   0   0   0   0   0   -   0
 380 |   -   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0   0   6   0   0
 400 |   0   0   0   7   0   0   0   -   0   0   0   0   0   0   0  11   0   0   0   0
 420 |   0   0   0   7   0   0   0   0   -   0  27   0   0   0   0   -   0   0   0   0
 440 |   0   0   0   0   0   0   0   0   0   1   0   0   0   0   1   0   0   0   0   0
 460 |   0   0   0   0   0   1   0   0   0   0   -   -   -   -   -   0   0   -   0   0
 480 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -   -   -   0   0
 500 |   0   -   0   0   0   0   0   -   0   0   0   0   0   0   -   -   0   1   0   -
 520 |   0   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0
 540 |   0   0   0   0   0   0   -   0   0   4   0   0   2   0   -   0   0   0   0   -
 560 |   -   0   1   0   0   -   0   1   0   -   6   0   0   0   0   -   0   -   0   -
 580 |   0   -   0   0   0   0   -   0   0   0   0   0   -   1   0   0   1   0   0   0
 600 |   0   -   0   0   0   -   0   8   0   0   -   0   0   0   0   -   0   -   0   0
 620 |   0   0   0   0   0   0   -   0   0   0   0   0   0   0  23   0   0   0   0   -
 640 |   0   -   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   -   0   0
 660 |   0   0   0   0   0   0   0   0   0   0   0   0   -   -   0   0   0   0   0   0
 680 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   1   0   0   0   0
 700 |   0   0   0   0   0   0   -   0   0   9   -   0   0   0   0   0   0   0   0   0
 720 |   0   0   -   0   0   0   0   1   0   1   0   0   0   -   0   0   0   3   0   0
 740 |   0   0   0   0   0   0   0   -   0  24   0   0   0   0   0   0   -   0   0   -
 760 |   0   0   0   0   0   0   0   -   0   -   0   0   0   0   0   0   -   0   0   0
 780 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   -   -
 800 |   0   0   0   -   0   0   0   3   0   0   -   0   0   0   0   0   -   0   0   -
 820 |   0   0   0  10   0   0   0   0   0   0   0   -   0   -   0   0   0   0   0   0
 840 |   0   -   0   0   -   0   0   0   0  22   0   2   0   0   0   0   0   0   0   -
 860 |   -   0   -   0   0   0   -   0   -   -   0   0   -   0   -   -  37   0   0   -
 880 |   0   0   0   0   0   0   0   0   0   -   0   4   0   0   0   0   0   0   0   0
 900 |   -   0   0   0   0   0   -   0   2   0   -   0   0   2   -   0   2   0   -   0
 920 |   0   0   0   -   0   0   0   -   0   0   0   -   0   3   0   -   0   5   4   -
 940 |   0   0   -   0   0   0   0   0   2   0   0   1   0   0   0   0   0   1   0   0
 960 |   -   0   0   0   0   0   0   0   0   -   0   0   -   6   0   0   0   0   3   0
 980 |   0   2   0   0   0   0   -   0   0   0   0   0   0   0   4   0   0   -   0   2
1000 |   0

   1 sec -> 787/1001
   2 sec -> 809/1001
   3 sec -> 821/1001
   4 sec -> 827/1001
   5 sec -> 832/1001
   6 sec -> 835/1001
   7 sec -> 839/1001
   8 sec -> 841/1001
   9 sec -> 843/1001
  10 sec -> 845/1001
  11 sec -> 846/1001
  12 sec -> 847/1001
  13 sec -> 847/1001
  14 sec -> 847/1001
  15 sec -> 847/1001
  20 sec -> 847/1001
  25 sec -> 850/1001
  30 sec -> 851/1001
  40 sec -> 852/1001
  50 sec -> 853/1001
  60 sec -> 853/1001
  90 sec -> 853/1001
 120 sec -> 853/1001
 150 sec -> 853/1001
 180 sec -> 853/1001
 240 sec -> 853/1001
 300 sec -> 853/1001
 360 sec -> 853/1001
 420 sec -> 853/1001
 480 sec -> 853/1001
 540 sec -> 853/1001
 600 sec -> 853/1001
 900 sec -> 853/1001
1200 sec -> 853/1001
1800 sec -> 853/1001
2400 sec -> 853/1001
3000 sec -> 853/1001
3600 sec -> 853/1001
  n/s: 579.488  
  TotTime: 258:31m    SolTime: 44:37m

Engine: Rainbow Serpent 1.6.3s(dc) Build 138 (Athlon 2009 MHz, 128 MB) 
by Tord Romstad, Marco Costalba, Joona Kiiski Modifications: Dann Corbit

Twelve ply fixed depth.
Eelco
Debugging is twice as hard as writing the code in the first
place. Therefore, if you write the code as cleverly as possible, you
are, by definition, not smart enough to debug it.
-- Brian W. Kernighan
jdart
Posts: 4411
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: All 1001 testpositions from Fred Reinfeld re-re-visited

Post by jdart »

Last time I looked at this, a lot of tests had multiple moves that led to forced mates. Since most programs don't necessarily find the shortest mate, they will fail on many of these. A dedicated solving program like CHEST won't have this difficulty. There were other problems with the test suite too but that was one of the more common ones.