Looking for a tactical test suite

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

kasinp
Posts: 251
Joined: Sat Dec 02, 2006 10:47 pm
Location: Toronto
Full name: Peter Kasinski

Looking for a tactical test suite

Post by kasinp »

...moderately difficult and vetted by modern engines.
Intended for second-tier engine testing - not Stockfish.

Thanks,
PK
User avatar
cc2150dx
Posts: 325
Joined: Sat Nov 30, 2013 9:51 am
Location: Canada
Full name: Jason Coombs

Re: Looking for a tactical test suite

Post by cc2150dx »

I recommend the Arasan Test Suite: https://www.arasanchess.org/testsuite.shtml

Or unless someone else here knows of something better.
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Looking for a tactical test suite

Post by Dann Corbit »

I second that recommendation.
It has a nice spectrum of difficulty and is thoroughly well debugged.
Most tactical suites are too easy for today's engines.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
kasinp
Posts: 251
Joined: Sat Dec 02, 2006 10:47 pm
Location: Toronto
Full name: Peter Kasinski

Re: Looking for a tactical test suite

Post by kasinp »

Thank you both. I should have thought of it myself! Again, appreciate the responses.
PK
Paloma
Posts: 1167
Joined: Thu Dec 25, 2008 9:07 pm
Full name: Herbert L

Re: Looking for a tactical test suite

Post by Paloma »

I recommend also the Hard-Talkchess-2019 set here:
http://www.talkchess.com/forum3/viewtop ... =2&t=69361
Last edited by Paloma on Thu Jan 17, 2019 5:46 pm, edited 1 time in total.
User avatar
Look
Posts: 364
Joined: Thu Jun 05, 2014 2:14 pm
Location: Iran
Full name: Mehdi Amini

Re: Looking for a tactical test suite

Post by Look »

I think test suites need much more number of positions. More than 1000 for instance.
Farewell.
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Looking for a tactical test suite

Post by Dann Corbit »

It is incredibly difficult to produce a tactical test suite with 1000 positions which is thoroughly debugged.
Even 100 positions is rather difficult.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Look
Posts: 364
Joined: Thu Jun 05, 2014 2:14 pm
Location: Iran
Full name: Mehdi Amini

Re: Looking for a tactical test suite

Post by Look »

Dann Corbit wrote: Thu Jan 17, 2019 9:20 pm It is incredibly difficult to produce a tactical test suite with 1000 positions which is thoroughly debugged.
Even 100 positions is rather difficult.
For instance, what if the line is confirmed by several top engines ?
Farewell.
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Looking for a tactical test suite

Post by Vinvin »

kasinp wrote: Thu Jan 17, 2019 1:25 am ...moderately difficult and vetted by modern engines.
Intended for second-tier engine testing - not Stockfish.

Thanks,
PK
On the easy side there are the WAC and the ECM-GCP.
And some more, all downloadable here : https://www.arasanchess.org/tests.shtml
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Looking for a tactical test suite

Post by Dann Corbit »

Look wrote: Fri Jan 18, 2019 12:05 pm
Dann Corbit wrote: Thu Jan 17, 2019 9:20 pm It is incredibly difficult to produce a tactical test suite with 1000 positions which is thoroughly debugged.
Even 100 positions is rather difficult.
For instance, what if the line is confirmed by several top engines ?
I have done that. I worked with Swaminathan in verification of the STS test suite. I took the three strongest engines of the day and ran for a full hour for each position. If the engines were not in agreement, I rejected the position and Swaminathan would give me a new position that fit the criteria of the test set we were working on. However, when I started the test set the strongest engine I had was 32 bit Rybka 2.3 and I had 4 core machines. Today, ten percent of the positions in STS are not valid. The reason is simple. The engines are exponentially stronger. The machines are exponentially stronger, and vastly better and deeper searches found yet better answers with a much deeper look.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.