Looking for a tactical test suite

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
kasinp
Posts: 188
Joined: Sat Dec 02, 2006 9:47 pm
Location: Toronto

Looking for a tactical test suite

Post by kasinp » Thu Jan 17, 2019 12:25 am

...moderately difficult and vetted by modern engines.
Intended for second-tier engine testing - not Stockfish.

Thanks,
PK

cc2150dx
Posts: 172
Joined: Sat Nov 30, 2013 8:51 am
Location: Canada

Re: Looking for a tactical test suite

Post by cc2150dx » Thu Jan 17, 2019 12:49 am

I recommend the Arasan Test Suite: https://www.arasanchess.org/testsuite.shtml

Or unless someone else here knows of something better.
Komodo tester

Dann Corbit
Posts: 9774
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Looking for a tactical test suite

Post by Dann Corbit » Thu Jan 17, 2019 1:15 am

I second that recommendation.
It has a nice spectrum of difficulty and is thoroughly well debugged.
Most tactical suites are too easy for today's engines.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

kasinp
Posts: 188
Joined: Sat Dec 02, 2006 9:47 pm
Location: Toronto

Re: Looking for a tactical test suite

Post by kasinp » Thu Jan 17, 2019 1:32 am

Thank you both. I should have thought of it myself! Again, appreciate the responses.
PK

Paloma
Posts: 766
Joined: Thu Dec 25, 2008 8:07 pm

Re: Looking for a tactical test suite

Post by Paloma » Thu Jan 17, 2019 4:43 pm

I recommend also the Hard-Talkchess-2019 set here:
http://www.talkchess.com/forum3/viewtop ... =2&t=69361
Last edited by Paloma on Thu Jan 17, 2019 4:46 pm, edited 1 time in total.

Look
Posts: 151
Joined: Thu Jun 05, 2014 12:14 pm
Location: Iran
Full name: Mehdi Amini
Contact:

Re: Looking for a tactical test suite

Post by Look » Thu Jan 17, 2019 4:50 pm

I think test suites need much more number of positions. More than 1000 for instance.
Mehdi Amini
www.my-c-codes.com/

Farewell.

Dann Corbit
Posts: 9774
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Looking for a tactical test suite

Post by Dann Corbit » Thu Jan 17, 2019 8:20 pm

It is incredibly difficult to produce a tactical test suite with 1000 positions which is thoroughly debugged.
Even 100 positions is rather difficult.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

Look
Posts: 151
Joined: Thu Jun 05, 2014 12:14 pm
Location: Iran
Full name: Mehdi Amini
Contact:

Re: Looking for a tactical test suite

Post by Look » Fri Jan 18, 2019 11:05 am

Dann Corbit wrote:
Thu Jan 17, 2019 8:20 pm
It is incredibly difficult to produce a tactical test suite with 1000 positions which is thoroughly debugged.
Even 100 positions is rather difficult.
For instance, what if the line is confirmed by several top engines ?
Mehdi Amini
www.my-c-codes.com/

Farewell.

Vinvin
Posts: 4244
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Looking for a tactical test suite

Post by Vinvin » Fri Jan 18, 2019 11:05 am

kasinp wrote:
Thu Jan 17, 2019 12:25 am
...moderately difficult and vetted by modern engines.
Intended for second-tier engine testing - not Stockfish.

Thanks,
PK
On the easy side there are the WAC and the ECM-GCP.
And some more, all downloadable here : https://www.arasanchess.org/tests.shtml

Dann Corbit
Posts: 9774
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Looking for a tactical test suite

Post by Dann Corbit » Fri Jan 18, 2019 7:10 pm

Look wrote:
Fri Jan 18, 2019 11:05 am
Dann Corbit wrote:
Thu Jan 17, 2019 8:20 pm
It is incredibly difficult to produce a tactical test suite with 1000 positions which is thoroughly debugged.
Even 100 positions is rather difficult.
For instance, what if the line is confirmed by several top engines ?
I have done that. I worked with Swaminathan in verification of the STS test suite. I took the three strongest engines of the day and ran for a full hour for each position. If the engines were not in agreement, I rejected the position and Swaminathan would give me a new position that fit the criteria of the test set we were working on. However, when I started the test set the strongest engine I had was 32 bit Rybka 2.3 and I had 4 core machines. Today, ten percent of the positions in STS are not valid. The reason is simple. The engines are exponentially stronger. The machines are exponentially stronger, and vastly better and deeper searches found yet better answers with a much deeper look.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

Post Reply