Huntsman surprises in testsuites

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Jouni
Posts: 3749
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Huntsman surprises in testsuites

Post by Jouni »

I thought, that The Huntsman 1 is only mate solver. But I tried it in Hard Talkchess suite. 1 min limit and 6 cores. Score 79/110 :!: . Stockfish 15.1 scores 64. How is this possible? Result also confirms "importance" of test suites. In test games vs Koivisto Huntsman loses ALL games :lol: .
Jouni
ImNotStockfish
Posts: 56
Joined: Tue Sep 14, 2021 12:29 am
Full name: .

Re: Huntsman surprises in testsuites

Post by ImNotStockfish »

Huntsman uses only king safety from HCE to evaluate, so it is not unexpected for it to perform well in positions with a clear winning move.
This result confirms the opposite - how unimportant some test suites are to measure the general strength of an engine.
Dann Corbit
Posts: 12804
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Huntsman surprises in testsuites

Post by Dann Corbit »

Ipman's page says:
"The Huntsman 1 (5 binary) The Huntsman is a specialized version of Stockfish with some tweaks for faster mate-finding."
So Huntsman is a version of SF, but with some changed parameters.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit
Posts: 12804
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Huntsman surprises in testsuites

Post by Dann Corbit »

Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.