1 core can be better than 6 cores (Stockfish)
Moderator: Ras
-
- Posts: 3546
- Joined: Wed Mar 08, 2006 8:15 pm
- Full name: Jouni Uski
1 core can be better than 6 cores (Stockfish)
I ran Arasan testsuite 2024 with Stockfish dev 12.1. With 15 sec limit 6 cores got 174 correct (2 tries same result). Funnily 1 cores got 175!
Jouni
-
- Posts: 645
- Joined: Sun Aug 04, 2013 1:19 pm
Re: 1 core can be better than 6 cores (Stockfish)
That's your fault because you are using the Arasan testsuite 2024.
Try the same test with this testsuite: https://www.mediafire.com/file/cypaz2t0 ... 2.pgn/file
Try the same test with this testsuite: https://www.mediafire.com/file/cypaz2t0 ... 2.pgn/file
-
- Posts: 174
- Joined: Sun Oct 30, 2022 5:26 pm
- Full name: Conor Anstey
Re: 1 core can be better than 6 cores (Stockfish)
That's your fault because you are using a testsuite.
-
- Posts: 2680
- Joined: Tue Aug 30, 2016 8:19 pm
- Full name: Rasmus Althoff
Re: 1 core can be better than 6 cores (Stockfish)
So there's one test position where the six cores don't get the expected result. Could be interesting to have a look at that. It's even possible that this position is actually ambiguous.
Rasmus Althoff
https://www.ct800.net
https://www.ct800.net
-
- Posts: 2058
- Joined: Wed Jul 13, 2011 9:04 pm
- Location: Madrid, Spain.
Re: 1 core can be better than 6 cores (Stockfish).
Hello Rasmus:
Otherwise, I agree with you that it would be interesting to have a look into the discrepant position/s and its/their ambiguity or soundness, all of this without trying to discredit Jon's continous effort of collecting, testing and choosing positions for his longly reviewed test suite.
Regards from Spain.
Ajedrecista.
Most likely IMHO, but not necessarily since the used test has got more than 175 positions (200 in fact). I mean, it could be that 1-core and 6-core solved the same s positions (149 =< s =< 174, but not necessarily s = 174 only), this is why I would say at least —and more likely— one position. If engine 1 solves s1 positions and engine 2 solves s2 positions in a test suite with n total positions (0 =< s1 =< n and 0 =< s2 =< n), I think that the number of common solved positions s must be max(0, s1 + s2 - n) =< s =< min(s1, s2). Hence, max(0, 175 + 174 - 200) =< s =< min(175, 174); 149 =< s =< 174. Any corrections are welcome.
Otherwise, I agree with you that it would be interesting to have a look into the discrepant position/s and its/their ambiguity or soundness, all of this without trying to discredit Jon's continous effort of collecting, testing and choosing positions for his longly reviewed test suite.
Regards from Spain.
Ajedrecista.
-
- Posts: 3546
- Joined: Wed Mar 08, 2006 8:15 pm
- Full name: Jouni Uski
Re: 1 core can be better than 6 cores (Stockfish)
In third try 6 cores solved 171. In second try 1 cores solved 177,when 2 positions were solved in just 15 seconds! OK this shows test suite is buggy and/or too easy.
Jouni
-
- Posts: 645
- Joined: Sun Aug 04, 2013 1:19 pm
Re: 1 core can be better than 6 cores (Stockfish)
Hai wrote: ↑Fri Jan 17, 2025 11:13 am That's your fault because you are using the Arasan testsuite 2024.
Try the same test with this testsuite: https://www.mediafire.com/file/cypaz2t0 ... 2.pgn/file
-
- Posts: 1965
- Joined: Thu Sep 18, 2008 10:24 pm
Re: 1 core can be better than 6 cores (Stockfish)
The more I've been thinking about this, the more I think this shouldn't happen. Even accepting there is virtually no link between Elo and tactical testsuite performance, you should see a better score on more cores.
Is there a pgn of Arasan to download?
-
- Posts: 1193
- Joined: Thu Dec 25, 2008 9:07 pm
- Full name: Herbert L
Re: 1 core can be better than 6 cores (Stockfish)
Not a pgn, but an epd here :https://arasanchess.org/testsuite.shtml
But you can create a new cbh database, and then chose
in Fritz GUI attach epd
But you can create a new cbh database, and then chose
in Fritz GUI attach epd
-
- Posts: 1965
- Joined: Thu Sep 18, 2008 10:24 pm
Re: 1 core can be better than 6 cores (Stockfish)
Thanks - but how do you actually do this? I have no import option or attach option. I'm wondering if this was in an earlier version of Fritz/Chessbase. I may well be being blind!Paloma wrote: ↑Wed Jan 29, 2025 12:15 am Not a pgn, but an epd here :https://arasanchess.org/testsuite.shtml
But you can create a new cbh database, and then chose
in Fritz GUI attach epd