Stockfish 15.1 is ready

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

dkappe
Posts: 1632
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Stockfish 15.1 is ready

Post by dkappe »

Eduard wrote: Tue Dec 13, 2022 12:52 am The fact of the matter is that Stockfish isn't getting any better. Maybe the testing environment has been good so far. Now it brings no more progress. The developers should think about changes. If you can't see any progress after 1.2 billion games after 8 months, you should change something.
While your idea of using longer testing TC for fishtest is interesting, I can confirm that SF15.1 is clearly better than SF15. This notion that SF isn’t improving is simply not true.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
Modern Times
Posts: 3726
Joined: Thu Jun 07, 2012 11:02 pm

Re: Stockfish 15.1 is ready

Post by Modern Times »

dkappe wrote: Tue Dec 13, 2022 3:53 am I can confirm that SF15.1 is clearly better than SF15. This notion that SF isn’t improving is simply not true.
Agreed.
Eduard
Posts: 1439
Joined: Sat Oct 27, 2018 12:58 am
Location: Germany
Full name: N.N.

Re: Stockfish 15.1 is ready

Post by Eduard »

dkappe wrote: Tue Dec 13, 2022 3:53 am
Eduard wrote: Tue Dec 13, 2022 12:52 am The fact of the matter is that Stockfish isn't getting any better. Maybe the testing environment has been good so far. Now it brings no more progress. The developers should think about changes. If you can't see any progress after 1.2 billion games after 8 months, you should change something.
While your idea of using longer testing TC for fishtest is interesting, I can confirm that SF15.1 is clearly better than SF15. This notion that SF isn’t improving is simply not true.
Hello Dietrich,
could you illustrate with practical examples what the improvements of Stockfish 15.1 are? Thanks!
dkappe
Posts: 1632
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Stockfish 15.1 is ready

Post by dkappe »

Eduard wrote: Tue Dec 13, 2022 6:05 am Hello Dietrich,
could you illustrate with practical examples what the improvements of Stockfish 15.1 are? Thanks!
As you might imagine, we test at various time controls and opening sets against different versions of Stockfish. Squeezing the error bars under 2.0, it’s clear that SF15.1 is better than SF15. With balanced openings, it’s almost +12 elo. Hats off to the Stockfish team for still improving at this level.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
Eduard
Posts: 1439
Joined: Sat Oct 27, 2018 12:58 am
Location: Germany
Full name: N.N.

Re: Stockfish 15.1 is ready

Post by Eduard »

At Stefan Pohl +4 Elo and CEGT -3 Elo. I'm currently testing a modified version of SF 15 live on the server PlayChess with 7 cores (about 14000 kns).
Modern Times
Posts: 3726
Joined: Thu Jun 07, 2012 11:02 pm

Re: Stockfish 15.1 is ready

Post by Modern Times »

Eduard wrote: Tue Dec 13, 2022 6:44 am At Stefan Pohl +4 Elo and CEGT -3 Elo. I'm currently testing a modified version of SF 15 live on the server PlayChess with 7 cores (about 14000 kns).
And CCRL:

+28 Elo (40/15 1CPU, fairly large error margins)
+21 Elo (Blitz 1CPU)
+94 Elo (FRC blitz 1CPU)
Magnum
Posts: 195
Joined: Thu Feb 04, 2021 10:24 pm
Full name: Arnold Magnum

Re: Stockfish 15.1 is ready

Post by Magnum »

Eduard wrote: Tue Dec 13, 2022 6:44 am At Stefan Pohl +4 Elo and CEGT -3 Elo. I'm currently testing a modified version of SF 15 live on the server PlayChess with 7 cores (about 14000 kns).
You can double the improvement by doubling the machines.
We have at the moment only: Workers - 269 machines
Eduard
Posts: 1439
Joined: Sat Oct 27, 2018 12:58 am
Location: Germany
Full name: N.N.

Re: Stockfish 15.1 is ready

Post by Eduard »

Currently on PlayChess after 5 Hours and 56 games in Auto mode: +1 =55 -0.
mehmet123
Posts: 682
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish 15.1 is ready

Post by mehmet123 »

Eduard wrote: Tue Dec 13, 2022 2:14 pm Currently on PlayChess after 5 Hours and 56 games in Auto mode: +1 =55 -0.
Eduard, I'm sure that if you play with Stockfish 13, your score will be positive at Playchess. Because you have very powerful and effective opening books for Playchess.
wickedpotus
Posts: 153
Joined: Sun May 16, 2021 5:33 pm
Full name: Aron Rodgriges

Re: Stockfish 15.1 is ready

Post by wickedpotus »

M ANSARI wrote: Sun Dec 11, 2022 8:01 am
I don't agree at all about the Apple hardware statement. I never really took notice of all the Apple hype, but my cousin happened to be the local agent for Apple in my country and I ended up getting one of the new Macbook Pro's 13 inch with the new M2 chip. OMG !!! I cannot explain how incredibly impressed I was with the video editing performance of my spearfishing GoPro footage. It was dramatically faster ... I mean by several orders of magnitude ... than my souped up 8 core PC with a 1500 watt power supply and a 2080Ti card. Even 4K videos would scream through it like it was nothing. Totally amazing ... and all that without the laptop even getting warm ... with battery life that lasted the full day. So I personally was absolutely impressed with the performance.

I will add however that I hardly ever use that laptop except for video editing. I just can't get around the learning curve required to learn the new OS as I have been using DOS then Windows since my first PC. It does get me frustrated when I want to do a simple task ... but I am sure that can be resolved once I put some time and effort into it. I also don't know how well the M2 chip performs for chess as I was not able to run the Ipman test on it ... but if video editing performance is comparable to chess engine performance ... that thing will fly!
You describe a specialized use case with tweaked hw+sw encoding/decoding that is heavily optimized substantially by specialty hw used by proprietary sw... These use cases could likley be much more optimized for other hw if sw vendors prioritized limited hw-configs over general compatibility.

If Apple-hw was "truly" amazing it would also be able to do 3D raytracing, games, GPU-bound chess, AI, etc., etc. better, not only just certain specialized use-cases like video/sound-editing. If Apples CPU was better at much more than posting some boosted tweaked geekbench results. It would perform much better on Stockfish, Ethereal, Dragon, Hiarcs, Berserk, Koivisto, etc., etc.

Running Linux like Asahi on it makes it easier to compare apples-to-apples... and M1/M2 is beaten quite badly by Intel+AMDs offerings. Not only in price/value but also in raw performance.

https://appuals.com/apple-m2-linux-vs-intel-amd/