There are two many updates ... does that really make sense?

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Frank Quisinsky
Posts: 7563
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

There are two many updates ... does that really make sense?

Post by Frank Quisinsky »

Here my diary message 060:

d060.
July 09th, 2026 (18:45):
At first, you might be happy, but if you think about it logically ...

Once again, the question of purpose arises. Starting around July 22th, 2026, 10 of
the “Super Generals” will compete one after another. Both release versions and
development versions are available. For some of these engines, there are even
be both release and development versions available. One day after a release follow
a dev version?? Often to fast releases, after a release version follow the bugfix
versions.

***
It is likely that all 10 engines combined will have improved by no more than 60-70
Elo. That's my tip!!
***

And that is exactly the point!?

Not to mention that for quite some time now, there hasn’t been a single person in
the world who can win a game against an engine rated higher than 3000 Elo. We’re
talking about engines (these Generals) rated around 3500 Elo or higher.

Why are these top engines updated so often? I see absolutely no point in it, which
once again raises the question of their purpose. Personally, I find every update to
a 3000 Elo engine much more interesting than an update to one of the many "Generals".

Once the programmers have reached around 3450 Elo, there should actually be far
fewer updates. Ultimately, Stockfish will probably remain our number one. After all,
the many “Generals” are, miraculously, very close behind it.

This looks very strange in every engine ranking and is also one reason why many
computer chess fans seem to be slowly losing interest.

Without downplaying the work being done on the TOP engines, if there were just one
update per year, the community would look forward to it more, all these updates are
definitely not a good thing. Thats my personal opinion about it.
Frank Quisinsky
Posts: 7563
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: There are two many updates ... does that really make sense?

Post by Frank Quisinsky »

I don't see many really good reviews here anymore. Instead, they're often just “praise from best friends.” I think it’s really a shame to see how the community has changed in recent years. About 15 years ago, hundreds of people were organizing tournaments and put the results in chess fora like this. Today, only a few remain who still do that. Mostly people who fall asleep and wake up again with their engines. Right now, I’m the best example of that (not for ever, currently). But it’s time to ask what the point of it all is.

At first:
Are all these updates really necessary?
If yes ... give me a tip to understand it better!

As a developer, don't you agree that you should give the few remaining testers a little time to work through a release?

Don't you think that fans of your engine would be much happier if there were fewer updates? Maybe then they'd test more thoroughly, rather than just skimming the surface as they tend to do now with so many updates?

Thinking on it before you go into an unnecessary argument.
Modern Times
Posts: 3922
Joined: Thu Jun 07, 2012 11:02 pm

Re: There are two many updates ... does that really make sense?

Post by Modern Times »

I disagree with all of this. Your assumption is that testers are the main or the only audience for engine developers. They aren't. Engine developers want people to actually use their engines. Of course it is a competitive landscape and developers like to see where they stand in the pecking order, but most of them know that anyway with their own testing.

Testers should not stifle innovation by dictating how often developers should release. It is entirely up to the developers, and in fact I'd encourage them to release as often as the like if they feel excited about their changes and want to release a new version.

Testers do not have to test every new version. They can just skip a release now and then. Simple.
Frank Quisinsky
Posts: 7563
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: There are two many updates ... does that really make sense?

Post by Frank Quisinsky »

It’s not about telling people what to do. Most of the time, people who are deeply immersed in a topic don’t even look left or right anymore. I’ve often felt that way myself, back when I spent a lot of time on Arena or Winboard or doing other things. I had those blinders on. In life, it’s always important to question things.

We shouldn’t always head straight for confrontation; instead, we should take the time to think things through calmly.

For example, if there’s still a battle for the top spots at 3500 Elo, one that’s decided by barely measurable margins of just a few Elo points, then that’s not a valid argument. Generating random ranking positions very quickly before the next update is released ...

Rather, the point is how we can get as many people as before to take an interest in this unprecedented diversity. Perhaps by highlighting new and interesting perspectives.

Unfortunately, I don’t see a single valid counterargument to the situation described in your reply. Please don’t be mad at me!

I’ve written this before, and I’d like to do so again:
Think about it first before getting into an unnecessary argument.
Frank Quisinsky
Posts: 7563
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: There are two many updates ... does that really make sense?

Post by Frank Quisinsky »

Ah I forgort,

what you wrote to the testers are mostly right.

But that is also not a point:
To skip a version or five versions if a tester like to do it is not the topic.

Personally, I can't bring myself to accept it when I've put work into something, am proud of it, and then see that it's already outdated by the next morning.

If I am thinking on the past:
Months of dicussions about a Fritz version in fora.
And christmas time ... a new Fritz will be out.

Strengths and weaknesses fit together like pieces of a puzzle, because many opinions are always better than individual impressions.

Expectations are very high these days. When an engine like Fritz 21 hits the market, one that has significantly improved its playing style and is quite interesting, the average user wonders …

“Where does Fritz 21 rank?”
The answer: “25th place… The answer: That’s terrible.”
We are speaking from humans!

Yet Fritz 21 is only 60 Elo points behind Stockfish.
If this result had been achieved before the pandemic, the community would have cheered.

Rankings are like neural networks.
They are both a curse and a blessing. The curse, however, leads to a decline in interest in our wonderful hobby.

Because our own arguments are becoming increasingly questionable.
Modern Times
Posts: 3922
Joined: Thu Jun 07, 2012 11:02 pm

Re: There are two many updates ... does that really make sense?

Post by Modern Times »

What I'm saying is that developers should never feel hesitant or guilty about releasing new versions on a frequent basis just because testers may not like that. They should not even think about that, they should release as and when they want to and I encourage that, because every new version is a good thing, not a bad thing.
User avatar
Gabor Szots
Posts: 1594
Joined: Sat Jul 21, 2018 7:43 am
Location: Budapest, Hungary
Full name: Gabor Szots

Re: There are two many updates ... does that really make sense?

Post by Gabor Szots »

Modern Times wrote: Thu Jul 16, 2026 9:49 am What I'm saying is that developers should never feel hesitant or guilty about releasing new versions on a frequent basis just because testers may not like that. They should not even think about that, they should release as and when they want to and I encourage that, because every new version is a good thing, not a bad thing.
I agree with Ray. Let them release their versions when they want. And let testers choose which versions to test. I can see no discrepancy between these two conditions.
Gabor Szots
CCRL testing group
Frank Quisinsky
Posts: 7563
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: There are two many updates ... does that really make sense?

Post by Frank Quisinsky »

Hallo Moderne Zeit,

that may be right but again, that's not the main point for my posting.

Often users wrote me, sentence like this one ...
I don't feel like being forced to constantly check a programmer's website to see if there's a new version that might fix bugs. That's too much of a hassle for me.

Let’s step away from chess for a moment and talk about other software developments. There’s a basic principle: Release as many updates as possible to stay in the spotlight and keep users engaged. But in times like these, the exact opposite is happening. Regular users find this annoying and end up avoiding these programs. In times like these ... what do I mean by that? Today, we have an oversupply for almost every application. If so, every user try to go the easiest way!!

The younger generation has grown up with frequent updates. For them, it’s a given that even the slightest change will result in a new version being released immediately.

For engines that have, for example, reached the very top, I see no reason to release an update for just a few more Elo points. It would take thousands of games to test that, and given the extremely high playing levels, that’s a waste of time. Maybe not for people who see such testing as their life’s work.

It makes no sense to try to talk our way out of something when it’s clear that interest is waning. We should be strong enough to really take a closer look at things rather than just going with the flow.

Moderne Zeit, Gabor ...
Thanks for your replays, I will not go in contra but again ...
It's about time we started questioning things a little.
Perfect is: Take off your glasses first, I wrote this before!

Best
Frank
Frank Quisinsky
Posts: 7563
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: There are two many updates ... does that really make sense?

Post by Frank Quisinsky »

An exemplary example is:
That's not a wonder, smart people are working on it ...

STOCKFISH

Releases are not often available.
Between the releases "freaks" can test dev versions.

The SF team is thinking on chess players, like to check 2 or 3 times in the year the Stockfish web site for a new release. Most using only Stockfish as engine for here analyzes. Most are thinking, if we have installed Stockfish we have all.

So it's also up to us to show that there are other engines besides Stockfish. But given the abundance of options, we need to approach this in a more thoughtful way. Random-Elo's without anything more, produced by testers, is old school and often no longer appropriate.

Why is Petrel interesting?
Do you think that any users can see that in good known rating systems?

Elo pure is old school.
Sorry, since many many years!


Best
Frank
Paloma
Posts: 1243
Joined: Thu Dec 25, 2008 9:07 pm
Full name: Herbert L

Re: There are too many updates ... does that really make sense?

Post by Paloma »

Or take Stefan Meyer-Kahlen, for example—he hasn't managed to release an update in 10–11 years.
Shredder 13 since 2016