I like to look at https://nextchessmove.com/dev-builds where you can find 20000 test games of the latest SF builds.
But the curve still irregular, so I made a smoothing in Excel : for each version I took the average of the 10 previous ratings. (+ a linear regression inside Excel on the dash line).
The curve start with Stockfish 10 ( 20181129-1445).
Nice to view !
Smoothing SF progress of nextchessmove
Moderators: hgm, Rebel, chrisw
-
- Posts: 5228
- Joined: Thu Mar 09, 2006 9:40 am
- Full name: Vincent Lejeune
-
- Posts: 3293
- Joined: Wed Mar 08, 2006 8:15 pm
Re: Smoothing SF progress of nextchessmove
Definitely average or more games is needed there! It's always funny when "Update Readme.md" gaves +5 ELO !
Jouni
-
- Posts: 550
- Joined: Tue Nov 19, 2019 8:48 pm
- Full name: Alayan Feh
Re: Smoothing SF progress of nextchessmove
The 100 elo regression patch in March is marring the curve. Otherwise, the averaging makes it much nicer.
-
- Posts: 5228
- Joined: Thu Mar 09, 2006 9:40 am
- Full name: Vincent Lejeune
Re: Smoothing SF progress of nextchessmove
Updated :
From SF 10 (20181129-1445) to SF 11 (20200118-0044)
Buggy version "20190405-1837" is removed to make a clean graph.
From SF 10 (20181129-1445) to SF 11 (20200118-0044)
Buggy version "20190405-1837" is removed to make a clean graph.
-
- Posts: 12542
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: Smoothing SF progress of nextchessmove
I guess that even with the bad version the correlation coefficient is very close to 1, which means the progression is very nearly linear.
Since Elo is exponential, this is excellent evidence of constantly having exponential progress in the strength of Stockfish.
That is really pretty amazing.
Too bad our salaries don't do that.
Since Elo is exponential, this is excellent evidence of constantly having exponential progress in the strength of Stockfish.
That is really pretty amazing.
Too bad our salaries don't do that.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
-
- Posts: 476
- Joined: Sun Mar 17, 2019 12:00 pm
- Full name: Henk Drost
Re: Smoothing SF progress of nextchessmove
Year by year few % growth is exponential.Dann Corbit wrote: ↑Tue Jan 21, 2020 6:17 pm I guess that even with the bad version the correlation coefficient is very close to 1, which means the progression is very nearly linear.
Since Elo is exponential, this is excellent evidence of constantly exponential progress in the strength of Stockfish.
That is really pretty amazing.
Too bad our salaries don't do that.
So your salary probably does show exponential growth.
But prices also go up exponentially.
-
- Posts: 12542
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: Smoothing SF progress of nextchessmove
I'm paid pretty well, but a graph of my salary over time won't look like the SF Elo graph.
Mine would look more like a square root function, where it rapidly rose after college for a few years then rose more and more slowly.
I do agree that even 0.05% interest growth per year would be exponential. But the constant in the exponent not nearly so desirable as the constant in the SF graph
Mine would look more like a square root function, where it rapidly rose after college for a few years then rose more and more slowly.
I do agree that even 0.05% interest growth per year would be exponential. But the constant in the exponent not nearly so desirable as the constant in the SF graph
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
-
- Posts: 4556
- Joined: Tue Jul 03, 2007 4:30 am
Re: Smoothing SF progress of nextchessmove
This is by design, if everyone's salary goes up, there's more demand, and not enough supply, so to fix that you increase the price of the supply, and we're back to how we started. The problem is the accumulation of wealth by people that already had wealth, and since their wealth increases faster than people's salary, prices seem to go up faster than salaries.
-
- Posts: 550
- Joined: Tue Nov 19, 2019 8:48 pm
- Full name: Alayan Feh
Re: Smoothing SF progress of nextchessmove
Could we get an updated graph ?
-
- Posts: 5228
- Joined: Thu Mar 09, 2006 9:40 am
- Full name: Vincent Lejeune