18 days from SF4 release and about ~30+ ELO gain!

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

jundery
Posts: 18
Joined: Thu Mar 14, 2013 5:57 am

Re: 18 days from SF4 release and about ~30+ ELO gain!

Post by jundery »

Uri Blass wrote:
I am not sure if I am copyright holder because it is not clear what means non trivial work(and I only changed few lines here and there when my most complex change is probably my time management change)

I also wonder what is the advantage that being a copyright holder can give people.

Can they win money at court against people who do not respect their copyright and sell stockfish derivatives?
I believe the main power is you have is a say in the license, unless your code is removed, Stockfish could never go commercial against your wishes. When it comes to damages in a lawsuit IMNALNDIPOOTV but I'd guess you'd see nothing.

<edit>s/private/commercial/</edit>
Uri Blass
Posts: 10899
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: 18 days from SF4 release and about ~30+ ELO gain!

Post by Uri Blass »

jundery wrote:
Uri Blass wrote:
I am not sure if I am copyright holder because it is not clear what means non trivial work(and I only changed few lines here and there when my most complex change is probably my time management change)

I also wonder what is the advantage that being a copyright holder can give people.

Can they win money at court against people who do not respect their copyright and sell stockfish derivatives?
I believe the main power is you have is a say in the license, unless your code is removed, Stockfish could never go commercial against your wishes. When it comes to damages in a lawsuit IMNALNDIPOOTV but I'd guess you'd see nothing.

<edit>s/private/commercial/</edit>
Note that it is possible that somebody sell stockfish's derivative and people discover that it is a stockfish derivative only one after he already earned money from it.

What is going to happen in this case?
User avatar
Leto
Posts: 2071
Joined: Thu May 04, 2006 3:40 am
Location: Dune

Re: 18 days from SF4 release and about ~30+ ELO gain!

Post by Leto »

S.Taylor wrote:
Houdini wrote:
mcostalba wrote:But there is another side effect of open development that could be more threatening for commercial engines, a threat that was not foreseen in advance and that even I didn't realize it would be a problem. This is the obsolescence of release process: just few days after Stockfish 4 is out, almost all power users have dismissed it in favor of last nightly build (I just come here now from Playchess where there is even not one SF 4 but are all nightly builds): this is something commercial engines have no defense against, simply they cannot do this. As long as the ELO gap is big it is ok, but when the open developed engine reaches the level of commercials, a new compile each day can really badly affect the commercial release because it greatly speeds up its obsolescent.

I have to say that this was not foreseen and I am sorry for this, it is not out target (daily binaries are even built outside of SF team) but it is something that, considered the open nature of the development, it is almost impossible to avoid.
Marco, there really is no reason to feel sorry, it's called progress. Commercial engines will have to adapt to the new situation or disappear.

You guys have done an awesome job - it's really outstanding to add 100+ Elo to a top engine in less than 6 months. Congratulations to all the contributors for this achievement!

Cheers,
Robert
Robert,
Can we see from your recent posts (or anyway), and mostly silence, that you are not at the momment expecting to come out with any major upgrades in the near future?
He said in the Rybka forum to expect Houdini 4 in November, and he'll announce details in October.
Dirt
Posts: 2851
Joined: Wed Mar 08, 2006 10:01 pm
Location: Irvine, CA, USA

Re: 18 days from SF4 release and about ~30+ ELO gain!

Post by Dirt »

Uri Blass wrote:Note that it is possible that somebody sell stockfish's derivative and people discover that it is a stockfish derivative only one after he already earned money from it.

What is going to happen in this case?
While you could theoretically win some money, in practice it is too hard and attorney fees eat everything up. Settlements are usually of the "don't do that any more" sort.
User avatar
Mithu
Posts: 213
Joined: Thu Jul 15, 2010 5:59 am

Re: 18 days from SF4 release and about ~30+ ELO gain!

Post by Mithu »

With all due respects - can we have the thread discussing and celebrating Stockfish's growth? I can see an undercurrent of mistrust and jealousy creeping up. I though the real world was full of that but looks like even the virtual world (espl. Talkchess) is getting infected by this virus. Lets stick to discussing Stockfish's growth rather than what would happen if x went commercial or if the commercial engine Y will be coming out soon and crush every other engine.

Lets behave like true learners in one giant classroom
lkaufman
Posts: 6259
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: 18 days from SF4 release and about ~30+ ELO gain!

Post by lkaufman »

Masta wrote:Yeah...seems that SF will run over other engines like a damn TRUCK!

18 days from release date of SF4 and almost +30 ELO gain. -> http://95.47.140.100/tests/view/522bcb1 ... 2ee68dc04a

Have a nice day yo false magicians. Your days are counted.
Since I found this hard to believe, I ran a similar test myself (SF Sept. 8 vs SF4). While the details differ slightly (book, exact time limit, hardware) the test was quite similar. My result showed a gain of just 11.5 elo. The difference is too large to attribute to sample error. Any other theories?
User avatar
RJN
Posts: 303
Joined: Fri Jun 21, 2013 5:18 am
Location: Orion Spiral Arm

Re: 18 days from SF4 release and about ~30+ ELO gain!

Post by RJN »

lkaufman wrote:
Masta wrote:Yeah...seems that SF will run over other engines like a damn TRUCK!

18 days from release date of SF4 and almost +30 ELO gain. -> http://95.47.140.100/tests/view/522bcb1 ... 2ee68dc04a

Have a nice day yo false magicians. Your days are counted.
Since I found this hard to believe, I ran a similar test myself (SF Sept. 8 vs SF4). While the details differ slightly (book, exact time limit, hardware) the test was quite similar. My result showed a gain of just 11.5 elo. The difference is too large to attribute to sample error. Any other theories?
My tournament currently shows 16 points over SF4, with 177 games played for the SF development version that was added. Seems a bit more realistic than 30 points, IMO.

(time control 40 in 5 minutes, repeating)

9/11/2013 11:08:40 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO-NONE : 3052 16 16 961 58.4 % 2993 46.2 %
2 Stockfish_13090815_x64_sse42 : 3040 31 30 177 55.9 % 2999 64.4 %
3 Stockfish_4_64bit_sse42 : 3024 15 15 963 54.0 % 2997 55.9 %
4 Komodo51r1-64bit : 3012 15 15 961 52.0 % 2998 55.9 %
5 Komodo51-64bit : 3010 14 14 963 51.6 % 2999 56.5 %
6 Komodo51r2-64bit : 3006 15 15 965 51.0 % 2999 53.0 %
7 Stockfish-3-64-pop-ja : 2984 15 15 953 47.3 % 3003 51.8 %
8 Critter_1.6a_64bit : 2978 15 16 960 46.5 % 3003 50.4 %
9 Deep Rybka 4.1 SSE42 x64 : 2926 16 16 965 38.1 % 3010 47.3 %
gladius
Posts: 568
Joined: Tue Dec 12, 2006 10:10 am
Full name: Gary Linscott

Re: 18 days from SF4 release and about ~30+ ELO gain!

Post by gladius »

lkaufman wrote:
Masta wrote:Yeah...seems that SF will run over other engines like a damn TRUCK!

18 days from release date of SF4 and almost +30 ELO gain. -> http://95.47.140.100/tests/view/522bcb1 ... 2ee68dc04a

Have a nice day yo false magicians. Your days are counted.
Since I found this hard to believe, I ran a similar test myself (SF Sept. 8 vs SF4). While the details differ slightly (book, exact time limit, hardware) the test was quite similar. My result showed a gain of just 11.5 elo. The difference is too large to attribute to sample error. Any other theories?
What were your testing conditions (time control, threads, # of games)? I'm assuming it's 11.5 elo +- some error bar :).

SF4 release version has a few changes that can influence self tests, the TT is not cleared between games, and Idle threads sleep is set to false, but that only affects matches with threads > 1. For this reason, our regression tests are performed against the non-release version.

Otherwise, I'm not really sure to be honest.
FWCC
Posts: 117
Joined: Wed Aug 22, 2007 4:39 pm

Re: 18 days from SF4 release and about ~30+ ELO gain!

Post by FWCC »

Don't throw in the towel Robert.Houdini is still a piece of art.I'm sure you have something stronger on your desktop in the name of Houdini 4!The problem is the Stockfish team is consistently developing.Have to give them credit,it is amazing or just evolution that they caught and MAYBE passed Houdini 3.







FWCC

Chess For Life
S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: 18 days from SF4 release and about ~30+ ELO gain!

Post by S.Taylor »

Leto wrote:
S.Taylor wrote:
Houdini wrote:
mcostalba wrote:But there is another side effect of open development that could be more threatening for commercial engines, a threat that was not foreseen in advance and that even I didn't realize it would be a problem. This is the obsolescence of release process: just few days after Stockfish 4 is out, almost all power users have dismissed it in favor of last nightly build (I just come here now from Playchess where there is even not one SF 4 but are all nightly builds): this is something commercial engines have no defense against, simply they cannot do this. As long as the ELO gap is big it is ok, but when the open developed engine reaches the level of commercials, a new compile each day can really badly affect the commercial release because it greatly speeds up its obsolescent.

I have to say that this was not foreseen and I am sorry for this, it is not out target (daily binaries are even built outside of SF team) but it is something that, considered the open nature of the development, it is almost impossible to avoid.
Marco, there really is no reason to feel sorry, it's called progress. Commercial engines will have to adapt to the new situation or disappear.

You guys have done an awesome job - it's really outstanding to add 100+ Elo to a top engine in less than 6 months. Congratulations to all the contributors for this achievement!

Cheers,
Robert
Robert,
Can we see from your recent posts (or anyway), and mostly silence, that you are not at the momment expecting to come out with any major upgrades in the near future?
He said in the Rybka forum to expect Houdini 4 in November, and he'll announce details in October.
THAT would be something to look forward to. If he hasn't changed his mind.