Rybka 1.0 vs. Strelka

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
Rolf
Posts: 6081
Joined: Fri Mar 10, 2006 11:14 pm
Location: Munster, Nuremberg, Princeton

Re: Wanted: some opposition to the provided evidence

Post by Rolf »

tiger wrote:
Uri Blass wrote:
kranium wrote:
Uri Blass wrote:
Rolf wrote:
Uri Blass wrote:
Terry McCracken wrote:

Also get this straight, it has nothing to do with contempt or jealousy over Rybka, if Christophe used the same technique as Vas or any top programmer the gap between not only Vasik's program but all chess programs would be negligible.
I disagree with the assumption that the gap between all chess program is going to be negligible in that case.

The only correct thing is that in this case programs are going to be stronger.

Uri

They ARE stronger, Uri. What is known about the actual strength of the known top programs if one assumes theoretically that Fruit did never exist? Why cant we state that there is a time ante and post Fruit ideas of programming? I simply dont support the campaign here that ONLY Vas has been inspired by Fabien's Fruit ideas.
I agree that not only Vas was inspired by Fabien's Fruit ideas.
The point is not fruit's idea but fruit's code and there is a difference between using fruit's code and using fruit's ideas.

My point is that even if all programmers use fruit's code there is going to be significant difference between playing strength of different programs.

Uri
From his interview with Frank Quisinsky and Alexander Schmidt 05.12.2005, the exact quote follows:

Vasik Rajlich: Yes, the publication of Fruit 2.1 was huge. Look at how many engines took a massive jump in its wake:
Rybka, Hiarcs, Fritz, Zappa, Spike, List, and so on. I went through the Fruit 2.1 source code forwards and backwards and took many things.

note he says: 'took many things'
(there is no differentiation here between ideas, fragments, chunks, tables, names, structure, etc.)

he also states that every commercial program immediately benefited...?
i guess fruit 2.1 was considered fair game at that time...
I believe that part of the commercial programmers also took many things from fruit2.1(not less than Vas) but they were less succesful in improving their program.

Not all of them but part of them.
The reason that people talk only about rybka as fruit derivative is simply the fact that rybka is number 1.

Uri


I'm not aware about any commercial program that would show such large code similarities and even long identical sections of code. If you can find them, please report them.

The reason people talk about Rybka 1.0 being a Fruit 2.1 derivative is simply the fact that it looks from analysis that it is. If you believe it is not, please contradict the factual evidence.

// Christophe
Why? If you go to court then you will see enough evidence against you but here it's useless. If you lose one argument you hiphop to the next.
The maximal shameless was when Vas was accused of having darkened his display to hide underlying unallowed actions. Wasnt this the starting point of your campaign? Are you really convinced that all this is still a normal "campaign" from people who "just wanted to know"? And last but not least, dont you realise how this all must be hurting Vas if, take this as a possibility for seriousness purposes, if he is legally innocent?
-Popper and Lakatos are good but I'm stuck on Leibowitz
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Wanted: some opposition to the provided evidence

Post by bob »

Rolf wrote:
tiger wrote: The fact that Rybka 1.0 is derived from Fruit 2.1 is a common opinion amongst programmers, especially since the reconstructed source code of Rybka 1.0 has been published (it is Strelka 2.0).

For some reason this fact has remained such a taboo that very few established programmers have dared to state clearly their opinion about it.

Now evidence is posted here for everybody to build his own opinion.

The important point to keep in mind is that if the evidence is considered as convincing it will demonstrate that an open source program has been used against the spirit of open source.

More specifically, the evidence is posted to show that a work derived from GPL'ed source code has been published as closed source, when the spirit of the GPL licence under which the original work was published is to always allow the source code to be kept open and shared. It is not only against the spirit, it is also explicitely forbidden by the GPL licence, which is the licence the author of the original work has chosen.

// Christophe
Often something shows only indirectly that and why it's worthless. And this is the case with this whole message.

Here a programmer, experienced technically as he might be, I can only trust Bob regarding this point, is talking too much about showing, forbidden, published, but also about spirit, taboo, opinion and fact, and all what he shows with all this is that he has nothing.
Rolf, I have to make detecting plagiarism a daily task when students turn in programming assignments. Most are too intelligent to just give me duplicate copies. They change variables. They change from a "for" loop (talking C here) to a "while" loop. They change the comments and the way they are structured. But the underlying structure of the program is still there to see. There are even software tools that help with this, as this is a problem at all universities, and some have spent a lot of time trying to develop automated tools to help.

The bottom line is that for regular programming assignments, there are _so_ many different ways to write a program that will take the same input and produce the same output, that the probability of two students writing nearly the same code/algorithm is extremely small. A chess program goes _far_ beyond the complexity of these assignments (and we even have an othello assignment in the AI class, which while not nearly as complex as chess is nevertheless very complex). The probability that program A will have major parts written _exactly_ the same as program B is not just vanishingly small. The old saying about putting enough monkeys in a room full of typewriters, and give them enough time, and one will manage to type the complete text of Lincoln's Gettyesburg address is a good example. It will probably happen with a probability > 0.00, but it is also probably going to take a _long_ time, and a _lot_ of monkeys.

I have not been one of the investigators here. But from what I have seen, it is pretty clear. And it isn't _that_ uncommon an experience. But the problem is amplified when the new program becomes commercial. "Standing on the shoulders of giants" is one thing. But ripping hunks out of the giants is a completely different matter.

From what I have seen, the case is becoming very clear. whether you like the conclusion or not notwithstanding. This is beyond the bounds of reasonable probability that it "happened by chance". Even small parts of chess engines (take the move generator which has a fixed input (a position) and a fixed output (a set of either legal or pseudo-legal moves) looking nothing alike when you compare them. Crafty would be a good example of comparison. Take gnuchess as an example, and compare the two programs. You might occasionally find a single printf() that matches since both support the winboard protocol, but no piece of code of any significant size will match up. Not the search, not the winboard communication, not the evaluation, not anything. That is the norm for every program I have looked at. I have looked at several open-source programs, and when I compare I find "ideas" that obviously came from Crafty in several places. I very rarely find "code".

So what is being presented here is both serious and accurate as best I can tell. While some might not like the conclusions, the evidence has a lot of factual weight behind it. It would be better to try and attack the evidence, rather than the presenter, because the evidence looks to be quite damning.

I'm old enough that I don't really care about this stuff. I have slowly learned that human nature is what it is. People lie, cheat, steal, kill, etc all the time and most of us depend on law enforcement to deal with it, having seen it for so many years. There have been so many "clone wars" over the years, some involving me, some (this one) not. But it isn't new. And it probably isn't going to suddenly go away either. To quote a former president, "it is what it is" but it depends on the meaning of "is"..



Because if it were different, this would mean a court case. Because only this could legally prove anything. While this here is a political campaign from a tech knowie programmer who cant find the linkage from his tech to what he's really doing and implying on a social and psychological level.
Something tells me this will _never_ become a "court case". The risks are _way_ too high with this volume of evidence to support the person being sued over this claim. Only a fool would start such an action given the potential risks of losing, which in my opinion would be extremely likely given what has been shown so far.

It's also important to remember, that messages like mine here must be carefully pronounced because other than the tech knowie who is allowed of the whole shameful campaign against other collegues in computerchess it is almost tabooed if it's described and criticised from an expert in psychological and sociological terms. As if the community couldnt understand that a tech knowie level by definition is sub-optimal to analyse itself for the positivistic reasons which can be learned elsewhere. If you want to criticise such a limited tech sphere there is but one possibility and that is from outside so to speak with social psychology.
Problem is, you are not qualified to weigh in on the discussion. This could likely turn _very_ ugly if people trained in copyright infringement become involved. recognizing copied code is not easy, but there are software tools that will do this with high accuracy. I believe Stanford developed such a system and made it public. And something tells me no one will take that source and try to copy it and call it their own, either. :)


Just to summarize what that angle allows me to conclude. The many professionals weho have read of the CT campaign cant want to openly enter such a debate because to a community with a rest of ethical considerations it would look strange if people raise their fingers and point on a scapegoat for a practice that they themselves are potentially also guilty of. At least that then their own work would be questioned.
I think that most have simply come to accept this as a common action, and have concluded that it just a part of computer chess from here on. I rest with the attitude that I know that whatever I have done in the past was my work, and my work alone (excepting that I do get help with Crafty of course, with Tracy, Mike and Peter, just as I did with Cray Blitz with Harry and Bert). I have not cheated in games using things like "move now" or providing other hints to the program, unlike some that have even been caught on video tape. When I win an event, our group can feel pride in doing so, untainted by the knowledge that we stole something from someone else. And that is good enough for us. We don't have the time nor energy to dwell on "how did they do that, did they cheat? did they copy code? etc. And a lot of us (not all) feel that way. And we can sleep at night knowing that _our_ actions are ethical. And we don't lose sleep over others that are not so ethical. Otherwise we would never sleep.
That context is so trivial and easy to understand that it really takes a tech knowie wih a very resticted view, one could call it 1-dimensional somewhat, who continues to propagate his limited perception. Not only that, he's now already on the lane where he thinks he can trust the deafening silence frfom his collegues as if that would mean that his restrictions have not yet been widely noticed. So here we have a clear aspect of tragical comedy content.
The evidence is convincing to those of us that understand software development. I have not personally validated the evidence, but several that I trust highly have done so. If you are unhappy with the conclusions, you are single-handedly keeping this story alive and active with your protests over and over and over.
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Wanted: some opposition to the provided evidence

Post by bob »

Steve B wrote:
tiger wrote:
More specifically, the evidence is posted to show that a work derived from GPL'ed source code has been published as closed source, when the spirit of the GPL licence under which the original work was published is to always allow the source code to be kept open and shared. It is not only against the spirit, it is also explicitely forbidden by the GPL licence, which is the licence the author of the original work has chosen.
// Christophe
let us suppose for discussion purposes that engine B(a closed commercially sold product) is derived from Engine A which is an open program released under the GPL Licence
what recourse is there and to whom can this charge be directed ?
must the author of Engine A make the charge?
can others make the claim for him?
suppose author A no longer cares about his work or is deceased?
can Author A give private permission to author B to continue his work commercially?

i am asking because i do not know if there is any group or persons responsible to insure that GPL licenses are respected
if there is no one to register a complaint with,, then all we have here .. in my hypothetical example ..is a violation of the Spirit of a licence with no legal recourse..
other then universal condemnation from other programmers in public and private forums ..it would seem that in this case.. one is free to take for his own, the work of others and sell it in the open market

again i am posing a hypothetical question ..a worst case scenario

Steve
That is a sticky issue. The original author of something that was copied is a "damaged party". But then there is (in this case) the GPL, produced by the free software foundation. So one could conclude that they were a "damaged party" At least in the US, a person directly affected by something has to bring a suit before the court. Many are tossed out as having no standing. It is unlikely this would happen I would imagine, unless someone starts a court action claiming defamation or whatever. Then the floodgates would open and it would be an ugly free-for-all.
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Wanted: some opposition to the provided evidence

Post by bob »

Uri Blass wrote:
tiger wrote:Zach is showing code snippets where Rybka 1.0 is actually more similar to Fruit than Strelka 2.0.

A few days ago there was some vocal opposition to the idea that Rybka 1.0 coud be a derived work of Fruit 2.1.

Where is the opposition now?

There are several skilled people ready to explain why many programmers think (without daring to tell it) that Rybka started its life as Fruit 2.1.

The evidence is now being shown factually. Feel free to contradict it factually.



// Christophe
There is a second possibility that rybka started her life with part of fruit but never had the full source.

I know that movei started its life with part of tscp structures and names of variables and constants (but no chess working code)

Uri
Unfortunately that is enough to settle this immediately. "part of fruit" is unacceptable since _all_ of fruit is GPL'ed. This issue is black or white, with no grey at all.

BTW, in some cases development is obvious. You can go back to reg.games.chess.computer circa 1994 november or so, and find posts by me where I was working on a _new_ program (now called Crafty). I started with the move generator and published the source there and got lots of feedback. You can also find discussions about search and evaluation as they were written, not copied. So starting with someone else's code is not a normal development course.
User avatar
mclane
Posts: 18892
Joined: Thu Mar 09, 2006 6:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub

Re: Wanted: some opposition to the provided evidence

Post by mclane »

terry, don't disturb rolf in his way of doing computerchess.
you think he insults christophe. but you are wrong. :wink:

actually he is doing computerchess.

he needs no computer for it.
he needs no software for it.

the only thing he needs is people like christophe, bob, ed, ...

to shorten the list: he needs US to do computerchess.
we are his vehicle to allow HIM to make his kind of computerchess.

maybe you would call it insult. but only because you don't have the same ethical point of view rolf has.

:wink:
:roll:

:oops:

:shock:

:D
User avatar
mclane
Posts: 18892
Joined: Thu Mar 09, 2006 6:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub

Re: Wanted: some opposition to the provided evidence

Post by mclane »

Rolf wrote: Why?
maybe because you would argue about the content instead of insulting others.

talking about the content. something that is difficult, isn't it ?
User avatar
mclane
Posts: 18892
Joined: Thu Mar 09, 2006 6:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub

Re: Wanted: some opposition to the provided evidence

Post by mclane »

IMO you all oversee something important:

you all believe that VAS has written Rybka.
there could be an alternative explanation why Rybka looks from the structure like fruit.
and it would not be a legal issue than.

what if rybka is in fact programmed by fabian letouzey FOR Vas purposes?
User avatar
Bill Rogers
Posts: 3562
Joined: Thu Mar 09, 2006 3:54 am
Location: San Jose, California

Re: Wanted: some opposition to the provided evidence

Post by Bill Rogers »

I would like to make a comment. It was posted on the CTF forum that they discovered that anyone who makes statements on these sites can be held for libel and that means that any accuasuations against another can result in a law suit.
Now just because Vas stated that he looked at Fruit does not mean that he copied any of Fruits algorythms at all and any one who claims that he did is or could be sued for libel. It never ceases to amaze me just how many experts that are here who don't even program or have the capaicity to program their own chess engines can make such claims against another who puts together a winning program.
Fortunately for these poor saps it appears that Vas is above and beyond such trival crap.
Bill
gerold
Posts: 10121
Joined: Thu Mar 09, 2006 12:57 am
Location: van buren,missouri

Re: Wanted: some opposition to the provided evidence

Post by gerold »

mclane wrote:terry, don't disturb rolf in his way of doing computerchess.
you think he insults christophe. but you are wrong. :wink:

actually he is doing computerchess.

he needs no computer for it.
he needs no software for it.

the only thing he needs is people like christophe, bob, ed, ...

to shorten the list: he needs US to do computerchess.
we are his vehicle to allow HIM to make his kind of computerchess.

maybe you would call it insult. but only because you don't have the same ethical point of view rolf has.

:wink:
:roll:

:oops:

:shock:

:D
Very good. I like this post you have made.

Rybka is getting free online publicity. The longer it lasts the
more advertising it gets. :)
Of course there will be no court case There is always the counter
suit. With a big court case Rybka would be known world wide. :)

No Rybka code no case.

Best to you,

Gerold.
User avatar
Zach Wegner
Posts: 1922
Joined: Thu Mar 09, 2006 12:51 am
Location: Earth

Re: Wanted: some opposition to the provided evidence

Post by Zach Wegner »

Bill Rogers wrote:I would like to make a comment. It was posted on the CTF forum that they discovered that anyone who makes statements on these sites can be held for libel and that means that any accuasuations against another can result in a law suit.
Now just because Vas stated that he looked at Fruit does not mean that he copied any of Fruits algorythms at all and any one who claims that he did is or could be sued for libel.
Nobody is claiming that looking at Fruit constitutes evidence. Nobody is even saying (as fact) that he copied anything. We saying that it looks like he did. The evidence is there. Now everyone can look at it and draw their own conclusions. Of course there are those who choose to not even look at (let alone comprehend) the evidence yet still wish to weigh in with their opinion.
It never ceases to amaze me just how many experts that are here who don't even program or have the capaicity to program their own chess engines...
Eh?
...can make such claims against another who puts together a winning program.
Fortunately for these poor saps it appears that Vas is above and beyond such trival crap.
I wonder why...