Results as of this morning, they are still being updated:
I now have what is supposed to be the final Rybka 3 engine (not GUI), except perhaps for cosmetic things and any bug fixes. I'm running test matches with opposing programs and with Rybka 2.32a mp. All tests are on my two quads and one octal. I'll report results here generally when they reach 100 games.
First result: Rybka 3 vs. Rybka 2.32a mp on octal, game/1': after 106 games, +54=43-9 for +157 Elo.
Update: now +98=61-15 for +180 Elo (!).
Update: now +136=76-19 for +193 Elo (!).
Final: +151=83-22 for +192 Elo.
Second result: Rybka 3 vs. Rybka 2.32a mp on quad, 40/1' repeating: test stopped with score +47=24-7 for +196 Elo (!!).
Third result: Rybka 3 vs. Zappa Mexico II on quad, 40/1' repeating: +59=36-7 for +195 Elo.
Update: +64=41-9 for +182 Elo.
Final: +85=46-11 for +200 Elo.
Comment: It seems that the much better time management helps much more against other Rybkas than against unrelated programs. Do not expect anywhere near a 200 Elo gain over 2.3.2a against programs unrelated to Rybka.
Fourth result: Rybka 3 vs. Hiarcs12 on quad, 40/1' repeating: test stopped after 100 games at +72=23-5 for +282 Elo.
Fifth result: Rybka 3 vs. Naum 3.1 on octal, 40/1' repeating: test stopped after 100 games at +76=22-2 for +330 Elo (!!).
Comment: overnight I'm switching the Naum and Hiarcs tests between machines, in case Naum has some problem utilizing octal computer. Results in the morning (US).
Sixth result: Rybka 3 vs. Deep Shredder 11 on quad, 40/1' repeating: +61=21-6 for +254 Elo. Will run overnight.
I think we could call this a Quantum Leap, wouldn't you agree? The numbers speak for themselves. Pretty devastating for now when you view it from the competition's side... But in the longer run I think this is good for computer-chess. Congratulations to Larry, Vas, Jeroen and all other members of the Rybka team!
I have been testing it overnight on big hardware ... and it looks like Rybka 3 is a totally different engine than Rybka 2.3.2a. I must say I am very impressed ... the evaluation and search are totally totally different. It finds tactics much quicker than 2.3.2a ... and I was hard pressed to find a situation where the old and the new Rybka agree on the evaluation of a certain position. I was especially impressed in a game against DF 10.1 ... where it looked like DF10.1 had a totally winning position with a pawn majority attack (DF10.1 eval was around +1.7) ... yet Rybka 3 only evaluated the seemingly very dangerous position as +.19 ... I was expecting the evaluation to drop dramatically as the pawn got closer to queening squares ... yet all the time Rybka 3 eval held steady at around +.2 Anyway eventually Rybka 3 had calculated everything and DF10.1 attack fizzled and it eventually lost the game. Overnight the tournament I am running is a 5 0 Gauntlet tourney using Quad at 4.2 ghz against Zappa Mexico II, DF10.1 and Rybka 2.3.2a ... scores so far are 91% !!! against DF10.1 ... 67% against Rybka 2.3.2a ... and 84% against ZM II. In the 55 or so games played so far Rybka 3 has only one loss against Rybka 2.3.2a ... with all the rest of the games being won or drawn. This is especially remarkable since I am using a very very sharp book and truncating the book moves at 15 moves ... and also using normal book settings. The idea is to allow inferior positions and see how Rybka 3 will handle them. So far I am quite amazed at how Rybka 3 is performing and I assure everyone that if anything ... Vas and Larry have been conservative in their claims.
Today I will test it on Octa 4.8Ghz ... I will use tournament controls of 16 0 and use similar method of allowing inferior positions by changing book parameters.
Last edited by M ANSARI on Thu Jul 24, 2008 10:56 am, edited 1 time in total.
Now I am wondering, what the heck am I supposed to use this engine for? Since they accomplished so much in such a short period of time, may be they could invent an eval that ends world hunger?? Every time Rybka wins, Big Momma feeds a poor person..
We all thought Rybka was named after a fish, the truth is Rybka is calling all of us "Fish", only their using the Czech language. Back in my days at New York's Washington Square Park a fish was someone you could win money off of easily ...., In other words a weak player.
Hmm, Rybka is making alot of money nowadays! I now get the inside joke.
Signed
Gone Swimming,
Ted
Last edited by AdminX on Thu Jul 24, 2008 11:16 am, edited 5 times in total.
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
They decided to release Rybka 3 in an arbitrary date and there's no reason to think that the improvements will stop, so Rybka 4 could be another quantum leap.
It seems Vas made a deal with the devil or something.
Ovyron wrote:They decided to release Rybka 3 in an arbitrary date and there's no reason to think that the improvements will stop, so Rybka 4 could be another quantum leap.
It seems Vas made a deal with the devil or something.
Anyone remembers Sergey Bubka?
An ukrainian pole vaulter who increased the world record many times. I think he was not only an extraordinary athlete but also a very clever business man as he made quite some money by improving his record so many times.
What I'm trying to say is that people would buy Rybka 3 even if it would only be about 50 Elos stronger than the previous version. I always thought Vas is a very good businessman too but after reading he's going to release a new version of Rybka which is 200 points stronger I'm not so sure about that anymore.
In other words a weak player. 
I now get the inside joke. 
