Some results from Larry with finalized Beta

[George Tsavdaris]

may be the book has its +50-100 elo, don't you think?

And here is a result with own books:

Rybka 3 (+ Rybka3.ctg) - Deep Junior 10 (+ Junior10.ctg) 45-5 !!!!
Score from Rybka's point of view: +41-1=8 (90% = +381 elo)

3 mins blitz, Q6600, ponder=off, both 512 MB hash and using 4 cores, no EGTB.

Is this amazing or what??

[Tony Thomas]

Rybka does it again...When the free version was first released, I had to give the other engines unfair advantages (better book, more hash) etc..for them to get a draw or an occasional win. It seems to me that we are going back to that stone age once again.

[mclane]

yes this is amazing.
i am disapointed that nobody comes with an idea WHAT it could be.
instead discussions if 100, 200 or 300 elo progress. as if this would be important.

where are all the programmers when we need them

[M ANSARI]

Rybka 3 tourney-1 2008

Rybka 3 - Deep Fritz 10 29.5 - 4.5 +26/-1/=7 86.76%
Rybka 3 - Zappa Mexico II 28.0 - 6.0 +22/-0/=12 82.35%
Rybka 3 - Rybka 2.3.2a mp 24.0 - 10.0 +15/-1/=18 70.59%

Hardware: Quadcore @4.2Ghz ... time control 5 0 ... hash 512mb ... ponder off ... sedat perfect book (truncated 15 moves "normal" setting)

[Father]

Hello George.
Great !!!! What a nice new.....then I have an stonger challenger fort myself to do this time...
Best,
Pablo

[ArmyBridge]

where are all the programmers when we need them

praying for its lives Thorsten:!:
I think that Larry Kaufman give some light about how how the previous versions of rybka worked "The key to Rybka's strength (and other programs too, though to a lesser degree) is that a decent evaluation after a very deep search will produce better positional play than a super evaluation after a much shallower or narrower search. No practical number of takebacks will change this; the human GM will be outplayed positionally despite his better evaluation, because he cannot possibly compete in the realm of search. ", so it was manly that it was a fast and deep search, how Vask di it? nobody knows, the eval function would be very simple, but very clever, who will catch this Fish...? maybe Chrilly Donninger and Hydra suddenly appears and kill Rybka in a match, at least Hydra is the only entity that can have a chance against this Monster.

[Tony Thomas]

where are all the programmers when we need them

praying for its lives Thorsten:!:
I think that Larry Kaufman give some light about how how the previous versions of rybka worked "The key to Rybka's strength (and other programs too, though to a lesser degree) is that a decent evaluation after a very deep search will produce better positional play than a super evaluation after a much shallower or narrower search. No practical number of takebacks will change this; the human GM will be outplayed positionally despite his better evaluation, because he cannot possibly compete in the realm of search. ", so it was manly that it was a fast and deep search, how Vask di it? nobody knows, the eval function would be very simple, but very clever, who will catch this Fish...? maybe Chrilly Donninger and Hydra suddenly appears and kill Rybka in a match, at least Hydra is the only entity that can have a chance against this Monster.

At this point, I simply do not care..I am once again having dilemmas about buying Rybka.. Last time I decided not to buy Rybka, because I didnt want to see my favorite engines getting slaughtered by Rybka..Now that I had sort of changed my mind, who will stop the bloodshed? I sure cant afford Hydra, at this point Alex Naumov is my best bet..

[George Tsavdaris]

maybe Chrilly Donninger and Hydra suddenly appears and kill Rybka in a match, at least Hydra is the only entity that can have a chance against this Monster.

Why do you believe Hydra is the only entity that can have a chance against Rybka 3?

I disagree since other engines may have a better version to beat Rybka 3.
I guess Hiarcs 12, Fritz 11, Shredder 11, Junior 10, Naum 3, Zappa Mexico II etc, are better than Hydra from its last public appearance.
So i'm not sure at all that Hydra is the only one that can threaten Rybka 3. The other engines seem to have equal possibilities if not greater, to threaten Rybka 3.

[Albert Silver]

Rybka 3 tourney-1 2008

Rybka 3 - Deep Fritz 10 29.5 - 4.5 +26/-1/=7 86.76%
Rybka 3 - Zappa Mexico II 28.0 - 6.0 +22/-0/=12 82.35%
Rybka 3 - Rybka 2.3.2a mp 24.0 - 10.0 +15/-1/=18 70.59%

Hardware: Quadcore @4.2Ghz ... time control 5 0 ... hash 512mb ... ponder off ... sedat perfect book (truncated 15 moves "normal" setting)

You testing 32-bit here or 64-bit? Also, any single CPU testing?

Albert

[bob]

Results as of this morning, they are still being updated:

I now have what is supposed to be the final Rybka 3 engine (not GUI), except perhaps for cosmetic things and any bug fixes. I'm running test matches with opposing programs and with Rybka 2.32a mp. All tests are on my two quads and one octal. I'll report results here generally when they reach 100 games.

First result: Rybka 3 vs. Rybka 2.32a mp on octal, game/1': after 106 games, +54=43-9 for +157 Elo.
Update: now +98=61-15 for +180 Elo (!).
Update: now +136=76-19 for +193 Elo (!).
Final: +151=83-22 for +192 Elo.

Second result: Rybka 3 vs. Rybka 2.32a mp on quad, 40/1' repeating: test stopped with score +47=24-7 for +196 Elo (!!).

Third result: Rybka 3 vs. Zappa Mexico II on quad, 40/1' repeating: +59=36-7 for +195 Elo.
Update: +64=41-9 for +182 Elo.
Final: +85=46-11 for +200 Elo.

Comment: It seems that the much better time management helps much more against other Rybkas than against unrelated programs. Do not expect anywhere near a 200 Elo gain over 2.3.2a against programs unrelated to Rybka.

Fourth result: Rybka 3 vs. Hiarcs12 on quad, 40/1' repeating: test stopped after 100 games at +72=23-5 for +282 Elo.

Fifth result: Rybka 3 vs. Naum 3.1 on octal, 40/1' repeating: test stopped after 100 games at +76=22-2 for +330 Elo (!!).

Comment: overnight I'm switching the Naum and Hiarcs tests between machines, in case Naum has some problem utilizing octal computer. Results in the morning (US).

Sixth result: Rybka 3 vs. Deep Shredder 11 on quad, 40/1' repeating: +61=21-6 for +254 Elo. Will run overnight.

I think we could call this a Quantum Leap, wouldn't you agree? The numbers speak for themselves. Pretty devastating for now when you view it from the competition's side... But in the longer run I think this is good for computer-chess. Congratulations to Larry, Vas, Jeroen and all other members of the Rybka team!

Eelco

Correct me if I am wrong, but the numbers he is giving is not _improvement_. For example, the result against Naum simply says rybka 3 is 330 elo _better_ than naum. But I didn't see any results with previous rybka against same opponent so that it is possible to see the improvement...

It is possible to compare with ccrl results against the same opponents
The opening choice may be different and the time control is also different(40/4 against 40/1) so the comparison is not perfect
but both played from fixed opening positions.

Larry used openings that are used by part of the cegt testers.

http://computerchess.org.uk/ccrl/4040.l ... 4-bit_4CPU

My point was that his "+306 Elo" is incorrect. That is suggesting that the new Rybka is 306 Elo better than the old to most readers. It would have been far more informative to say "rybka 2 +175 Rybka 3 +306. For a gain of +131 elo over the old version. I can't begin to interpret the current numbers and certainly don't believe any +300 Elo claims...