Komodo CCT vs Houdini 3 (CCRL 40/40)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Modern Times
Posts: 3799
Joined: Thu Jun 07, 2012 11:02 pm

Komodo CCT vs Houdini 3 (CCRL 40/40)

Post by Modern Times »

CCRL 40/40 so far:

Komodo CCT vs Houdini 3: 26.5 - 23.5 (+13 =27 -10)
Outstanding result.


But what isn't so outstanding:
Komodo CCT vs Rybka 4.1: 25.0 - 23.0 (+7 =36 -5)

So it will be interesting to see how the ratings work out.


And another:
Komodo CCT vs Stockfish 3: 33.0 - 19.0 (+18 =30 -4)

And another:
Komodo CCT vs Critter 1.6a: 34.5 -21.5 (+19 =31 -6)
lkaufman
Posts: 6283
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: Komodo CCT vs Houdini 3 (CCRL 40/40)

Post by lkaufman »

Modern Times wrote:CCRL 40/40 so far:

Komodo CCT vs Houdini 3: 26.5 - 23.5 (+13 =27 -10)
Outstanding result.


But what isn't so outstanding:
Komodo CCT vs Rybka 4.1: 25.0 - 23.0 (+7 =36 -5)

So it will be interesting to see how the ratings work out.


And another:
Komodo CCT vs Stockfish 3: 33.0 - 19.0 (+18 =30 -4)

And another:
Komodo CCT vs Critter 1.6a: 34.5 -21.5 (+19 =31 -6)
A rough calculation, making the plausible assumption that Stockfish 3 will be about 20 elo above previous Stockfish, puts the rating of Komodo CCT based on these results VERY close to the rating of Houdini 3! But of course it's a small sample, so I dare not predict that we will remain so close to Houdini 3, but I can hope! Early results from CEGT at 40/20 are also encouraging (i.e. better than at blitz) so there are signs that Komodo CCT scales very well. We shall see.
Modern Times
Posts: 3799
Joined: Thu Jun 07, 2012 11:02 pm

Re: Komodo CCT vs Houdini 3 (CCRL 40/40)

Post by Modern Times »

You should be reasonably close. For Saturday's update we should have approx. 500 games so the picture will be a little clearer. But it won't be until we get over 1,000 that it would be safe to draw any sort of conclusions.

In the meantime, Komodo has increased the gap slightly over Houdini, but Rybka has closed the gap to 1 point now. Whenever I see Komodo vs Rybka, I'm thinking "Larry vs Larry"...
lkaufman
Posts: 6283
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: Komodo CCT vs Houdini 3 (CCRL 40/40)

Post by lkaufman »

Modern Times wrote:You should be reasonably close. For Saturday's update we should have approx. 500 games so the picture will be a little clearer. But it won't be until we get over 1,000 that it would be safe to draw any sort of conclusions.

In the meantime, Komodo has increased the gap slightly over Houdini, but Rybka has closed the gap to 1 point now. Whenever I see Komodo vs Rybka, I'm thinking "Larry vs Larry"...
Just for the record, while I had a huge role in Rybka 3, I had almost nothing to do with whatever gains were achieved between Rybka 3 and Rybka 4 (or 4.1).
Various other reports trickling in suggest that Komodo CCT is no match for Houdini 3 at bullet speeds but a very good match at levels around half an hour per player per game or slower, such as your 40/40 level.