Look who's number 1 at 40/2 on CEGT!

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: Look who's number 1 at 40/2 on CEGT!

Post by Dr.Wael Deeb »

lkaufman wrote:I thought the previous poster got it right and just doesn't care about anything except blitz chess. Perhaps I am wrong; only he can clarify this.
No,I thought it was 40 moves in 2 minutes time control....I hate blitz time controls and for that I think that Komodo's performance is even more impressive 8-)
Dr.D
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
lkaufman
Posts: 6279
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: Look who's number 1 at 40/2 on CEGT!

Post by lkaufman »

I didn't mean to mislead anyone by the caption. I would much rather have Komodo be considered the best program at 40/2 hours than the best program at 40/2 minutes, if we can only have one of the two options! Really, the main reason to care about blitz ratings is that it takes so long to get an accurate rating at a long time control that by the time it is done, the program being rated is no longer the current version.
User avatar
Desperado
Posts: 879
Joined: Mon Dec 15, 2008 11:45 am

Re: Look who's number 1 at 40/2 on CEGT!

Post by Desperado »

Congratulations to the Komodo Team.

It must be a very good feeling to be at top at todays rating lists.

Enjoy :)

Michael
lkaufman
Posts: 6279
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: Look who's number 1 at 40/2 on CEGT!

Post by lkaufman »

Thanks. The real sense of accomplishment is having achieved this level without starting from someone else's codebase. When we started on this adventure (with DOCH) I think the most we could even hope for was to be second behind Rybka 3 someday. I would never have guessed we would reach today's level by now, especially given that we never made any single advance that was worth more than twenty elo points. I can't guess where the next real gains will be found, but I have no doubt that we will continue to make progress.
tomgdrums
Posts: 736
Joined: Wed Dec 02, 2009 9:48 am

Re: Look who's number 1 at 40/2 on CEGT!

Post by tomgdrums »

lkaufman wrote:Thanks. The real sense of accomplishment is having achieved this level without starting from someone else's codebase. When we started on this adventure (with DOCH) I think the most we could even hope for was to be second behind Rybka 3 someday. I would never have guessed we would reach today's level by now, especially given that we never made any single advance that was worth more than twenty elo points. I can't guess where the next real gains will be found, but I have no doubt that we will continue to make progress.
So for post game analysis of an OTB game is it good to let Komodo look at each position for about 3-4 minutes? Is that productive enough?
lkaufman
Posts: 6279
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: Look who's number 1 at 40/2 on CEGT!

Post by lkaufman »

There's no magic amount of time that's best; the longer the better the quality. I used an average of 15 minutes for the analysis I did for my new book. What this result suggests (subject to sample error of course) is that if you have at least 3 minutes available for the computer to think, Komodo might be your best choice (assuming equal number of cores). If you want an answer in a few seconds Houdini might be a better choice until we catch it in the blitz lists too.
ThatsIt
Posts: 992
Joined: Thu Mar 09, 2006 2:11 pm

Re: Look who's number 1 at 40/2 on CEGT!

Post by ThatsIt »

online now: http://www.husvankempen.de/nunn/rating120.htm

Best wishes,
G.S.
lucasart
Posts: 3243
Joined: Mon May 31, 2010 1:29 pm
Full name: lucasart

Re: Look who's number 1 at 40/2 on CEGT!

Post by lucasart »

ThatsIt wrote:online now: http://www.husvankempen.de/nunn/rating120.htm

Best wishes,
G.S.
interesting result.
however critter 1.4, stockfish 2.2.2, and houdini 2 need to be tested too for that conclusion to make sense.
JManion
Posts: 213
Joined: Wed Dec 23, 2009 8:53 am

Re: Look who's number 1 at 40/2 on CEGT!

Post by JManion »

Did not Komodo 4 come out after

Critter 1.0
Critter 1.2
Critter 1.4

Stockfish 2.1
Stockfish 2.1.1
Stockfish 2.2

Houdini 2.0

Strange those engines have not played 300-500 games already.
lkaufman
Posts: 6279
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: Look who's number 1 at 40/2 on CEGT!

Post by lkaufman »

No, Critter 1.4 and SF 2.2.2 came out after Komodo 4. Also note that Komodo 3 was skipped. As for Houdini 2.0, yes it was before Komodo 4, but it got a lower rating on their 40/20 list than Houdini 1.5, so they had no compelling reason to test it at 40/2. I would say Critter 1.4 is the most deserving of being tested next, considering its large gain over Critter 0.9 based on 40/20 list. I think they are rightly following the policy of only testing new versions at 40/2 when the version has shown a substantial gain at 40/20. Otherwise they'll never have decent samples of any engine.