AH_LTC Match: Houdini 3 vs Komodo 6

Discussion of computer chess matches and engine tournaments.

Moderators: Harvey Williamson, Dann Corbit, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
Aser Huerga
Posts: 812
Joined: Tue Jun 16, 2009 8:09 am
Location: Spain

AH_LTC Match: Houdini 3 vs Komodo 6

Post by Aser Huerga » Sat Nov 09, 2013 8:18 am

AH_LTC Match: Houdini 3 vs Komodo 6

i7-3930K CPUs 4.25 GHz
90'+30" TC
1 core for all engines
Ponder off
1024 Hash
3-4-5 EGTBs (when available) in SSDs
150 Early Starting Positions Suite, slightly tunned to avoid transpositions (checked with engine vs same-engine matches), and created as a proportional representation of the most played openings/variations on the last recent years in high quality human chess tournaments (source TWIC, only 2400+ ELO players) AH_150_Opening_Suite
All positions are played with Switched Colors for a total of 300 games per match
Games available for download, including eval/time/depth and PV for each move

Results:

Code: Select all

1 Komodo 6  +74/-58/=168 52.67% 158.0/300
2 Houdini 3 +58/-74/=168 47.33% 142.0/300
[/color]

Games: Houdini 3 - Komodo 6

Modern Times
Posts: 2612
Joined: Thu Jun 07, 2012 9:02 pm

Re: AH_LTC Match: Houdini 3 vs Komodo 6

Post by Modern Times » Sat Nov 09, 2013 8:24 am

Thanks for that match, that is interesting. Longer time control on a recent Intel CPU, and Komodo sneaks ahead. But, it still gets beaten by Stockfish.

Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 8:31 pm
Location: Fuquay-Varina, North Carolina

Re: AH_LTC Match: Houdini 3 vs Komodo 6

Post by Adam Hair » Sat Nov 09, 2013 9:21 am

Here are the Ordo ratings computed from the three matches:

Code: Select all

   # PLAYER                   : RATING  ERROR   POINTS  PLAYED    (%)
   1 Stockfish_SZ 13110122    :   29.7   12.9    337.5     600   56.2%
   2 Komodo 6                 :   -4.7   13.0    294.0     600   49.0%
   3 Houdini 3                :  -24.9   13.0    268.5     600   44.8%

User avatar
Aser Huerga
Posts: 812
Joined: Tue Jun 16, 2009 8:09 am
Location: Spain

Re: AH_LTC Match: Houdini 3 vs Komodo 6

Post by Aser Huerga » Sat Nov 09, 2013 9:30 am

Thanks!
Now I will be out for a week, but there will be more matches with new engines in the future.

lkaufman
Posts: 4414
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: AH_LTC Match: Houdini 3 vs Komodo 6

Post by lkaufman » Sat Nov 09, 2013 1:37 pm

Modern Times wrote:Thanks for that match, that is interesting. Longer time control on a recent Intel CPU, and Komodo sneaks ahead. But, it still gets beaten by Stockfish.
These results confirm my contention that both Komodo and Stockfish scale better than Houdini. When Stockfish plays Komodo, time limit doesn't seem to make much difference, but the rate of progress for both programs is such that if one of the programs tested is a month newer than the other it will win the match!

User avatar
Don
Posts: 5106
Joined: Tue Apr 29, 2008 2:27 pm

Re: AH_LTC Match: Houdini 3 vs Komodo 6

Post by Don » Tue Nov 12, 2013 2:42 pm

Modern Times wrote:Thanks for that match, that is interesting. Longer time control on a recent Intel CPU, and Komodo sneaks ahead. But, it still gets beaten by Stockfish.
Which version Komodo and SF are you talking about? I'll bet you are comparing the most cutting edge SF dev version against some ancient version of Komodo, right? Komodo 6 is now ancient.

So which version o these programs are you talking about? It's not fair to make comparisons like this without being specific.

Both Houdini and Komodo have advance you should realize.

Don
Capital punishment would be more effective as a preventive measure if it were administered prior to the crime.

beram
Posts: 1187
Joined: Wed Jan 06, 2010 2:11 pm

Re: AH_LTC Match: Houdini 3 vs Komodo 6

Post by beram » Tue Nov 12, 2013 5:03 pm

Aser has used Stockfish_SZ 13110122 against Komodo 6 http://www.talkchess.com/forum/viewtopic.php?t=49944

Code: Select all

1 Stockfish_SZ 13110122 +70/-42/=188 54.67% 164.0/300 
2 Komodo 6              +42/-70/=188 45.33% 136.0/300
As far as I can see there is only 3 weeks in release date for them.
btw since when is an engine of nearly one month old, an ancient engine ?

I guess that only when you would have improved Komodo 6 by 35 ELO in that three weeks you would have been on par with it
But even then, by now SF131111 has already been improved with yet another 8 ELO..

It would be really very impressive if Komodo team could keep up that incredible pace of improvement of Stockfish worldwide framework

kind regards

Modern Times
Posts: 2612
Joined: Thu Jun 07, 2012 9:02 pm

Re: AH_LTC Match: Houdini 3 vs Komodo 6

Post by Modern Times » Tue Nov 12, 2013 7:00 pm

I'm referring to publicly available versions of both engines. Yes of course Komodo has improved since K6. Aser is using K6, so that was the context of my observations.

Modern Times
Posts: 2612
Joined: Thu Jun 07, 2012 9:02 pm

Re: AH_LTC Match: Houdini 3 vs Komodo 6

Post by Modern Times » Tue Nov 12, 2013 7:53 pm

I'm convinced that the latest version of Komodo will win TCEC, let's see.

User avatar
Don
Posts: 5106
Joined: Tue Apr 29, 2008 2:27 pm

Re: AH_LTC Match: Houdini 3 vs Komodo 6

Post by Don » Wed Nov 13, 2013 12:51 pm

Modern Times wrote:I'm referring to publicly available versions of both engines. Yes of course Komodo has improved since K6. Aser is using K6, so that was the context of my observations.
Yes that is what I thought. Komodo has made a lot of progress since Komodo 6 so the fairst compairson is whatever SF version was avilable then.
Capital punishment would be more effective as a preventive measure if it were administered prior to the crime.

Post Reply