Komodo CCT: Why I am satisfied now.

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Mike S.
Posts: 1480
Joined: Thu Mar 09, 2006 5:33 am

Komodo CCT: Why I am satisfied now.

Post by Mike S. »

i5-3210M, 512 MB hash
0:20m+0,2s ponder=on
S.Canbaz' Top-50 Openings
Arena 2.0.1, Windows 8 x64

Code: Select all

1   Komodo CCT  +100  +45/=38/-17 64.00%   64.0/100
2   Komodo 3    -100  +17/=38/-45 36.00%   36.0/100
+102 Elo by FIDE table. Good! :mrgreen: IPON gives +66 for this difference. Of course, small (?!) number of games and head-to-head only can be a bit misleading. But I am satisfied with the result.

P.S. Before, I did the same match but with fixed depth of 11 plies for both. The result was 51.5-48.5, only +10 Elo for K.CCT. That leads me to the conclusion that the strength gain is mostly based on search improvements (but I do not doubt that there were eval improvements as well).
Regards, Mike
lkaufman
Posts: 6284
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: Komodo CCT: Why I am satisfied now.

Post by lkaufman »

Mike S. wrote:i5-3210M, 512 MB hash
0:20m+0,2s ponder=on
S.Canbaz' Top-50 Openings
Arena 2.0.1, Windows 8 x64

Code: Select all

1   Komodo CCT  +100  +45/=38/-17 64.00%   64.0/100
2   Komodo 3    -100  +17/=38/-45 36.00%   36.0/100
+102 Elo by FIDE table. Good! :mrgreen: IPON gives +66 for this difference. Of course, small (?!) number of games and head-to-head only can be a bit misleading. But I am satisfied with the result.

P.S. Before, I did the same match but with fixed depth of 11 plies for both. The result was 51.5-48.5, only +10 Elo for K.CCT. That leads me to the conclusion that the strength gain is mostly based on search improvements (but I do not doubt that there were eval improvements as well).
Actually, you can't tell anything based on fixed depth searches, because we can (and often do) very easily make tradeoffs between speed and "quality" by changing various selectivity parameters. So for example, we could have improved the eval tremendously, but also gone "more selective", in which case the fixed depth results might be about even but timed play would show the gains. I'm not saying this is the case here, just that you can't tell this way.