Top Three Engines Are Essentially Equal Strength!

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Sean Evans
Posts: 1777
Joined: Thu Jun 05, 2008 8:58 pm
Location: Canada

Top Three Engines Are Essentially Equal Strength!

Post by Sean Evans » Mon Apr 03, 2017 2:27 pm

Only ten Elo rating points between the top three programs is quite amazing at this strength level :) Very exciting times in the computer chess world! We need a round-robin playoff between these three programs, may be 100 games :) It would potentially make for some great chess game to review and analyze!

CCRL Elo List

Stockfish 8 64-bit 4CPU Elo 3390

Houdini 5.01 64-bit 4CPU Elo 3387

Komodo 10.3 64-bit 4CPU Elo 3380


Cordially,

Sean

Leo
Posts: 807
Joined: Fri Sep 16, 2016 4:55 pm
Location: USA/Minnesota
Full name: Leo

Re: Top Three Engines Are Essentially Equal Strength!

Post by Leo » Mon Apr 03, 2017 6:09 pm

I think on powerful hardware like that used in the TCEC the difference is greater.
Advanced Micro Devices fan.

Jouni
Posts: 1957
Joined: Wed Mar 08, 2006 7:15 pm

Re: Top Three Engines Are Essentially Equal Strength!

Post by Jouni » Mon Apr 03, 2017 6:46 pm

But no more if Houdini 6 makes another 200 ELO jump :wink: .
Jouni

Werewolf
Posts: 1187
Joined: Thu Sep 18, 2008 8:24 pm

Re: Top Three Engines Are Essentially Equal Strength!

Post by Werewolf » Mon Apr 03, 2017 7:58 pm

SzG wrote:
Jouni wrote:But no more if Houdini 6 makes another 200 ELO jump :wink: .
For that to happen Stockfish has to make a 200 Elo jump first. :wink:
:lol:

Milos
Posts: 3383
Joined: Wed Nov 25, 2009 12:47 am

Re: Top Three Engines Are Essentially Equal Strength!

Post by Milos » Mon Apr 03, 2017 8:37 pm

Leo wrote:I think on powerful hardware like that used in the TCEC the difference is greater.
Lol, sure, the "law of augmented returns".
The longer the TC, the more difference between engines. :lol: :lol: :lol:

Sound like a commercial for mentally challenged. The more money you spent the richer you'd be ;).

gerold
Posts: 10121
Joined: Wed Mar 08, 2006 11:57 pm
Location: van buren,missouri

Re: Top Three Engines Are Essentially Equal Strength!

Post by gerold » Mon Apr 03, 2017 11:26 pm

Werewolf wrote:
SzG wrote:
Jouni wrote:But no more if Houdini 6 makes another 200 ELO jump :wink: .
For that to happen Stockfish has to make a 200 Elo jump first. :wink:
:lol:
you got that right. SF leads the way. :)

mjlef
Posts: 1420
Joined: Thu Mar 30, 2006 12:08 pm
Contact:

Re: Top Three Engines Are Essentially Equal Strength!

Post by mjlef » Tue Apr 04, 2017 12:56 am

Sean,

In case you missed it, we release Komodo 10.4 in March. It has tested as considerably stronger than Komodo 10.4.

Mark

Dann Corbit
Posts: 9895
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Top Three Engines Are Essentially Equal Strength!

Post by Dann Corbit » Tue Apr 04, 2017 1:21 am

Milos wrote:
Leo wrote:I think on powerful hardware like that used in the TCEC the difference is greater.
Lol, sure, the "law of augmented returns".
The longer the TC, the more difference between engines. :lol: :lol: :lol:

Sound like a commercial for mentally challenged. The more money you spent the richer you'd be ;).
If it is true, it is extremely surprising.

I would expect that under longer and longer time control you would see more and more draws and the Elo values would converge.

If an engine gets larger and larger Elo advantage at bigger time control or with a big thread count that would really be astonishing.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

BrendanJNorman
Posts: 1362
Joined: Sun Feb 07, 2016 11:43 pm
Full name: Brendan J Norman

Re: Top Three Engines Are Essentially Equal Strength!

Post by BrendanJNorman » Tue Apr 04, 2017 1:49 am

mjlef wrote:Sean,

In case you missed it, we release Komodo 10.4 in March. It has tested as considerably stronger than Komodo 10.4.

Mark
My copy is about equal strength. :lol:

lkaufman
Posts: 3641
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: Top Three Engines Are Essentially Equal Strength!

Post by lkaufman » Tue Apr 04, 2017 2:44 am

BrendanJNorman wrote:
mjlef wrote:Sean,

In case you missed it, we release Komodo 10.4 in March. It has tested as considerably stronger than Komodo 10.4.

Mark
My copy is about equal strength. :lol:
On the CCRL 40/40 single thread list, Komodo 10.4 is 34 elo ahead of 10.3 after 770 games. It doesn't have enough 4 cpu games yet to talk about the difference there. Overall I think our 20 elo estimated gain was conservative.

Regarding the effect of longer time controls (and/or more cores), if one engine is stronger because of more efficient code then the difference will shrink with more time. But if one scales better than another, either due to better chess knowledge or better pruning/reducing, it is possible for it to gain elo relative to the other engine with more time. It seems pretty clear that both Stockfish and Komodo scale better than Houdini with more time; between SF and Komodo the evidence is mixed.
Komodo rules!

Post Reply