Komodo 10.2 released.

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
mclane
Posts: 16263
Joined: Thu Mar 09, 2006 5:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub
Contact:

Re: Komodo 10.2 released.

Post by mclane » Sat Nov 19, 2016 7:04 pm

I don't see that Komodo underperforms against stockfish,
I have an old Komodo and it beats all stockfish versions.
Only Houdini is ahead of Komodo. So I maybe have to update my Komodo version now.
What seems like a fairy tale today may be reality tomorrow.
Here we have a fairy tale of the day after tomorrow....

Andre
Posts: 93
Joined: Thu Jul 23, 2009 3:40 am

Re: Komodo 10.2 released.

Post by Andre » Sat Nov 19, 2016 7:42 pm

So you obviously have an old version of Stockfish

User avatar
mclane
Posts: 16263
Joined: Thu Mar 09, 2006 5:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub
Contact:

Re: Komodo 10.2 released.

Post by mclane » Sat Nov 19, 2016 10:40 pm

Is 8 old ?
What seems like a fairy tale today may be reality tomorrow.
Here we have a fairy tale of the day after tomorrow....

User avatar
Mike S.
Posts: 1480
Joined: Thu Mar 09, 2006 4:33 am

Re: Komodo 10.2 released.

Post by Mike S. » Sun Nov 20, 2016 5:43 am

mclane wrote:I have an old Komodo and it beats all stockfish versions.
Results from CEGT 40/20 1CPU:

http://www.husvankempen.de/nunn/40_40%2 ... ion/2.html

Among those, against

13 Komodo 10.1 x64 1CPU - 3264 100 + 31 = 66 - 3 64.0 % 3363
14 Komodo 10.2 x64 1CPU - 3259 100 + 38 = 58 - 4 67.0 % 3382

Brutal results.

The smallest gaps I found between SF8 and K10.x are at CCRL. - I did not yet find a list where H5 is ahead of SF8.
Regards, Mike

User avatar
Graham Banks
Posts: 33239
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: Komodo 10.2 released.

Post by Graham Banks » Sun Nov 20, 2016 6:01 am

Mike S. wrote:
mclane wrote: I did not yet find a list where H5 is ahead of SF8.
Early days, but look here:

http://www.computerchess.org.uk/ccrl/40 ... ons_only=1

Houdini could well go top of the 40/4 4CPU list as well.
My email addresses:
gbanksnz at gmail.com
gbanksnz at yahoo.co.nz

lkaufman
Posts: 3756
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: Komodo 10.2 released.

Post by lkaufman » Sun Nov 20, 2016 6:38 am

CCRL 40/40 list now shows Komodo 10.1 tied for lead on 4 cpu with SF8, and Komodo 10.2 only 3 elo behind SF8 on one cpu. But we are not competitive in direct matches. I think this shows beyond much doubt that Komodo underperforms playing directly against SF compared to how they each do against a range of opponents. I expect Komodo 10.3 will top the 40/40 lists when it comes out, since we're virtually tied now.
Komodo rules!

JJJ
Posts: 1287
Joined: Sat Apr 19, 2014 11:47 am

Re: Komodo 10.2 released.

Post by JJJ » Sun Nov 20, 2016 6:41 am

lkaufman wrote:CCRL 40/40 list now shows Komodo 10.1 tied for lead on 4 cpu with SF8, and Komodo 10.2 only 3 elo behind SF8 on one cpu. But we are not competitive in direct matches. I think this shows beyond much doubt that Komodo underperforms playing directly against SF compared to how they each do against a range of opponents. I expect Komodo 10.3 will top the 40/40 lists when it comes out, since we're virtually tied now.
Komodo is not tied on every list and is behind in http://fastgm.de/ for exemple.

Also Komodo seems to loose against Houdini 5, would you says it's underperform against it ?

I ask with no offense here, just want to know you opinion about it. I truly respect your work and your engine and I m happy you re still on top with your very small team :)

User avatar
mclane
Posts: 16263
Joined: Thu Mar 09, 2006 5:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub
Contact:

Re: Komodo 10.2 released.

Post by mclane » Sun Nov 20, 2016 8:13 am

That's why measuring elo via match between a few top programs is not helping.
You always need a big variety of opponents to measure elo.
The smaller the group of opponents, the less real your results are.

Second match with many games against one opponent gives learning effects that influence result.
What seems like a fairy tale today may be reality tomorrow.
Here we have a fairy tale of the day after tomorrow....

User avatar
mclane
Posts: 16263
Joined: Thu Mar 09, 2006 5:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub
Contact:

Re: Komodo 10.2 released.

Post by mclane » Sun Nov 20, 2016 8:14 am

I guess Houdini is the better killer.
What seems like a fairy tale today may be reality tomorrow.
Here we have a fairy tale of the day after tomorrow....

lkaufman
Posts: 3756
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: Komodo 10.2 released.

Post by lkaufman » Sun Nov 20, 2016 1:34 pm

JJJ wrote:
lkaufman wrote:CCRL 40/40 list now shows Komodo 10.1 tied for lead on 4 cpu with SF8, and Komodo 10.2 only 3 elo behind SF8 on one cpu. But we are not competitive in direct matches. I think this shows beyond much doubt that Komodo underperforms playing directly against SF compared to how they each do against a range of opponents. I expect Komodo 10.3 will top the 40/40 lists when it comes out, since we're virtually tied now.
Komodo is not tied on every list and is behind in http://fastgm.de/ for exemple.

Also Komodo seems to loose against Houdini 5, would you says it's underperform against it ?

I ask with no offense here, just want to know you opinion about it. I truly respect your work and your engine and I m happy you re still on top with your very small team :)
Both Stockfish 8 and Houdini 5 are stronger than Komodo 10.2 at blitz or near-blitz speeds. But at 40/40' it remains to be seen how Houdini 5 will fare; my guess is that it will not do better than Stockfish 8 did. Until we have significant data at that level it's too early to say much about Houdini 5.
Komodo rules!

Post Reply