Komodo 11 v. Stockfish 8 - Any Elo strength comparison yet?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Sean Evans
Posts: 1777
Joined: Thu Jun 05, 2008 10:58 pm
Location: Canada

Komodo 11 v. Stockfish 8 - Any Elo strength comparison yet?

Post by Sean Evans »

Hi, has anyone compared the strength of K11 v. SF8 yet?

Just wondering if K11 has become stronger than SF8.

Thank you,

Sean
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by Adam Hair »

Check out IPON
Lyudmil Tsvetkov
Posts: 6052
Joined: Tue Jun 12, 2012 12:41 pm

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by Lyudmil Tsvetkov »

komodo is 3 versions stronger.
PaulieD
Posts: 211
Joined: Tue Jun 25, 2013 8:19 pm

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by PaulieD »

CCRL 40/4 Rating List — All engines (Quote)
Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on May 27, 2017 with Bayeselo based on 1'465'515 games
Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 350 games or more. Normal font - less than 350 games.
Rank Name Rating Score Average
Opponent Draws Games LOS
Elo + −
1 Stockfish 8 64-bit 4CPU 3484 +15 −15 76.4% −184.0 42.3% 1708
88.5%
2 Houdini 5.01 64-bit 4CPU 3471 +17 −17 73.9% −169.8 44.3% 1301
63.7%
3 Komodo 10.4 64-bit 4CPU 3467 +20 −19 77.5% −194.6 37.7% 1012
67.9%
Komodo 11.01 64-bit 4CPU 3457 +32 −31 76.9% −185.2 40.2% 366
53.7%
PaulieD
Posts: 211
Joined: Tue Jun 25, 2013 8:19 pm

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by PaulieD »

FastGMs Rating Lists (FGRL)




Time control: 60 sec./game + 0.6 sec./move


Playing conditions

CPU: Dual Intel Xeon E5-2670 @ 2.6 GHz
OS: Windows 10 64-Bit
Tool: LittleBlitzer GUI, no draw and resign rules
Engines: 1 Core, 64 Bit, default settings
Hash-Table: 128 MB
Time control: 60 seconds + 0.6 seconds
Tablebases: None
Openings: 8moves_v3.epd, random
Ponder: Off
Learning: Off


Ordo v1.2.6: 3000

Best version list: 26.05.2017

New: 4. Komodo 11.01 64-bit

Engine : Elo Error Games Points (%) W D L D(%) CFS
------------------------------------------------------------------------------------------------------------
1 asmFish 161212 x64 : 3519 9 13000 11968.5 92.07 11110 1717 173 13.21 100
2 Stockfish 8 64 : 3501 9 13000 11875.5 91.35 10926 1899 175 14.61 100
3 Houdini 5 x64 : 3483 9 13000 11781.5 90.63 10818 1927 255 14.82 97
4 Komodo 11.01 64-bit : 3472 8 13000 11718.0 90.14 10765 1906 329 14.66 100
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by yanquis1972 »

paul, any results of the 4+2 test w/ k11 vs latest SF dev?

(id rather SF dev than asmfish personally bc i get the impression asmfish makes a better use of system resources)
PaulieD
Posts: 211
Joined: Tue Jun 25, 2013 8:19 pm

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by PaulieD »

yanquis1972 wrote:paul, any results of the 4+2 test w/ k11 vs latest SF dev?

(id rather SF dev than asmfish personally bc i get the impression asmfish makes a better use of system resources)
100 GAME GAUNTLET

i7 6700HQ | 4 @ 2.6-3.5 | Win10x64-16GB |Gui~CuteChess 0.9.4
Book~TopGM_8move.pgn | Hash~256 MB | Cores~1 | HT~On
Concurrency 7 | Ponder~No | TB~No | Time~4'+2"


Latest SF Dev +86 Elo (K 11.01 Contempt=10 Default)

Code: Select all

   # PLAYER          :  RATING  PLAYED   (%)    W    D    L  D(%)
   1 SF 170523       :    3243     101  61.4   33   58   10  57.4
   2 Komodo 11.01    :    3157     101  38.6   10   58   33  57.4
Sean Evans
Posts: 1777
Joined: Thu Jun 05, 2008 10:58 pm
Location: Canada

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by Sean Evans »

Adam Hair wrote:Check out IPON
IPON states:
"2017.05.23 The new Komodo 11.01 gained 19 Elo in the IPON-RRRL, is the new leader and the first engine to pass 3300 Elo! In the full List it improved by 14 Elo but is still second. If you are interested please check the archive to compare the old TOP16 with the new TOP16."
Sean Evans
Posts: 1777
Joined: Thu Jun 05, 2008 10:58 pm
Location: Canada

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by Sean Evans »

PaulieD wrote:FastGMs Rating Lists (FGRL)




Time control: 60 sec./game + 0.6 sec./move


Playing conditions

CPU: Dual Intel Xeon E5-2670 @ 2.6 GHz
OS: Windows 10 64-Bit
Tool: LittleBlitzer GUI, no draw and resign rules
Engines: 1 Core, 64 Bit, default settings
Hash-Table: 128 MB
Time control: 60 seconds + 0.6 seconds
Tablebases: None
Openings: 8moves_v3.epd, random
Ponder: Off
Learning: Off


Ordo v1.2.6: 3000

Best version list: 26.05.2017

New: 4. Komodo 11.01 64-bit

Engine : Elo Error Games Points (%) W D L D(%) CFS
------------------------------------------------------------------------------------------------------------
1 asmFish 161212 x64 : 3519 9 13000 11968.5 92.07 11110 1717 173 13.21 100
2 Stockfish 8 64 : 3501 9 13000 11875.5 91.35 10926 1899 175 14.61 100
3 Houdini 5 x64 : 3483 9 13000 11781.5 90.63 10818 1927 255 14.82 97
4 Komodo 11.01 64-bit : 3472 8 13000 11718.0 90.14 10765 1906 329 14.66 100
What the heck is asmFish?
retep1
Posts: 44
Joined: Sun Aug 07, 2016 5:24 pm

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by retep1 »

"What the heck is asmFish?"
look here -
https://github.com/lantonov/asmFish/tre ... es/Windows