Komodo 11 v. Stockfish 8 - Any Elo strength comparison yet?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Sean Evans
Posts: 1777
Joined: Thu Jun 05, 2008 8:58 pm
Location: Canada

Komodo 11 v. Stockfish 8 - Any Elo strength comparison yet?

Post by Sean Evans » Wed May 31, 2017 11:18 am

Hi, has anyone compared the strength of K11 v. SF8 yet?

Just wondering if K11 has become stronger than SF8.

Thank you,

Sean

Adam Hair
Posts: 3201
Joined: Wed May 06, 2009 8:31 pm
Location: Fuquay-Varina, North Carolina

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by Adam Hair » Wed May 31, 2017 11:49 am

Check out IPON

Lyudmil Tsvetkov
Posts: 6037
Joined: Tue Jun 12, 2012 10:41 am

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by Lyudmil Tsvetkov » Wed May 31, 2017 1:20 pm

komodo is 3 versions stronger.

PaulieD
Posts: 205
Joined: Tue Jun 25, 2013 6:19 pm

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by PaulieD » Wed May 31, 2017 1:40 pm

CCRL 40/4 Rating List — All engines (Quote)
Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on May 27, 2017 with Bayeselo based on 1'465'515 games
Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 350 games or more. Normal font - less than 350 games.
Rank Name Rating Score Average
Opponent Draws Games LOS
Elo + −
1 Stockfish 8 64-bit 4CPU 3484 +15 −15 76.4% −184.0 42.3% 1708
88.5%
2 Houdini 5.01 64-bit 4CPU 3471 +17 −17 73.9% −169.8 44.3% 1301
63.7%
3 Komodo 10.4 64-bit 4CPU 3467 +20 −19 77.5% −194.6 37.7% 1012
67.9%
Komodo 11.01 64-bit 4CPU 3457 +32 −31 76.9% −185.2 40.2% 366
53.7%

PaulieD
Posts: 205
Joined: Tue Jun 25, 2013 6:19 pm

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by PaulieD » Wed May 31, 2017 1:41 pm

FastGMs Rating Lists (FGRL)




Time control: 60 sec./game + 0.6 sec./move


Playing conditions

CPU: Dual Intel Xeon E5-2670 @ 2.6 GHz
OS: Windows 10 64-Bit
Tool: LittleBlitzer GUI, no draw and resign rules
Engines: 1 Core, 64 Bit, default settings
Hash-Table: 128 MB
Time control: 60 seconds + 0.6 seconds
Tablebases: None
Openings: 8moves_v3.epd, random
Ponder: Off
Learning: Off


Ordo v1.2.6: 3000

Best version list: 26.05.2017

New: 4. Komodo 11.01 64-bit

Engine : Elo Error Games Points (%) W D L D(%) CFS
------------------------------------------------------------------------------------------------------------
1 asmFish 161212 x64 : 3519 9 13000 11968.5 92.07 11110 1717 173 13.21 100
2 Stockfish 8 64 : 3501 9 13000 11875.5 91.35 10926 1899 175 14.61 100
3 Houdini 5 x64 : 3483 9 13000 11781.5 90.63 10818 1927 255 14.82 97
4 Komodo 11.01 64-bit : 3472 8 13000 11718.0 90.14 10765 1906 329 14.66 100

yanquis1972
Posts: 1762
Joined: Tue Jun 02, 2009 10:14 pm

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by yanquis1972 » Wed May 31, 2017 5:32 pm

paul, any results of the 4+2 test w/ k11 vs latest SF dev?

(id rather SF dev than asmfish personally bc i get the impression asmfish makes a better use of system resources)

PaulieD
Posts: 205
Joined: Tue Jun 25, 2013 6:19 pm

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by PaulieD » Wed May 31, 2017 7:52 pm

yanquis1972 wrote:paul, any results of the 4+2 test w/ k11 vs latest SF dev?

(id rather SF dev than asmfish personally bc i get the impression asmfish makes a better use of system resources)
100 GAME GAUNTLET

i7 6700HQ | 4 @ 2.6-3.5 | Win10x64-16GB |Gui~CuteChess 0.9.4
Book~TopGM_8move.pgn | Hash~256 MB | Cores~1 | HT~On
Concurrency 7 | Ponder~No | TB~No | Time~4'+2"


Latest SF Dev +86 Elo (K 11.01 Contempt=10 Default)

Code: Select all

   # PLAYER          :  RATING  PLAYED   (%)    W    D    L  D(%)
   1 SF 170523       :    3243     101  61.4   33   58   10  57.4
   2 Komodo 11.01    :    3157     101  38.6   10   58   33  57.4

Sean Evans
Posts: 1777
Joined: Thu Jun 05, 2008 8:58 pm
Location: Canada

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by Sean Evans » Wed May 31, 2017 9:38 pm

Adam Hair wrote:Check out IPON
IPON states:
"2017.05.23 The new Komodo 11.01 gained 19 Elo in the IPON-RRRL, is the new leader and the first engine to pass 3300 Elo! In the full List it improved by 14 Elo but is still second. If you are interested please check the archive to compare the old TOP16 with the new TOP16."

Sean Evans
Posts: 1777
Joined: Thu Jun 05, 2008 8:58 pm
Location: Canada

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by Sean Evans » Wed May 31, 2017 9:40 pm

PaulieD wrote:FastGMs Rating Lists (FGRL)




Time control: 60 sec./game + 0.6 sec./move


Playing conditions

CPU: Dual Intel Xeon E5-2670 @ 2.6 GHz
OS: Windows 10 64-Bit
Tool: LittleBlitzer GUI, no draw and resign rules
Engines: 1 Core, 64 Bit, default settings
Hash-Table: 128 MB
Time control: 60 seconds + 0.6 seconds
Tablebases: None
Openings: 8moves_v3.epd, random
Ponder: Off
Learning: Off


Ordo v1.2.6: 3000

Best version list: 26.05.2017

New: 4. Komodo 11.01 64-bit

Engine : Elo Error Games Points (%) W D L D(%) CFS
------------------------------------------------------------------------------------------------------------
1 asmFish 161212 x64 : 3519 9 13000 11968.5 92.07 11110 1717 173 13.21 100
2 Stockfish 8 64 : 3501 9 13000 11875.5 91.35 10926 1899 175 14.61 100
3 Houdini 5 x64 : 3483 9 13000 11781.5 90.63 10818 1927 255 14.82 97
4 Komodo 11.01 64-bit : 3472 8 13000 11718.0 90.14 10765 1906 329 14.66 100
What the heck is asmFish?

retep1
Posts: 42
Joined: Sun Aug 07, 2016 3:24 pm

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Post by retep1 » Wed May 31, 2017 9:50 pm

"What the heck is asmFish?"
look here -
https://github.com/lantonov/asmFish/tre ... es/Windows

Post Reply