Page 1 of 2

Komodo 11 v. Stockfish 8 - Any Elo strength comparison yet?

Posted: Wed May 31, 2017 11:18 am
by Sean Evans
Hi, has anyone compared the strength of K11 v. SF8 yet?

Just wondering if K11 has become stronger than SF8.

Thank you,

Sean

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Posted: Wed May 31, 2017 11:49 am
by Adam Hair
Check out IPON

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Posted: Wed May 31, 2017 1:20 pm
by Lyudmil Tsvetkov
komodo is 3 versions stronger.

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Posted: Wed May 31, 2017 1:40 pm
by PaulieD
CCRL 40/4 Rating List — All engines (Quote)
Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern Intel CPU.
Computed on May 27, 2017 with Bayeselo based on 1'465'515 games
Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 350 games or more. Normal font - less than 350 games.
Rank Name Rating Score Average
Opponent Draws Games LOS
Elo + −
1 Stockfish 8 64-bit 4CPU 3484 +15 −15 76.4% −184.0 42.3% 1708
88.5%
2 Houdini 5.01 64-bit 4CPU 3471 +17 −17 73.9% −169.8 44.3% 1301
63.7%
3 Komodo 10.4 64-bit 4CPU 3467 +20 −19 77.5% −194.6 37.7% 1012
67.9%
Komodo 11.01 64-bit 4CPU 3457 +32 −31 76.9% −185.2 40.2% 366
53.7%

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Posted: Wed May 31, 2017 1:41 pm
by PaulieD
FastGMs Rating Lists (FGRL)




Time control: 60 sec./game + 0.6 sec./move


Playing conditions

CPU: Dual Intel Xeon E5-2670 @ 2.6 GHz
OS: Windows 10 64-Bit
Tool: LittleBlitzer GUI, no draw and resign rules
Engines: 1 Core, 64 Bit, default settings
Hash-Table: 128 MB
Time control: 60 seconds + 0.6 seconds
Tablebases: None
Openings: 8moves_v3.epd, random
Ponder: Off
Learning: Off


Ordo v1.2.6: 3000

Best version list: 26.05.2017

New: 4. Komodo 11.01 64-bit

Engine : Elo Error Games Points (%) W D L D(%) CFS
------------------------------------------------------------------------------------------------------------
1 asmFish 161212 x64 : 3519 9 13000 11968.5 92.07 11110 1717 173 13.21 100
2 Stockfish 8 64 : 3501 9 13000 11875.5 91.35 10926 1899 175 14.61 100
3 Houdini 5 x64 : 3483 9 13000 11781.5 90.63 10818 1927 255 14.82 97
4 Komodo 11.01 64-bit : 3472 8 13000 11718.0 90.14 10765 1906 329 14.66 100

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Posted: Wed May 31, 2017 5:32 pm
by yanquis1972
paul, any results of the 4+2 test w/ k11 vs latest SF dev?

(id rather SF dev than asmfish personally bc i get the impression asmfish makes a better use of system resources)

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Posted: Wed May 31, 2017 7:52 pm
by PaulieD
yanquis1972 wrote:paul, any results of the 4+2 test w/ k11 vs latest SF dev?

(id rather SF dev than asmfish personally bc i get the impression asmfish makes a better use of system resources)
100 GAME GAUNTLET

i7 6700HQ | 4 @ 2.6-3.5 | Win10x64-16GB |Gui~CuteChess 0.9.4
Book~TopGM_8move.pgn | Hash~256 MB | Cores~1 | HT~On
Concurrency 7 | Ponder~No | TB~No | Time~4'+2"


Latest SF Dev +86 Elo (K 11.01 Contempt=10 Default)

Code: Select all

   # PLAYER          :  RATING  PLAYED   (%)    W    D    L  D(%)
   1 SF 170523       :    3243     101  61.4   33   58   10  57.4
   2 Komodo 11.01    :    3157     101  38.6   10   58   33  57.4

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Posted: Wed May 31, 2017 9:38 pm
by Sean Evans
Adam Hair wrote:Check out IPON
IPON states:
"2017.05.23 The new Komodo 11.01 gained 19 Elo in the IPON-RRRL, is the new leader and the first engine to pass 3300 Elo! In the full List it improved by 14 Elo but is still second. If you are interested please check the archive to compare the old TOP16 with the new TOP16."

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Posted: Wed May 31, 2017 9:40 pm
by Sean Evans
PaulieD wrote:FastGMs Rating Lists (FGRL)




Time control: 60 sec./game + 0.6 sec./move


Playing conditions

CPU: Dual Intel Xeon E5-2670 @ 2.6 GHz
OS: Windows 10 64-Bit
Tool: LittleBlitzer GUI, no draw and resign rules
Engines: 1 Core, 64 Bit, default settings
Hash-Table: 128 MB
Time control: 60 seconds + 0.6 seconds
Tablebases: None
Openings: 8moves_v3.epd, random
Ponder: Off
Learning: Off


Ordo v1.2.6: 3000

Best version list: 26.05.2017

New: 4. Komodo 11.01 64-bit

Engine : Elo Error Games Points (%) W D L D(%) CFS
------------------------------------------------------------------------------------------------------------
1 asmFish 161212 x64 : 3519 9 13000 11968.5 92.07 11110 1717 173 13.21 100
2 Stockfish 8 64 : 3501 9 13000 11875.5 91.35 10926 1899 175 14.61 100
3 Houdini 5 x64 : 3483 9 13000 11781.5 90.63 10818 1927 255 14.82 97
4 Komodo 11.01 64-bit : 3472 8 13000 11718.0 90.14 10765 1906 329 14.66 100
What the heck is asmFish?

Re: Komodo 11 v. Stockfish 8 - Any Elo strength comparison y

Posted: Wed May 31, 2017 9:50 pm
by retep1
"What the heck is asmFish?"
look here -
https://github.com/lantonov/asmFish/tre ... es/Windows