Komodo Dragon - 16 vs 32 threads

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Komodo Dragon - 16 vs 32 threads

Post by fastgm »

Playing conditions

Code: Select all

CPU:          Dual Intel Xeon E5-2673 v4, 40 cores (80 threads)
OS:           Windows 10 64-Bit
Tool:         Cutechess-Cli, no draw and resign rules
Engines:      Komodo Dragon 64 Bit AVX2, default settings
Hash-Table:   2048 MB
Time control: 60 seconds + 0.6 seconds
Tablebases:   None
Openings:     4 moves book, changing colors
Ponder:       Off
Komodo Dragon AVX2 32 threads vs Komodo Dragon AVX2 16 threads, 1000 games

+26 Elo

Code: Select all

Komodo Dragon T32   +26  +92/=890/-18 53.70%  537.0/1000
Komodo Dragon T16   -26  +18/=890/-92 46.30%  463.0/1000

Engine                 Depth       Time   Games     Moves  Average    MIDG   EARLY    ENDG    LATE
---------------------------------------------------------------------------------------------------
Komodo Dragon T32      25.58   31:50:56    1000    107211    1.07    24.58 | 26.05 | 27.20 | 25.46
Komodo Dragon T16      24.74   31:48:58    1000    107202    1.07    23.66 | 24.81 | 26.23 | 24.76

Legend

Depth     : Overall average search depth
Time      : Total time engine used
Moves     : Total moves engine played
Average   : Average time per move in centi-seconds

MIDG      : Average search depth during the opening and middle game
EARLY     : Average search depth during the middle game without Queens, the so called early end game
ENDG      : Average search depth during the end game
LATE      : Average search depth during the late end game
Jouni
Posts: 3843
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: Komodo Dragon - 16 vs 32 threads

Post by Jouni »

Your old test with Komodo 14 gave +25 ELO, very similar! BTW how many PCs You have?

http://www.talkchess.com/forum3/viewtop ... g+of+cores
Jouni
mar
Posts: 2680
Joined: Fri Nov 26, 2010 2:00 pm
Location: Czech Republic
Full name: Martin Sedlak

Re: Komodo Dragon - 16 vs 32 threads

Post by mar »

so that pretty much debunks the myth that NNUE-based engines don't scale with lazy smp (assuming that's what Komodo Dragon uses)
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: Komodo Dragon - 16 vs 32 threads

Post by Milos »

mar wrote: Tue Mar 30, 2021 9:24 am so that pretty much debunks the myth that NNUE-based engines don't scale with lazy smp (assuming that's what Komodo Dragon uses)
This debunks absolutely nothing. There is no baseline to compare. If going from 1 to 2 threads one gains 70Elo but going from 16 to 32 gains only 25Elo talking about good scaling is ridiculous. Or if with classic based eval one gains 40Elo going from 16 to 32 threads and with NNUE eval only 25Elo, again we can't just claim all is great.
mar
Posts: 2680
Joined: Fri Nov 26, 2010 2:00 pm
Location: Czech Republic
Full name: Martin Sedlak

Re: Komodo Dragon - 16 vs 32 threads

Post by mar »

Milos wrote: Tue Mar 30, 2021 9:44 am This debunks absolutely nothing. There is no baseline to compare. If going from 1 to 2 threads one gains 70Elo but going from 16 to 32 gains only 25Elo talking about good scaling is ridiculous. Or if with classic based eval one gains 40Elo going from 16 to 32 threads and with NNUE eval only 25Elo, again we can't just claim all is great.
+25 for 32 vs 16 is pretty good, actually. try this with YBW, then come back :)
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Re: Komodo Dragon - 16 vs 32 threads

Post by fastgm »

Same conditions, 5 min + 3 sec
Hash-Table: 16384 MB

Komodo Dragon AVX2 32 threads vs Komodo Dragon AVX2 16 threads, 522 games

+23 Elo

Code: Select all

Komodo Dragon T32   +23  +44/=468/-10 53.26%  278.0/522
Komodo Dragon T16   -23  +10/=468/-44 46.74%  244.0/522

Engine                 Depth       Time   Games     Moves  Average    MIDG   EARLY    ENDG    LATE
Komodo Dragon T32      31.69   82:25:39     522     56514    5.25    29.57 | 31.64 | 32.94 | 32.62
Komodo Dragon T16      30.63   82:20:22     522     56489    5.25    28.44 | 30.11 | 31.93 | 31.60
Games:
http://www.fastgm.de/schach/K-Dragon-T32-T16-300+3.7z