Komodo Dragon 2 released.

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Cornfed
Posts: 511
Joined: Sun Apr 26, 2020 11:40 pm
Full name: Brian D. Smith

Re: Komodo Dragon 2 released.

Post by Cornfed »

Krzysztof Grzelak wrote: Sun May 16, 2021 8:08 pm
Cornfed wrote: Sun May 16, 2021 6:38 pm Of course everyone KNOWS what you meant...'it's a pity' you said it so poorly.

However, you do not appear to have read WHY Dragon 2 was released. It has value to those who use it for certain purposes as some items got a nice improvement.
What you write nonsense and stupidity. Not interested in improvements, I'm interested in the power of the game.
I'll take that as a compliment....

Explain "the power of the game"? I presume English is not your native language...which means you need to stick more to specifics and less to generalities if you actually want people to understand....otherwise, you tend to sound like a crank.
KLc
Posts: 140
Joined: Wed Jun 03, 2020 6:46 am
Full name: Kurt Lanc

Re: Komodo Dragon 2 released.

Post by KLc »

Cornfed wrote: Sun May 16, 2021 9:27 pm Explain "the power of the game"? I presume English is not your native language...which means you need to stick more to specifics and less to generalities if you actually want people to understand....otherwise, you tend to sound like a crank.
I forgot what people used to say before the social media era but: +1 :!:
the_real_greco
Posts: 70
Joined: Thu Sep 19, 2019 5:55 am
Full name: Andy!

Re: Komodo Dragon 2 released.

Post by the_real_greco »

Krzysztof Grzelak wrote: Sun May 16, 2021 11:09 pm
Cornfed wrote: Sun May 16, 2021 9:27 pm Explain "the power of the game"? I presume English is not your native language...which means you need to stick more to specifics and less to generalities if you actually want people to understand....otherwise, you tend to sound like a crank.
If not you understand what I am writing, about it I am sorry.
There are people out there (including me and you) who have interest in engine tournaments or correspondence chess. We only get excited when an engine is stronger compared to other engines. But we are the minority.

For everybody else, it's more important to have a engine that is easier to use. Or can come up with new ideas. Or something. Whether Dragon 2 was +100 or +0 Elo against Dragon 1, doesn't really matter.

And it's the second group of people that will buy more copies of Dragon. So it should be no surprise that a new Dragon version, has updates targeted to them.
User avatar
pohl4711
Posts: 2954
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: Komodo Dragon 2 released.

Post by pohl4711 »

lkaufman wrote: Tue May 04, 2021 5:53 pm We believe that the MultiPV search is now more effective than the Stockfish MultiPV search, and that if MultiPV is set to more than 4
Dragon 2 is now the favorite against Stockfish 13 on typical modern hardware.
I did a huge, experimental RoundRobin tournament with 3 engines (Stockfish 13, KomodoDragon 1.0 and KomodoDragon 2.0), each with 4 different MultiPV-settings (1-4, were 1 is the normal, default playing mode). Goal: Measure, how much Elo is lost by calculating more than on PV-line. And to measure, if Dragon 2.0 has less Elo-loss here, than Dragon 1.0, and if Dragon 2.0 is on one Elo-level with Stockfish 13, when both engines are running with MultiPV=4.
Tournament with 2'+1'' thinking-time on an old QuadcoreCPU, singelthread-mode, no ponder, no bases (except for cutechess-cli, to end a game), cutechess-cli, classical 4 moves deep openings, played by humans (out of Megabase 2020, both players 2400 Elo or better). 100 rounds = 6600 games played.

See the results (and download the games) on my website:

https://www.sp-cc.de/experiments.htm
Pi4Chess
Posts: 253
Joined: Mon Nov 16, 2020 12:13 pm
Full name: Manuel Rivera

Re: Komodo Dragon 2 released.

Post by Pi4Chess »

pohl4711 wrote: Mon May 24, 2021 10:28 am
lkaufman wrote: Tue May 04, 2021 5:53 pm We believe that the MultiPV search is now more effective than the Stockfish MultiPV search, and that if MultiPV is set to more than 4
Dragon 2 is now the favorite against Stockfish 13 on typical modern hardware.
I did a huge, experimental RoundRobin tournament with 3 engines (Stockfish 13, KomodoDragon 1.0 and KomodoDragon 2.0), each with 4 different MultiPV-settings (1-4, were 1 is the normal, default playing mode). Goal: Measure, how much Elo is lost by calculating more than on PV-line. And to measure, if Dragon 2.0 has less Elo-loss here, than Dragon 1.0, and if Dragon 2.0 is on one Elo-level with Stockfish 13, when both engines are running with MultiPV=4.
Tournament with 2'+1'' thinking-time on an old QuadcoreCPU, singelthread-mode, no ponder, no bases (except for cutechess-cli, to end a game), cutechess-cli, classical 4 moves deep openings, played by humans (out of Megabase 2020, both players 2400 Elo or better). 100 rounds = 6600 games played.

See the results (and download the games) on my website:

https://www.sp-cc.de/experiments.htm
Thanks again for all the fantastic testing and information you are sharing !
User avatar
pohl4711
Posts: 2954
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: Komodo Dragon 2 released.

Post by pohl4711 »

Pi4Chess wrote: Mon May 24, 2021 2:09 pm
Thanks again for all the fantastic testing and information you are sharing !
My pleasure. To be honest, this idea was not mine. I was asked about a MultiPV-testing by the contact function of my website... After a sleepover, I thought, this was an interesting request, because a lot of people use engines in MultiPV-mode for analyzing human games. And I could not find valid testing results for this engine-mode. so, I did it by myself.
Interesting fact: The Elo-loss of KomodoDragon 2.0 is only around -30 Elo, if MultiPV is increased +1 in my test-tournament, the Elo-loss of SF 13 is around -60 Elo, so if MultiPV is set to 5-6, KomodoDragon 2.0 should be at the same Elo-level as SF 13. But in reality, most people use engines for analyzing with MultiPV 2,3 or 4, I believe. Nevertheless, the small Elo-loss of only -30 Elo of KomodoDragon 2.0 is quite impressive.
Cornfed
Posts: 511
Joined: Sun Apr 26, 2020 11:40 pm
Full name: Brian D. Smith

Re: Komodo Dragon 2 released.

Post by Cornfed »

pohl4711 wrote: Mon May 24, 2021 5:39 pm
Pi4Chess wrote: Mon May 24, 2021 2:09 pm
Thanks again for all the fantastic testing and information you are sharing !
My pleasure. To be honest, this idea was not mine. I was asked about a MultiPV-testing by the contact function of my website... After a sleepover, I thought, this was an interesting request, because a lot of people use engines in MultiPV-mode for analyzing human games. And I could not find valid testing results for this engine-mode. so, I did it by myself.
Interesting fact: The Elo-loss of KomodoDragon 2.0 is only around -30 Elo, if MultiPV is increased +1 in my test-tournament, the Elo-loss of SF 13 is around -60 Elo, so if MultiPV is set to 5-6, KomodoDragon 2.0 should be at the same Elo-level as SF 13. But in reality, most people use engines for analyzing with MultiPV 2,3 or 4, I believe. Nevertheless, the small Elo-loss of only -30 Elo of KomodoDragon 2.0 is quite impressive.
Nice to see actual 'flesh on the bone' of the general idea that KomDragon loses less ELO the greater the pv!

So, is it fair to say

SF 13, 4pv = 3544
KDragon 2, 4pv = 3499

is the break and maybe 5pv and greater leads to an = or slight edge for KDragon 2? I mean, you do not try 5pv, but one might think that is the case given the trendline.
lkaufman
Posts: 6305
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: Komodo Dragon 2 released.

Post by lkaufman »

Cornfed wrote: Mon May 24, 2021 7:01 pm
pohl4711 wrote: Mon May 24, 2021 5:39 pm
Pi4Chess wrote: Mon May 24, 2021 2:09 pm
Thanks again for all the fantastic testing and information you are sharing !
My pleasure. To be honest, this idea was not mine. I was asked about a MultiPV-testing by the contact function of my website... After a sleepover, I thought, this was an interesting request, because a lot of people use engines in MultiPV-mode for analyzing human games. And I could not find valid testing results for this engine-mode. so, I did it by myself.
Interesting fact: The Elo-loss of KomodoDragon 2.0 is only around -30 Elo, if MultiPV is increased +1 in my test-tournament, the Elo-loss of SF 13 is around -60 Elo, so if MultiPV is set to 5-6, KomodoDragon 2.0 should be at the same Elo-level as SF 13. But in reality, most people use engines for analyzing with MultiPV 2,3 or 4, I believe. Nevertheless, the small Elo-loss of only -30 Elo of KomodoDragon 2.0 is quite impressive.
Nice to see actual 'flesh on the bone' of the general idea that KomDragon loses less ELO the greater the pv!

So, is it fair to say

SF 13, 4pv = 3544
KDragon 2, 4pv = 3499

is the break and maybe 5pv and greater leads to an = or slight edge for KDragon 2? I mean, you do not try 5pv, but one might think that is the case given the trendline.
Our own testing had them dead even with MPV=5, but I tested on four threads, while this test is single thread. I don't know which program this would favor, but any difference in results would probably be due to this difference in the testing.
Komodo rules!
gaard
Posts: 464
Joined: Mon Jun 07, 2010 3:13 am
Location: Holland, MI
Full name: Martin W

Re: Komodo Dragon 2 released.

Post by gaard »

Cornfed wrote: Mon May 24, 2021 7:01 pm
pohl4711 wrote: Mon May 24, 2021 5:39 pm
Pi4Chess wrote: Mon May 24, 2021 2:09 pm
Thanks again for all the fantastic testing and information you are sharing !
My pleasure. To be honest, this idea was not mine. I was asked about a MultiPV-testing by the contact function of my website... After a sleepover, I thought, this was an interesting request, because a lot of people use engines in MultiPV-mode for analyzing human games. And I could not find valid testing results for this engine-mode. so, I did it by myself.
Interesting fact: The Elo-loss of KomodoDragon 2.0 is only around -30 Elo, if MultiPV is increased +1 in my test-tournament, the Elo-loss of SF 13 is around -60 Elo, so if MultiPV is set to 5-6, KomodoDragon 2.0 should be at the same Elo-level as SF 13. But in reality, most people use engines for analyzing with MultiPV 2,3 or 4, I believe. Nevertheless, the small Elo-loss of only -30 Elo of KomodoDragon 2.0 is quite impressive.
Nice to see actual 'flesh on the bone' of the general idea that KomDragon loses less ELO the greater the pv!

So, is it fair to say

SF 13, 4pv = 3544
KDragon 2, 4pv = 3499

is the break and maybe 5pv and greater leads to an = or slight edge for KDragon 2? I mean, you do not try 5pv, but one might think that is the case given the trendline.
I think a more useful metric would be comparing (say) the 5th best moves, when MultiPV = 5. Or at least, min(4, Number of Legal Moves), in base 0. Otherwise, it is quite trivial to make Stockfish search MultiPV moves 2+ with reduced depth, to produce a first move that is better. It's that fact which makes this current metric suspect, or at least, less than convincing.
jr66
Posts: 47
Joined: Sun May 23, 2021 6:04 pm
Full name: Jacques Ress

Re: Komodo Dragon 2 released.

Post by jr66 »

the_real_greco wrote: Mon May 17, 2021 3:22 am
Krzysztof Grzelak wrote: Sun May 16, 2021 11:09 pm
Cornfed wrote: Sun May 16, 2021 9:27 pm Explain "the power of the game"? I presume English is not your native language...which means you need to stick more to specifics and less to generalities if you actually want people to understand....otherwise, you tend to sound like a crank.
If not you understand what I am writing, about it I am sorry.
There are people out there (including me and you) who have interest in engine tournaments or correspondence chess. We only get excited when an engine is stronger compared to other engines. But we are the minority.

For everybody else, it's more important to have a engine that is easier to use. Or can come up with new ideas. Or something. Whether Dragon 2 was +100 or +0 Elo against Dragon 1, doesn't really matter.
As correspondance player, i don't search the better engine in the ultra fast time control engines rating lists !
Even if Stockfish and some derivatives seem the best in many situations, they are not in some others where Leela and why not Dragon can be better for a good reason : they are différent and not a derivative....
I don't think i am alone to think that ?
Regards
Jacques
IM ICCF player