Dragon 3.2 Released at KomodoChess.com

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Krzysztof Grzelak
Posts: 1585
Joined: Tue Jul 15, 2014 12:47 pm

Re: Dragon 3.2 Released at KomodoChess.com

Post by Krzysztof Grzelak »

Dariusz wrote: Tue Dec 20, 2022 2:03 pm
Krzysztof Grzelak wrote: Tue Dec 20, 2022 12:30 pm Your tests cannot be taken seriously.
Krzysztof, can you explain the reasoning behind your saying ?
Może odpowiem na Twoje pytanie Dariuszu po polsku a potem po angielsku. Dlaczego jego testów nie można brać poważnie - z powodu jednego bardzo ważnego czynnika. A tym czynnikiem jest książka debiutowa. Jego książka zła i nie nadaję się do testów. Aby nie być gołosłowny i kłamliwy, na pewnej stronie przeprowadzono test książek debiutowych, mówię tu o stronie https://sites.google.com/site/computers ... testings-2 i zauważ jak jego książka wypada - najgorzej z wszystkich książek. Jak to widzę to tylko przychodzi myśl w głowy - tragedia i rozpacz.

Why his tests cannot be taken seriously - because of one very important factor. His book is bad and I'm not up for testing. In order not to be groundless and deceitful, a test of debut books was conducted on a certain website, I'm talking about the site https://sites.google.com/site/computers ... testings-2 and notice how his book fares - the worst of all books. When I see it, the only thing that comes to mind is tragedy and despair.
dkappe
Posts: 1632
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Dragon 3.2 Released at KomodoChess.com

Post by dkappe »

Krzysztof Grzelak wrote: Tue Dec 20, 2022 3:48 pm
Dariusz wrote: Tue Dec 20, 2022 2:03 pm
Krzysztof Grzelak wrote: Tue Dec 20, 2022 12:30 pm Your tests cannot be taken seriously.
Krzysztof, can you explain the reasoning behind your saying ?
Why his tests cannot be taken seriously - because of one very important factor. His book is bad and I'm not up for testing. In order not to be groundless and deceitful, a test of debut books was conducted on a certain website, I'm talking about the site https://sites.google.com/site/computers ... testings-2 and notice how his book fares - the worst of all books. When I see it, the only thing that comes to mind is tragedy and despair.
Ouch! 100 game tests? The error margins are bigger than the elo diff in most cases. And the elo diff Cfish vs Kayra should be 15 elo a priori? Shouldn’t that be determined through extensive tests with some 30k games?

UHO accentuates the elo diff, so if with balanced openings we have 15 elo, with uho we should have 30 elo.

That page cannot be taken seriously. :lol:
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
User avatar
Gabor Szots
Posts: 1447
Joined: Sat Jul 21, 2018 7:43 am
Location: Budapest, Hungary
Full name: Gabor Szots

Re: Dragon 3.2 Released at KomodoChess.com

Post by Gabor Szots »

Krzysztof Grzelak wrote: Tue Dec 20, 2022 3:48 pm
Dariusz wrote: Tue Dec 20, 2022 2:03 pm
Krzysztof Grzelak wrote: Tue Dec 20, 2022 12:30 pm Your tests cannot be taken seriously.
Krzysztof, can you explain the reasoning behind your saying ?
Może odpowiem na Twoje pytanie Dariuszu po polsku a potem po angielsku. Dlaczego jego testów nie można brać poważnie - z powodu jednego bardzo ważnego czynnika. A tym czynnikiem jest książka debiutowa. Jego książka zła i nie nadaję się do testów. Aby nie być gołosłowny i kłamliwy, na pewnej stronie przeprowadzono test książek debiutowych, mówię tu o stronie https://sites.google.com/site/computers ... testings-2 i zauważ jak jego książka wypada - najgorzej z wszystkich książek. Jak to widzę to tylko przychodzi myśl w głowy - tragedia i rozpacz.

Why his tests cannot be taken seriously - because of one very important factor. His book is bad and I'm not up for testing. In order not to be groundless and deceitful, a test of debut books was conducted on a certain website, I'm talking about the site https://sites.google.com/site/computers ... testings-2 and notice how his book fares - the worst of all books. When I see it, the only thing that comes to mind is tragedy and despair.

If you test several books between 2 engines giving the same book to both, results will be meaningless. To test books you have to use the same engine against other ones (or even against itself) and give them different books.
Gabor Szots
CCRL testing group
Krzysztof Grzelak
Posts: 1585
Joined: Tue Jul 15, 2014 12:47 pm

Re: Dragon 3.2 Released at KomodoChess.com

Post by Krzysztof Grzelak »

dkappe wrote: Tue Dec 20, 2022 4:00 pm Ouch! 100 game tests? The error margins are bigger than the elo diff in most cases. And the elo diff Cfish vs Kayra should be 15 elo a priori? Shouldn’t that be determined through extensive tests with some 30k games?

UHO accentuates the elo diff, so if with balanced openings we have 15 elo, with uho we should have 30 elo.

That page cannot be taken seriously. :lol:
With more games, it can be even more of a tragedy.
kasinp
Posts: 259
Joined: Sat Dec 02, 2006 10:47 pm
Location: Toronto
Full name: Peter Kasinski

Re: Dragon 3.2 Released at KomodoChess.com

Post by kasinp »

A pleasant surprise. Given how difficult is to make progress, the fact that v3.2 clearly improves on a difficult test suite is impressive.
Not only did v3.2 find two more solutions, the time-to-solution was improved basically across the suite. Congrats to Komodo team!

Cheers,
Peter
Sopel
Posts: 391
Joined: Tue Oct 08, 2019 11:39 pm
Full name: Tomasz Sobczyk

Re: Dragon 3.2 Released at KomodoChess.com

Post by Sopel »

Krzysztof Grzelak wrote: Tue Dec 20, 2022 3:48 pm
Dariusz wrote: Tue Dec 20, 2022 2:03 pm
Krzysztof Grzelak wrote: Tue Dec 20, 2022 12:30 pm Your tests cannot be taken seriously.
Krzysztof, can you explain the reasoning behind your saying ?
Może odpowiem na Twoje pytanie Dariuszu po polsku a potem po angielsku. Dlaczego jego testów nie można brać poważnie - z powodu jednego bardzo ważnego czynnika. A tym czynnikiem jest książka debiutowa. Jego książka zła i nie nadaję się do testów. Aby nie być gołosłowny i kłamliwy, na pewnej stronie przeprowadzono test książek debiutowych, mówię tu o stronie https://sites.google.com/site/computers ... testings-2 i zauważ jak jego książka wypada - najgorzej z wszystkich książek. Jak to widzę to tylko przychodzi myśl w głowy - tragedia i rozpacz.

Why his tests cannot be taken seriously - because of one very important factor. His book is bad and I'm not up for testing. In order not to be groundless and deceitful, a test of debut books was conducted on a certain website, I'm talking about the site https://sites.google.com/site/computers ... testings-2 and notice how his book fares - the worst of all books. When I see it, the only thing that comes to mind is tragedy and despair.
UHO book looks the best actually. It has the highest resolution. Do you understand what the purpose of an opening book for testing is?
dangi12012 wrote:No one wants to touch anything you have posted. That proves you now have negative reputations since everyone knows already you are a forum troll.

Maybe you copied your stockfish commits from someone else too?
I will look into that.
ImNotStockfish
Posts: 56
Joined: Tue Sep 14, 2021 12:29 am
Full name: .

Re: Dragon 3.2 Released at KomodoChess.com

Post by ImNotStockfish »

Krzysztof Grzelak wrote: Tue Dec 20, 2022 3:48 pm
Dariusz wrote: Tue Dec 20, 2022 2:03 pm
Krzysztof Grzelak wrote: Tue Dec 20, 2022 12:30 pm Your tests cannot be taken seriously.
Krzysztof, can you explain the reasoning behind your saying ?
Może odpowiem na Twoje pytanie Dariuszu po polsku a potem po angielsku. Dlaczego jego testów nie można brać poważnie - z powodu jednego bardzo ważnego czynnika. A tym czynnikiem jest książka debiutowa. Jego książka zła i nie nadaję się do testów. Aby nie być gołosłowny i kłamliwy, na pewnej stronie przeprowadzono test książek debiutowych, mówię tu o stronie https://sites.google.com/site/computers ... testings-2 i zauważ jak jego książka wypada - najgorzej z wszystkich książek. Jak to widzę to tylko przychodzi myśl w głowy - tragedia i rozpacz.

Why his tests cannot be taken seriously - because of one very important factor. His book is bad and I'm not up for testing. In order not to be groundless and deceitful, a test of debut books was conducted on a certain website, I'm talking about the site https://sites.google.com/site/computers ... testings-2 and notice how his book fares - the worst of all books. When I see it, the only thing that comes to mind is tragedy and despair.
UHO is not meant to be a "good" or "strong" book, for that, you should use either no book at all or a book like "Perfect 2021".
UHO is meant to be a "bad" or "biased" book to exaggerate engine strength differences and realize more easily and with less games if your engine is superior to the competition, not to be used by humans.
criko
Posts: 153
Joined: Wed Feb 28, 2018 2:50 pm

Re: Dragon 3.2 Released at KomodoChess.com

Post by criko »

CornfedForever wrote: Tue Dec 20, 2022 2:45 pm
criko wrote: Tue Dec 20, 2022 8:48 am I get this :-(

Dragon 3.2 (C) 2022 Don Dailey, Larry Kaufman, Mark Lefler, Dmitry Pervov, and Dietrich Kappe
using hardware POPCNT
info string Licensed to illegal copy
info string embedded NN is loaded
"Sounds' like you got an illegal copy (?). Did you actually download it from the Komodo/Dragon website?
Downloaded from original website as a customer!!
CornfedForever
Posts: 648
Joined: Mon Jun 20, 2022 4:08 am
Full name: Brian D. Smith

Re: Dragon 3.2 Released at KomodoChess.com

Post by CornfedForever »

criko wrote: Tue Dec 20, 2022 5:29 pm
CornfedForever wrote: Tue Dec 20, 2022 2:45 pm
criko wrote: Tue Dec 20, 2022 8:48 am I get this :-(

Dragon 3.2 (C) 2022 Don Dailey, Larry Kaufman, Mark Lefler, Dmitry Pervov, and Dietrich Kappe
using hardware POPCNT
info string Licensed to illegal copy
info string embedded NN is loaded
"Sounds' like you got an illegal copy (?). Did you actually download it from the Komodo/Dragon website?
Downloaded from original website as a customer!!
True...why would an 'illegal' copy actually say 'illegal'. Perhaps it's some internal thing to ward of pirates or people who share their copies.
Krzysztof Grzelak
Posts: 1585
Joined: Tue Jul 15, 2014 12:47 pm

Re: Dragon 3.2 Released at KomodoChess.com

Post by Krzysztof Grzelak »

Sopel wrote: Tue Dec 20, 2022 5:19 pm UHO book looks the best actually. It has the highest resolution. Do you understand what the purpose of an opening book for testing is?
It's supposed to be fair.