My test for Stockfish_22011019_x64_bmi2

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Dann Corbit, Harvey Williamson

amanjpro
Posts: 883
Joined: Sat Mar 13, 2021 1:47 am
Full name: Amanj Sherwany

Re: My test for Stockfish_22011019_x64_bmi2

Post by amanjpro »

Sylwy wrote: Wed Jan 12, 2022 4:09 pm
connor_mcmonigle wrote: Wed Jan 12, 2022 3:39 pm You're testing books rather than engines.
1.-Just your opinion!
False, that is a fact. Now you are the one who has an opinion, that is basically untrue.
Sylwy wrote: Wed Jan 12, 2022 4:09 pm 2.-Kaira1.1.bin is a small engine book; Perfect_2010.abk is a larger one accompanying a popular GUI:

Image

Image

3.-the book is only used at the root where it basically has nothing to do with the engine logic. Not in search;
Book size is not really a factor, it is unfair either way. In your case Kayra has two books, SF has one...
Sylwy wrote: Wed Jan 12, 2022 4:09 pm 4.-SF hasn't polyglot book support. Why ?
Book support is a GUI concern not an engine one. A good GUI should be able to support different books for different engines. But still why not use the same polyglot book for both engines? Ah because you want to prove a point, sweet

If your GUI doesn't support polyglot, you are using the wrong tool, fix it
User avatar
Sylwy
Posts: 4435
Joined: Fri Apr 21, 2006 4:19 pm
Location: IASI - the historical capital of MOLDOVA
Full name: SilvianR

Re: My test for Stockfish_22011019_x64_bmi2

Post by Sylwy »

I have long been clear about who this is. The man who knows them all ...... or compulsions ......?

:lol:

Image
amanjpro
Posts: 883
Joined: Sat Mar 13, 2021 1:47 am
Full name: Amanj Sherwany

Re: My test for Stockfish_22011019_x64_bmi2

Post by amanjpro »

Sylwy wrote: Wed Jan 12, 2022 6:33 pm I have long been clear about who this is. The man who knows them all ...... or compulsions ......?

:lol:

Image

You are funny, I give you this :P
User avatar
Rebel
Posts: 6946
Joined: Thu Aug 18, 2011 12:04 pm

Re: My test for Stockfish_22011019_x64_bmi2

Post by Rebel »

Sylwy wrote: Wed Jan 12, 2022 4:09 pm
connor_mcmonigle wrote: Wed Jan 12, 2022 3:39 pm You're testing books rather than engines.
1.-Just your opinion!

2.-Kaira1.1.bin is a small engine book; Perfect_2010.abk is a larger one accompanying a popular GUI:

Image

Image

3.-the book is only used at the root where it basically has nothing to do with the engine logic. Not in search;

4.-SF hasn't polyglot book support. Why ?

And more. I stop here. I will come back with the final result of the match.
Sylvian, try the SOMU function "Double Openings" and watch the horror of the number of double games.
90% of coding is debugging, the other 10% is writing bugs.
mehmet123
Posts: 669
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: My test for Stockfish_22011019_x64_bmi2

Post by mehmet123 »

If we do the rematch of the match in a different condition , we can reach a clearer result.
Let Kayra 1.1 play with Perfect 10 book and let Stockfish Dev play with Kayra 1.1 book.
mehmet123
Posts: 669
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: My test for Stockfish_22011019_x64_bmi2

Post by mehmet123 »

Arena Gui is the most downloaded chess program after Stockfish. It is strange that Arena still uses the Perfect 2010 opening book as the official book instead of Perfect 2021. And the standart chess engines came with Arena are 10- 20 year old chess programs. I don't think anyone uses these chess engines except those who love nostalgic chess programs.
User avatar
Sylwy
Posts: 4435
Joined: Fri Apr 21, 2006 4:19 pm
Location: IASI - the historical capital of MOLDOVA
Full name: SilvianR

Re: My test for Stockfish_22011019_x64_bmi2

Post by Sylwy »

mehmet123 wrote: Thu Jan 13, 2022 7:29 am Arena Gui is the most downloaded chess program after Stockfish. It is strange that Arena still uses the Perfect 2010 opening book as the official book instead of Perfect 2021. And the standart chess engines came with Arena are 10- 20 year old chess programs. I don't think anyone uses these chess engines except those who love nostalgic chess programs.
Yeah, Arena GUI is a great graphical interface with plenty of capabilities. Arena partner engines? Yes, a lot of nostalgia. Many have made the era. I have several hundred engines installed on the Arena 3.5.1 GUI! From all ages ...... and even from the multiverse. :lol:

The final result of the match that caused yesterday's hysteria of my "friends" ( :lol: & co):

Image

+8 -0 =92
+28 Elo points

I just replayed the match on Hiarcs Chess Explorer Pro v1.0 using the same Hiarcs book for both engines. The result - so far - is still poor for SF.

Talkchess "scientists" have not yet answered point 3.-the book is only used at the root where it basically has nothing to do with the engine logic. Not in search.
I see the role of the book only for the variety of the opening, not something like a monster like Cerebellum. Just a few moves in the opening. The rest is engine logic. Otherwise it's just statistics.
I will come back with other matches. I'll see when!
Have a nice day !
connor_mcmonigle
Posts: 510
Joined: Sun Sep 06, 2020 4:40 am
Full name: Connor McMonigle

Re: My test for Stockfish_22011019_x64_bmi2

Post by connor_mcmonigle »

Sylwy wrote: Thu Jan 13, 2022 11:38 am
mehmet123 wrote: Thu Jan 13, 2022 7:29 am Arena Gui is the most downloaded chess program after Stockfish. It is strange that Arena still uses the Perfect 2010 opening book as the official book instead of Perfect 2021. And the standart chess engines came with Arena are 10- 20 year old chess programs. I don't think anyone uses these chess engines except those who love nostalgic chess programs.
Yeah, Arena GUI is a great graphical interface with plenty of capabilities. Arena partner engines? Yes, a lot of nostalgia. Many have made the era. I have several hundred engines installed on the Arena 3.5.1 GUI! From all ages ...... and even from the multiverse. :lol:

The final result of the match that caused yesterday's hysteria of my "friends" ( :lol: & co):

Image

+8 -0 =92
+28 Elo points

I just replayed the match on Hiarcs Chess Explorer Pro v1.0 using the same Hiarcs book for both engines. The result - so far - is still poor for SF.

Talkchess "scientists" have not yet answered point 3.-the book is only used at the root where it basically has nothing to do with the engine logic. Not in search.
I see the role of the book only for the variety of the opening, not something like a monster like Cerebellum. Just a few moves in the opening. The rest is engine logic. Otherwise it's just statistics.
I will come back with other matches. I'll see when!
Have a nice day !
If a book forces the engine to play inferior moves in the opening, of course the engine is going to perform worse. It's unclear why you find this surprising. Introducing another manipulated variable to any test makes drawing conclusions about the impact of any one of the manipulated variables impossible. This isn't my opinion, this is fact. If variety is all you're after, you should just use some large book of forced opening lines and insure that openings are repeated across game pairs to minimize noise as is well established best practice.

Needless to say, 100 games is still insufficient to draw any conclusions, but you're certainly making the situation even worse.
User avatar
Eduard
Posts: 1306
Joined: Sat Oct 27, 2018 12:58 am
Location: Germany
Full name: Eduard Nemeth

Re: My test for Stockfish_22011019_x64_bmi2

Post by Eduard »

I don't want to do any more tests, but I took a quick look at the variants.

An old book from 2010 is not competitive. The engines back then were weaker, so the book versions are also weaker.

In addition, openings like Caro Kann and French are difficult to defend. Even harder with a book from 2010.

My little Kayra book is based on the best games on servers with some monster hardware. It is therefore only normal if Kayra wins with Kayra1.1.bin.

It would be interesting to see if a book from Hiarcs 15 can do something against Kayra1.1.bin?
mehmet123
Posts: 669
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: My test for Stockfish_22011019_x64_bmi2

Post by mehmet123 »

Although Kayra 1.1 is a very small opening book (435 kbyte !!), it shows good performance in the SCCT Book Tournament where very strong opening books compete.
https://sites.google.com/site/computers ... book-cs-59