Stockfish and Multi-PV

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
Rebel
Posts: 4703
Joined: Thu Aug 18, 2011 10:04 am

Re: Stockfish and Multi-PV

Post by Rebel » Fri Jun 07, 2019 4:01 am

Lots of truth in there. We need a CCRL shorty rating list. A couple of years ago I (out of curiosity) played a shorty match between 2 equal rated versions of Stockfish and Komodo and the latter was crushed. And I concluded Stockfish had the better opening code. Now I know better lol. What you said, the last bastion. We need a new competition to tickle the programmers.
Everybody is unique, except me.

MikeB
Posts: 3461
Joined: Thu Mar 09, 2006 5:34 am
Location: Pen Argyl, Pennsylvania

Re: Stockfish and Multi-PV

Post by MikeB » Fri Jun 07, 2019 5:53 am

Rebel wrote:
Fri Jun 07, 2019 4:01 am
Lots of truth in there. We need a CCRL shorty rating list. A couple of years ago I (out of curiosity) played a shorty match between 2 equal rated versions of Stockfish and Komodo and the latter was crushed. And I concluded Stockfish had the better opening code. Now I know better lol. What you said, the last bastion. We need a new competition to tickle the programmers.
Stockfish could use an opening phase function in its evaluation. My thought was that HIARCS always seemed to play pretty well without an opening book - but that was from observations years ago - not sure today If i would have the same opinion.

User avatar
Rebel
Posts: 4703
Joined: Thu Aug 18, 2011 10:04 am

Re: Stockfish and Multi-PV

Post by Rebel » Fri Jun 07, 2019 10:32 am

One idea would be to create a STS type of opening set rating engines with MEA from Ferdy.

Such as:
1.d4 and 1.e4 10 points
1.c4 and 1.Nf3 8 points
1.f4 6 points

etc.

http://rebel13.nl/rebel13/experiments.html#six
Last edited by Rebel on Fri Jun 07, 2019 10:45 am, edited 1 time in total.
Everybody is unique, except me.

jp
Posts: 818
Joined: Mon Apr 23, 2018 5:54 am

Re: Stockfish and Multi-PV

Post by jp » Fri Jun 07, 2019 10:43 am

Ovyron wrote:
Fri Jun 07, 2019 3:37 am
Rebel wrote:
Mon Jun 03, 2019 1:29 pm
I think I am wasting my time looking at the moves it sometimes produces.
This situation happened because engine testers chose to play with generic books that take over the opening and play reasonable moves for the engine, and when the engine has to play it already skipped the problem entirely.

Engine developers have had no reason whatsoever to get better at the opening, and self-play has had a similar resolution. The elo chase is real

InfinityChess's Chess Engine Master tournament has shown that Leela isn't good at the openings either
That's why it's bad to give Leela tablebases. There needs to be incentive to improve its endgame play.

User avatar
Ovyron
Posts: 2706
Joined: Tue Jul 03, 2007 2:30 am

Re: Stockfish and Multi-PV

Post by Ovyron » Wed Jun 12, 2019 8:53 am

Rebel wrote:
Fri Jun 07, 2019 10:32 am
Such as:
1.d4 and 1.e4 10 points
1.c4 and 1.Nf3 8 points
1.f4 6 points
Hmmm, what recent developments in opening theory have showed me is that I'm not sure anymore if our preconceptions about what opening moves are best is good.

This started because of the bin book I downloaded that was bugged, and played 1.Nc3 no matter what, and I had a great performance with it. Then someone beat me with the black pieces, and I took a look, and noticed 1.Nc3 had 0% probability. I "fixed" it, and the book was now playing 1.e4 and 1.d4 as it should. And with those moves people keep beating me with the black pieces and have had the worst performance since then.

What if 1.Nc3 is a great move but people haven't found about it because it's an undiscovered gem? I have been using it to beat +2000 rated players on lichess.com and got 2nd place on < chess.com tourney, no way I could have done that with 1.e4 or 1.d4.

Should we give 1.Nc3 11 points in the test your propose? What if Rybka 2.2n2 (that loves the move) is best on the opening, but plays really badly the early middle game that nobody knows?

Maybe what we need is software like Aiquiry, that allows one engine to be used "as book", to play without book assistance until some point in the game, then switches to Stockfish, or some other at some point in the game, and we see how this new chess entity plays, maybe it'll play better than Stockfish without book all game, maybe some engine can push Leela's results beyond what we've seen. Maybe some engine without book with very low rating helps discover a new variation that is great that nobody has paid attention to because that engine misplays the positions.

The sky is the limit, but we have no idea of what openings are best, just what current entities are best at, but top Correspondence chess players, those that play at 2 years per game time control, have a preferrence of 1.c4 over 1.d4 or 1.e4, because at that level it's easier to with with c4. It's a bit mysterious.
Great spirits have always encountered violent opposition from mediocre minds.

Post Reply