Test-summary of various opening-sets

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
pohl4711
Posts: 2435
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Test-summary of various opening-sets

Post by pohl4711 »

Here some testing-results of some opening-sets - all with the same conditions (asmFish 170426 vs. Komodo 10.4, 5'+3'', singlecore, 256MB Hash, no endgame-bases, no ponder, both engines with Contempt=+15, 1000 games, if the openingset has at least 500 positions, otherwise all positions of the openingset were played twice (repeated with reversed colors))

All results and details and download of most of the games on my website ("SALC openings"- section (scroll down a little bit)):
http://www.sp-cc.de/salc-openings.htm

Stockfish Framework 8 move openings: Score 60.3% - 39.7%, draws: 63.4%
FEOBOS v20 contempt 5 Top500: Score 58.7% - 41.3%, draws: 64.1%
HERT 500: Score: 60.6% - 39.4%, draws: 60.4%
Noomen Gambit-Lines: Score 59.1% - 40.9%, draws: 59.3%
Old SALC V2: Score: 62.1% - 37.9%, draws: 53.9%
Noomen TCEC Superfinal (Season 9+10): Score: 62.5% - 37.5%, draws: 50.0%
SALC V5 half-closed: Score 61.6% - 38.4%, draws: 49.2%
SALC V5 full-closed 500 positions: Score 66.5% - 33.5%, draws: 47.7%
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Test-summary of various opening-sets

Post by Dann Corbit »

I would very much like to get the PGN, especially if it is decorated with the evaluations and depths created by the engines.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
pohl4711
Posts: 2435
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: Test-summary of various opening-sets

Post by pohl4711 »

The download is on my website (see first post) nearby the results-summary, but I use LittleBlitzer, and LittleBlitzer does not save evals,time, depth - only the moves.
User avatar
pohl4711
Posts: 2435
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: Test-summary of various opening-sets

Post by pohl4711 »

pohl4711 wrote:The download is on my website (see first post) nearby the results-summary, but I use LittleBlitzer, and LittleBlitzer does not save evals,time, depth - only the moves.
The 2 first testruns (Stockfish Framework 8 move openings and Old SALC V2), the games were lost, because of the death of my external HDD...