Komodo seems the best in closed positions

[Laskos]

I filtered one of the FGRL PGN databases for games having at least 6 pawns (6,7,8) each side to move 50. The resulting PGN of closed mostly midgame positions was fed as openings to a Round-Robin of 1400 games at 60'' + 0.6'' between top 8 engines.

The usual positions are similar to following:

[D]2r5/2p1rpkp/1p1p1qp1/pP1Q4/P1P1PP2/6PP/5R1K/5R2 w - - 1 51

[D]3r4/p4p1k/1pbr2p1/2nNp1q1/2P1P2p/P1Q1R2P/2P1BPP1/3R2K1 w - - 2 51

[D]3r2k1/1b2qppr/4p2p/pPnpP2P/P1p2N2/2P1R1P1/Q4PBK/3R4 w - - 25 51

The PGN of 1118 "opening" positions is here:
http://s000.tinyupload.com/index.php?fi ... 5634484625

The result was a bit surprising, Komodo 10.3 is ahead of a recent asmFish, which is stronger than Komodo 10.3 at this time control by 60-90 ELO points from regular openings:

Code: Select all

Games Completed = 1400 of 1400 (Avg game length = 124.367 sec)
Settings = RR/64MB/60000ms+600ms/M 500cp for 3 moves, D 120 moves/PGN:C:\LittleBlitzer\AtLeast6pawn.pgn(1118)
Time = 43690 sec elapsed, 0 sec remaining

 1.  Komodo 10.3 64-bit       	219.0/350	134-46-170  	(tpm=1558.3 d=25.97 nps=2302863)
 2.  asmFishW_2017-02-15_popcnt  209.5/350	120-51-179  	(tpm=1505.3 d=29.28 nps=2960203)
 3.  Houdini 5.01 Pro x64-popc	199.5/350	107-58-185  	(tpm=1511.6 d=22.30 nps=2744216)
 4.  Fire 5 x64               	174.5/350	80-81-189  	 (tpm=1453.4 d=20.86 nps=2351251)
 5.  Deep Shredder 13 x64     	170.0/350	79-89-182  	 (tpm=1681.2 d=28.12 nps=2481086)
 6.  Fizbo 1.9                	164.5/350	78-99-173  	 (tpm=1664.6 d=19.85 nps=1912900)
 7.  Andscacs 0.89            	139.5/350	50-121-179  	(tpm=1544.7 d=23.85 nps=1523463)
 8.  Texel 1.06               	123.5/350	43-146-161  	(tpm=1602.0 d=18.39 nps=1968017)

Andscacs seems to underperform in closed positions, maybe Daniel reads this.

[Leto]

Good find Kai. Hopefully this helps Stockfish become stronger.

[cdani]

Andscacs seems to underperform in closed positions, maybe Daniel reads this.

Thanks! I will review this

[JJJ]

That's could also mean Komodo should improve more in open position than in closed.

[Laskos]

That's could also mean Komodo should improve more in open position than in closed.

Yes, maybe this is more important. Closed positions are not that easy to reach if the opponent is determined to open them. Closed positions are in fact a minority of midgames.

[carldaman]

That's could also mean Komodo should improve more in open position than in closed.

Yes, maybe this is more important. Closed positions are not that easy to reach if the opponent is determined to open them. Closed positions are in fact a minority of midgames.

Is this based on engine vs engine games only? The percentage may change if the opponents are skilled humans, as they can consciously attempt to keep the positions closed.

[Laskos]

That's could also mean Komodo should improve more in open position than in closed.

Yes, maybe this is more important. Closed positions are not that easy to reach if the opponent is determined to open them. Closed positions are in fact a minority of midgames.

Is this based on engine vs engine games only? The percentage may change if the opponents are skilled humans, as they can consciously attempt to keep the positions closed.

Both engine and human games. Only 10-30% of midgames are closed ones, probably skilled humans more than engines. In human games, usually both players need to agree to a closed game, if one tries to open it, he usually succeeds.

[Henrik Dinesen]

That's could also mean Komodo should improve more in open position than in closed.

Yes, maybe this is more important. Closed positions are not that easy to reach if the opponent is determined to open them. Closed positions are in fact a minority of midgames.

My general impression is, that engines is already extremely strong in open and semi.open postions, so in fact, when you addressed the issue with closed, my thought was, that was because they (the engines) could improve (a lot) more in those. That's at least what I believe.

[Amateur]

news about new komodo's version?

[lkaufman]

news about new komodo's version?

There has been no slowdown in our rate of progress, but no decision yet on next release.