Komodo: My humble tournament

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
RJN
Posts: 303
Joined: Fri Jun 21, 2013 5:18 am
Location: Orion Spiral Arm

Re: Komodo: My humble tournament

Post by RJN »

Vinvin wrote:Hello Rob, would mind to add Stockfish 10082013 in your tournament ( http://www.talkchess.com/forum/viewtopic.php?t=48929 ) ?
Hi Vincent

I took a look at the Stockfish dev download page, and did not see this version.

As far as adding an additional engine to the tournament, I don't want too many dev variations of Stockfish, since it's being updated with such frequency. Also, this tournament was mainly to test Komodo. I was on the FishTest team for a bit, and only have limited resources, but don't mind contributing again by adding another Stockfish to my tournament.

That said, is 10082013 the most useful version I can test at this point?....and where can I find it, if not on the Stockfish dev list?

BTW, anyone else reading this can feel free to chime in.
Vinvin
Posts: 5296
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Komodo: My humble tournament

Post by Vinvin »

RJN wrote:
Vinvin wrote:Hello Rob, would mind to add Stockfish 10082013 in your tournament ( http://www.talkchess.com/forum/viewtopic.php?t=48929 ) ?
Hi Vincent

I took a look at the Stockfish dev download page, and did not see this version.

As far as adding an additional engine to the tournament, I don't want too many dev variations of Stockfish, since it's being updated with such frequency. Also, this tournament was mainly to test Komodo. I was on the FishTest team for a bit, and only have limited resources, but don't mind contributing again by adding another Stockfish to my tournament.

That said, is 10082013 the most useful version I can test at this point?....and where can I find it, if not on the Stockfish dev list?

BTW, anyone else reading this can feel free to chime in.
Yes, it's on this list : 2013-08-10 but later versions are may be stronger ...
User avatar
RJN
Posts: 303
Joined: Fri Jun 21, 2013 5:18 am
Location: Orion Spiral Arm

Re: Komodo: My humble tournament

Post by RJN »

New Stockfish added to tournament: DEV August 13, 2013.

Author: Ryan Takker
Date: Tue Aug 13 07:36:33 2013 +0200
Timestamp: 1376372193

http://abrok.eu/stockfish/

I like that there is now an "automatic" min split depth option (when set at 0).

BTW, I see that the DEV list for stockfish has already been updated with yet another version today, the same day I downloaded this one!!

Note: I took "modern" out of the new Stockfish name below, to neaten it up a bit.


2719 games played

8/13/2013 2:48:26 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO-NONE : 3061 18 18 773 60.1 % 2990 46.4 %
2 Stockfish_13081307_x64_sse42 : 3023 79 78 33 53.0 % 3002 57.6 %
3 Komodo51r1-64bit : 3015 16 16 776 52.6 % 2997 55.2 %
4 Komodo51-64bit : 3013 16 16 773 52.3 % 2998 57.4 %
5 Komodo51r2-64bit : 3004 17 17 775 50.7 % 2999 52.4 %
6 Stockfish-3-64-pop-ja : 2988 18 18 762 48.0 % 3002 48.4 %
7 Critter_1.6a_64bit : 2987 17 18 773 47.8 % 3002 49.0 %
8 Deep Rybka 4.1 SSE42 x64 : 2930 18 18 773 38.4 % 3012 46.6 %
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Komodo: My humble tournament

Post by beram »

RJN wrote:New Stockfish added to tournament: DEV August 13, 2013.

Author: Ryan Takker
Date: Tue Aug 13 07:36:33 2013 +0200
Timestamp: 1376372193

http://abrok.eu/stockfish/

I like that there is now an "automatic" min split depth option (when set at 0).

BTW, I see that the DEV list for stockfish has already been updated with yet another version today, the same day I downloaded this one!!

Note: I took "modern" out of the new Stockfish name below, to neaten it up a bit.


2719 games played

8/13/2013 2:48:26 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO-NONE : 3061 18 18 773 60.1 % 2990 46.4 %
2 Stockfish_13081307_x64_sse42 : 3023 79 78 33 53.0 % 3002 57.6 %
3 Komodo51r1-64bit : 3015 16 16 776 52.6 % 2997 55.2 %
4 Komodo51-64bit : 3013 16 16 773 52.3 % 2998 57.4 %
5 Komodo51r2-64bit : 3004 17 17 775 50.7 % 2999 52.4 %
6 Stockfish-3-64-pop-ja : 2988 18 18 762 48.0 % 3002 48.4 %
7 Critter_1.6a_64bit : 2987 17 18 773 47.8 % 3002 49.0 %
8 Deep Rybka 4.1 SSE42 x64 : 2930 18 18 773 38.4 % 3012 46.6 %
Thx, for your great _not so humble_ tournament
Lets see if the new Stockfish becomes the new number two after master Houdini
User avatar
RJN
Posts: 303
Joined: Fri Jun 21, 2013 5:18 am
Location: Orion Spiral Arm

Re: Komodo: My humble tournament

Post by RJN »

2760 games played

8/14/2013 4:12:04 AM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO-NONE : 3060 18 18 779 59.9 % 2990 46.5 %
2 Komodo51r1-64bit : 3016 16 16 782 52.6 % 2997 55.1 %
3 Komodo51-64bit : 3013 16 16 778 52.2 % 2998 57.2 %
4 Stockfish_13081307_x64_sse42 : 3006 53 53 74 50.7 % 3001 55.4 %
5 Komodo51r2-64bit : 3005 17 17 781 50.8 % 2999 52.5 %
6 Stockfish-3-64-pop-ja : 2988 18 18 768 48.0 % 3002 48.6 %
7 Critter_1.6a_64bit : 2987 17 17 779 47.8 % 3002 49.2 %
8 Deep Rybka 4.1 SSE42 x64 : 2930 18 18 779 38.4 % 3012 46.6 %
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Komodo: My humble tournament

Post by kranium »

with no book (i.e. games beginning from the start position),
...it will be interesting to see if you have duplicate games

if so, no big deal IMO, they can be easily weeded out if need be...(SCID comes to mind)
are you going to make the PGN available?
User avatar
RJN
Posts: 303
Joined: Fri Jun 21, 2013 5:18 am
Location: Orion Spiral Arm

Re: Komodo: My humble tournament

Post by RJN »

kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Komodo: My humble tournament

Post by kranium »

cool...
chessbase: no doubles found
User avatar
RJN
Posts: 303
Joined: Fri Jun 21, 2013 5:18 am
Location: Orion Spiral Arm

Re: Komodo: My humble tournament

Post by RJN »

I'm sure there are lots of repeat openings though!

Norman, do you have a way to list the frequency of each opening from the PGN?

I have PGN-extract, which I am am not fluent in, but it's probably quicker for you to do using Chessbase, or something which I don't have.
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Komodo: My humble tournament

Post by beram »

RJN wrote:I'm sure there are lots of repeat openings though!

Norman, do you have a way to list the frequency of each opening from the PGN?

I have PGN-extract, which I am am not fluent in, but it's probably quicker for you to do using Chessbase, or something which I don't have.
Well if I may be so free to answer. You can use SCID thats a free chess database program, which has a lot of tools and options such as Player report:
Because you have not used an openingbook we can perhaps see something of the playing style by using this option
When you comparise them we can observe the liking of opposite castling, kingside pawnstorm etc. etc.
It looks as if Houdini wants to hold his queen the most and that Komodo wants to castle same side and that Stockfish likes pawnstorm at kingside the most

3.2 Positional Themes Houdini 3 white

Code: Select all

Frequency of themes in the first 20 moves of each game:
Same-side castling:	54%	White Isolated Queen Pawn:	7%
Opposite castling:	35%	Black Isolated Queen Pawn:	4%
Kingside pawn storm:	9%	White Pawn on 5/6/7th rank:	38%
Queens exchanged:	34%	Black Pawn on 2/3/4th rank:	48%
Only one side has Bishop pair:	21%	Open c/d/e file:	29%
3.2 Positional Themes Komodo 5.1MP white (I have put all three versions together)

Code: Select all

Frequency of themes in the first 20 moves of each game:
Same-side castling:	85%	White Isolated Queen Pawn:	11%
Opposite castling:	5%	Black Isolated Queen Pawn:	9%
Kingside pawn storm:	10%	White Pawn on 5/6/7th rank:	49%
Queens exchanged:	43%	Black Pawn on 2/3/4th rank:	26%
Only one side has Bishop pair:	2%	Open c/d/e file:	46%
3.2 Positional Themes Stockfish 3 white

Code: Select all

Frequency of themes in the first 20 moves of each game:
Same-side castling:	51%	White Isolated Queen Pawn:	5%
Opposite castling:	41%	Black Isolated Queen Pawn:	7%
Kingside pawn storm:	23%	White Pawn on 5/6/7th rank:	31%
Queens exchanged:	68%	Black Pawn on 2/3/4th rank:	36%
Only one side has Bishop pair:	11%	Open c/d/e file:	57%

grts Bram