Komodo: My humble tournament

[RJN]

Hi, my first post here. Thanks for all the contributions from everyone, volunteers, authors both commercial and freebies, too numerous to name. I'm a long time computer chess junkie since the days of Sargon, and even Atari Video Chess.

I know I don't hold a candle to some of the testers here (WOW!), but thought I would contribute what I have.

The following tournament is 40 in 5 minutes, repeating.
Round Robin

512MB hash
2 threads with hyperthreading turned off via Process Lasso utility (no BIOS option available).
No books, no Tablebases, and no large pages.
Average of about 3000 kN/s in the middle game for Houdini.

Houdini is called NONE in the below, since it is an instance with no EGTBs.

Critter book deleted (renamed) on my machine from the Critter folder, since it likes to use it, even when turned off, and with a blank path! (anyone else see this?)

All Split depths, etc at defaults, as with all settings except hash (and did I say no books? )

Machine about 80% "dedicated" to the tournament, but since my use is random, I hope that evens out for all engines.

Tournament running under Arena 3.0, with engines restarting every game. Global Hash setting turned off, all engines set individually to insure hash size.

498 of 15000 games played

Tournament start: 2013.06.19, 17:44:42
Latest update: 2013.06.28, 20:37:58
Site/ Country: Rob-PC, United States
Level: Tournament 40/5
Hardware: Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz with 15.9 GB Memory (Corsair Vengeance DDR3 1600)
Sandisk Extreme 480GB SSD (as mentioned, Tablebases not used in this tournament, but they reside here)

Operating system: Windows 7 Home Premium Home Edition Service Pack 1 (Build 7601) 64 bit
PGN-File: K51 512 40 in 5.pgn
Table created with: Arena 3.0

ELOstat start ELO 3000

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO-NONE : 3079 36 35 193 63.7 % 2981 47.7 %
2 Komodo51r1-64bit : 3013 79 79 41 52.4 % 2996 46.3 %
3 Komodo51-64bit : 3009 33 33 194 51.5 % 2999 54.6 %
4 Critter_1.6a_64bit : 2991 33 33 194 48.5 % 3002 53.6 %
5 Stockfish-3-64-pop-ja : 2986 35 35 194 47.4 % 3004 48.5 %
6 Deep Rybka 4.1 SSE42 x64 : 2923 39 40 172 36.9 % 3016 43.6 %

[Graham Banks]

Hi Rob,

thanks for sharing.
Everybody's results are valuable to the big picture, so it's great to see new contributors.

Cheers,
Graham.

[RJN]

Hi Graham:

Thanks, I recall some of your CM900 "personalities", very entertaining back in the day.

Updated Komodo Tournament:

(Note: in my first post, I forgot to mention ponder is OFF)

621 games played, 40 in 5 minutes, repeating (Round Robin)

ELOstat start ELO 3000

7/1/2013 3:52:24 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO-NONE : 3078 33 32 219 63.2 % 2984 49.8 %
2 Komodo51r1-64bit : 3006 36 35 170 51.2 % 2997 54.1 %
3 Komodo51-64bit : 3005 30 30 220 50.7 % 3000 56.8 %
4 Critter_1.6a_64bit : 2995 32 32 219 49.1 % 3001 52.5 %
5 Stockfish-3-64-pop-ja : 2984 33 33 218 47.0 % 3005 49.1 %
6 Deep Rybka 4.1 SSE42 x64 : 2927 36 37 196 37.8 % 3013 44.9 %

[RJN]

751 games played, 40 in 5 minutes, repeating (Round Robin)

ELOstat start ELO 3000

7/3/2013 10:54:40 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO-NONE : 3078 30 30 252 63.1 % 2984 51.6 %
2 Komodo51r1-64bit : 3003 28 28 252 50.6 % 2999 56.7 %
3 Komodo51-64bit : 3002 28 28 249 50.4 % 3000 58.2 %
4 Critter_1.6a_64bit : 2991 29 29 250 48.6 % 3001 54.8 %
5 Stockfish-3-64-pop-ja : 2990 30 30 249 48.2 % 3002 50.6 %
6 Deep Rybka 4.1 SSE42 x64 : 2935 31 32 250 39.0 % 3013 46.8 %

[RJN]

918 games played, 40 in 5 minutes, repeating (Round Robin)

ELOstat start ELO 3000

7/6/2013 1:03:48 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO-NONE : 3069 28 27 308 61.7 % 2986 50.0 %
2 Komodo51r1-64bit : 3008 26 26 306 51.5 % 2998 56.5 %
3 Komodo51-64bit : 3001 26 26 304 50.2 % 3000 54.3 %
4 Critter_1.6a_64bit : 2990 26 26 305 48.4 % 3001 54.8 %
5 Stockfish-3-64-pop-ja : 2989 28 28 305 48.0 % 3003 49.5 %
6 Deep Rybka 4.1 SSE42 x64 : 2943 28 29 308 40.3 % 3011 46.8 %

[RJN]

1065 games played

7/8/2013 10:37:04 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO-NONE : 3067 26 25 356 61.4 % 2987 50.3 %
2 Komodo51r1-64bit : 3010 24 24 357 51.7 % 2998 55.2 %
3 Komodo51-64bit : 3008 25 25 353 51.4 % 2998 53.0 %
4 Stockfish-3-64-pop-ja : 2990 26 26 352 48.3 % 3002 50.6 %
5 Critter_1.6a_64bit : 2987 25 25 355 47.7 % 3002 53.2 %
6 Deep Rybka 4.1 SSE42 x64 : 2938 26 27 357 39.5 % 3012 46.5 %

[RJN]

I'm removing Komodo 5.1 "original" from the tournament, it will be replaced by the latest r2 version that was released today. Results from 5.1 original will still be shown (for now), but no more games will be played for this version.

I'll keep r1 in the mix for now.

Note: this tournament is still set as Round Robin, but will be more like a Gauntlet until Komodo 5.1 r2 catches up, which will take some time.

40 in 5 minutes, repeating (etc, same as stated in previous posts)

It's early, but so far Komodo51r2 is undefeated!!!! 4 wins, 4 draws.

1233 games played

7/11/2013 5:15:08 PM :

Program Elo + - Games Score Av.Op. Draws

1 Komodo51r2-64bit : 3196 241 137 8 75.0 % 3006 50.0 %
2 Houdini_3_PRO-NONE : 3062 24 24 410 60.5 % 2988 48.8 %
3 Komodo51r1-64bit : 3013 23 23 413 52.3 % 2997 54.7 %
4 Komodo51-64bit : 3010 23 23 408 51.8 % 2997 54.7 %
5 Stockfish-3-64-pop-ja : 2987 24 24 405 47.9 % 3002 50.9 %
6 Critter_1.6a_64bit : 2984 24 24 410 47.2 % 3003 51.0 %
7 Deep Rybka 4.1 SSE42 x64 : 2940 24 24 412 39.8 % 3012 47.6 %

[RJN]

1258 games played

7/12/2013 3:35:04 AM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO-NONE : 3061 24 24 415 60.4 % 2988 48.4 %
2 Komodo51r2-64bit : 3031 93 92 33 54.5 % 2999 42.4 %
3 Komodo51r1-64bit : 3013 22 22 418 52.3 % 2997 54.8 %
4 Komodo51-64bit : 3010 23 23 408 51.8 % 2998 54.7 %
5 Stockfish-3-64-pop-ja : 2989 24 24 410 48.2 % 3002 51.0 %
6 Critter_1.6a_64bit : 2984 24 24 415 47.2 % 3003 50.6 %
7 Deep Rybka 4.1 SSE42 x64 : 2940 24 24 417 39.8 % 3012 47.5 %

[RJN]

I know it's still early, with only 45 games so far by Komodo51r2, but this is getting interesting!

7/12/2013 9:25:50 AM :
Individual statistics:

1 Komodo51r2-64bit : 3075 45 (+ 18,= 19,- 8), 61.1 %

Houdini_3_PRO-NONE : 9 (+ 5,= 2,- 2), 66.7 %
Stockfish-3-64-pop-ja : 9 (+ 4,= 3,- 2), 61.1 %
Critter_1.6a_64bit : 9 (+ 3,= 4,- 2), 55.6 %
Deep Rybka 4.1 SSE42 x64 : 9 (+ 3,= 5,- 1), 61.1 %
Komodo51r1-64bit : 9 (+ 3,= 5,- 1), 61.1 %


1270 games played total:

7/12/2013 9:25:50 AM :

Program Elo + - Games Score Av.Op. Draws

1 Komodo51r2-64bit : 3075 80 78 45 61.1 % 2997 42.2 %
2 Houdini_3_PRO-NONE : 3060 24 24 417 60.1 % 2989 48.2 %
3 Komodo51r1-64bit : 3013 22 22 420 52.1 % 2998 54.8 %
4 Komodo51-64bit : 3009 23 23 408 51.8 % 2997 54.7 %
5 Stockfish-3-64-pop-ja : 2987 24 24 413 47.8 % 3002 50.6 %
6 Critter_1.6a_64bit : 2983 23 24 417 47.1 % 3003 50.6 %
7 Deep Rybka 4.1 SSE42 x64 : 2940 24 24 420 39.9 % 3012 47.9 %

[RJN]

Looks like Komodo51r2 rating has settled down a bit, after starting out on a roll, but still a decent amount of uncertainty.

1358 games played:


7/13/2013 7:32:58 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini_3_PRO4-NONE : 3061 24 24 435 60.2 % 2989 47.8 %
2 Komodo51r2-64bit : 3018 46 46 133 53.0 % 2998 39.8 %
3 Komodo51r1-64bit : 3012 22 22 438 51.9 % 2998 54.6 %
4 Komodo51-64bit : 3010 23 23 408 51.8 % 2997 54.7 %
5 Stockfish-3-64-pop-ja : 2986 23 23 430 47.6 % 3003 50.0 %
6 Critter_1.6a_64bit : 2985 23 23 435 47.5 % 3003 49.9 %
7 Deep Rybka 4.1 SSE42 x64 : 2942 24 24 437 40.2 % 3011 47.4 %