Testing Komodo 5 at three different time controls: 540 games

[Tomcass]

i7 975 3.33 Ghz.
1 core each engine
GUI: Fritz 12
Book: Masterbook 3.1
Ponder: Off.
No tablebases

201207Komodo5_2+2 2012

Komodo 5 64-bit - Houdini 2.0c x64x1 13.0 - 17.0 +7/=12/-11 43.33%
Komodo 5 64-bit - Strelka 5.5 x64 15.5 - 14.5 +6/=19/-5 51.67%
Komodo 5 64-bit - Rybka 4.1 x64 18.0 - 12.0 +9/=18/-3 60.00%

Games: http://www.mediafire.com/?9kbqujp7vosu2au

201207Komodo5_10+0-1 2012

Komodo 5 64-bit - Houdini 2.0c x64x1 14.5 - 15.5 +8/=13/-9 48.33%
Komodo 5 64-bit - Strelka 5.5 x64 13.5 - 16.5 +4/=19/-7 45.00%
Komodo 5 64-bit - Rybka 4.1 x64 18.0 - 12.0 +11/=14/-5 60.00%

Games: http://www.mediafire.com/?qi28b5ow6qyv6yc

201207Komodo5_15+0_off 2012

Komodo 5 64-bit - Houdini 2.0c x64x1 12.5 - 17.5 +6/=13/-11 41.67%
Komodo 5 64-bit - Strelka 5.5 x64 16.5 - 13.5 +8/=17/-5 55.00%
Komodo 5 64-bit - Rybka 4.1 x64x1 17.0 - 13.0 +9/=16/-5 56.67%

Games: http://www.mediafire.com/?nmc61nm2o0l3e5i

I7 980 3.33 Ghz.
1 core each engine
GUI: Fritz 12
Book: Perfect 2012
Ponder: Off
No tablebases

201207Komodo5 2012_2+2 2012

Komodo 5 64-bit_x1 - Houdini 2.0c Pro x64(x1) 13.0 - 17.0 +8/=10/-12 43.33%
Komodo 5 64-bit_x1 - Strelka 5.5 x64_bo 12.0 - 18.0 +5/=14/-11 40.00%
Komodo 5 64-bit_x1 - Deep Rybka 4 SSE42 x64(x1) 17.5 - 12.5 +9/=17/-4 58.33%

Games: http://www.mediafire.com/?ikzcdb6a5fjdkd3

201207Komodo5_10+0 2012

Komodo 5 64-bit_x1 - Houdini 2.0c Pro x64(x1) 11.0 - 19.0 +6/=10/-14 36.67%
Komodo 5 64-bit_x1 - Strelka 5.5 x64_bo 18.0 - 12.0 +11/=14/-5 60.00%
Komodo 5 64-bit_x1 - Deep Rybka 4.1 SSE42 x64(x1) 15.5 - 14.5 +9/=13/-8 51.67%

Games: http://www.mediafire.com/?g7prbsgqgfbffml

201207Komodo5_15+0 2012

Komodo 5 64-bit_x1 - Houdini 2.0c Pro x64(x1) 14.0 - 16.0 +6/=16/-8 46.67%
Komodo 5 64-bit_x1 - Strelka 5.5 x64_bo 17.5 - 12.5 +8/=19/-3 58.33%
Komodo 5 64-bit_x1 - Deep Rybka 4.1 SSE42 x64(x1) 14.5 - 15.5 +7/=15/-8 48.33%

Games: http://www.mediafire.com/?nv1de1pgmndx4bb

------------------------------------------------------------------------------

180 games at 2+2 tc

Komodo 5 64-bit - Houdini 2.0c x64x1 26.0 -34.0 +15/=22/-33 43.33%
Komodo 5 64-bit - Strelka 5.5 x64 27.5 - 32.5 +11/=33/-16 45.83%
Komodo 5 64-bit - Rybka 4.1 x64 35.5 – 24.5 +18/=35/-7 59.17%

180 games at 10+0 tc

Komodo 5 64-bit - Houdini 2.0c x64x1 25.5 - 34.5 +14/=23/-23 42.50%
Komodo 5 64-bit - Strelka 5.5 x64 31.5 - 28.5 +15/=33/-12 52.50%
Komodo 5 64-bit - Rybka 4.1 x64 33.5 - 26.5 +20/=27/-13 55.83%

180 games at 15+0 tc

Komodo 5 64-bit_x1 - Houdini 2.0c Pro x64(x1) 26.5 – 33.5 +12/=29/-19 44.17%
Komodo 5 64-bit_x1 - Strelka 5.5 x64_bo 34.0 - 26.0 +16/=36/-8 56.67%
Komodo 5 64-bit_x1 - Deep Rybka 4.1 SSE42 x64(x1) 31.5 - 28.5 +16/=31/-13 52.50%

-----------------------------------------------------------------------

TESTING KOMODO 5. SUMMARY AFTER 540 GAMES AT THREE DIFFERENT TIME CONTROLS:

Komodo 5 64-bit_x1 - Houdini 2.0c Pro x64(x1) 78.0 – 102.0 43.33%
Komodo 5 64-bit_x1 - Strelka 5.5 x64_bo 93.0 – 87.0 51.67%
Komodo 5 64-bit_x1 - Deep Rybka 4.1 SSE42 x64(x1) 100.5 – 79.5 55.83%

Very good result against Strelka 5.5 and Rybka 4.1 but still far from Houdini2.0c Pro at all time controls.

Regards from Barcelona,

Tom.

[Ajedrecista]

Hello Tom:

Thank you very much for your interesting tests! They are always much appreciated.

180 games at 2+2 tc

Komodo 5 64-bit - Houdini 2.0c x64x1 26.0 -34.0 +15/=22/-33 43.33%

This score is incorrect; the correct one must be +15 =22 -23 in view of that 26 - 34; I do not know if other scores contain typos in your post.

I have computed error bars for 95% confidence and likelihood of superiority values from Komodo POV using my own programme, so please take these values with lots of care. This is what I obtained for each 180-game match (the results are rounded). I hope no typos:

Code: Select all

Komodo 5 - Houdini 2.0c:
+41 -65 =74 (180 games).
-46.6 ± 39.2 Elo.
LOS ~ 0.95%.

-----------------------

Komodo 5 - Strelka 5.5:
+42 -36 =102 (180 games).
+11.6 ± 33.5 Elo.
LOS ~ 75.09%.

-----------------------

Komodo 5 - Deep Rybka 4.1:
+54 -33 =103 (180 games).
+38.6 ± 33.5 Elo.
LOS ~ 98.82%.

Please keep up the good work! ¡Buen trabajo, como siempre!

Regards from Spain.

Ajedrecista.

[Tomcass]

Hi Jesús!

Thanks for pointing out my typo. You are right. I hope this is my only typo there. Although I try to make sure about all elements of my tests, sometimes a minor mistake can appear.

On the other hand, your diagnose about the likelihood of superiority seems to be very precise, so that thank you very much for calculating it for my tests.

Un abrazo desde Barcelona!

Tom.