10 min + 5 sec engines ratinglist

[majortom]

TC 10'+5"

i7-3960x
1-core
ponder off
colours reversed openings
512 mb hash

Code: Select all

    Program                        Elo    +   -   Games   Score   Av.Op.  Draws

  1 Stockfish 281013 64 SSE4.2   : 2963   11  11  2000    52.8 %   2944   51.0 %
  2 Houdini 3 Pro x64            : 2949   11  11  2000    49.8 %   2950   48.4 %
  3 Komodo 6 64-bit              : 2938   11  11  2000    47.4 %   2956   50.8 %

Code: Select all

1 Stockfish 281013 64 SSE4.2     : 2963  2000 (+545,=1021,-434), 52.8 %

  Houdini 3 Pro x64                      1000 (+274,= 487,-239), 51.7 %
  Komodo 6 64-bit                        1000 (+271,= 534,-195), 53.8 %

2 Houdini 3 Pro x64              : 2949  2000 (+512,= 968,-520), 49.8 %

  Stockfish 281013 64 SSE4.2             1000 (+239,= 487,-274), 48.2 %
  Komodo 6 64-bit                        1000 (+273,= 481,-246), 51.3 %

3 Komodo 6 64-bit                : 2938  2000 (+441,=1015,-544), 47.4 %

  Stockfish 281013 64 SSE4.2             1000 (+195,= 534,-271), 46.2 %
  Houdini 3 Pro x64                      1000 (+246,= 481,-273), 48.6 %

3000 games

Homepage:
http://treu.ru/rl/ratinglist.php

[ThatsIt]

Great - like it.

Best wishes,
G.S.

[Modern Times]

Code: Select all

    Program                        Elo    +   -   Games   Score   Av.Op.  Draws

  1 Stockfish 281013 64 SSE4.2   : 2963   11  11  2000    52.8 %   2944   51.0 %
  2 Houdini 3 Pro x64            : 2949   11  11  2000    49.8 %   2950   48.4 %
  3 Komodo 6 64-bit              : 2938   11  11  2000    47.4 %   2956   50.8 %

Thanks for the results ! Same ranking as a match I ran a few weeks back, 4CPU at 5 min + 3 secs, although yours is statistically more sound due to the larger number of games

Code: Select all

Rank Name                           Elo    +    - games score oppo. draws 
   1 Stockfish 091013 x64 4CPU       12   10   10  1000   53%    -6   57% 
   2 Houdini 3 x64 4CPU               6   10   10  1000   51%    -3   52% 
   3 Komodo 6 x64 4CPU              -18   10   10  1000   46%     9   55% 

[gladius]

Cool, thanks!

It will be very interesting to see how things will settle out after Komodo 7 and Houdini 4 are released.

[majortom]

Great - like it.

Best wishes,
G.S.

Thank you, Gerhard.

[majortom]

Code: Select all

Rank Name                           Elo    +    - games score oppo. draws 
   1 Stockfish 091013 x64 4CPU       12   10   10  1000   53%    -6   57% 
   2 Houdini 3 x64 4CPU               6   10   10  1000   51%    -3   52% 
   3 Komodo 6 x64 4CPU              -18   10   10  1000   46%     9   55% 

Thank you, Ray, for you match!
Could you, pls, share these games?

[majortom]

Cool, thanks!

It will be very interesting to see how things will settle out after Komodo 7 and Houdini 4 are released.

You are welcome, Gary!

I'm waiting for Stockfish 5, Houdini 4 and Komodo 7 for rating list updates.
When SF beta will be about 15 elo stronger than Stockfish 281013, it will be ranked too.

[Modern Times]

Thank you, Ray, for you match!
Could you, pls, share these games?

The pgn is attached to the post here:

http://rybkaforum.net/cgi-bin/rybkaforu ... pid=489540

[Ajedrecista]

Hello Andrey:

Code: Select all

    Program                        Elo    +   -   Games   Score   Av.Op.  Draws

  1 Stockfish 281013 64 SSE4.2   : 2963   11  11  2000    52.8 %   2944   51.0 %
  2 Houdini 3 Pro x64            : 2949   11  11  2000    49.8 %   2950   48.4 %
  3 Komodo 6 64-bit              : 2938   11  11  2000    47.4 %   2956   50.8 %

Thanks for the results ! Same ranking as a match I ran a few weeks back, 4CPU at 5 min + 3 secs, although yours is statistically more sound due to the larger number of games

Code: Select all

Rank Name                           Elo    +    - games score oppo. draws 
   1 Stockfish 091013 x64 4CPU       12   10   10  1000   53%    -6   57% 
   2 Houdini 3 x64 4CPU               6   10   10  1000   51%    -3   52% 
   3 Komodo 6 x64 4CPU              -18   10   10  1000   46%     9   55% 

Well done! Thank you very much for sharing your results.

------------

@Ray: I hate to say this, but are you sure about the error bars of your list? I can not run Bayeselo now but it seems that these error bars are for less than 95% confidence. Could you please check it? Thanks in advance. You also do a great job.

Regards from Spain.

Ajedrecista.

[Modern Times]

@Ray: I hate to say this, but are you sure about the error bars of your list? I can not run Bayeselo now but it seems that these error bars are for less than 95% confidence. Could you please check it? Thanks in advance. You also do a great job.

Regards from Spain.

Ajedrecista.

One-off Tournament, not a list. That is directly from Bayeselo, I didn't modify the output it in any way. I ran it again, and it is the same. I used mm 1 1.

Komodo did worse for me than Andrey, could be the AMD factor Don and Larry mention, or else just statistical noise.