IPON TOP 20 One on One!

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

IPON TOP 20 One on One!

Post by IWB »

Hello

If you take the top 20 and make a tourney out of the games which where played between them, this is the result:

Code: Select all

Rank Name                      Elo    +    - games score oppo. draws 
   1 Houdini 2.0 STD          3022   12   12  2850   77%  2812   26% 
   2 Critter 1.4a             2982   11   11  2850   73%  2814   35% 
   3 Komodo 4                 2980   11   11  2850   73%  2814   33% 
   4 Stockfish 2.2.2 JA       2956   11   11  2850   70%  2816   39% 
   5 Deep Rybka 4.1           2951   11   11  2850   70%  2816   40% 
   6 Naum 4.2                 2836   11   10  2850   53%  2822   43% 
   7 Chiron 1.1a              2835   10   11  2850   52%  2822   41% 
   8 Fritz 13 32b             2821   10   11  2850   50%  2823   42% 
   9 Deep Shredder 12         2800   11   10  2850   47%  2824   40% 
  10 Deep Sjeng c't 2010 32b  2799   11   11  2850   47%  2824   41% 
  11 Gull 1.2                 2796   10   11  2850   46%  2824   38% 
  12 Spike 1.4 32b            2791   11   10  2850   45%  2824   41% 
  13 Protector 1.4.0          2770   11   11  2850   42%  2826   38% 
  14 spark-1.0                2769   11   11  2850   42%  2826   41% 
  15 Hannibal 1.1             2758   11   10  2850   40%  2826   41% 
  16 Deep Junior 13           2754   11   11  2850   40%  2826   35% 
  17 HIARCS 13.2 MP 32b       2753   11   11  2850   40%  2826   37% 
  18 Zappa Mexico II          2724   11   11  2850   35%  2828   37% 
  19 Deep Onno 1-2-70         2689   11   11  2850   30%  2830   35% 
  20 Strelka 2.0 B            2670   11   11  2850   28%  2831   33% 

150 games between each engine combination! This is most likely the biggest tourney 'one on one' on identical hardware, same positions,
changing colors that was ever played. This might be the best comparision of these engines in the world today showing the real relation between those!

Individual results on http://www.inwoba.de

Bye
Ingo
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: IPON TOP 20 One on One!

Post by beram »

Thx Ingo for your good work,

difference between Houdini 2.0 and Komodo 4 is 42 ELO
while difference between them in the 150 games result is a remarkable 50 %

seems Komodo 4 plays very well against Houdini or perhaps its tuned to do so

grts Bram
Uri Blass
Posts: 11123
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: IPON TOP 20 One on One!

Post by Uri Blass »

beram wrote:Thx Ingo for your good work,

difference between Houdini 2.0 and Komodo 4 is 42 ELO
while difference between them in the 150 games result is a remarkable 50 %

seems Komodo 4 plays very well against Houdini or perhaps its tuned to do so

grts Bram
The statistical error based on 150 games is higher than 40 elo so no tuning is needed to explain result of 50%.
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Re: IPON TOP 20 One on One!

Post by IWB »

Uri Blass wrote:
The statistical error based on 150 games is higher than 40 elo so no tuning is needed to explain result of 50%.
Yes, the better tool for this is the LOS which is part of my download. There Houdini 2.0 has a 99% likelyhood that it is better than Komodo 4.

Bye
Ingo

(BTW: The likelyhood that H2.0 is better than H1.5a is 82%!)
Jouni
Posts: 3764
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: IPON TOP 20 One on One!

Post by Jouni »

Stockfish 2.2.2 is ahead of Rybka 4.1, but LOS is 37% :roll:

Jouni
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Re: IPON TOP 20 One on One!

Post by IWB »

Jouni wrote:Stockfish 2.2.2 is ahead of Rybka 4.1, but LOS is 37% :roll:

Jouni
Stockfish is behind Rybka 4.1!

Code: Select all

4 Deep Rybka 4.1           2953    9    9  5150   72%  2793   36% 
5 Stockfish 2.2.2 JA       2951   10   11  3750   74%  2772   34% 
The LOS is for the full list, not for the excerpt 'one on one' tourney.

If someone is interested I can publish the LOS for that 'one on one' tourney as well!

Bye
Ingo