FGRL-Rating List: 240+2.40 - Komodo 8

[fastgm]

Komodo 8 is the new leader!

Code: Select all

    Program            Elo    +   -   Games   Score   Av.Op.  Draws
 --------------------------------------------------------------------
  1 Komodo 8         : 3119   10  10  2700    68.2 %   2987   46.4 %
  2 Stockfish 5      : 3103    9   9  2700    65.9 %   2988   49.7 %
  3 Houdini 4        : 3085   10  10  2700    63.4 %   2990   46.1 %
  4 Gull 3           : 3045    9   9  2700    57.1 %   2995   52.0 %
  5 Critter 1.6a     : 2987    9   9  2700    48.0 %   3001   53.8 %
  6 Fire 3.0 x64     : 2973    9   9  2700    45.7 %   3003   55.3 %
  7 Bouquet 1.8      : 2966    9   9  2700    44.6 %   3004   52.8 %
  8 Rybka 4.1        : 2945    9   9  2700    41.3 %   3006   50.4 %
  9 Chiron 2         : 2895   10  10  2700    33.9 %   3011   42.7 %
 10 Protector 1.6.0  : 2882   10  10  2700    32.0 %   3013   43.7 %

More infos:
http://www.fastgm.de

[lkaufman]

Komodo 8 is the new leader!

Code: Select all

    Program            Elo    +   -   Games   Score   Av.Op.  Draws
 --------------------------------------------------------------------
  1 Komodo 8         : 3119   10  10  2700    68.2 %   2987   46.4 %
  2 Stockfish 5      : 3103    9   9  2700    65.9 %   2988   49.7 %
  3 Houdini 4        : 3085   10  10  2700    63.4 %   2990   46.1 %
  4 Gull 3           : 3045    9   9  2700    57.1 %   2995   52.0 %
  5 Critter 1.6a     : 2987    9   9  2700    48.0 %   3001   53.8 %
  6 Fire 3.0 x64     : 2973    9   9  2700    45.7 %   3003   55.3 %
  7 Bouquet 1.8      : 2966    9   9  2700    44.6 %   3004   52.8 %
  8 Rybka 4.1        : 2945    9   9  2700    41.3 %   3006   50.4 %
  9 Chiron 2         : 2895   10  10  2700    33.9 %   3011   42.7 %
 10 Protector 1.6.0  : 2882   10  10  2700    32.0 %   3013   43.7 %

More infos:
http://www.fastgm.de

I notice that in your complete list you show an increase of 60 elo for Komodo 8 over Komodo 7. That is a very pleasant surprise! I also notice that in your individual results Komodo 8 defeated all opponents other than Stockfish by larger margins than Stockfish did (equal margin against Protector), but lost the direct match to Stockfish. This seems to be a real phenomenon, not a statistical fluke. Even though Stockfish is our main test opponent, we underperform in direct matches with Stockfish. Contempt could be a factor, but I don't think it is the main factor.

[Ed Trice]

I notice that in your complete list you show an increase of 60 elo for Komodo 8 over Komodo 7. That is a very pleasant surprise!

Sometimes better time control handling code in a new version can lead to such a bubble. Games could be fairly even all the way down to the last few moves. Scaled across the breadth of a long match, it really adds up.

[shrapnel]

Contempt could be a factor, but I don't think it is the main factor.

You got THAT spot on !
No matter what DrawScore I try, it always loses to strong Stockfish players....can draw or beat them only with Stockfish !
And Komodo 8 is beating other Engines by larger margins than SF, because of Komodo's default -7, while SF always uses 0, so more draws, obvious.

[lkaufman]

Contempt could be a factor, but I don't think it is the main factor.

You got THAT spot on !
No matter what DrawScore I try, it always loses to strong Stockfish players....can draw or beat them only with Stockfish !
And Komodo 8 is beating other Engines by larger margins than SF, because of Komodo's default -7, while SF always uses 0, so more draws, obvious.

It seems that we were perhaps reading too much into the results, because at the longer time limit of 10' plus 6 seconds Komodo won the 300 game match from SF but did worse against the other engines, exactly the opposite of what happened at 4' plus 2.4"! So perhaps it was mostly luck or sample error; the combined result at the two levels is a few elo plus for Komodo despite a slight plus score for SF in their direct matches.