SWCR: Better comparison between R4 Exp. 42 to R4 Exp. 61

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Frank Quisinsky
Posts: 7192
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

SWCR: Better comparison between R4 Exp. 42 to R4 Exp. 61

Post by Frank Quisinsky »

Hi there,

an user asked me for a better comparison between Rybka 4 Exp. 42 x64 und Rybka 4 Exp. 61 x64.

Here the SWCR-64 (each one vs. each one 40 games with both settings).
Clear, no games Exp.61 vs. Exp. 42, the settings have 1.000 games, the others 1.040 games.

First one, Bayesian 0056:

Code: Select all

   1 Houdini 1.5 x64             3003   21   20  1040   82%  2749   26% 
   2 Rybka 4 x64 Exp. 42         2965   20   20  1000   79%  2742   26% 
   3 Rybka 4 x64 Exp. 61         2959   20   20  1000   78%  2742   27% 
   4 IvanHoe B49jA x64           2930   19   19  1040   74%  2751   35% 
   5 Stockfish 1.9.1 JA x64      2905   19   18  1040   71%  2752   35% 
   6 Critter 0.90 x64            2870   18   18  1040   67%  2754   38% 
   7 Naum 4.2 x64                2834   18   18  1040   62%  2755   39% 
   8 Komodo 1.2 JA x64           2809   17   17  1040   58%  2756   43% 
   9 Shredder 12                 2800   18   17  1040   57%  2756   39% 
  10 Sjeng c't 2010              2786   17   17  1040   54%  2757   39% 
  11 GullChess 1.1 x64           2781   18   17  1040   54%  2757   38% 
  12 Spark 1.0 x64               2755   17   17  1040   50%  2758   42% 
  13 Thinker 5.4d Inert x64      2736   17   17  1040   47%  2759   41% 
  14 Hiarcs 13.1                 2736   18   17  1040   47%  2759   36% 
  15 Zappa Mexico II x64         2724   17   17  1040   45%  2759   39% 
  16 Fruit 09_07_05 x64          2718   17   18  1040   44%  2760   35% 
  17 Junior 12.0 x64             2715   18   18  1040   44%  2760   34% 
  18 Protector 1.3.6-370 JA x64  2706   18   18  1040   43%  2760   34% 
  19 Booot 5.1.0                 2693   18   18  1040   41%  2761   37% 
  20 Onno 1.2.70 x64             2677   18   18  1040   39%  2761   35% 
  21 Hannibal 1.0a x64           2675   18   18  1040   38%  2761   36% 
  22 Umko 1.1 x64                2636   18   18  1040   33%  2763   34% 
  23 Crafty 23.4 JA x64          2619   18   19  1040   30%  2763   33% 
  24 Loop 2007 x64               2616   18   19  1040   30%  2763   33% 
  25 Equinox 0.87t x64           2615   18   19  1040   30%  2763   32% 
  26 Jonny 4.00                  2609   19   19  1040   30%  2764   26% 
  27 SmarThink 1.20 x64          2592   19   19  1040   27%  2764   31% 
And now the same with ELOstat 1.3:

Code: Select all

  1 Houdini 1.5 x64                : 3007   21  20  1040    81.8 %   2746   25.9 %
  2 Rybka 4 x64 Exp. 42            : 2965   21  20  1000    78.5 %   2740   26.2 %
  3 Rybka 4 x64 Exp. 61            : 2960   20  20  1000    78.0 %   2740   26.7 %
  4 IvanHoe B49jA x64              : 2934   18  18  1040    74.3 %   2749   35.1 %
  5 Stockfish 1.9.1 JA x64         : 2906   18  18  1040    71.0 %   2750   34.9 %
  6 Critter 0.90 x64               : 2873   17  17  1040    66.8 %   2752   38.2 %
  7 Naum 4.2 x64                   : 2835   17  17  1040    61.5 %   2753   39.0 %
  8 Komodo 1.2 JA x64              : 2810   16  16  1040    58.0 %   2754   42.5 %
  9 Shredder 12                    : 2800   17  17  1040    56.6 %   2754   38.6 %
 10 Sjeng c't 2010                 : 2783   17  16  1040    54.0 %   2755   39.1 %
 11 GullChess 1.1 x64              : 2780   17  17  1040    53.6 %   2755   37.9 %
 12 Spark 1.0 x64                  : 2755   16  16  1040    49.9 %   2756   41.7 %
 13 Hiarcs 13.1                    : 2736   17  17  1040    47.1 %   2757   36.2 %
 14 Thinker 5.4d Inert x64         : 2734   16  16  1040    46.7 %   2757   41.2 %
 15 Zappa Mexico II x64            : 2722   17  17  1040    45.0 %   2757   38.9 %
 16 Fruit 09_07_05 x64             : 2719   17  17  1040    44.4 %   2758   35.4 %
 17 Junior 12.0 x64                : 2716   17  17  1040    44.0 %   2758   33.8 %
 18 Protector 1.3.6-370 JA x64     : 2709   17  17  1040    43.0 %   2758   34.3 %
 19 Booot 5.1.0                    : 2692   17  17  1040    40.5 %   2759   37.2 %
 20 Onno 1.2.70 x64                : 2679   17  17  1040    38.6 %   2759   35.5 %
 21 Hannibal 1.0a x64              : 2674   17  17  1040    38.0 %   2759   36.3 %
 22 Umko 1.1 x64                   : 2636   18  18  1040    32.8 %   2761   33.9 %
 23 Crafty 23.4 JA x64             : 2618   18  18  1040    30.5 %   2761   32.7 %
 24 Loop 2007 x64                  : 2617   18  18  1040    30.4 %   2761   32.7 %
 25 Equinox 0.87t x64              : 2616   18  18  1040    30.1 %   2762   32.2 %
 26 Jonny 4.00                     : 2614   19  19  1040    29.9 %   2762   26.0 %
 27 SmarThink 1.20 x64             : 2592   19  19  1040    27.2 %   2762   30.6 %
Very interesting to compare the other 26 engines too.

Code: Select all

Conditions:
Windows XP Prof. x64 Edition
SClassic 4, Fritz 11 GUI
S12: Random-Book 4.1
F12: Perfect 2010

40 moves in 10 minutes
ponder = on
each engine = 1 core
resign / learning = off
hashtables = 256Mb
4TB Nalimov, GaviotaB., egbb,
ShredderB., TotalB. & TripleB.

Intel® Core™2 Quad
4x Q9550, 2,83GHz
Best
Frank