A rating list

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

A rating list

Post by Adam Hair »

85,248 games played
4' + 3" time control
Windows XP x64
Intel E8400 @ 2.95 GHz and QX6700 @ 3.05 GHz ( equal Crafty benchmarks)
Arena 2.01
HS MainBook 7 moves and start positions from Albert Silver, Marc LaCrosse,
Jon Dart, and Franklin T
128 MB hash
3/4 men EGTB, egbb, and GTB
Ponder off
Anything else?

The rating list is computed with BayesElo (Remi Coulon) using the covariance
function and an offset of 2132. The offset was computed by using the average
rating of 4 engines found on the CCRL pure rating list (40/4). My goal
is to play a relatively significant amount of games with all engines I can play
on my computers. Commercial engines, or at least the commercial versions,
won't be tested in the foreseeable future, but if my financial fortunes change
that may change as well.

Ippolit Disclaimer: I am choosing not to test engines derived from Ippolit
at this time

Code: Select all

Rank Name                         Elo    +    - games score oppo. draws 
   1 Stockfish-16-x64-ja         3123   31   31   812   75%  2936   27% 
   2 Komodo-10-x64-ja            3058   30   30   816   65%  2949   33% 
   3 Rybka v2.2n2x64             3053   30   30   778   65%  2952   34% 
   4 Thinker54d Inertx64         2991   28   28  1063   58%  2934   33% 
   5 Protector_1.3.2_Win64       2972   29   29   927   53%  2947   35% 
   6 Spark-0.3-gcc64             2916   26   26  1339   60%  2839   31% 
   7 Toga141se                   2914   27   27  1082   54%  2887   32% 
   8 Glaurung22_x64_ja           2898   28   28   938   53%  2873   31% 
   9 Fruit23-EM64T               2889   26   26  1201   54%  2862   31% 
  10 Critter_0.52b_64bit         2887   27   27  1123   60%  2814   30% 
  11 Bright-0.5c                 2876   27   27  1055   55%  2843   27% 
  12 TwistedLogic20090922_x64    2843   26   26  1217   49%  2852   28% 
  13 Bison_9.11_x64              2842   27   27   967   57%  2793   26% 
  14 Spike1.2 Turin              2825   25   25  1369   48%  2839   31% 
  15 Naum2.0_x64                 2812   29   29   744   49%  2821   34% 
  16 Frenzee_Feb08_x64           2780   28   28   920   42%  2841   27% 
  17 Crafty_231_x64_ja           2769   26   26  1071   47%  2793   31% 
  18 Delfi5.4                    2765   25   25  1147   54%  2740   32% 
  19 Scorpio-2.5-x64-ja          2763   25   25  1156   50%  2766   31% 
  20 Booot415                    2756   29   29   789   42%  2810   30% 
  21 BugChess2_V1_6_4_x64        2747   27   27   983   48%  2765   27% 
  22 WildCat_8                   2737   30   30   646   46%  2770   31% 
  23 Alaric707                   2734   28   28   793   44%  2777   27% 
  24 Deuterium_090126492         2726  171  171    10   55%  2698   30% 
  25 Chronos197_Opt              2725   24   24  1281   52%  2712   32% 
  26 Cyrano06b17_x64             2720   29   29   705   44%  2757   33% 
  27 Et_Chess_130108             2720   30   30   669   42%  2776   29% 
  28 Colossus2008b               2716   29   29   719   42%  2770   31% 
  29 SlowChessBlitzWV21          2703   29   29   719   42%  2757   30% 
  30 Alfil811Optimized           2703   29   29   733   42%  2755   27% 
  31 ProDeo1.5                   2700   24   24  1215   50%  2696   27% 
  32 Pharaon_3.51                2698   28   28   595   58%  2643   29% 
  33 Movei00_8_438(10 10 10)     2694   30   30   617   39%  2770   32% 
  34 Amyan_1.72                  2691   71   71    68   55%  2656   31% 
  35 GarboChess2_2               2682   29   29   731   42%  2738   24% 
  36 SOS-51_Arena                2677   33   33   428   51%  2671   34% 
  37 Sloppy_022_x64_ja           2676   24   24  1064   48%  2693   28% 
  38 Ruffian_105                 2675   35   35   392   51%  2669   29% 
  39 SmarThink_017a              2670   32   32   448   51%  2661   32% 
  40 Zappa_11_win_64             2666   30   30   594   40%  2740   25% 
  41 Jonny 2.83                  2664   32   32   497   52%  2652   23% 
  42 Pseudo07c                   2661   32   32   465   49%  2664   35% 
  43 List512                     2649   32   32   458   48%  2659   39% 
  44 Aristarch_450               2644   31   31   502   48%  2654   26% 
  45 Hamsters_071                2640   23   23  1252   47%  2658   30% 
  46 The Baron 223x64            2637   32   32   475   47%  2654   26% 
  47 GreenLightChess301.2.2      2623   31   31   490   51%  2613   23% 
  48 Ufim802                     2617   31   31   512   46%  2643   29% 
  49 AnMon_5.75                  2615   31   31   498   51%  2609   23% 
  50 Ktulu42                     2612   24   24   920   48%  2624   25% 
  51 Bruja19_x64_ja              2610   32   32   441   59%  2545   27% 
  52 Amyan_162                   2608   40   40   267   56%  2568   28% 
  53 Tornado_342a_x64            2607   29   29   564   47%  2627   25% 
  54 Arasan_11.7_x64             2606  174  174    10   35%  2698   30% 
  55 LittleGoliathEvolution_312  2600   32   32   434   52%  2584   28% 
  56 Hermann_2.5_x64             2581   22   22  1028   53%  2560   20% 
  57 Trace_137a                  2577   35   35   361   51%  2568   24% 
  58 Tao_56                      2563   33   33   415   44%  2605   26% 
  59 Yace9987                    2560   34   34   359   49%  2563   26% 
  60 KingOfKings_256             2529   34   34   387   51%  2521   23% 
  61 Abrok_5_0                   2528   34   34   384   51%  2521   23% 
  62 Kiwi_06D                    2515   32   32   451   51%  2508   21% 
  63 SpiderChess070603           2511   31   31   426   46%  2541   30% 
  64 NanoSzachy3.7               2507   20   20  1302   58%  2446   23% 
  65 Dragon_46                   2504   32   32   423   55%  2467   24% 
  66 Gaviota-win64-v0.74.12      2487   18   18  1666   51%  2476   19% 
  67 Romichess_P3Kx64            2481   30   30   478   52%  2467   26% 
  68 Sjeng12_13                  2481   24   24   763   56%  2435   23% 
  69 Quark235                    2477   34   34   384   41%  2544   21% 
  70 Gaia_3.5_x64                2475   29   29   542   52%  2458   16% 
  71 Snitch1.6.2                 2469   27   27   619   53%  2449   22% 
  72 Diablo051_ja                2464   28   28   568   47%  2488   23% 
  73 Leila_053h                  2461   24   24   787   54%  2430   22% 
  74 Comet_B68                   2460   30   30   469   49%  2465   22% 
  75 KnightDreamer_D33           2454   29   29   499   52%  2443   25% 
  76 Nejmet_307                  2452   19   19  1355   51%  2446   24% 
  77 Horizon_4_4                 2442   26   26   689   38%  2540   20% 
  78 Homer_201                   2442   26   26   665   49%  2444   25% 
  79 Amy087_DC                   2440   20   20  1234   52%  2421   21% 
  80 Muse0899b                   2438   20   20  1274   53%  2416   22% 
  81 Patzer380                   2435   20   20  1220   53%  2413   22% 
  82 Gosu_016                    2435   26   26   658   51%  2432   20% 
  83 Bringer_19                  2428   22   22  1053   49%  2433   21% 
  84 Amateur282                  2427   22   22  1017   50%  2427   21% 
  85 Arion_17                    2424   19   19  1399   54%  2398   25% 
  86 Djinn925x                   2419   22   22   998   47%  2443   25% 
  87 TheCrazyBishop0052          2406   22   22  1001   49%  2415   24% 
  88 Averno081                   2392   20   20  1174   57%  2341   22% 
  89 Cheese_13                   2388   21   21  1105   52%  2376   22% 
  90 Sage353                     2380   21   21  1117   46%  2409   19% 
  91 Asterisk_06                 2375   21   21  1113   49%  2379   23% 
  92 Ayito 0.2.994               2369   21   21  1211   58%  2303   17% 
  93 Knightx192                  2358   21   21  1116   47%  2383   20% 
  94 Joker1114w                  2357   21   21  1144   52%  2340   21% 
  95 Ares_1003a                  2328   23   23   881   58%  2253   20% 
  96 Popochin_32                 2325   21   21  1063   50%  2330   24% 
  97 Beowulf_24_x64_ja           2319   21   21  1065   56%  2279   25% 
  98 Chispa403-blend             2311   20   20  1090   47%  2334   30% 
  99 Anechka008                  2299   20   20  1266   44%  2346   20% 
 100 Natwarlal014                2298   21   21  1128   48%  2309   20% 
 101 Hagrid0756                  2274   21   21  1206   59%  2199   17% 
 102 Scidlet_361_x64_ja          2268   19   19  1495   53%  2237   21% 
 103 Atlas220uci                 2268   21   21  1189   50%  2266   18% 
 104 ATAK_65                     2258   22   22  1152   65%  2132   15% 
 105 Sinobyl150                  2253   21   21  1111   49%  2260   24% 
 106 Rattatechess_Bologna2007    2227   22   22  1102   52%  2208   16% 
 107 Matant_5_04                 2224   21   21  1164   60%  2143   20% 
 108 BlackBishop1.0              2224   21   21  1120   53%  2202   20% 
 109 Deuterium06082504           2221   21   21  1040   42%  2278   25% 
 110 Fortress_162                2206   21   21  1276   58%  2141   19% 
 111 EveAnn163                   2204   21   21  1140   49%  2209   23% 
 112 TJchess0121R                2186   21   21  1116   48%  2201   20% 
 113 Parrot-070116               2169   20   20  1468   57%  2095   17% 
 114 FireFly256_x64              2142   22   22  1116   50%  2141   19% 
 115 Matheus-2.3                 2127   22   22  1133   48%  2145   18% 
 116 Ifrit_j2_9                  2101   27   27   670   49%  2109   16% 
 117 Gerbil_02_x64_ja            2084   23   23  1059   52%  2070   16% 
 118 ZCT_032500_x64              2077   23   23  1050   51%  2068   15% 
 119 Myrddin083_x64              2063   26   26   697   46%  2093   21% 
 120 Taktix_223                  2034   22   22  1194   52%  2012   17% 
 121 Marvin_130                  2020   22   22  1157   45%  2061   19% 
 122 BigLion_223x                2020   23   23  1079   43%  2075   17% 
 123 Micromax48_c2d              2020   22   22  1145   44%  2064   19% 
 124 MatMoi_7.15.0_cct_x64       2020   22   22  1126   41%  2097   18% 
 125 Warrior_103                 1984   22   22  1178   51%  1974   20% 
 126 Smash                       1954   22   22  1249   47%  1980   16% 
 127 Surprise_4.3b13             1948   23   23  1152   47%  1971   15% 
 128 SnailChess_4013             1946   23   23  1239   61%  1849   14% 
 129 Clueless_14                 1925   23   23  1160   45%  1973   12% 
 130 Embracer_112                1891   22   22  1165   57%  1833   28% 
 131 Grizzly1401b                1869   23   23  1180   54%  1835   13% 
 132 Elf130                      1799   23   23  1136   49%  1811   15% 
 133 TSCP181                     1772   23   23  1231   50%  1777   15% 
 134 Mephisto_MM V               1750   28   28   684   49%  1760   19% 
 135 Mizar3.0                    1746   24   24  1043   53%  1725   18% 
 136 DChess1_0_2                 1733   24   24  1057   51%  1732   16% 
 137 Storm_06                    1716   24   24  1073   48%  1734   17% 
 138 Beaches226                  1704   25   25  1040   53%  1686   14% 
 139 PolarChess1.2               1697   24   24  1119   49%  1708   17% 
 140 Bace_045                    1686   24   24  1205   48%  1710   17% 
 141 MSCP_144_uci_ja             1686   25   25  1074   51%  1657   18% 
 142 Needle_0531                 1633   25   25  1062   55%  1572   24% 
 143 RataAeroespacial005         1579   28   28   827   67%  1439   29% 
 144 LarsenVB                    1566   26   26  1025   46%  1583   15% 
 145 Pentagon_12                 1544   25   25  1014   37%  1645   29% 
 146 StAndersen_v1.31_X64        1527   25   25  1048   37%  1635   16% 
 147 Braincrack_alpha_ja         1525   29   29   784   59%  1446   15% 
 148 TarraschToyEngineV0.906     1523   25   25  1151   37%  1632   16% 
 149 Yawce016                    1523   25   25  1243   53%  1495   13% 
 150 Nero_61                     1497   24   24  1373   44%  1550   17% 
 151 Eden0013-jet                1425   27   27  1042   57%  1356   15% 
 152 Joanna2002-104_ja           1414   26   26  1059   54%  1389   32% 
 153 Fimbulwinter_5_00           1373   29   29   963   58%  1315   14% 
 154 MiniChessAI_119             1353   29   29   864   55%  1317   24% 
 155 Numpty_0.4pr                1297   27   27  1115   44%  1343   22% 
 156 Trex1.9                     1291   28   28  1115   56%  1244   21% 
 157 Gringo149b                  1281   28   28   937   46%  1311   20% 
 158 Marquis16                   1278   28   28  1006   51%  1268   22% 
 159 KillerQueen_20b3            1267   28   28  1164   64%  1154   29% 
 160 Toledo_Nanochess_wb         1259   27   27  1173   53%  1241   37% 
 161 Mystery2.1                  1253   27   27   942   41%  1317   44% 
 162 QuteChess_101t_rev3_ja      1242   29   29  1012   63%  1138   37% 
 163 Pierre17ja                  1239   27   27  1397   54%  1205   11% 
 164 BlitzKibitz5                1227   28   28   955   38%  1318   39% 
 165 Raffaela                    1215   28   28  1163   60%  1141   31% 
 166 BRAMA_051204                1185   28   28  1177   55%  1142   34% 
 167 Talvmenni                   1116   30   30   840   51%  1111   39% 
 168 BlitzterV2_0                1085   31   31   928   46%  1119    7% 
 169 Xadreco_v5.7                1063   28   28  1373   40%  1166   22% 
 170 MFChess_13_ja               1057   30   30   898   43%  1119   40% 
 171 GIUChess10-beta2-dc         1012   32   32   710   42%  1074   36% 
 172 Testina2_2                  1011   29   29  1121   36%  1126   34% 
 173 Youk_105                    1010   32   32   733   42%  1080   33% 
 174 NSVChess v0.14               981   32   32   706   38%  1074   34% 
 175 EvolChess_0.05               941   30   30  1202   54%   911   26% 
 176 Cassandre_0.21               928   30   30  1254   51%   916   33% 
 177 Dika_04209                   885   30   30  1289   46%   926   49% 
 178 Pyotr-am_06                  862   29   29  1677   35%  1008   27% 
 179 Ram2.0                       776   36   36   566   54%   738   51% 
 180 Neg03d                       719   35   35   698   41%   801   35% 
 181 Dendron042_win32             680   35   35   670   36%   800   55% 
 182 CPP1                         643   38   38   496   34%   768   35% 
 183 LaMoSca_v0.10                617   37   37   542   31%   752   60% 
 184 POS-1.20                     587   38   38   584   27%   760   40% 
 185 BrutusRND                    483   41   41   552   15%   772   30% 

Code: Select all

Games        :  85248 (finished)

White Wins   :  34600 (40.6 %)
Black Wins   :  29952 (35.1 %)
Draws        :  20696 (24.3 %)
Unfinished   :      5

White Perf.  : 52.7 %
Black Perf.  : 47.3 %

ECO A =  15051 Games (17.7 %)
ECO B =  22024 Games (25.8 %)
ECO C =  18488 Games (21.7 %)
ECO D =  17638 Games (20.7 %)
ECO E =  11776 Games (13.8 %)
I will make the games available in the near future.

If your engine is not on the list, know that it will be tested eventually. If
you want to cut in line in front of the other engines, send me a pm.

Any suggestions are welcomed.

Adam
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: A rating list

Post by michiguel »

Great work!

Miguel
User avatar
Graham Banks
Posts: 45132
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: A rating list

Post by Graham Banks »

Nice job Adam. :)
gbanksnz at gmail.com
Mincho Georgiev
Posts: 454
Joined: Sat Apr 04, 2009 6:44 pm
Location: Bulgaria

Re: A rating list

Post by Mincho Georgiev »

And Pawny is off-the list again :?
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: A rating list

Post by Adam Hair »

Mincho Georgiev wrote:And Pawny is off-the list again :?
Sorry Mincho! I will start playing Pawny this week :wink:
Mincho Georgiev
Posts: 454
Joined: Sat Apr 04, 2009 6:44 pm
Location: Bulgaria

Re: A rating list

Post by Mincho Georgiev »

Adam Hair wrote:
Mincho Georgiev wrote:And Pawny is off-the list again :?
Sorry Mincho! I will start playing Pawny this week :wink:
Many Thanks, Adam!
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: A rating list

Post by Adam Hair »

michiguel wrote:Great work!

Miguel
Thank you Miguel. I'm doing this because it is something I'm interested in,
but increasingly more so, I'm doing this because it does provide a little help
to engine authors, if nothing more than to inspire them to work on their
engines.
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: A rating list

Post by Adam Hair »

Graham Banks wrote:Nice job Adam. :)
Thank you Graham. The CCRL is my role model and guide.
Carlos777
Posts: 1977
Joined: Sun Dec 13, 2009 6:09 pm

Re: A rating list

Post by Carlos777 »

Hi Adam,

Finally you posted it. :D

Thank you for testing so many engines.

Best,
Carlos
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: A rating list

Post by Adam Hair »

Carlos777 wrote:Hi Adam,

Finally you posted it. :D

Thank you for testing so many engines.

Best,
Carlos
Yeah, I decided to post, even though I have a lot of games left to play just
to finalize the first phase of the the list. Not to mention the 100+ engines I
have not gotten to yet, nor the new engines and new versions of existing
engines. I'm sure that I will never cover them all.

By the way, thank you for your testing. Your work has been valuable to me.