Tournament of the Also-Rans

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Tournament of the Also-Rans

Post by Adam Hair »

Also-ran is a term from horse racing for a horse that finishes outside the top three.

My use of the term is for weaker engines, old and new, that have not been tested for the CCRL blitz list. Besides Oliver DeVille (Chess War) and Leo Dijksman (WBEC), most people do not spend time testing these engines. Two years ago, Carlos Pagador did a great job creating a list called "Battle of the Forgotten" which highlighted these engines. Though many people's interest lies with the strongest engines (and I must admit, I can not wait for Komodo 4 and the next version of Critter), there are a handful of us, authors and enthusiasts, who like these unsung engines. For myself, I like watching some of these engines play because I can understand their moves :) .

The intent of my testing is to included many of the engines into the CCRL 40/4 rating list. Thus, they will be tested under the exact same conditions that I use for all other engines. Also, engines that I deem to be a bit too troublesome will be dropped from the tests. I will report any problems that I come across for all to see. I hope my efforts will highlight some nice engines (and their authors) for others to appreciate, and maybe even play against.

The first part of my testing consist of each canidate engine playiing a 4 round gauntlet against the bottom 30 engines from the CCRL 40/4 rating list (Note: I have had some trouble making Cecir run properly, so I replaced it with Dabbaba). The test conditions are as follows:

OS: Windows XP 64-bit
GUI: Arena 2.01
Time Control: 40 moves in 3 minutes, repeating (conforms to 40/4 on CCRL reference computer)
Starting Positions: 17,909 positions 4 moves deep
Rating Program: Bayeselo

Here are results for the first set of engines:
The games used to construct this list included CCRL games played between the bottom 30 engines from the CCRL 40/4 rating list

Code: Select all

Rank Name                         Elo    +    - games score oppo. draws 
   1 KMTChess 1.2.1 64-bit       2244  113   88   120   95%  1754    6% 
   2 Betsabe II 1.09 JA          2122  185  133    30   93%  1754   13% 
   3 ProChess 101 CN             2056   75   67   117   84%  1751   10% 
   4 Protej 0.57                 2038   74   67   114   81%  1753    7% 
   5 Zeta Dva 0204 64-bit JA     2035   73   66   110   83%  1748   15% 
   6 Arabian Knight 1.51 JA      1980   65   60   118   78%  1752   16% 
   7 Dabbaba 2.62                1945   34   33   423   73%  1741   11% 
   8 Grizzly 1.40.1b             1904   25   24   736   69%  1740   13% 
   9 Predateur 2.1 64-bit        1902   26   26   630   67%  1761   14% 
  10 Beaches 2.32                1894   29   28   532   67%  1749   14% 
  11 MatMoi 0.7.15               1884   60   57   118   66%  1753   14% 
  12 Soldat 0.25b                1875   21   21   874   67%  1736   22% 
  13 NoonianChess 3206P2         1875   88   83    50   67%  1749   22% 
  14 RataAeroespacial 0.2.1      1873   61   59   118   64%  1753   10% 
  15 Cecir 3.5                   1868   25   24   630   63%  1771   19% 
  16 Chenard 2010.08.23 64-bit   1855   26   26   586   57%  1794   15% 
  17 Embracer 1.12               1833   25   25   602   61%  1748   23% 
  18 Robin 0.983                 1830   21   21   839   60%  1745   20% 
  19 Elf 1.3.0                   1826   20   20   942   60%  1743   18% 
  20 Laurifer 1.0                1809   21   21   872   58%  1739   19% 
  21 Tscp 1.81                   1800   25   25   630   58%  1732   18% 
  22 Adamant 1.7                 1800   20   20   963   55%  1755   19% 
  23 SEE 0.6.9                   1776   21   21   868   55%  1736   20% 
  24 Bace 0.45                   1776   19   19   999   53%  1749   21% 
  25 Aldebaran 0.7.0             1776   20   20   869   55%  1735   35% 
  26 GChess IV 0.2.0             1772   22   22   745   57%  1717   30% 
  27 JaksaH 1.11 64-bit          1767   54   54   116   53%  1750   26% 
  28 Mizar 3.0                   1761   21   21   911   52%  1740   17% 
  29 Belzebub 0.67               1745   21   22   776   50%  1742   27% 
  30 PolarChess 1.3              1741   20   21   913   49%  1748   18% 
  31 DChess 1.0.2                1730   20   20   973   48%  1749   19% 
  32 ALChess 1.5b                1719   20   20   907   47%  1744   21% 
  33 Storm 0.6                   1719   21   21   874   46%  1753   16% 
  34 Vapor 0.01r12               1707   52   53   118   44%  1752   38% 
  35 MSCP 1.44                   1685   20   20   954   41%  1756   18% 
  36 Damas 9                     1663   56   58   119   39%  1753   13% 
  37 Needle 0.531                1661   20   21   926   37%  1754   23% 
  38 Zotron 4.4.6                1651   21   21   847   39%  1734   24% 
  39 Rocinante 1.01 64-bit       1641   21   21   902   38%  1734   18% 
  40 Larsen VB 0.05.0001         1607   23   24   750   34%  1735   17% 
  41 VanillaChess 2.6g           1596   58   62   116   30%  1754   14% 
  42 Alibaba 1.38 wb JA          1595   60   64   107   30%  1755   15% 
  43 Vajolet 0.4.1               1578   59   63   119   29%  1755   11% 
  44 Purple Haze 2.0             1578   28   28   536   28%  1750   22% 
  45 MiniMax                     1577   84   92    54   28%  1752   15% 
  46 Pentagon 1.2                1565   56   60   117   24%  1755   30% 
  47 Butterfly 0.4               1559   59   63    99   24%  1754   36% 
  48 Piranha 0.5                 1555   23   23   851   28%  1737   13% 
  49 Tarrasch Toy Engine 0.906   1554   60   65   117   26%  1752   11% 
  50 St Andersen 1.31 64-bit JA  1551   60   64   119   25%  1755   13% 
  51 Numpty Omega                1502   61   67   119   20%  1753   15% 
  52 Yawce 0.16                  1477  196  266    10   20%  1743    0% 
  53 MiniMardi 1.3               1467   26   27   746   20%  1727   14% 
  54 EvolChess 0.6.15            1369   99  120    48   11%  1725   19% 
  55 Toledo nanoChess v15012010  1289   84  105   119    6%  1755    8% 
  56 TRex 1.9                    1288   85  105   120    6%  1753    8% 
  57 SUPRA 8.2.2                 1208  189  336    16    3%  1677    6% 
  58 Safrad 2.1.35.210           1127  119  177   116    2%  1752    3% 
lucasart
Posts: 3242
Joined: Mon May 31, 2010 1:29 pm
Full name: lucasart

Re: Tournament of the Also-Rans

Post by lucasart »

there's a player on FICS called fjjvh. This program is so weak... It's almost as good as a random move generator. You might want to test this one (although I dont know where to find it).
smatovic
Posts: 3376
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: Tournament of the Also-Rans

Post by smatovic »

cool, thanks.

--
Srdja
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Tournament of the Also-Rans

Post by Adam Hair »

lucasart wrote:there's a player on FICS called fjjvh. This program is so weak... It's almost as good as a random move generator. You might want to test this one (although I dont know where to find it).
Here is the bottom end of a personal rating list of mine. BrutusRND and I believe Ram are random movers (HGM is the author of Ram).

I don't think I will carry it out this far again. The engines (other than the random movers) at the very bottom are buggy. Adjudicating their games was and would be a big headache.

Code: Select all

135 Taktix_223                  1992   21   21  1254   52%  1975   17% 
 136 BigLion_223x                1982   21   21  1148   43%  2037   17% 
 137 Marvin_130                  1982   21   21  1216   45%  2021   19% 
 138 MatMoi_7.15.0_cct_x64       1981   21   21  1186   41%  2055   18% 
 139 Micromax48_c2d              1978   21   21  1205   44%  2024   19% 
 140 Sjakk v1.1.5                1965   24   24   871   47%  1988   17% 
 141 Warrior_103                 1945   21   21  1238   51%  1938   20% 
 142 Smash                       1918   21   21  1307   47%  1944   16% 
 143 SnailChess_4013             1910   22   22  1299   60%  1819   15% 
 144 Surprise_4.3b13             1908   21   21  1211   46%  1936   15% 
 145 Clueless_14                 1886   22   22  1220   44%  1938   12% 
 146 Embracer_112                1850   21   21  1225   55%  1805   28% 
 147 Grizzly1401b                1831   22   22  1240   52%  1806   13% 
 148 Elf130                      1761   22   22  1196   47%  1784   15% 
 149 TSCP181                     1732   22   22  1291   48%  1751   14% 
 150 Mephisto_MM V               1713   27   27   741   47%  1740   19% 
 151 Mizar3.0                    1708   24   24  1043   53%  1687   18% 
 152 DChess1_0_2                 1695   24   24  1057   51%  1694   16% 
 153 Storm_06                    1677   24   24  1069   48%  1696   17% 
 154 Beaches226                  1666   24   24  1040   53%  1649   14% 
 155 PolarChess1.2               1659   23   23  1119   49%  1670   17% 
 156 Bace_045                    1652   23   23  1265   47%  1687   17% 
 157 MSCP_144_uci_ja             1648   24   24  1073   51%  1619   18% 
 158 Needle_0531                 1595   24   24  1061   55%  1534   24% 
 159 RataAeroespacial005         1542   27   27   827   67%  1402   29% 
 160 LarsenVB                    1529   25   25  1025   46%  1546   15% 
 161 Pentagon_12                 1507   24   24  1014   37%  1607   29% 
 162 StAndersen_v1.31_X64        1490   25   25  1047   37%  1597   16% 
 163 Braincrack_alpha_ja         1488   28   28   784   59%  1409   15% 
 164 TarraschToyEngineV0.906     1486   24   24  1151   37%  1595   16% 
 165 Yawce016                    1485   24   24  1243   53%  1457   13% 
 166 Nero_61                     1457   23   23  1373   44%  1513   17% 
 167 Eden0013-jet                1388   27   27  1042   57%  1318   15% 
 168 Joanna2002-104_ja           1376   26   26  1059   54%  1352   32% 
 169 Fimbulwinter_5_00           1335   28   28   963   58%  1277   14% 
 170 MiniChessAI_119             1316   28   28   864   55%  1279   24% 
 171 Numpty_0.4pr                1260   26   26  1115   44%  1306   22% 
 172 Trex1.9                     1254   27   27  1114   56%  1207   21% 
 173 Gringo149b                  1244   28   28   937   46%  1274   20% 
 174 Marquis16                   1242   28   28  1006   52%  1230   21% 
 175 KillerQueen_20b3            1230   28   28  1164   64%  1117   29% 
 176 Toledo_Nanochess_wb         1222   26   26  1173   53%  1204   37% 
 177 Mystery2.1                  1216   27   27   941   41%  1280   44% 
 178 QuteChess_101t_rev3_ja      1205   28   28  1012   63%  1100   37% 
 179 Pierre17ja                  1202   27   27  1397   54%  1167   11% 
 180 BlitzKibitz5                1190   27   27   955   38%  1281   39% 
 181 Raffaela                    1178   28   28  1163   60%  1103   31% 
 182 BRAMA_051204                1148   27   27  1177   55%  1104   34% 
 183 Talvmenni                   1076   29   29  1042   59%   978   34% 
 184 BlitzterV2_0                1049   31   31  1129   54%   993    6% 
 185 Xadreco_v5.7                1033   27   27  1568   47%  1059   19% 
 186 MFChess_13_ja               1011   29   29  1108   51%   987   35% 
 187 Youk_105                     987   31   31   941   54%   940   27% 
 188 GIUChess10-beta2-dc          983   31   31   915   54%   934   30% 
 189 Testina2_2                   971   28   28  1312   44%  1014   30% 
 190 NSVChess v0.14               952   31   31   912   50%   933   29% 
 191 EvolChess_0.05               896   30   30  1202   54%   865   26% 
 192 Cassandre_0.21               883   29   29  1254   51%   869   33% 
 193 Dika_04209                   839   29   29  1289   46%   881   49% 
 194 Pyotr-am_06                  817   28   28  1676   35%   964   27% 
 195 Ram2.0                       715   33   33   802   42%   779   40% 
 196 Neg03d                       651   33   33   933   32%   815   28% 
 197 Dendron042_win32             634   33   33   890   31%   811   46% 
 198 CPP1                         571   36   36   725   24%   807   25% 
 199 LaMoSca_v0.10                568   34   34   771   25%   788   46% 
 200 POS-1.20                     518   35   35   819   20%   793   29% 
 201 BrutusRND                    416   39   39   789   11%   805   21% 
User avatar
geots
Posts: 4790
Joined: Sat Mar 11, 2006 12:42 am

Re: Tournament of the Also-Rans

Post by geots »

Adam Hair wrote:Also-ran is a term from horse racing for a horse that finishes outside the top three.

My use of the term is for weaker engines, old and new, that have not been tested for the CCRL blitz list. Besides Oliver DeVille (Chess War) and Leo Dijksman (WBEC), most people do not spend time testing these engines. Two years ago, Carlos Pagador did a great job creating a list called "Battle of the Forgotten" which highlighted these engines. Though many people's interest lies with the strongest engines (and I must admit, I can not wait for Komodo 4 and the next version of Critter), there are a handful of us, authors and enthusiasts, who like these unsung engines. For myself, I like watching some of these engines play because I can understand their moves :) .

The intent of my testing is to included many of the engines into the CCRL 40/4 rating list. Thus, they will be tested under the exact same conditions that I use for all other engines. Also, engines that I deem to be a bit too troublesome will be dropped from the tests. I will report any problems that I come across for all to see. I hope my efforts will highlight some nice engines (and their authors) for others to appreciate, and maybe even play against.

The first part of my testing consist of each canidate engine playiing a 4 round gauntlet against the bottom 30 engines from the CCRL 40/4 rating list (Note: I have had some trouble making Cecir run properly, so I replaced it with Dabbaba). The test conditions are as follows:

OS: Windows XP 64-bit
GUI: Arena 2.01
Time Control: 40 moves in 3 minutes, repeating (conforms to 40/4 on CCRL reference computer)
Starting Positions: 17,909 positions 4 moves deep
Rating Program: Bayeselo

Here are results for the first set of engines:
The games used to construct this list included CCRL games played between the bottom 30 engines from the CCRL 40/4 rating list

Code: Select all

Rank Name                         Elo    +    - games score oppo. draws 
   1 KMTChess 1.2.1 64-bit       2244  113   88   120   95%  1754    6% 
   2 Betsabe II 1.09 JA          2122  185  133    30   93%  1754   13% 
   3 ProChess 101 CN             2056   75   67   117   84%  1751   10% 
   4 Protej 0.57                 2038   74   67   114   81%  1753    7% 
   5 Zeta Dva 0204 64-bit JA     2035   73   66   110   83%  1748   15% 
   6 Arabian Knight 1.51 JA      1980   65   60   118   78%  1752   16% 
   7 Dabbaba 2.62                1945   34   33   423   73%  1741   11% 
   8 Grizzly 1.40.1b             1904   25   24   736   69%  1740   13% 
   9 Predateur 2.1 64-bit        1902   26   26   630   67%  1761   14% 
  10 Beaches 2.32                1894   29   28   532   67%  1749   14% 
  11 MatMoi 0.7.15               1884   60   57   118   66%  1753   14% 
  12 Soldat 0.25b                1875   21   21   874   67%  1736   22% 
  13 NoonianChess 3206P2         1875   88   83    50   67%  1749   22% 
  14 RataAeroespacial 0.2.1      1873   61   59   118   64%  1753   10% 
  15 Cecir 3.5                   1868   25   24   630   63%  1771   19% 
  16 Chenard 2010.08.23 64-bit   1855   26   26   586   57%  1794   15% 
  17 Embracer 1.12               1833   25   25   602   61%  1748   23% 
  18 Robin 0.983                 1830   21   21   839   60%  1745   20% 
  19 Elf 1.3.0                   1826   20   20   942   60%  1743   18% 
  20 Laurifer 1.0                1809   21   21   872   58%  1739   19% 
  21 Tscp 1.81                   1800   25   25   630   58%  1732   18% 
  22 Adamant 1.7                 1800   20   20   963   55%  1755   19% 
  23 SEE 0.6.9                   1776   21   21   868   55%  1736   20% 
  24 Bace 0.45                   1776   19   19   999   53%  1749   21% 
  25 Aldebaran 0.7.0             1776   20   20   869   55%  1735   35% 
  26 GChess IV 0.2.0             1772   22   22   745   57%  1717   30% 
  27 JaksaH 1.11 64-bit          1767   54   54   116   53%  1750   26% 
  28 Mizar 3.0                   1761   21   21   911   52%  1740   17% 
  29 Belzebub 0.67               1745   21   22   776   50%  1742   27% 
  30 PolarChess 1.3              1741   20   21   913   49%  1748   18% 
  31 DChess 1.0.2                1730   20   20   973   48%  1749   19% 
  32 ALChess 1.5b                1719   20   20   907   47%  1744   21% 
  33 Storm 0.6                   1719   21   21   874   46%  1753   16% 
  34 Vapor 0.01r12               1707   52   53   118   44%  1752   38% 
  35 MSCP 1.44                   1685   20   20   954   41%  1756   18% 
  36 Damas 9                     1663   56   58   119   39%  1753   13% 
  37 Needle 0.531                1661   20   21   926   37%  1754   23% 
  38 Zotron 4.4.6                1651   21   21   847   39%  1734   24% 
  39 Rocinante 1.01 64-bit       1641   21   21   902   38%  1734   18% 
  40 Larsen VB 0.05.0001         1607   23   24   750   34%  1735   17% 
  41 VanillaChess 2.6g           1596   58   62   116   30%  1754   14% 
  42 Alibaba 1.38 wb JA          1595   60   64   107   30%  1755   15% 
  43 Vajolet 0.4.1               1578   59   63   119   29%  1755   11% 
  44 Purple Haze 2.0             1578   28   28   536   28%  1750   22% 
  45 MiniMax                     1577   84   92    54   28%  1752   15% 
  46 Pentagon 1.2                1565   56   60   117   24%  1755   30% 
  47 Butterfly 0.4               1559   59   63    99   24%  1754   36% 
  48 Piranha 0.5                 1555   23   23   851   28%  1737   13% 
  49 Tarrasch Toy Engine 0.906   1554   60   65   117   26%  1752   11% 
  50 St Andersen 1.31 64-bit JA  1551   60   64   119   25%  1755   13% 
  51 Numpty Omega                1502   61   67   119   20%  1753   15% 
  52 Yawce 0.16                  1477  196  266    10   20%  1743    0% 
  53 MiniMardi 1.3               1467   26   27   746   20%  1727   14% 
  54 EvolChess 0.6.15            1369   99  120    48   11%  1725   19% 
  55 Toledo nanoChess v15012010  1289   84  105   119    6%  1755    8% 
  56 TRex 1.9                    1288   85  105   120    6%  1753    8% 
  57 SUPRA 8.2.2                 1208  189  336    16    3%  1677    6% 
  58 Safrad 2.1.35.210           1127  119  177   116    2%  1752    3% 




I think this is really great that you are doing this. All these authors deserve recognition for their work. They work just as hard ad anyone else.


Best,

george
lucasart
Posts: 3242
Joined: Mon May 31, 2010 1:29 pm
Full name: lucasart

Re: Tournament of the Also-Rans

Post by lucasart »

Adam Hair wrote: I don't think I will carry it out this far again. The engines (other than the random movers) at the very bottom are buggy. Adjudicating their games was and would be a big headache.

Code: Select all

135 Taktix_223                  1992   21   21  1254   52%  1975   17% 
 136 BigLion_223x                1982   21   21  1148   43%  2037   17% 
 137 Marvin_130                  1982   21   21  1216   45%  2021   19% 
 138 MatMoi_7.15.0_cct_x64       1981   21   21  1186   41%  2055   18% 
 139 Micromax48_c2d              1978   21   21  1205   44%  2024   19% 
 140 Sjakk v1.1.5                1965   24   24   871   47%  1988   17% 
 141 Warrior_103                 1945   21   21  1238   51%  1938   20% 
 142 Smash                       1918   21   21  1307   47%  1944   16% 
 143 SnailChess_4013             1910   22   22  1299   60%  1819   15% 
 144 Surprise_4.3b13             1908   21   21  1211   46%  1936   15% 
 145 Clueless_14                 1886   22   22  1220   44%  1938   12% 
 146 Embracer_112                1850   21   21  1225   55%  1805   28% 
 147 Grizzly1401b                1831   22   22  1240   52%  1806   13% 
 148 Elf130                      1761   22   22  1196   47%  1784   15% 
 149 TSCP181                     1732   22   22  1291   48%  1751   14% 
 150 Mephisto_MM V               1713   27   27   741   47%  1740   19% 
 151 Mizar3.0                    1708   24   24  1043   53%  1687   18% 
 152 DChess1_0_2                 1695   24   24  1057   51%  1694   16% 
 153 Storm_06                    1677   24   24  1069   48%  1696   17% 
 154 Beaches226                  1666   24   24  1040   53%  1649   14% 
 155 PolarChess1.2               1659   23   23  1119   49%  1670   17% 
 156 Bace_045                    1652   23   23  1265   47%  1687   17% 
 157 MSCP_144_uci_ja             1648   24   24  1073   51%  1619   18% 
 158 Needle_0531                 1595   24   24  1061   55%  1534   24% 
 159 RataAeroespacial005         1542   27   27   827   67%  1402   29% 
 160 LarsenVB                    1529   25   25  1025   46%  1546   15% 
 161 Pentagon_12                 1507   24   24  1014   37%  1607   29% 
 162 StAndersen_v1.31_X64        1490   25   25  1047   37%  1597   16% 
 163 Braincrack_alpha_ja         1488   28   28   784   59%  1409   15% 
 164 TarraschToyEngineV0.906     1486   24   24  1151   37%  1595   16% 
 165 Yawce016                    1485   24   24  1243   53%  1457   13% 
 166 Nero_61                     1457   23   23  1373   44%  1513   17% 
 167 Eden0013-jet                1388   27   27  1042   57%  1318   15% 
 168 Joanna2002-104_ja           1376   26   26  1059   54%  1352   32% 
 169 Fimbulwinter_5_00           1335   28   28   963   58%  1277   14% 
 170 MiniChessAI_119             1316   28   28   864   55%  1279   24% 
 171 Numpty_0.4pr                1260   26   26  1115   44%  1306   22% 
 172 Trex1.9                     1254   27   27  1114   56%  1207   21% 
 173 Gringo149b                  1244   28   28   937   46%  1274   20% 
 174 Marquis16                   1242   28   28  1006   52%  1230   21% 
 175 KillerQueen_20b3            1230   28   28  1164   64%  1117   29% 
 176 Toledo_Nanochess_wb         1222   26   26  1173   53%  1204   37% 
 177 Mystery2.1                  1216   27   27   941   41%  1280   44% 
 178 QuteChess_101t_rev3_ja      1205   28   28  1012   63%  1100   37% 
 179 Pierre17ja                  1202   27   27  1397   54%  1167   11% 
 180 BlitzKibitz5                1190   27   27   955   38%  1281   39% 
 181 Raffaela                    1178   28   28  1163   60%  1103   31% 
 182 BRAMA_051204                1148   27   27  1177   55%  1104   34% 
 183 Talvmenni                   1076   29   29  1042   59%   978   34% 
 184 BlitzterV2_0                1049   31   31  1129   54%   993    6% 
 185 Xadreco_v5.7                1033   27   27  1568   47%  1059   19% 
 186 MFChess_13_ja               1011   29   29  1108   51%   987   35% 
 187 Youk_105                     987   31   31   941   54%   940   27% 
 188 GIUChess10-beta2-dc          983   31   31   915   54%   934   30% 
 189 Testina2_2                   971   28   28  1312   44%  1014   30% 
 190 NSVChess v0.14               952   31   31   912   50%   933   29% 
 191 EvolChess_0.05               896   30   30  1202   54%   865   26% 
 192 Cassandre_0.21               883   29   29  1254   51%   869   33% 
 193 Dika_04209                   839   29   29  1289   46%   881   49% 
 194 Pyotr-am_06                  817   28   28  1676   35%   964   27% 
 195 Ram2.0                       715   33   33   802   42%   779   40% 
 196 Neg03d                       651   33   33   933   32%   815   28% 
 197 Dendron042_win32             634   33   33   890   31%   811   46% 
 198 CPP1                         571   36   36   725   24%   807   25% 
 199 LaMoSca_v0.10                568   34   34   771   25%   788   46% 
 200 POS-1.20                     518   35   35   819   20%   793   29% 
 201 BrutusRND                    416   39   39   789   11%   805   21% 
I can make a few trivial modifications to my engine DoubleCheck to make it play random moves
So I can finally make to the first place of a rating list (starting from the bottom) :D
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Tournament of the Also-Rans

Post by Adam Hair »

Thanks, George.
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Tournament of the Also-Rans

Post by Adam Hair »

lucasart wrote:
Adam Hair wrote: I don't think I will carry it out this far again. The engines (other than the random movers) at the very bottom are buggy. Adjudicating their games was and would be a big headache.

Code: Select all

135 Taktix_223                  1992   21   21  1254   52%  1975   17% 
 136 BigLion_223x                1982   21   21  1148   43%  2037   17% 
 137 Marvin_130                  1982   21   21  1216   45%  2021   19% 
 138 MatMoi_7.15.0_cct_x64       1981   21   21  1186   41%  2055   18% 
 139 Micromax48_c2d              1978   21   21  1205   44%  2024   19% 
 140 Sjakk v1.1.5                1965   24   24   871   47%  1988   17% 
 141 Warrior_103                 1945   21   21  1238   51%  1938   20% 
 142 Smash                       1918   21   21  1307   47%  1944   16% 
 143 SnailChess_4013             1910   22   22  1299   60%  1819   15% 
 144 Surprise_4.3b13             1908   21   21  1211   46%  1936   15% 
 145 Clueless_14                 1886   22   22  1220   44%  1938   12% 
 146 Embracer_112                1850   21   21  1225   55%  1805   28% 
 147 Grizzly1401b                1831   22   22  1240   52%  1806   13% 
 148 Elf130                      1761   22   22  1196   47%  1784   15% 
 149 TSCP181                     1732   22   22  1291   48%  1751   14% 
 150 Mephisto_MM V               1713   27   27   741   47%  1740   19% 
 151 Mizar3.0                    1708   24   24  1043   53%  1687   18% 
 152 DChess1_0_2                 1695   24   24  1057   51%  1694   16% 
 153 Storm_06                    1677   24   24  1069   48%  1696   17% 
 154 Beaches226                  1666   24   24  1040   53%  1649   14% 
 155 PolarChess1.2               1659   23   23  1119   49%  1670   17% 
 156 Bace_045                    1652   23   23  1265   47%  1687   17% 
 157 MSCP_144_uci_ja             1648   24   24  1073   51%  1619   18% 
 158 Needle_0531                 1595   24   24  1061   55%  1534   24% 
 159 RataAeroespacial005         1542   27   27   827   67%  1402   29% 
 160 LarsenVB                    1529   25   25  1025   46%  1546   15% 
 161 Pentagon_12                 1507   24   24  1014   37%  1607   29% 
 162 StAndersen_v1.31_X64        1490   25   25  1047   37%  1597   16% 
 163 Braincrack_alpha_ja         1488   28   28   784   59%  1409   15% 
 164 TarraschToyEngineV0.906     1486   24   24  1151   37%  1595   16% 
 165 Yawce016                    1485   24   24  1243   53%  1457   13% 
 166 Nero_61                     1457   23   23  1373   44%  1513   17% 
 167 Eden0013-jet                1388   27   27  1042   57%  1318   15% 
 168 Joanna2002-104_ja           1376   26   26  1059   54%  1352   32% 
 169 Fimbulwinter_5_00           1335   28   28   963   58%  1277   14% 
 170 MiniChessAI_119             1316   28   28   864   55%  1279   24% 
 171 Numpty_0.4pr                1260   26   26  1115   44%  1306   22% 
 172 Trex1.9                     1254   27   27  1114   56%  1207   21% 
 173 Gringo149b                  1244   28   28   937   46%  1274   20% 
 174 Marquis16                   1242   28   28  1006   52%  1230   21% 
 175 KillerQueen_20b3            1230   28   28  1164   64%  1117   29% 
 176 Toledo_Nanochess_wb         1222   26   26  1173   53%  1204   37% 
 177 Mystery2.1                  1216   27   27   941   41%  1280   44% 
 178 QuteChess_101t_rev3_ja      1205   28   28  1012   63%  1100   37% 
 179 Pierre17ja                  1202   27   27  1397   54%  1167   11% 
 180 BlitzKibitz5                1190   27   27   955   38%  1281   39% 
 181 Raffaela                    1178   28   28  1163   60%  1103   31% 
 182 BRAMA_051204                1148   27   27  1177   55%  1104   34% 
 183 Talvmenni                   1076   29   29  1042   59%   978   34% 
 184 BlitzterV2_0                1049   31   31  1129   54%   993    6% 
 185 Xadreco_v5.7                1033   27   27  1568   47%  1059   19% 
 186 MFChess_13_ja               1011   29   29  1108   51%   987   35% 
 187 Youk_105                     987   31   31   941   54%   940   27% 
 188 GIUChess10-beta2-dc          983   31   31   915   54%   934   30% 
 189 Testina2_2                   971   28   28  1312   44%  1014   30% 
 190 NSVChess v0.14               952   31   31   912   50%   933   29% 
 191 EvolChess_0.05               896   30   30  1202   54%   865   26% 
 192 Cassandre_0.21               883   29   29  1254   51%   869   33% 
 193 Dika_04209                   839   29   29  1289   46%   881   49% 
 194 Pyotr-am_06                  817   28   28  1676   35%   964   27% 
 195 Ram2.0                       715   33   33   802   42%   779   40% 
 196 Neg03d                       651   33   33   933   32%   815   28% 
 197 Dendron042_win32             634   33   33   890   31%   811   46% 
 198 CPP1                         571   36   36   725   24%   807   25% 
 199 LaMoSca_v0.10                568   34   34   771   25%   788   46% 
 200 POS-1.20                     518   35   35   819   20%   793   29% 
 201 BrutusRND                    416   39   39   789   11%   805   21% 
I can make a few trivial modifications to my engine DoubleCheck to make it play random moves
So I can finally make to the first place of a rating list (starting from the bottom) :D
:lol:
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Tournament of the Also-Rans

Post by Adam Hair »

As of December 28, 2011:

Code: Select all

Rank Name                         Elo    +    - games score oppo. draws 
   1 KMTChess 1.2.1 64-bit       2246  114   89   119   95%  1759    6% 
   2 EnginMax 5.24 64-bit        2242  550  225    18  100%  1696    0% 
   3 Betsabe II 1.09 JA          2230  109   86   118   94%  1759    7% 
   4 PLP 1661571 JA              2105   81   70   118   86%  1760    8% 
   5 ProChess 101 CN             2062   76   67   117   84%  1757   10% 
   6 Protej 0.57                 2043   75   67   114   81%  1758    7% 
   7 Zeta Dva 0204 64-bit JA     2041   73   66   110   83%  1754   15% 
   8 SamChess                    2039   87   77    87   82%  1756    8% 
   9 MrChess 2.1                 2035   71   64   117   82%  1758   13% 
  10 ChessterfieldCL i5a         2003   67   62   119   79%  1759   14% 
  11 Arabian Knight 1.51 JA      1986   65   60   118   78%  1758   16% 
  12 Tyrell 1.02                 1975   66   61   117   75%  1760   12% 
  13 Dabbaba 2.62                1950   31   30   529   73%  1731   12% 
  14 NoonianChess 3206P2         1923   61   58   117   71%  1762   18% 
  15 Grizzly 1.40.1b             1907   24   23   816   69%  1737   12% 
  16 HeavyChess 0.13 beta        1904   58   56   117   69%  1759   25% 
  17 Predateur 2.1 64-bit        1899   25   24   733   67%  1754   14% 
  18 Beaches 2.32                1892   27   26   637   66%  1743   14% 
  19 MatMoi 0.7.15               1889   60   58   118   66%  1759   14% 
  20 Bremboce 0.6.2              1883   58   56   120   65%  1760   19% 
  21 Soldat 0.25b                1881   21   20   978   68%  1734   21% 
  22 RataAeroespacial 0.2.1      1879   61   59   118   64%  1759   10% 
  23 Cecir 3.5                   1873   25   24   630   63%  1776   19% 
  24 Chenard 2010.08.23 64-bit   1855   24   24   688   57%  1782   15% 
  25 Vicki 0.041a                1854   60   58   114   62%  1756   16% 
  26 Mint 2.3                    1853   57   56   117   62%  1757   24% 
  27 Embracer 1.12               1845   24   24   706   62%  1742   22% 
  28 Lodocase 240208             1842  138  126    23   65%  1753    9% 
  29 Elf 1.3.0                   1838   20   20  1043   61%  1743   17% 
  30 Robin 0.983                 1836   21   20   943   61%  1742   19% 
  31 Laurifer 1.0                1817   20   20   977   59%  1737   18% 
  32 Pulsar 2009-9b              1806   73   72    69   57%  1758   22% 
  33 Adamant 1.7                 1805   19   19  1066   56%  1753   18% 
  34 Tscp 1.81                   1803   24   24   733   58%  1730   17% 
  35 Kanguruh 1.93               1794   57   56   114   55%  1755   21% 
  36 SEE 0.6.9                   1787   20   20   968   56%  1736   19% 
  37 Bace 0.45                   1782   19   19  1101   54%  1748   20% 
  38 GChess IV 0.2.0             1781   21   21   848   58%  1718   30% 
  39 Golem 0.441                 1779   57   56   116   53%  1757   17% 
  40 Aldebaran 0.7.0             1779   19   19   970   55%  1734   34% 
  41 JaksaH 1.11 64-bit          1772   55   54   116   53%  1756   26% 
  42 Mizar 3.0                   1765   20   20  1010   52%  1740   16% 
  43 AL Chess 1.5b               1754   51   50   191   55%  1690   15% 
  44 Belzebub 0.67               1752   21   21   876   51%  1742   26% 
  45 Jester 0.84 JA              1749   57   57   118   49%  1759   14% 
  46 PolarChess 1.3              1742   20   20  1005   49%  1748   17% 
  47 DChess 1.0.2                1734   19   19  1077   48%  1748   19% 
  48 Storm 0.6                   1721   21   21   974   46%  1751   15% 
  49 ALChess 1.5b                1719   21   21   820   45%  1755   22% 
  50 Vapor 0.01r12               1713   52   53   118   44%  1758   38% 
  51 Pooky 2.7                   1701   78   80    64   43%  1758   11% 
  52 MSCP 1.44                   1692   20   20  1055   42%  1754   17% 
  53 Damas 9                     1669   57   58   119   39%  1759   13% 
  54 Needle 0.531                1667   20   20  1030   38%  1753   23% 
  55 Zotron 4.4.6                1658   22   22   752   38%  1747   24% 
  56 Rocinante 1.01 64-bit       1647   20   20  1006   39%  1734   17% 
  57 Zotron 4.46                 1644   49   49   198   45%  1685   19% 
  58 SharpChess2 2.6             1623   60   63   117   34%  1758    5% 
  59 Larsen VB 0.05.0001         1612   22   23   850   35%  1737   16% 
  60 VanillaChess 2.6g           1602   59   62   116   30%  1759   14% 
  61 Alibaba 1.38 wb JA          1600   61   64   107   30%  1761   15% 
  62 Purple Haze 2.0             1586   26   26   637   30%  1745   22% 
  63 Vajolet 0.4.1               1584   60   63   119   29%  1760   11% 
  64 Butterfly 0.4               1575   56   59   113   25%  1762   35% 
  65 Pentagon 1.2                1571   56   60   117   24%  1760   30% 
  66 Piranha 0.5                 1560   22   22   953   29%  1736   13% 
  67 Tarrasch Toy Engine 0.906   1560   61   65   117   26%  1758   11% 
  68 St Andersen 1.31 64-bit JA  1557   60   64   119   25%  1760   13% 
  69 Yawce 0.16                  1553   64   69   105   25%  1759   12% 
  70 Nero 6.1                    1521   61   66   119   22%  1759   15% 
  71 Braincrack alpha JA         1508   66   73   109   20%  1767   12% 
  72 Numpty Omega                1507   62   68   119   20%  1759   15% 
  73 Tony's Chess 0.02           1497   65   72   118   20%  1761    9% 
  74 Exacto 0.d                  1496   62   68   116   18%  1758   22% 
  75 MiniMardi 1.3               1468   25   26   851   21%  1727   13% 
  76 Joanna 2002 1.03            1463   65   72   120   15%  1760   17% 
  77 KillerQueen 2.0b3           1401   72   83   112   10%  1759   15% 
  78 MiniChessAI 1.19            1381   76   89   116   11%  1760    7% 
  79 Toledo nanoChess v15012010  1294   85  105   119    6%  1760    8% 
  80 TRex 1.9                    1293   85  105   120    6%  1759    8% 
  81 Raffaela                    1291   85  105   120    5%  1760   10% 
  82 SUPRA 8.2.2                 1184  106  147   118    3%  1760    4% 
  83 Safrad 2.1.35.210           1133  120  178   116    2%  1758    3% 
  84 Supra 9.0                   1096  130  204   118    1%  1763    3% 
  85 Chad's Chess 0.15            936  209  466    69    0%  1744    0% 
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Tournament of the Also-Rans

Post by Adam Hair »

Corrected Dec 28 list:

Code: Select all

   1 KMTChess 1.2.1 64-bit       2246  114   89   119   95%  1758    6% 
   2 EnginMax 5.24 64-bit        2242  552  225    18  100%  1696    0% 
   3 Betsabe II 1.09 JA          2230  109   86   118   94%  1758    7% 
   4 PLP 1661571 JA              2105   81   70   118   86%  1760    8% 
   5 ProChess 101 CN             2061   76   67   117   84%  1757   10% 
   6 Protej 0.57                 2043   75   67   114   81%  1758    7% 
   7 Zeta Dva 0204 64-bit JA     2040   73   66   110   83%  1753   15% 
   8 SamChess                    2039   87   77    87   82%  1755    8% 
   9 MrChess 2.1                 2034   71   64   117   82%  1758   13% 
  10 ChessterfieldCL i5a         2003   67   62   119   79%  1759   14% 
  11 Arabian Knight 1.51 JA      1985   65   60   118   78%  1757   16% 
  12 Tyrell 1.02                 1975   66   61   117   75%  1760   12% 
  13 Dabbaba 2.62                1950   31   30   529   73%  1730   12% 
  14 NoonianChess 3206P2         1923   61   58   117   71%  1761   18% 
  15 Grizzly 1.40.1b             1908   24   23   816   69%  1738   12% 
  16 HeavyChess 0.13 beta        1903   58   56   117   69%  1758   25% 
  17 Predateur 2.1 64-bit        1899   25   24   733   67%  1754   14% 
  18 Beaches 2.32                1892   27   26   637   66%  1742   14% 
  19 MatMoi 0.7.15               1889   60   58   118   66%  1758   14% 
  20 Bremboce 0.6.2              1882   58   56   120   65%  1760   19% 
  21 Soldat 0.25b                1881   21   20   978   68%  1734   21% 
  22 RataAeroespacial 0.2.1      1878   61   59   118   64%  1759   10% 
  23 Cecir 3.5                   1874   25   24   630   63%  1777   19% 
  24 Chenard 2010.08.23 64-bit   1855   24   24   688   57%  1782   15% 
  25 Vicki 0.041a                1853   60   58   114   62%  1755   16% 
  26 Mint 2.3                    1852   57   56   117   62%  1757   24% 
  27 Embracer 1.12               1845   24   24   706   62%  1742   22% 
  28 Lodocase 240208             1842  138  126    23   65%  1754    9% 
  29 Elf 1.3.0                   1838   20   20  1043   61%  1743   17% 
  30 Robin 0.983                 1836   21   20   943   61%  1742   19% 
  31 Laurifer 1.0                1817   20   20   977   59%  1737   18% 
  32 Pulsar 2009-9b              1806   73   72    69   57%  1758   22% 
  33 Adamant 1.7                 1806   19   19  1066   56%  1753   18% 
  34 Tscp 1.81                   1803   24   24   733   58%  1730   17% 
  35 Kanguruh 1.93               1794   57   56   114   55%  1755   21% 
  36 SEE 0.6.9                   1788   20   20   968   56%  1736   19% 
  37 Bace 0.45                   1782   19   19  1101   54%  1748   20% 
  38 GChess IV 0.2.0             1781   21   21   848   58%  1718   30% 
  39 Aldebaran 0.7.0             1780   19   19   970   55%  1734   34% 
  40 Golem 0.441                 1779   56   56   116   53%  1756   17% 
  41 JaksaH 1.11 64-bit          1772   55   54   116   53%  1755   26% 
  42 Mizar 3.0                   1765   20   20  1010   52%  1740   16% 
  43 Belzebub 0.67               1752   21   21   876   51%  1742   26% 
  44 Jester 0.84 JA              1749   57   57   118   49%  1758   14% 
  45 PolarChess 1.3              1742   20   20  1005   49%  1748   17% 
  46 DChess 1.0.2                1734   19   19  1077   48%  1748   19% 
  47 ALChess 1.5b                1724   20   20  1011   47%  1743   20% 
  48 Storm 0.6                   1721   20   21   974   46%  1751   15% 
  49 Vapor 0.01r12               1712   52   53   118   44%  1757   38% 
  50 Pooky 2.7                   1700   78   80    64   43%  1758   11% 
  51 MSCP 1.44                   1692   20   20  1055   42%  1754   17% 
  52 Damas 9                     1668   57   58   119   39%  1758   13% 
  53 Needle 0.531                1667   20   20  1030   38%  1753   23% 
  54 Zotron 4.4.6                1656   20   20   950   40%  1734   23% 
  55 Rocinante 1.01 64-bit       1647   20   20  1006   39%  1735   17% 
  56 SharpChess2 2.6             1623   60   63   117   34%  1757    5% 
  57 Larsen VB 0.05.0001         1612   22   23   850   35%  1737   16% 
  58 VanillaChess 2.6g           1602   59   62   116   30%  1759   14% 
  59 Alibaba 1.38 wb JA          1600   61   64   107   30%  1760   15% 
  60 Purple Haze 2.0             1586   26   26   637   30%  1745   22% 
  61 Vajolet 0.4.1               1583   60   63   119   29%  1760   11% 
  62 Butterfly 0.4               1574   56   59   113   25%  1761   35% 
  63 Pentagon 1.2                1570   56   60   117   24%  1760   30% 
  64 Piranha 0.5                 1560   22   23   953   29%  1737   13% 
  65 Tarrasch Toy Engine 0.906   1559   61   65   117   26%  1757   11% 
  66 St Andersen 1.31 64-bit JA  1556   60   64   119   25%  1760   13% 
  67 Yawce 0.16                  1553   64   69   105   25%  1759   12% 
  68 Nero 6.1                    1521   61   66   119   22%  1758   15% 
  69 Braincrack alpha JA         1507   66   73   109   20%  1766   12% 
  70 Numpty Omega                1507   62   68   119   20%  1758   15% 
  71 Tony's Chess 0.02           1496   65   72   118   20%  1760    9% 
  72 Exacto 0.d                  1496   62   68   116   18%  1757   22% 
  73 MiniMardi 1.3               1468   25   26   851   21%  1727   13% 
  74 Joanna 2002 1.03            1463   65   72   120   15%  1760   17% 
  75 KillerQueen 2.0b3           1400   72   83   112   10%  1759   15% 
  76 MiniChessAI 1.19            1380   76   89   116   11%  1759    7% 
  77 Toledo nanoChess v15012010  1294   85  105   119    6%  1760    8% 
  78 TRex 1.9                    1293   85  105   120    6%  1758    8% 
  79 Raffaela                    1290   85  105   120    5%  1760   10% 
  80 SUPRA 8.2.2                 1183  106  147   118    3%  1759    4% 
  81 Safrad 2.1.35.210           1132  120  179   116    2%  1757    3% 
  82 Supra 9.0                   1094  130  205   118    1%  1762    3% 
  83 Chad's Chess 0.15            932  211  469    69    0%  1743    0%