Round-robin for Also-Rans

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Round-robin for Also-Rans

Post by Adam Hair »

I am currently running a round-robin for Also-Ran engines which need additional games. It also includes engines not yet on the Also-Ran list. Here is a ratings estimate (Ordo 0.6; rating for Tyrell 1.02 set at 1839 Elo) for the games played so far (excluding time forfeits and games adjudicated for rule infractions):

Code: Select all

# ENGINE                        : RATING    POINTS  PLAYED    (%)
   1 Bismark 1.4                   : 1981.0     203.0     230   88.3%
   2 Protej 0.57                   : 1936.8     199.5     234   85.3%
   3 Dabbaba 7.49                  : 1930.9     200.0     237   84.4%
   4 SamChess                      : 1904.9     207.0     249   83.1%
   5 Arabian Knight 1.51           : 1866.8     193.0     241   80.1%
   6 FreeChessII 2.17              : 1856.4     196.0     246   79.7%
   7 MrChess 2.1                   : 1850.8     193.5     244   79.3%
   8 Tyrell 1.02                   : 1839.0     192.5     245   78.6%
   9 HeavyChess 0.13 beta          : 1797.8     182.0     244   74.6%
  10 JARS 1.75a                    : 1783.0     172.5     235   73.4%
  11 Bremboce 0.6.2                : 1778.4     177.5     245   72.4%
  12 Milady 3.25                   : 1770.1     170.5     236   72.2%
  13 Eia 0.1                       : 1764.3     174.0     242   71.9%
  14 NoonianChess 3206P2           : 1761.3     177.0     246   72.0%
  15 Macromix 2.01                 : 1752.9     168.5     241   69.9%
  16 Vicki 0.41a                   : 1734.6     168.0     243   69.1%
  17 BeRoChess 1.00                : 1726.6     156.0     232   67.2%
  18 Pulsar 2009-9b                : 1723.7     167.5     242   69.2%
  19 Zoidberg 0.1                  : 1718.0     156.5     234   66.9%
  20 NGplay 0.83                   : 1714.7     159.5     238   67.0%
  21 Lodocase 240208               : 1713.6     164.0     243   67.5%
  22 Mint 2.3                      : 1703.3     167.5     250   67.0%
  23 Ziggy 0.7                     : 1684.0     151.5     236   64.2%
  24 Chess 4.1a                    : 1663.0     153.0     244   62.7%
  25 SharpChess2 2.6.9             : 1639.8     149.0     241   61.8%
  26 Tristram 3.36                 : 1616.2     136.0     233   58.4%
  27 Cmcchess 2.5                  : 1609.1     141.5     245   57.8%
  28 Revati 0.4c                   : 1598.7      88.5     144   61.5%
  29 Darky 0.5d                    : 1582.2     135.5     245   55.3%
  30 Marginal 0.1                  : 1562.8     127.0     232   54.7%
  31 Kitteneitor 0.18.1            : 1543.9     128.5     246   52.2%
  32 MSCP 1.6h                     : 1530.7     122.0     241   50.6%
  33 Alibaba 1.38                  : 1496.3      98.0     209   46.9%
  34 Apep 1.01                     : 1388.2      75.5     200   37.8%
  35 Nanook 0.17                   : 1381.6      95.0     241   39.4%
  36 SUPRA 15.0                    : 1371.5      68.0     183   37.2%
  37 Goyaz 0.007                   : 1370.3      91.0     241   37.8%
  38 VirutorChess 1.1              : 1325.3      86.5     245   35.3%
  39 Ozwald 0.43                   : 1310.1      78.5     247   31.8%
  40 Abulafia 0.61                 : 1298.1      59.0     185   31.9%
  41 MiniChessAI 1.19              : 1267.5      71.0     236   30.1%
  42 Skaki 1.23                    : 1249.6      69.5     240   29.0%
  43 Tikov 0.6.3 JA                : 1248.7      67.0     233   28.8%
  44 Joanna 2002 1.03              : 1228.2      62.0     227   27.3%
  45 KillerQueen 2.0b3             : 1217.7      62.5     224   27.9%
  46 QuTeChess 1.0.1t r3           : 1217.3      55.0     193   28.5%
  47 TRex 1.9 beta                 : 1215.3      64.5     245   26.3%
  48 Raffaela                      : 1199.6      63.5     243   26.1%
  49 Toledo nanoChess v15012010    : 1191.5      59.0     243   24.3%
  50 Project Invincible 2.04       : 1164.3      59.5     246   24.2%
  51 Gringo 1.4.9b                 : 1051.7      28.0     158   17.7%
  52 AdaChess 1.0                  :  965.1      30.5     246   12.4%
  53 Safrad 2.1.35.210             :  938.4      26.5     237   11.2%
  54 Zoe 0.1                       :  918.3      26.0     240   10.8%
  55 DarkFusch 0.9                 :  891.8      23.0     247    9.3%
  56 DarkTemplar 0.1               :  884.6      18.5     187    9.9%
  57 Fimbulwinter 5.00             :  871.7      21.0     248    8.5%
  58 Chess4j 1.2                   :  744.0      12.5     250    5.0%
What may be of interest to some is that the ratings for the engines for the already established Also-Ran engines roughly correspond with the ratings computed for the Also-Rans list (which are derived from the entire CCRL 40/4 database using Ordo), though the common opponent overlap between the two databases for each engine is small. I have not compared the Bayeselo ratings yet, but I fully expect those to roughly correspond also.
mloftus955
Posts: 98
Joined: Tue Jun 08, 2010 5:36 pm
Location: Westfield, IN
Full name: mark loftus

Re: Round-robin for Also-Rans

Post by mloftus955 »

Wow, what happened to Fimbulwinter 5?
I would have figured at least 1300 for the rating. It's not great in Arena, but would seem to be higher than 1000. In my Chessmaster 10th Edition it plays better.


Mark
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Round-robin for Also-Rans

Post by Adam Hair »

mloftus955 wrote:Wow, what happened to Fimbulwinter 5?
I would have figured at least 1300 for the rating. It's not great in Arena, but would seem to be higher than 1000. In my Chessmaster 10th Edition it plays better.


Mark
Thanks for pointing this out!

Fimbulwinter is rated 1337 on the CCRL 40/4 list, much higher than the rating here. Also, I just checked a few of its games, and it gave away pieces. It is not running correctly on my Pentium IV.
mloftus955
Posts: 98
Joined: Tue Jun 08, 2010 5:36 pm
Location: Westfield, IN
Full name: mark loftus

Re: Round-robin for Also-Rans

Post by mloftus955 »

Maybe the newer James Ablett version will run better.

Fimbulwinter 5.04ja

I appreciate what you are doing.


Mark