UCI Engines Ligue updated

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Le Fou numerique
Posts: 859
Joined: Wed Apr 05, 2006 9:58 pm
Location: Elsass

UCI Engines Ligue updated

Post by Le Fou numerique »

Hi,

The Divisions in the UCI Engines Ligue are updated.

45.338 games rated, 230.946 played.

Code: Select all

Rank Name                     Ruel    +    -  games score oppo. draws 
   1 Fruit 2.3.1              2699   21   21   856   69%  2548   29% 
   2 Spike 1.2 Turin          2684   14   14  1961   68%  2545   32% 
   3 Glaurung 2.0.1           2651   29   28   464   64%  2530   27% 
   4 Naum 2.0                 2617   14   14  1701   57%  2560   35% 
   5 Alaric 707               2613   19   19   980   56%  2562   28% 
   6 Bright 0.2c              2605   35   35   306   62%  2502   27% 
   7 Booot 4.14.0             2602   41   40   226   66%  2469   28% 
   8 Colossus 2007d           2575   24   24   646   52%  2551   27% 
   9 Pharaon 3.5.1            2563   14   14  1720   48%  2565   31% 
  10 SlowChess Blitz WV2.1    2562   15   15  1453   47%  2567   34% 
  11 Ruffian 1.0.5            2548   10   10  3621   54%  2512   31% 
  12 Delfi 5.2                2547   25   25   588   54%  2505   24% 
  13 Movei 0.08.438           2540   25   24   590   55%  2492   29% 
  14 List 5.12                2538   10   10  3375   53%  2510   33% 
  15 Hamsters 0.6             2528   33   33   326   58%  2465   28% 
  16 Aristarch 4.50           2528   10   11  3376   53%  2498   29% 
  17 SOS 5.1                  2500   12   12  2681   49%  2498   29% 
  18 Zappa 1.1                2499   12   12  2323   50%  2492   30% 
  19 Ktulu 4.2                2486   11   11  3198   50%  2477   26% 
  20 AnMon 5.60               2477   14   14  1826   53%  2447   27% 
  21 Alfil 8.1                2475   50   49   154   61%  2394   24% 
  22 Ufim 8.02                2471   17   17  1282   53%  2439   28% 
  23 Tao 5.6                  2451   13   13  2198   51%  2435   24% 
  24 Pepito v1.59             2442   12   12  2539   52%  2419   27% 
  25 Yace Paderborn           2427   12   12  2557   47%  2440   24% 
  26 Amyan 1.597              2413   14   14  1815   50%  2406   26% 
  27 Twisted Logic 20071202x  2407   35   35   284   53%  2378   26% 
  28 Arasan 10.1              2396   42   42   196   53%  2376   30% 
  29 Nejmet 3.07              2384   12   12  2502   52%  2363   28% 
  30 Delphil 1.8              2369   22   22   712   49%  2370   29% 
  31 Abrok 5.0                2365   12   12  2563   50%  2361   25% 
  32 Snitch 1.6.2             2364   16   16  1305   48%  2370   27% 
  33 Dragon 4.6               2362   13   13  2262   49%  2362   28% 
  34 Diablo 0.5.1             2351   16   16  1373   52%  2335   27% 
  35 Gaia 3.5                 2348   16   16  1510   50%  2344   22% 
  36 Sjeng 12.13              2346   13   13  2248   51%  2333   25% 
  37 Hermann 2.0              2344   20   21   840   50%  2342   26% 
  38 Cyrano 0.2f              2336   37   37   284   50%  2330   19% 
  39 Muse 0.899b              2334   14   14  1773   52%  2316   25% 
  40 Patzer 3.80              2321   18   18  1089   50%  2314   27% 
  41 Arion 1.7                2317   16   16  1389   49%  2319   29% 
  42 Flux 2.2                 2305   23   23   682   50%  2305   27% 
  43 Queen 4.03               2302   37   37   260   44%  2345   25% 
  44 Pupsi 0.19               2297   28   28   472   51%  2290   23% 
  45 Cheese 1.1b              2293   49   49   160   43%  2348   20% 
  46 GreKo 5.5                2290   38   39   244   44%  2339   24% 
  47 Aice 0.99.2              2289   18   18  1088   50%  2279   23% 
  48 Homer 2.01               2289   28   28   483   49%  2291   17% 
  49 Counter 0.8              2285   40   40   210   45%  2327   35% 
  50 Asterisk 0.6             2276   24   24   648   54%  2247   23% 
  51 BBChess 1.2a             2275   31   31   392   45%  2312   21% 
  52 Ayito 0.2.994            2263   16   16  1465   51%  2253   18% 
  53 Rotor 0.2                2255   25   25   572   47%  2278   23% 
  54 Anechka 0.08             2240   19   19  1070   49%  2246   20% 
  55 Chispa 4.0.3             2229   15   15  1664   52%  2213   28% 
  56 LittleThought 1.03       2225   46   48   188   38%  2329   14% 
  57 Gibbon 2.42c             2223   29   29   450   46%  2256   21% 
  58 GarboChess 0.21          2193   30   30   416   43%  2250   24% 
  59 Atlas 2.20               2186   19   19  1020   47%  2205   19% 
  60 AliChess 4.16            2180   47   49   188   35%  2313   15% 
  61 Mediocre 0.332           2152   24   24   684   47%  2178   15% 
  62 Madeleine 0.2            2142   16   16  1692   49%  2146   14% 
  63 WJChess v1.64            2138   15   15  1623   48%  2153   19% 
  64 Feuerstein 0.4.5.2       2126   27   27   532   44%  2183   19% 
  65 Adam 3.1                 2096   21   21   894   45%  2138   16% 
  66 Monarch 1.7              2073   21   21   889   45%  2119   16% 
  67 Matheus 2.3              2069   17   17  1447   44%  2112   18% 
  68 Lime 62                  2058   23   23   784   44%  2108   14% 
  69 BigLion 2.23x            2007   43   44   244   36%  2137   19% 
  70 DelphiMAX 2.9            2002   24   24   733   45%  2032   14% 
  71 Etude 0.1.2              1992   60   63   156   29%  2203    9% 
  72 Smash 1.0.3              1982   35   35   346   44%  2039   15% 
  73 RivalChess 1.18          1966   35   36   330   42%  2043   17% 
  74 BiBiChess 0.5            1958   33   32   388   48%  1976   18% 
  75 FireFly 2.4.1            1950   72   82   130   12%  2349   10% 
  76 FreeChess 2.17b          1901   39   40   300   43%  1982   12% 
  77 BikJump 1.5              1892   50   52   206   30%  2108   14% 
  78 Clueless 1.4             1883   44   44   248   37%  2032   12% 
  79 Heracles 0.5.14          1795   89  105   122    8%  2319    7% 
  80 AlChess 1.5b             1788   39   39   311   40%  1906   17% 
  81 Alex 1.85                1780   48   49   230   36%  1964    9% 
  82 Roce 0.0360              1775   43   43   248   34%  1956   26% 
  83 Simontacchi v1.81a       1757   37   37   359   56%  1719    5% 
  84 Iq23 003                 1678   40   40   270   42%  1783   24% 
  85 Pooky 2.7                1677   36   36   354   47%  1716   12% 
  86 Eden 0.0.13 JA           1644   67   69   180   22%  2038    7% 
  87 Piranha 0.5              1638   34   34   428   50%  1664    7% 
  88 Philemon C               1615   37   37   334   47%  1673   17% 
  89 ApilChess 1.05r1b        1556   43   43   294   43%  1674   15% 
  90 Nanook 0.16              1517   53   54   220   29%  1833   17% 
  91 T.rex 1.8.5              1443   35   36   410   31%  1639    9% 
  92 NSVChess 0.14            1273   47   50   318   18%  1674    5% 
  93 Ace 0.1                   998   95  118   208    4%  1849    0% 
Regards,
Patrick
User avatar
hgm
Posts: 28387
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: UCI Engines Ligue updated

Post by hgm »

What exactly is the meaning of the terms 'games rated' and 'games played'. Is the list you give now only based on the former games? How exactly did you extract the ratings frm this? If you used BayesElo, what prior did you use?
User avatar
Le Fou numerique
Posts: 859
Joined: Wed Apr 05, 2006 9:58 pm
Location: Elsass

Re: UCI Engines Ligue updated

Post by Le Fou numerique »

hgm wrote:What exactly is the meaning of the terms 'games rated' and 'games played'. Is the list you give now only based on the former games? How exactly did you extract the ratings frm this? If you used BayesElo, what prior did you use?
Hi,

Since the UEL exists, there are 230.946 games played.

But for calculed the rating, only the games of the actual versions, 93 engines, are used. These 93 engines played 45.338 games.

I use a file that contains only these 46.338 games. If a new version of an engine is added, the games of the old version are deleted from the file.

Regards,
Patrick
User avatar
hgm
Posts: 28387
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: UCI Engines Ligue updated

Post by hgm »

OK, I see. Wouldn't you get more accurate ratings by keeping all 230.946 games, and deleting the old engines from the list afterwards?

Am I correct in assuming that you are extracting the ratings with BayesElo, with the default prior setting (2)? I noticed that for processing data sets that were not from a simple single-division round robin, (e.g. the Chess War results), this had the tendency to compress the rating scale quite a lot, and that much more realistic ratings were obtained by tetting the prior to 0.
User avatar
Le Fou numerique
Posts: 859
Joined: Wed Apr 05, 2006 9:58 pm
Location: Elsass

Re: UCI Engines Ligue updated

Post by Le Fou numerique »

hgm wrote:OK, I see. Wouldn't you get more accurate ratings by keeping all 230.946 games, and deleting the old engines from the list afterwards?

Am I correct in assuming that you are extracting the ratings with BayesElo, with the default prior setting (2)? I noticed that for processing data sets that were not from a simple single-division round robin, (e.g. the Chess War results), this had the tendency to compress the rating scale quite a lot, and that much more realistic ratings were obtained by tetting the prior to 0.
Hi,

The purpose of the UEL is to rang the free available UCI engines.

Only the engines there are actually in the Ligue are interresting.

If I make a ranking with all engines they played the list wouldn't have a single interest. There would be engines no play a single game since 4 years. The only purpose would be a inflation of the rating.

Regards,
Patrick
User avatar
Graham Banks
Posts: 44620
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: UCI Engines Ligue updated

Post by Graham Banks »

Hi Patrick,

has anybody checked out this new Bison engine to make sure it's not another clone?
The author's surname Bonkin sounds a little dubious for a Russian name.

Regards, Graham.
gbanksnz at gmail.com
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: UCI Engines Ligue updated

Post by Dr.Wael Deeb »

Graham Banks wrote:Hi Patrick,

has anybody checked out this new Bison engine to make sure it's not another clone?
The author's surname Bonkin sounds a little dubious for a Russian name.

Regards, Graham.
Definitely a very good question Graham....
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
User avatar
hgm
Posts: 28387
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: UCI Engines Ligue updated

Post by hgm »

Le Fou numerique wrote:The purpose of the UEL is to rang the free available UCI engines.

Only the engines there are actually in the Ligue are interresting.
Yes, but the games you now delete might help to reduce the error bars on the rating of the engines you now keep. This is hard to say without knowing who played who, and which engines in the pairing network you typicaly delete.

Did you actually try using all 230k games, to see what effect it does have on the eror bars? Do they get larger or smaller, compred to th calculation with 40k games?
If I make a ranking with all engines they played the list wouldn't have a single interest. There would be engines no play a single game since 4 years. The only purpose would be a inflation of the rating.
Tony Thomas

Re: UCI Engines Ligue updated

Post by Tony Thomas »

Dr.Wael Deeb wrote:
Graham Banks wrote:Hi Patrick,

has anybody checked out this new Bison engine to make sure it's not another clone?
The author's surname Bonkin sounds a little dubious for a Russian name.

Regards, Graham.
Definitely a very good question Graham....
What is Bison? I have never heard of it, is there a legal download link?
User avatar
Graham Banks
Posts: 44620
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: UCI Engines Ligue updated

Post by Graham Banks »

Tony Thomas wrote:
Dr.Wael Deeb wrote:
Graham Banks wrote:Hi Patrick,

has anybody checked out this new Bison engine to make sure it's not another clone?
The author's surname Bonkin sounds a little dubious for a Russian name.

Regards, Graham.
Definitely a very good question Graham....
What is Bison? I have never heard of it, is there a legal download link?
On both WBEC and UCI Engines Ligue sites.
gbanksnz at gmail.com