Help creating a rating list

[Tony Thomas]

I wanted to create a rating list that includes almost all the major tournaments that I have played using many different engines. First challenge was merging all the .pgn files. I was able to successfully merge them using Gabriel Gullory's great tool, pgnscanner. I created a rating list using elostat, I know that many of you will tell me to use bayesian elo, but elostat under arena is more user friendly for those who arent technically savvy. Now that I have a rating list, I am trying to create one that has only the best version, I manually deleted almost all double, triple, quadruple entries and the raw list looks something like the one below, I edited the initial part of the list, I found that it is a tedious job to weed out a list with around 300 engines. Is there an easier way to do it? Any help will be appreciated.

Code: Select all

 1 HiarcsX50UCI                   : 2883   48  47   201    72.4 %   2716   17.4 %
  2 Shredder11UCI                  : 2877   54  53   144    71.2 %   2720   22.9 %
  3 Rybka v1.0 Beta.w32            : 2860   44  43   214    69.6 %   2715   23.4 %
  4 Fruit 2.3                      : 2859   50  49   160    69.4 %   2717   25.0 %
  5 TogaII 1.2 beta 2a KS/EHP      : 2855   43  42   210    69.0 %   2716   26.7 %
  6 Ktulu 8.0                      : 2802   44  43   208    61.8 %   2719   19.7 %
  7 ChessTiger2007UCI              : 2797   41  40   360    86.9 %   2468   18.9 %
  8 Naum 2.2                       : 2787   46  46   160    59.7 %   2719   29.4 
  9 AlaricWB707                    : 2756   52  52   132    54.9 %   2722   25.0 %
 10 Spike 1.2 Turin                : 2755   41  41   209    55.3 %   2718   24.4 %
 11 Smarthink 1.00                 : 2740   41  41   208    52.9 %   2720   26.0 %
 12 Glaurung 2 Epsilon/4           : 2740   58  58   108    53.7 %   2714   24.1 %
 13 Delfi 5.2                      : 2719   51  51   152    49.3 %   2723   17.1 %
 14 DeepSjeng27                    : 2713   47  47   156    49.0 %   2719   26.3 %
 15 Scorpio 2.0                    : 2712   55  55   132    48.5 %   2723   15.2 %
 16 Gandalf 6.01                   : 2710   43  43   200    48.8 %   2718   22.5 %
 17 List 5.12                      : 2709   53  53   118    49.2 %   2715   28.8 %
 18 Zappa_mexico fix               : 2692   55  55   128    45.3 %   2724   18.8 %
 19 Pharaon 3.5.1                  : 2689   41  41   208    45.4 %   2721   24.5 %
 36 WildCat 7.0                    : 2675   45  45   200    43.8 %   2719   14.5 %
 37 Prodeo 1.2                     : 2674   41  41   200    43.5 %   2719   28.0 %
 38 Ruffian 1.0.5                  : 2674   45  45   200    43.5 %   2719   15.0 %
 39 CM10th D2Alos                  : 2670   42  42   200    43.0 %   2719   25.0 %
 40 SlowChess Blitz WV 2.1         : 2669   41  42   208    42.5 %   2721   24.5 %
 41 Thinker 4.7a                   : 2658   43  43   199    41.2 %   2720   24.1 %
 43 Crafty 21.6 JA                 : 2655   37  37   264    51.7 %   2643   20.8 %
 45 Frenzee  2.0                   : 2631   53  52   176    74.1 %   2448   16.5 %
 46 Movei00_8_438                  : 2629   49  50   152    36.5 %   2725   24.3 %
......................................

280 Hoichess-0.7.0                 : 1681   78  81    79    29.7 %   1830   11.4 %
281 Elf 1.30                       : 1672   80  83    78    28.8 %   1828    9.0 %
282 Beaches 2.2                    : 1660   82  86    74    27.0 %   1833   10.8 %
283 Surprise 4.2.8                 : 1654   83  88    79    26.6 %   1831    5.1 %
284 Hokus-Pokus 0.6.3              : 1644   82  86    78    25.6 %   1829   10.3 %
285 Chess-Rikus 1.466              : 1639   81  85    80    25.0 %   1830   10.0 %
286 Roce 0.0350                    : 1638   77  79    78    25.0 %   1829   19.2 %
287 TJchess 0.49                   : 1637   84  89    75    24.0 %   1837   10.7 %
288 Roque 1.1                      : 1621   84  89    78    23.1 %   1830   10.3 %
289 Mizar 3.0                      : 1618   87  93    77    22.7 %   1830    6.5 %
290 Cilian 4.14se                  : 1617   78  82    82    22.0 %   1838   17.1 %
291 Eden 0.0.11                    : 1567   96 105    80    17.5 %   1836    2.5 %
292 Nero 6.1                       : 1510  100 108    80    13.8 %   1829    7.5 %
293 Dimitri 1.32 beta 4            : 1499  114 129    71    12.7 %   1834    2.8 %
294 MiniChessAI 1.19               : 1404  133 156    77     7.8 %   1833    2.6 %
295 Marquis 0.1.5                  : 1351  146 117    77     5.8 %   1834    3.9 %
296 Chad's Chess 0.15              : 1249  229   3    64     3.1 %   1845    0.0 %

[IgorGorelikov]

You can use the sort command (= Windows utility) to sort any text file.
The following command will sort rating.dat by engine's names.

sort /+5 rating.dat /O output.txt

After cleaning up/editing output.txt you can sort it back by sequence numbers.

sort output.txt /O output2.txt

Regards,
Igor Gorelikov