SPCC: EAS-Tool major update

[pohl4711]

I released a major update for the EAS-tool (Engines Aggressiveness Statistics-tool):

There are now 2 tools: The EAS-tool and the Gauntlet EAS-tool: The EAS-tool evaluates all played games in a source.pgn-file of all engines/players. The Gauntlet EAS-tool only evaluates the engine/player, which played the most games in the source.pgn file. The Gauntlet EAS-tool is IMHO a good thing for engine-developers, when they test their engine-dev-version vs. several opponents and are just interested in the EAS-score of their own engine...or for analyzing human players (search one player in the Megabase and calculate the EAS-score, without doing so for all of his opponents).

The scoring-system of the EAS-tools was complete rewritten and improved. Please check the ReadMe-File in the EAS-tool download for full explanation, because meanwhile the scoring-system got really complex...

Download the EAS-tool V5.2 on my website or right here:
https://www.sp-cc.de/files/engines_aggr ... cs_tool.7z

(The EAS-ratinglist on my website is already updated with the scores of the new EAS-tool)

[hafni]

Thanks Stefan,

your rate of improvement is amazing, i struggling to keep your pace.

good luck with your hard work.

Regards

[adnoh]

I am seeing an issue with v5.2 of EAS which I did not have with prior versions.

The output reports one engine twice (Koivisto 8.0 at the bottom of the list with the same stats) and am missing another one.

Code: Select all

***************************************************************************** 
*** Engine Aggressiveness Tool V5.2 Score points Ratinglist 
***************************************************************************** 
*** Meanwhile, the scoring-system of the EAS-Tool got really complex, so 
*** please check out the ReadMe-file, where you find the explanation... 
***************************************************************************** 
*** Evaluated file: CuteChess-PGNAll.pgn 
***************************************************************************** 
                                 bad  avg.win 
Rank  EAS-Score  sacs   shorts  draws  moves  Engine/player 
-------------------------------------------------------------------
   1    136284  18.03%  22.13%  17.74%   57   Stockfish 13 
   2    119714  15.38%  25.96%  17.76%   59   Stockfish 11 
   3    116287  10.64%  18.44%  15.70%   61   Arasan 23.4 
   4    109975  19.81%  15.09%  13.10%   60   Slow Chess Blitz 2.9 
   5    108344  10.00%  27.27%  22.52%   56   Wasp 6.00 
   6    102627  22.08%  13.42%  20.43%   61   Stockfish 15 
   7    101122  21.23%  15.07%  19.46%   60   Dragon 3.1 
   8    100560  24.39%  13.82%  23.43%   61   Stockfish 15.1 
   9    100117  23.96%  15.62%  17.56%   59   Dragon 3.1 MCTS 
  10     99353  18.85%  23.77%  19.42%   58   Stockfish Final HCE 
  11     98130  16.96%  17.83%  19.22%   58   RubiChess 20221120 
  12     95878  08.45%  19.72%  16.30%   58   Revenge 3.0 
  13     85064  12.30%  15.21%  17.91%   61   rofChade 3.0 
  14     81608  24.04%  16.35%  18.87%   64   Igel 3.1.0 
  15     80316  10.14%  17.39%  23.50%   59   Komodo 14.1 
  16     73374  15.38%  06.99%  20.11%   64   Stockfish 14 
  17     73303  13.04%  20.77%  23.99%   59   Stockfish 10 
  18     70533  12.44%  11.00%  20.60%   63   Minic 3.30 
  19     69421  11.81%  14.58%  21.48%   61   Rebel 16a 
  20     68793  13.92%  07.59%  21.50%   64   Stockfish 14.1 
  21     66697  08.14%  15.12%  22.75%   63   Berserk 10 
  22     65430  09.70%  14.18%  20.05%   63   Stockfish 12 
  23     59005  07.59%  15.17%  26.12%   58   Seer 2.6.0 
  24     57095  05.56%  13.89%  20.27%   62   Ethereal 13.75   XXXXX WARNING: Not enough games, EAS-score not reliable [50+ wins and 30+ draws needed] XXXXX 
  25     38715  05.59%  08.39%  23.30%   65   Koivisto 8.0 
  26     38715  05.59%  08.39%  23.30%   65   Koivisto 8.0 
-------------------------------------------------------------------
*** Average length of all won games:     60 moves
*** Engine gets bonuspoints, if its avg. won games length is shorter
*** Engine gets maluspoints, if its avg. won games length is longer
***************************************************************************** 
***************************************************************************** 
***************************************************************************** 
*** 2nd Ratinglist with more stats in percent-values ************************ 
***************************************************************************** 
*** Average length of all won games:  60 moves 
*** Calculated limit for short wins giving EAS-points: 45 moves 
***************************************************************************** 
                       avg.win                                                                                                                          bad   
Rank  EAS-Score   wins  moves   sacs    sacsQ    sacs5+   sacs4    sacs3    sacs2    sacs1    all shorts short25  short30  short35  short40  short45   draws    Engine/player
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
   1    136284      122   57   18.03% =[00.00% + 00.82% + 00.82% + 04.10% + 04.10% + 08.20%]    22.13% = [00.82% + 00.82% + 02.46% + 08.20% + 09.84%]  17.74%   Stockfish 13 
   2    119714      104   59   15.38% =[00.00% + 00.96% + 00.00% + 00.96% + 04.81% + 08.65%]    25.96% = [00.00% + 01.92% + 07.69% + 07.69% + 08.65%]  17.76%   Stockfish 11 
   3    116287      141   61   10.64% =[00.00% + 00.71% + 01.42% + 00.71% + 00.71% + 07.09%]    18.44% = [00.71% + 02.84% + 03.55% + 03.55% + 07.80%]  15.70%   Arasan 23.4 
   4    109975      106   60   19.81% =[00.00% + 00.00% + 00.00% + 03.77% + 02.83% + 13.21%]    15.09% = [00.00% + 00.94% + 01.89% + 04.72% + 07.55%]  13.10%   Slow Chess Blitz 2.9 
   5    108344      110   56   10.00% =[00.00% + 00.91% + 00.00% + 00.91% + 02.73% + 05.45%]    27.27% = [00.00% + 02.73% + 04.55% + 10.91% + 09.09%]  22.52%   Wasp 6.00 
   6    102627      231   61   22.08% =[00.00% + 00.43% + 01.30% + 03.03% + 06.49% + 10.82%]    13.42% = [00.43% + 00.43% + 01.73% + 04.33% + 06.49%]  20.43%   Stockfish 15 
   7    101122      146   60   21.23% =[00.00% + 00.68% + 00.68% + 02.05% + 06.85% + 10.96%]    15.07% = [00.00% + 00.00% + 01.37% + 06.85% + 06.85%]  19.46%   Dragon 3.1 
   8    100560      123   61   24.39% =[00.00% + 00.00% + 01.63% + 04.07% + 08.94% + 09.76%]    13.82% = [00.81% + 00.81% + 02.44% + 04.07% + 05.69%]  23.43%   Stockfish 15.1 
   9    100117       96   59   23.96% =[00.00% + 00.00% + 01.04% + 01.04% + 07.29% + 14.58%]    15.62% = [00.00% + 00.00% + 01.04% + 07.29% + 07.29%]  17.56%   Dragon 3.1 MCTS 
  10     99353      122   58   18.85% =[00.00% + 00.00% + 00.00% + 02.46% + 00.82% + 15.57%]    23.77% = [00.82% + 00.82% + 05.74% + 05.74% + 10.66%]  19.42%   Stockfish Final HCE 
  11     98130      230   58   16.96% =[00.00% + 00.00% + 01.30% + 01.30% + 03.91% + 10.43%]    17.83% = [00.43% + 00.43% + 03.48% + 04.35% + 09.13%]  19.22%   RubiChess 20221120 
  12     95878       71   58   08.45% =[00.00% + 00.00% + 00.00% + 00.00% + 05.63% + 02.82%]    19.72% = [01.41% + 00.00% + 04.23% + 07.04% + 07.04%]  16.30%   Revenge 3.0 
  13     85064      309   61   12.30% =[00.00% + 00.00% + 00.00% + 01.29% + 04.21% + 06.80%]    15.21% = [00.97% + 00.97% + 03.24% + 03.24% + 06.80%]  17.91%   rofChade 3.0 
  14     81608      104   64   24.04% =[00.00% + 00.00% + 00.00% + 00.96% + 04.81% + 18.27%]    16.35% = [00.00% + 00.00% + 05.77% + 02.88% + 07.69%]  18.87%   Igel 3.1.0 
  15     80316      138   59   10.14% =[00.00% + 00.00% + 01.45% + 00.72% + 03.62% + 04.35%]    17.39% = [00.72% + 00.00% + 03.62% + 06.52% + 06.52%]  23.50%   Komodo 14.1 
  16     73374      143   64   15.38% =[00.00% + 00.00% + 00.00% + 04.90% + 01.40% + 09.09%]    06.99% = [00.70% + 00.00% + 01.40% + 00.70% + 04.20%]  20.11%   Stockfish 14 
  17     73303      207   59   13.04% =[00.00% + 00.00% + 00.00% + 01.45% + 02.42% + 09.18%]    20.77% = [00.00% + 00.97% + 04.35% + 05.31% + 10.14%]  23.99%   Stockfish 10 
  18     70533      209   63   12.44% =[00.00% + 00.00% + 00.48% + 00.96% + 02.87% + 08.13%]    11.00% = [01.44% + 00.48% + 01.91% + 01.91% + 05.26%]  20.60%   Minic 3.30 
  19     69421      144   61   11.81% =[00.00% + 00.00% + 00.00% + 00.69% + 02.78% + 08.33%]    14.58% = [00.69% + 01.39% + 04.17% + 05.56% + 02.78%]  21.48%   Rebel 16a 
  20     68793       79   64   13.92% =[00.00% + 00.00% + 00.00% + 05.06% + 01.27% + 07.59%]    07.59% = [00.00% + 00.00% + 02.53% + 00.00% + 05.06%]  21.50%   Stockfish 14.1 
  21     66697       86   63   08.14% =[00.00% + 00.00% + 01.16% + 01.16% + 01.16% + 04.65%]    15.12% = [00.00% + 01.16% + 01.16% + 03.49% + 09.30%]  22.75%   Berserk 10 
  22     65430      134   63   09.70% =[00.00% + 00.00% + 00.00% + 01.49% + 02.99% + 05.22%]    14.18% = [00.00% + 01.49% + 00.75% + 02.24% + 09.70%]  20.05%   Stockfish 12 
  23     59005      145   58   07.59% =[00.00% + 00.00% + 00.69% + 00.00% + 01.38% + 05.52%]    15.17% = [00.00% + 00.00% + 02.76% + 07.59% + 04.83%]  26.12%   Seer 2.6.0 
  24     57095       36   62   05.56% =[00.00% + 00.00% + 00.00% + 00.00% + 00.00% + 05.56%]    13.89% = [00.00% + 02.78% + 00.00% + 02.78% + 08.33%]  20.27%   Ethereal 13.75 
  25     38715      143   65   05.59% =[00.00% + 00.00% + 00.00% + 00.00% + 00.70% + 04.90%]    08.39% = [00.00% + 00.70% + 00.70% + 02.10% + 04.90%]  23.30%   Koivisto 8.0 
  26     38715      143   65   05.59% =[00.00% + 00.00% + 00.00% + 00.00% + 00.70% + 04.90%]    08.39% = [00.00% + 00.70% + 00.70% + 02.10% + 04.90%]  23.30%   Koivisto 8.0 
**************************************************** 
*** EAS-tool (C) 2022 Stefan Pohl (www.sp-cc.de) *** 
**************************************************** 

The missing engine is Stockfish 9. This was the bayeselo output from the same PGN file.

Code: Select all

Rank Name                   Elo    +    - games score oppo. draws 
   1 Stockfish 15.1        3558   20   20   600   59%  3511   77% 
   2 Stockfish 15          3550   20   19   600   57%  3512   78% 
   3 Stockfish 14.1        3531   19   19   600   53%  3515   80% 
   4 Stockfish 14          3520   20   20   600   51%  3517   80% 
   5 Dragon 3.1            3510   20   20   600   48%  3519   80% 
   6 Stockfish 13          3494   16   16   900   51%  3490   74% 
   7 Stockfish 12          3459   15   15  1100   47%  3477   69% 
   8 Dragon 3.1 MCTS       3435   20   20   600   50%  3434   68% 
   9 Berserk 10            3431   20   20   600   50%  3435   70% 
  10 Revenge 3.0           3416   20   20   600   46%  3437   69% 
  11 RubiChess 20221120    3407   14   14  1200   53%  3390   68% 
  12 Ethereal 13.75        3396   22   22   500   44%  3430   73% 
  13 Koivisto 8.0          3383   19   19   700   53%  3367   65% 
  14 Seer 2.6.0            3383   19   19   700   53%  3367   64% 
  15 Rebel 16a             3381   19   19   700   53%  3367   64% 
  16 Slow Chess Blitz 2.9  3367   19   19   700   50%  3369   69% 
  17 Stockfish Final HCE   3353   19   19   700   47%  3371   59% 
  18 Stockfish 11          3340   19   19   700   44%  3373   59% 
  19 rofChade 3.0          3337   14   14  1400   52%  3325   59% 
  20 Minic 3.30            3316   20   20   700   56%  3279   53% 
  21 Stockfish 10          3313   20   20   700   56%  3279   53% 
  22 Stockfish 9           3281   20   20   700   49%  3284   46% 
  23 Arasan 23.4           3275   19   19   700   48%  3285   56% 
  24 Komodo 14.1           3262   20   20   700   46%  3287   52% 
  25 Wasp 6.00             3244   20   20   700   42%  3289   53% 
  26 Igel 3.1.0            3240   20   20   700   41%  3290   53% 

[pohl4711]

Very strange. Especially, because I did not change anything in the part, where the engines are recognized. And with my pgn files, this problem does not appear. Can you provide me a download link to your pgn file for further investigation?

I wrote you a PM with my email-adress, you could send me the pgn-file (zipped) directly, if it is not too big. Otherwise please upload it to a cloud-service (Google Drive or so) an send me the link (please to my email).

Thank you

[adnoh]

Very strange. Especially, because I did not change anything in the part, where the engines are recognized. And with my pgn files, this problem does not appear. Can you provide me a download link to your pgn file for further investigation?

I wrote you a PM with my email-adress, you could send me the pgn-file (zipped) directly, if it is not too big. Otherwise please upload it to a cloud-service (Google Drive or so) an send me the link (please to my email).

Thank you

Here is the PGN file with the problem. It is actually a bit newer than the one that produced the reports above but I just ran it with EAS v5.2 and still has the problem.

[pohl4711]

Very strange. Especially, because I did not change anything in the part, where the engines are recognized. And with my pgn files, this problem does not appear. Can you provide me a download link to your pgn file for further investigation?

I wrote you a PM with my email-adress, you could send me the pgn-file (zipped) directly, if it is not too big. Otherwise please upload it to a cloud-service (Google Drive or so) an send me the link (please to my email).

Thank you

Here is the PGN file with the problem. It is actually a bit newer than the one that produced the reports above but I just ran it with EAS v5.2 and still has the problem.

Fixed! Bug is in the batch interpreter of windows, not in my sources. But I found a way to evade it, so the EAS-tool should work, now.

[adnoh]

Thanks Stefan for EAS v5.21. The new version no longer has the problem.

[pohl4711]

Thanks Stefan for EAS v5.21. The new version no longer has the problem.

Thank you for pointing this extremly strange bug in the windows batch interpreter out...