Ordo 1.0.9 (new features for testers)

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Ordo 1.0.9 (new features for testers)

Post by michiguel »

Frank Quisinsky wrote:Hi Miguel,

Ordo 1.2.2 x64 crashed directly under W7 with my i7 4th systems. Ordo 1.2.2 w32 works fine.

Best
Frank
Strange... but I will try to reproduce this tomorrow in a windows 64 system (I don't have that at home).

Thanks!
Miguel
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Ordo 1.0.9 (new features for testers)

Post by michiguel »

Frank Quisinsky wrote:55 opp. maximal here ...
Have a look on OppD ... can't be right ... should be max. 55!!
w32 version ... x64 crashed directly, have a look in my other message!

Best
Frank

PS: Current list each one against each other with all games I have, shortly before Arasan test-run ended and missed matches for Texel ended.

Code: Select all

   # Player                           :      Elo  Games  Score%   won  draw  lost  Points  Draw%  Error   OppAvg   OppE   OppD
   1 Komodo 9.42 x64                  :  3193.23   2749    87.9  2121   593    35  2417.5   21.6  14.36  2807.97  10.57  107.0
   2 Stockfish 7 KP BMI2 x64          :  3166.75   2749    86.3  2016   714    19  2373.0   26.0  13.73  2808.45  10.57  109.0
   3 Houdini 4 STD B x64              :  3095.59   2249    78.8  1424   698   127  1773.0   31.0  13.30  2841.35  10.51   86.0
   4 Fire 4 x64                       :  3049.25   2249    74.5  1255   840   154  1675.0   37.3  12.01  2842.38  10.52   88.0
   5 GullChess 3.0 BMI2 x64           :  3045.50   2249    74.1  1243   847   159  1666.5   37.7  13.09  2842.47  10.48   85.0
   6 Equinox 3.30 x64                 :  3001.95   2249    69.5  1086   955   208  1563.5   42.5  11.48  2843.44  10.55   88.0
   7 Fritz 15 x64                     :  2997.35   2249    69.0  1093   918   238  1552.0   40.8  11.79  2843.54  10.53   89.0
   8 Critter 1.6a x64                 :  2989.92   2249    68.2  1056   955   238  1533.5   42.5  11.42  2843.70  10.51   88.0
   9 Protector 1.9.0 x64              :  2950.32   2249    63.6   927  1006   316  1430.0   44.7  11.26  2844.58  10.53   89.0
  10 Andscacs 0.85 POP x64            :  2949.49   2749    67.0  1298  1090   361  1843.0   39.7  10.47  2812.40  10.63  109.0
  11 Nirvanachess 2.2 POP x64         :  2939.43   2249    62.3   901   999   349  1400.5   44.4  10.64  2844.83  10.58   86.0
  12 iCE 3.0 v658 POP x64             :  2928.83   2249    61.0   891   961   397  1371.5   42.7  11.77  2845.06  10.50   89.0
  13 Chiron 2.0 x64                   :  2913.75   2749    62.9  1186  1087   476  1729.5   39.5  10.31  2813.05  10.63  109.0
  14 Hannibal 1.5 x64                 :  2910.93   2449    60.4   951  1058   440  1480.0   43.2  10.74  2831.40  10.57   96.0
  15 Texel 1.05 x64                   :  2906.05   2740    61.9  1126  1140   474  1696.0   41.6  10.58  2814.10  10.59  101.3
  16 Naum 4.6 x64                     :  2890.00   2749    60.1  1043  1216   490  1651.0   44.2   9.87  2813.48  10.61  104.0
  17 SmarThink 1.80 AVX x64           :  2844.82   2749    54.4   943  1107   699  1496.5   40.3  10.03  2814.30  10.64  109.0
  18 Fizbo 1.6 x64                    :  2844.36   2749    54.4   861  1268   620  1495.0   46.1   9.71  2814.31  10.65  109.0
  19 Senpai 1.0 SSE42 x64             :  2842.23   2749    54.1   893  1189   667  1487.5   43.3  10.13  2814.35  10.65  107.0
  20 Hakkapeliitta 3.0 x64            :  2835.46   2749    53.3   915  1098   736  1464.0   39.9   9.85  2814.47  10.65  108.0
  21 Hiarcs 14 WCSC w32               :  2830.20   2749    52.6   866  1159   724  1445.5   42.2   9.58  2814.57  10.63  105.0
  22 Sjeng c't 2010 w32               :  2806.96   2749    49.6   805  1118   826  1364.0   40.7   9.97  2814.99  10.63  108.0
  23 Vajolet2 2.1 POP x64             :  2799.74   2749    48.7   735  1207   807  1338.5   43.9   9.87  2815.12  10.65  109.0
  24 Cheng 4.39 x64                   :  2799.15   2749    48.6   757  1159   833  1336.5   42.2   9.86  2815.14  10.65  109.0
  25 Shredder 12 x64                  :  2797.33   2748    48.4   723  1213   812  1329.5   44.1  10.10  2815.19  10.62  105.0
  26 Junior 13.3.00 x64               :  2793.72   2749    47.9   757  1121   871  1317.5   40.8  10.11  2815.23  10.61  108.0
  27 Spike 1.4 Leiden w32             :  2784.01   2749    46.7   712  1142   895  1283.0   41.5   9.89  2815.41  10.64  110.0
  28 DiscoCheck 5.2.1 x64             :  2781.68   2749    46.4   733  1084   932  1275.0   39.4  10.11  2815.45  10.61  105.0
  29 Quazar 0.4 x64                   :  2774.02   2748    45.4   652  1191   905  1247.5   43.3   9.93  2815.61  10.61  107.0
  30 Booot 5.2.0 x64                  :  2771.06   2748    45.0   687  1100   961  1237.0   40.0   9.42  2815.67  10.65  109.0
  31 Deuterium 14.3.34.130 POP x64    :  2762.18   2748    43.9   590  1232   926  1206.0   44.8  10.03  2815.83  10.63  108.0
  32 Arasan 18.3 POP x64              :  2758.07   2667    43.2   577  1152   938  1153.0   43.2  10.30  2816.93  10.63  110.0
  33 Zappa Mexico II x64              :  2752.00   2748    42.6   572  1197   979  1170.5   43.6  10.08  2816.01  10.65  108.0
  34 Spark 1.0 x64                    :  2751.14   2748    42.5   584  1167   997  1167.5   42.5   9.90  2816.03  10.63  104.0
  35 Doch 1.3.4 JA x64                :  2748.41   2748    42.1   566  1184   998  1158.0   43.1   9.82  2816.08  10.63  109.0
  36 Thinker 5.4d Inert x64           :  2743.22   2748    41.5   558  1164  1026  1140.0   42.4  10.19  2816.17  10.64  108.0
  37 TogaII 280513 Intel w32          :  2736.13   2748    40.6   570  1091  1087  1115.5   39.7   9.97  2816.30  10.63  109.0
  38 Tornado 5.0 SSE4 x64             :  2730.60   2748    39.9   569  1055  1124  1096.5   38.4  10.26  2816.40  10.59  104.0
  39 Crafty 25.0.1 JA POP x64         :  2729.73   2748    39.8   543  1101  1104  1093.5   40.1   9.82  2816.42  10.65  107.0
  40 Atlas 3.80 x64                   :  2729.58   2748    39.8   545  1096  1107  1093.0   39.9  10.09  2816.42  10.63  108.0
  41 EXchess 7.88b x64                :  2728.30   2748    39.6   552  1073  1123  1088.5   39.0  10.06  2816.45  10.62  106.0
  42 Gaviota 1.0 AVX x64              :  2727.25   2748    39.5   550  1070  1128  1085.0   38.9   9.98  2816.46  10.62  106.0
  43 Dirty 03NOV2015 POP x64          :  2727.13   2748    39.5   530  1109  1109  1084.5   40.4   9.75  2816.47  10.65  109.0
  44 Nemo 1.01 Beta POP x64           :  2712.18   2748    37.6   485  1098  1165  1034.0   40.0  10.01  2816.74  10.64  108.0
  45 Bobcat 7.1 x64                   :  2707.29   2247    41.4   464   934   849   931.0   41.6  10.93  2778.05  10.36   89.0
  46 Murka 3 x64                      :  2705.69   2298    40.8   419  1039   840   938.5   45.2  10.38  2781.03  10.41   90.0
  47 Pedone 1.2 BMI2 x64              :  2700.47   2748    36.2   426  1137  1185   994.5   41.4   9.81  2816.95  10.65  109.0
  48 Rodent II 0.8.7 x64              :  2685.33   2748    34.4   432  1025  1291   944.5   37.3  10.02  2817.23  10.62  105.0
  49 DisasterArea 1.54 x64            :  2682.15   2297    37.8   362  1013   922   868.5   44.1  10.66  2781.39  10.36   87.3
  50 Scorpio 2.77 JA POP x64          :  2674.83   2298    36.9   406   882  1010   847.0   38.4  11.03  2781.70  10.38   91.0
  51 GNU Chess5 5.60 x64              :  2674.54   2247    37.2   379   913   955   835.5   40.6  10.89  2778.78  10.39   86.0
  52 Glaurung 2.2 JA x64              :  2661.74   2248    35.5   332   934   982   799.0   41.5  10.91  2779.23  10.35   88.0
  53 Rhetoric 1.4.3 POP x64           :  2657.03   2247    35.0   338   896  1013   786.0   39.9  11.22  2779.17  10.37   89.0
  54 The Baron 3.29 x64               :  2651.15   2298    33.9   361   836  1101   779.0   36.4  10.73  2782.22  10.34   87.0
  55 Octochess r5190 SSE4 x64         :  2641.21   2247    33.0   305   874  1068   742.0   38.9  11.29  2779.52  10.37   88.0
  56 BugChess2 1.9 POP x64            :  2619.99   2244    30.5   290   789  1165   684.5   35.2  11.51  2779.83  10.36   89.0

White advantage = 36.03 +/- 1.02
Draw rate (equal opponents) = 48.80 % +/- 0.22
Clearly, I messed up when I optimized the OppD calculation (which was really slow for giant databases). I saw this problem and I thought I fixed it but apparently not (I tested this, arghhh...). The program is seeing by mistake that if you play engine A with white and engine B with black, as two different opponents. That is why it is almost double. I will correct it.

Miguel
Last edited by michiguel on Mon Apr 18, 2016 5:39 am, edited 2 times in total.
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Ordo 1.0.9 (new features for testers)

Post by Frank Quisinsky »

Hi Miguel,

I have to say thanks for your great tool again and again!

Best
Frank

batch file ...

Code: Select all

@ECHO off

Ordo_122-x64.exe -a 2890 -A "Naum 4.6 x64" -p 1.pgn -o ordo122.txt -j programs.txt -b columns.txt -N2 -QEWDV -U "0,1,4,5,7,8,9,3,10,2,11,12,14" -s1000

rem open results with notepad

notepad ordo122.txt

columns.txt file ...

Code: Select all

0, 0, "Player"
1, 6, "Elo"
2, 5, "Error"
3, 7, "Points"
4, 5, "Games"
5, 5, "Score%"
6, 11, "CFS(next)"
7, 4, "won"
8, 4, "draw"
9, 4, "lost"
10, 5, "Draw%"
11, 6, "OppAvg"
12, 6, "OppE"
13, 6, "OppN"
14, 6, "OppD"
Try to reproduce with my database v 4.06 ...
http://www.amateurschach.de/download/_f ... -v4.06.zip

v4.07 will be available tomorrow in the night!

Best
Frank
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Ordo 1.0.9 (new features for testers)

Post by michiguel »

Frank Quisinsky wrote:Hi Miguel,

I have to say thanks for your great tool again and again!

Best
Frank

batch file ...

Code: Select all

@ECHO off

Ordo_122-x64.exe -a 2890 -A "Naum 4.6 x64" -p 1.pgn -o ordo122.txt -j programs.txt -b columns.txt -N2 -QEWDV -U "0,1,4,5,7,8,9,3,10,2,11,12,14" -s1000

rem open results with notepad

notepad ordo122.txt

columns.txt file ...

Code: Select all

0, 0, "Player"
1, 6, "Elo"
2, 5, "Error"
3, 7, "Points"
4, 5, "Games"
5, 5, "Score%"
6, 11, "CFS(next)"
7, 4, "won"
8, 4, "draw"
9, 4, "lost"
10, 5, "Draw%"
11, 6, "OppAvg"
12, 6, "OppE"
13, 6, "OppN"
14, 6, "OppD"
Try to reproduce with my database v 4.06 ...
http://www.amateurschach.de/download/_f ... -v4.06.zip

v4.07 will be available tomorrow in the night!

Best
Frank
Great.

In Linux I get

Code: Select all

   # PLAYER                           :   RATING  PLAYED   (%)     W     D     L  POINTS  D(%)  ERROR   OppAvg  OppErr  OppDiv
   1 Komodo 9.42 x64                  :  3192.57    2750  87.9  2122   593    35  2418.5  21.6  14.60  2806.90   10.56    55.0
   2 Stockfish 7 KP BMI2 x64          :  3165.52    2750  86.3  2015   716    19  2373.0  26.0  14.38  2807.39   10.56    55.0
   3 Houdini 4 STD B x64              :  3096.62    2250  79.0  1430   695   125  1777.5  30.9  13.05  2840.20   10.50    45.0
   4 Fire 4 x64                       :  3049.64    2200  74.3  1225   821   154  1635.5  37.3  12.47  2843.83   10.51    44.0
   5 GullChess 3.0 BMI2 x64           :  3045.79    2200  74.0  1213   828   159  1627.0  37.6  12.35  2843.92   10.51    44.0
etc.

OppD is correct here. I wonder whether I packed the incorrect version (I cannot imagine how, since I pack everything with a script), or the issue is seen only in windows. But, just in case, if you try

ordo -v

What version does it display?
(anyway, I will test all this tomorrow)

Miguel
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Ordo 1.0.9 (new features for testers)

Post by Frank Quisinsky »

Hi Miguel,

I am using Ordo 1.2.2 w32 ...

Renamed your "ordo-win32.exe" file to ... Ordo_122-x64.exe ... (so I must not changed my bat file) ... and saw the "OppD" problem.

Do that with my current database and the games I have shortly before Arasan test-run and Texel "Missed matches" ended.

Again ...

If I try the same with your 1.2.2 "ordo-win64.exe" file ... renamend to "Ordo_122-x64.exe" I got ...

http://www.amateurschach.de/common/ordo ... roblem.png

You can see on this pic ... Total Commander (GUI I am using, sure you know this program) and the W7 error message in German language after I am starting my batch file. The same batch file works fine with your w32 version.

Best
Frank
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Ordo 1.2.2 ... a big wish!!

Post by Frank Quisinsky »

Hi Miguel,

I have a big wish ...

I wish me a prameter for "Move average".

Example:
Arasan have so far a move average in the current test-run from 89 moves. Better is to display 89,25 moves.

This is an important information for further statistics ... example ... Stockfish with or without contempt.

Or if I select out 1-0 or 0-1 games and I have interest to create from such a database a new statistic ... for playing style questions.

I know that in all other available rating systems testers using resign=on. This is bad for further statistics. I am using in all of my games ... resign=off. Better stats are possible if games ended with draw or mate.

It would be nice if I can display the information with move average. More easy for me as to look in ChessBase for move average ...

or ...

Norm Pollock have the information to move average in his summary file.

Example of summary file:

Code: Select all

Games = 205300  (without a result = 0)
Players = 134
Clusters = 1
Date Range: 2014.03.28 - 2016.04.11

Games with:  WhiteElo = 0   BlackElo = 0   Both = 0

White Wins = 71157 ( 34.66 % )
Draws      = 81417 ( 39.66 % )
Black Wins = 52726 ( 25.68 % )
White Pct = 54.49 %
Black Pct = 45.51 %

ECO:  Total = 205300  A: 39038  B: 47865  C: 41355  D: 40482  E: 36560
PlyCount:  Total = 205300  Range: 37-598  Average = 175.84  StdDev = 69.76

finished: be sure to rename/copy outSummary
You can see on the end of the file ...
Average 175,84 ... = 87,92 moves!!
So I have it but only for the complete database!!

I will see that information for each listed engine in a rating list.

Again ...
Very important ...
You can see directly the trick Houdart is working ... move average is 20 moves higher (again 20 moves in average higher) as from Stockfish or Komodo because Houdart is working with an extrem contempt. Same for DiscoCheck ...

Nice other information can be see with such an output to move average.

Best
Frank
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: StdDev ... saw that in summary?!

Post by Frank Quisinsky »

Hi,

never see that before ... "StdDev" ???
I have to search for it ... must be new!

Life can be hard ...

Best
Frank
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Ordo 1.0.9 (new features for testers)

Post by michiguel »

Frank Quisinsky wrote:Hi Miguel,

I am using Ordo 1.2.2 w32 ...

Renamed your "ordo-win32.exe" file to ... Ordo_122-x64.exe ... (so I must not changed my bat file) ... and saw the "OppD" problem.

Do that with my current database and the games I have shortly before Arasan test-run and Texel "Missed matches" ended.

Again ...

If I try the same with your 1.2.2 "ordo-win64.exe" file ... renamend to "Ordo_122-x64.exe" I got ...

http://www.amateurschach.de/common/ordo ... roblem.png

You can see on this pic ... Total Commander (GUI I am using, sure you know this program) and the W7 error message in German language after I am starting my batch file. The same batch file works fine with your w32 version.

Best
Frank
I think I fixed the bugs exposed in the Windows version:
https://github.com/michiguel/Ordo/releases/tag/v1.2.4

I guess it should work now.

Miguel
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Ordo 1.2.2 ... a big wish!!

Post by michiguel »

Frank Quisinsky wrote:Hi Miguel,

I have a big wish ...

I wish me a prameter for "Move average".

Example:
Arasan have so far a move average in the current test-run from 89 moves. Better is to display 89,25 moves.

This is an important information for further statistics ... example ... Stockfish with or without contempt.

Or if I select out 1-0 or 0-1 games and I have interest to create from such a database a new statistic ... for playing style questions.

I know that in all other available rating systems testers using resign=on. This is bad for further statistics. I am using in all of my games ... resign=off. Better stats are possible if games ended with draw or mate.

It would be nice if I can display the information with move average. More easy for me as to look in ChessBase for move average ...

or ...

Norm Pollock have the information to move average in his summary file.

Example of summary file:

Code: Select all

Games = 205300  (without a result = 0)
Players = 134
Clusters = 1
Date Range: 2014.03.28 - 2016.04.11

Games with:  WhiteElo = 0   BlackElo = 0   Both = 0

White Wins = 71157 ( 34.66 % )
Draws      = 81417 ( 39.66 % )
Black Wins = 52726 ( 25.68 % )
White Pct = 54.49 %
Black Pct = 45.51 %

ECO:  Total = 205300  A: 39038  B: 47865  C: 41355  D: 40482  E: 36560
PlyCount:  Total = 205300  Range: 37-598  Average = 175.84  StdDev = 69.76

finished: be sure to rename/copy outSummary
You can see on the end of the file ...
Average 175,84 ... = 87,92 moves!!
So I have it but only for the complete database!!

I will see that information for each listed engine in a rating list.

Again ...
Very important ...
You can see directly the trick Houdart is working ... move average is 20 moves higher (again 20 moves in average higher) as from Stockfish or Komodo because Houdart is working with an extrem contempt. Same for DiscoCheck ...

Nice other information can be see with such an output to move average.

Best
Frank
Hi Frank,

Unfortunately, Ordo does not record moves when it scans pgn files. So, I cannot average that information because it does not have it.

Miguel
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Ordo 1.0.9 (new features for testers)

Post by Frank Quisinsky »

Hi Miguel,

I try it out and Version 1.2.4 works fine for me.
http://www.amateurschach.de/fcp-rating- ... st-run.txt

Thanks!!

Best
Frank