SWCR: IPP family, final results ...

[Frank Quisinsky]

Hi there,

here are the final results of my IPP family test:

- 6 x 920 games played.

- qualified for the experimental SWCR-64: IvanHoe T0.4 x64

- the other 5 are deleted in SWCR databases and rating lists, but 4.480 games can be found in my download area with Shredder Classic 4.0 GUI comments (evaluation, time). In this download file I added the statistics from ELOstat and Bayesian too.

Code: Select all

Bayesian 0056 (TOP 24 of 97 only)

01. IPP Houdini 1.03a x64        2.948 22 21  920 79% 2.718 29%
02. IPP IvanHoe T0.4 x64         2.938 21 20  920 77% 2.736 34%
02. Rybka 4 x64                  2.938 16 16 1640 78% 2.716 32%
04. IPP IvanHoe 52iUSTMO x64     2.924 21 20  920 75% 2.736 35%
05. IPP IvanHoe B52aC x64        2.921 21 20  920 76% 2.735 36%
06. Stockfish 1.8.0 JA x64       2.905 17 17 1320 72% 2.733 35%
06. Rybka 3 x64                  2.905 23 22  840 78% 2.687 28%
08. IPP Fire 1.31 x64            2.900 21 20  920 75% 2.720 36%
09. IPP FireBird 1.1 x64 WD      2.897 20 19  920 73% 2.736 41%
10. Stockfish 1.7.1 JA x64       2.895 19 19 1120 76% 2.706 34%
10. Rybka 4 w32                  2.895 20 20  960 76% 2.704 32%
12. Stockfish 1.7.1 JA w32       2.875 18 18 1200 75% 2.691 31%
13. Stockfish 1.8.0 JA w32       2.864 20 20  920 74% 2.698 37%
14. Rybka 3 w32                  2.861 16 16 1520 74% 2.690 31%
15. Naum 4.2 x64                 2.833 14 14 1880 65% 2.721 37%
15. Critter 0.80 x64             2.833 17 16 1320 63% 2.735 36%
17. Stockfish 1.6.3 JA w32       2.827 18 18 1080 71% 2.681 36%
18. Naum 4.2 w32                 2.825 16 16 1440 68% 2.701 36%
19. Critter 0.80 w32             2.815 21 20  800 66% 2.704 39%
20. Naum 4.1 w32                 2.812 19 19  920 68% 2.686 35%
21. Critter 0.70 x64             2.806 20 19  880 65% 2.701 38%
22. Stockfish 1.6.0 JA w32       2.803 19 18  960 68% 2.688 39%
23. Shredder 12 w32              2.800 10 10 3840 63% 2.711 36%
24. Komodo 1.2 JA x64            2.799 15 15 1640 61% 2.719 40%

ELOstat 1.3 (TOP 24 of 97 only)

01. IPP Houdini 1.03a x64        2.952 21 21  920 79% 2.718 29%
02. IPP IvanHoe T0.4 x64         2.947 19 19  920 77% 2.736 34%
03. Rybka 4 x64                  2.934 15 15 1640 78% 2.716 32%
04. IPP IvanHoe B52aC x64        2.932 19 19  920 76% 2.735 36%
05. IPP IvanHoe 52iUSTMO x64     2.931 19 19  920 75% 2.736 35%
06. IPP FireBird 1.1 x64 WD      2.908 18 17  920 73% 2.736 41%
06. Rybka 3 x64                  2.908 22 22  840 78% 2.686 28%
08. IPP Fire 1.31 x64            2.907 19 19  920 75% 2.720 36%
09. Rybka 4 w32                  2.903 19 19  960 76% 2.702 32%
10. Stockfish 1.7.1 JA x64       2.901 18 17 1120 76% 2.704 34%
10. Stockfish 1.8.0 JA x64       2.901 16 16 1320 72% 2.734 35%
12. Stockfish 1.7.1 JA w32       2.882 18 17 1200 75% 2.688 31%
13. Stockfish 1.8.0 JA w32       2.875 19 18  920 74% 2.696 37%
14. Rybka 3 w32                  2.868 15 15 1520 74% 2.688 31%
15. Stockfish 1.6.3 JA w32       2.836 17 17 1080 71% 2.678 36%
16. Naum 4.2 x64                 2.830 13 13 1880 65% 2.721 37%
17. Naum 4.2 w32                 2.829 15 15 1440 68% 2.700 36%
17. Critter 0.80 x64             2.829 15 15 1320 63% 2.736 36%
19. Critter 0.80 w32             2.818 19 19  800 66% 2.702 39%
20. Naum 4.1 w32                 2.816 19 19  920 68% 2.685 35%
21. Stockfish 1.6.0 JA w32       2.812 18 17  960 68% 2.685 39%
22. Critter 0.70 x64             2.805 18 18  880 65% 2.700 38%
23. Shredder 12 w32              2.800  9  9 3840 63% 2.710 36%
24. Komodo 1.2 JA x64            2.796 13 13 1640 61% 2.719 40%

Individual statistics:

Code: Select all

1 Houdini 1.03a x64         : 2952  920 (+596,=269,- 55), 79.4 %

Shredder 12                   :  40 (+ 21,= 18,-  1), 75.0 %
Zappa Mexico II x64           :  40 (+ 27,= 11,-  2), 81.2 %
Protector 1.3.4 JA x64        :  40 (+ 27,= 13,-  0), 83.8 %
Naum 4.2 x64                  :  40 (+ 23,= 12,-  5), 72.5 %
SmarThink 1.20 x64            :  40 (+ 33,=  6,-  1), 90.0 %
Thinker 5.4d Inert x64        :  40 (+ 20,= 18,-  2), 72.5 %
Sjeng WC-2008 x64             :  40 (+ 26,=  9,-  5), 76.2 %
Komodo 1.2 JA x64             :  40 (+ 23,= 16,-  1), 77.5 %
Junior 11.2 x64               :  40 (+ 33,=  4,-  3), 87.5 %
Fruit 09_07_05 x64            :  40 (+ 32,=  8,-  0), 90.0 %
Rybka 4 x64                   :  40 (+ 10,= 23,-  7), 53.8 %
Onno 1.2.70 x64               :  40 (+ 30,=  9,-  1), 86.2 %
Spark 0.5 x64                 :  40 (+ 24,= 12,-  4), 75.0 %
Stockfish 1.8.0 JA x64        :  40 (+  8,= 21,- 11), 46.2 %
Hannibal 1.0a x64             :  40 (+ 27,= 10,-  3), 80.0 %
Critter 0.80 x64              :  40 (+ 18,= 20,-  2), 70.0 %
Crafty 23.3 JA x64            :  40 (+ 35,=  5,-  0), 93.8 %
Umko 1.0 x64                  :  40 (+ 28,= 12,-  0), 85.0 %
Loop M1-T x64                 :  40 (+ 33,=  7,-  0), 91.2 %
Equinox 0.83 x64              :  40 (+ 34,=  5,-  1), 91.2 %
Cipollino 3.25 x64            :  40 (+ 36,=  4,-  0), 95.0 %
Fire 1.31 x64                 :  40 (+ 11,= 23,-  6), 56.2 %
Crafty 23.3 JA x64 NP         :  40 (+ 37,=  3,-  0), 96.2 %

2 IvanHoe T0.4 x64          : 2947  920 (+552,=316,- 52), 77.2 %

Shredder 12                   :  40 (+ 27,=  9,-  4), 78.8 %
Hiarcs 13.1                   :  40 (+ 24,= 13,-  3), 76.2 %
Zappa Mexico II x64           :  40 (+ 28,= 10,-  2), 82.5 %
Protector 1.3.4 JA x64        :  40 (+ 30,= 10,-  0), 87.5 %
Naum 4.2 x64                  :  40 (+ 16,= 19,-  5), 63.7 %
Loop 2007 x64                 :  40 (+ 30,= 10,-  0), 87.5 %
SmarThink 1.20 x64            :  40 (+ 28,= 11,-  1), 83.8 %
Thinker 5.4d Inert x64        :  40 (+ 22,= 17,-  1), 76.2 %
Sjeng WC-2008 x64             :  40 (+ 27,= 12,-  1), 82.5 %
Komodo 1.2 JA x64             :  40 (+ 22,= 16,-  2), 75.0 %
Junior 11.2 x64               :  40 (+ 30,=  9,-  1), 86.2 %
Fruit 09_07_05 x64            :  40 (+ 22,= 16,-  2), 75.0 %
Rybka 4 x64                   :  40 (+  6,= 29,-  5), 51.2 %
Onno 1.2.70 x64               :  40 (+ 33,=  7,-  0), 91.2 %
Spark 0.5 x64                 :  40 (+ 26,= 10,-  4), 77.5 %
Stockfish 1.8.0 JA x64        :  40 (+  9,= 25,-  6), 53.8 %
Hannibal 1.0a x64             :  40 (+ 33,=  5,-  2), 88.8 %
Critter 0.80 x64              :  40 (+ 14,= 23,-  3), 63.7 %
Crafty 23.3 JA x64            :  40 (+ 32,=  8,-  0), 90.0 %
Umko 1.0 x64                  :  40 (+ 30,=  8,-  2), 85.0 %
Equinox 0.83 x64              :  40 (+ 33,=  7,-  0), 91.2 %
GullChess 1.0a x64            :  40 (+ 24,= 12,-  4), 75.0 %
IvanHoe 52iUSTMO x64          :  40 (+  6,= 30,-  4), 52.5 %

4 IvanHoe B52aC x64         : 2932  920 (+532,=329,- 59), 75.7 %

Shredder 12                   :  40 (+ 18,= 13,-  9), 61.3 %
Hiarcs 13.1                   :  40 (+ 20,= 16,-  4), 70.0 %
Zappa Mexico II x64           :  40 (+ 21,= 19,-  0), 76.2 %
Protector 1.3.4 JA x64        :  40 (+ 29,=  8,-  3), 82.5 %
Naum 4.2 x64                  :  40 (+ 15,= 21,-  4), 63.7 %
Loop 2007 x64                 :  40 (+ 33,=  6,-  1), 90.0 %
SmarThink 1.20 x64            :  40 (+ 31,=  9,-  0), 88.8 %
Thinker 5.4d Inert x64        :  40 (+ 26,= 13,-  1), 81.2 %
Sjeng WC-2008 x64             :  40 (+ 27,= 13,-  0), 83.8 %
Komodo 1.2 JA x64             :  40 (+ 18,= 18,-  4), 67.5 %
Junior 11.2 x64               :  40 (+ 30,=  9,-  1), 86.2 %
Fruit 09_07_05 x64            :  40 (+ 29,= 10,-  1), 85.0 %
Rybka 4 x64                   :  40 (+ 11,= 23,-  6), 56.2 %
Onno 1.2.70 x64               :  40 (+ 25,= 15,-  0), 81.2 %
Spark 0.5 x64                 :  40 (+ 28,= 11,-  1), 83.8 %
Stockfish 1.8.0 JA x64        :  40 (+  9,= 18,- 13), 45.0 %
Hannibal 1.0a x64             :  40 (+ 26,= 12,-  2), 80.0 %
Critter 0.80 x64              :  40 (+ 17,= 21,-  2), 68.8 %
Crafty 23.3 JA x64            :  40 (+ 34,=  6,-  0), 92.5 %
Umko 1.0 x64                  :  40 (+ 27,= 13,-  0), 83.8 %
Equinox 0.83 x64              :  40 (+ 33,=  7,-  0), 91.2 %
GullChess 1.0a x64            :  40 (+ 19,= 18,-  3), 70.0 %
FireBird 1.1 x64 WD           :  40 (+  6,= 30,-  4), 52.5 %

5 IvanHoe 52iUSTMO x64      : 2931  920 (+533,=321,- 66), 75.4 %

Shredder 12                   :  40 (+ 23,= 13,-  4), 73.8 %
Hiarcs 13.1                   :  40 (+ 22,= 15,-  3), 73.8 %
Zappa Mexico II x64           :  40 (+ 25,= 13,-  2), 78.8 %
Protector 1.3.4 JA x64        :  40 (+ 24,= 13,-  3), 76.2 %
Naum 4.2 x64                  :  40 (+ 16,= 16,-  8), 60.0 %
Loop 2007 x64                 :  40 (+ 32,=  7,-  1), 88.8 %
SmarThink 1.20 x64            :  40 (+ 32,=  6,-  2), 87.5 %
Thinker 5.4d Inert x64        :  40 (+ 26,= 10,-  4), 77.5 %
Sjeng WC-2008 x64             :  40 (+ 30,=  9,-  1), 86.2 %
Komodo 1.2 JA x64             :  40 (+ 20,= 18,-  2), 72.5 %
Junior 11.2 x64               :  40 (+ 31,=  6,-  3), 85.0 %
Fruit 09_07_05 x64            :  40 (+ 31,=  7,-  2), 86.2 %
Rybka 4 x64                   :  40 (+  5,= 28,-  7), 47.5 %
Onno 1.2.70 x64               :  40 (+ 26,= 12,-  2), 80.0 %
Spark 0.5 x64                 :  40 (+ 17,= 21,-  2), 68.8 %
Stockfish 1.8.0 JA x64        :  40 (+  6,= 26,-  8), 47.5 %
Hannibal 1.0a x64             :  40 (+ 29,=  9,-  2), 83.8 %
Critter 0.80 x64              :  40 (+ 22,= 15,-  3), 73.8 %
Crafty 23.3 JA x64            :  40 (+ 29,= 10,-  1), 85.0 %
Umko 1.0 x64                  :  40 (+ 32,=  8,-  0), 90.0 %
Equinox 0.83 x64              :  40 (+ 35,=  5,-  0), 93.8 %
GullChess 1.0a x64            :  40 (+ 16,= 24,-  0), 70.0 %
IvanHoe T0.4 x64              :  40 (+  4,= 30,-  6), 47.5 %

6 FireBird 1.1 x64 WD       : 2908  920 (+482,=379,- 59), 73.0 %

Shredder 12                   :  40 (+ 19,= 16,-  5), 67.5 %
Hiarcs 13.1                   :  40 (+ 21,= 16,-  3), 72.5 %
Zappa Mexico II x64           :  40 (+ 22,= 17,-  1), 76.2 %
Protector 1.3.4 JA x64        :  40 (+ 26,= 12,-  2), 80.0 %
Naum 4.2 x64                  :  40 (+ 13,= 25,-  2), 63.7 %
Loop 2007 x64                 :  40 (+ 35,=  5,-  0), 93.8 %
SmarThink 1.20 x64            :  40 (+ 31,=  9,-  0), 88.8 %
Thinker 5.4d Inert x64        :  40 (+ 25,= 14,-  1), 80.0 %
Sjeng WC-2008 x64             :  40 (+ 26,= 13,-  1), 81.2 %
Komodo 1.2 JA x64             :  40 (+ 15,= 24,-  1), 67.5 %
Junior 11.2 x64               :  40 (+ 19,= 15,-  6), 66.2 %
Fruit 09_07_05 x64            :  40 (+ 21,= 15,-  4), 71.2 %
Rybka 4 x64                   :  40 (+  4,= 27,-  9), 43.8 %
Onno 1.2.70 x64               :  40 (+ 26,= 11,-  3), 78.8 %
Spark 0.5 x64                 :  40 (+ 22,= 15,-  3), 73.8 %
Stockfish 1.8.0 JA x64        :  40 (+ 10,= 25,-  5), 56.2 %
Hannibal 1.0a x64             :  40 (+ 20,= 19,-  1), 73.8 %
Critter 0.80 x64              :  40 (+ 14,= 25,-  1), 66.2 %
Crafty 23.3 JA x64            :  40 (+ 30,=  9,-  1), 86.2 %
Umko 1.0 x64                  :  40 (+ 26,= 12,-  2), 80.0 %
Equinox 0.83 x64              :  40 (+ 31,=  8,-  1), 87.5 %
GullChess 1.0a x64            :  40 (+ 22,= 17,-  1), 76.2 %
IvanHoe B52aC x64             :  40 (+  4,= 30,-  6), 47.5 %

8 Fire 1.31 x64             : 2907  920 (+520,=332,- 68), 74.6 %

Shredder 12                   :  40 (+ 16,= 21,-  3), 66.2 %
Zappa Mexico II x64           :  40 (+ 16,= 21,-  3), 66.2 %
Protector 1.3.4 JA x64        :  40 (+ 27,= 11,-  2), 81.2 %
Naum 4.2 x64                  :  40 (+ 13,= 22,-  5), 60.0 %
SmarThink 1.20 x64            :  40 (+ 31,=  9,-  0), 88.8 %
Thinker 5.4d Inert x64        :  40 (+ 21,= 15,-  4), 71.2 %
Sjeng WC-2008 x64             :  40 (+ 33,=  6,-  1), 90.0 %
Komodo 1.2 JA x64             :  40 (+ 13,= 21,-  6), 58.8 %
Junior 11.2 x64               :  40 (+ 29,=  9,-  2), 83.8 %
Fruit 09_07_05 x64            :  40 (+ 29,=  9,-  2), 83.8 %
Rybka 4 x64                   :  40 (+ 11,= 22,-  7), 55.0 %
Onno 1.2.70 x64               :  40 (+ 24,= 15,-  1), 78.8 %
Spark 0.5 x64                 :  40 (+ 18,= 15,-  7), 63.7 %
Stockfish 1.8.0 JA x64        :  40 (+  9,= 26,-  5), 55.0 %
Hannibal 1.0a x64             :  40 (+ 27,= 11,-  2), 81.2 %
Critter 0.80 x64              :  40 (+ 20,= 16,-  4), 70.0 %
Crafty 23.3 JA x64            :  40 (+ 27,= 13,-  0), 83.8 %
Umko 1.0 x64                  :  40 (+ 24,= 16,-  0), 80.0 %
Houdini 1.03a x64             :  40 (+  6,= 23,- 11), 43.8 %
Loop M1-T x64                 :  40 (+ 28,= 10,-  2), 82.5 %
Equinox 0.83 x64              :  40 (+ 28,= 11,-  1), 83.8 %
Cipollino 3.25 x64            :  40 (+ 34,=  6,-  0), 92.5 %
Crafty 23.3 JA x64 NP         :  40 (+ 36,=  4,-  0), 95.0 %

Code: Select all

Conditions:
Windows XP Prof. x64 Edition
SClassic 4, Fritz 11 GUI
S12: Random-Book 4.1
F12: Perfect 2010

40 moves in 10 minutes
ponder = on
each engine = 1 core
resign / learning = off
hashtables = 256Mb
4TB Nalimov, GaviotaB., egbb,
ShredderB., TotalB. & TripleB.

Intel® Core™2 Quad
4x Q9550, 2,83GHz

Frank's Chess Page, SWCR
http://www.amateurschach.de

Best
Frank

[Frank Quisinsky]

Hi there,

here is the new SWCR rating list (all SWCR-32 / SWCR-64) games.

Code: Select all

After 55.960 games, 31 different engines, 92 versions included
ELO are fixed to 2.800 for Shredder 12 32bit. All other engines are derived from that fixed number.
Calculated with:  Bayesian 0056

The separate columns give the (mean) Elo performance, the + and - margins of error given with 95 % confidence,
the number of finished games, the relative score given in percentages, the average opponent ELO and finally the
relative number of draws for each program.

01. Rybka 4 x64                  2.944 18 18 1440 82% 2.688 28% +49 to 32bit
02. IvanHoe T0.4 x64             2.940 21 21  920 79% 2.720 32%
--. Rybka 3 x64                  2.906 23 22  840 78% 2.688 28% +45 to 32bit
03. Stockfish 1.8.0 JA x64       2.903 19 19 1120 76% 2.701 31% +39 to 32bit
--. Stockfish 1.7.1 JA x64       2.897 19 18 1120 76% 2.707 34% +22 to 32bit
--. Rybka 4 w32                  2.895 20 20  960 76% 2.703 32%
--. Stockfish 1.7.1 JA w32       2.875 18 18 1200 75% 2.690 31%
--. Stockfish 1.8.0 JA w32       2.864 20 20  920 74% 2.697 37%
--. Rybka 3 w32                  2.861 16 16 1520 74% 2.690 31%
04. Critter 0.80 x64             2.840 18 18 1120 69% 2.703 34% +26 to 32bit
05. Naum 4.2 x64                 2.834 15 15 1680 69% 2.698 35% + 9 to 32bit
--. Stockfish 1.6.3 JA w32       2.827 18 18 1080 71% 2.680 36%
--. Naum 4.2 w32                 2.825 16 15 1440 68% 2.701 36%
--. Critter 0.80 w32             2.814 21 20  800 66% 2.703 39%
--. Naum 4.1 w32                 2.812 19 19  920 68% 2.686 35%
--. Critter 0.70 x64             2.807 20 20  880 65% 2.702 38% +29 to 32bit
--. Stockfish 1.6.0 JA w32       2.802 19 18  960 68% 2.688 39%
06. Shredder 12 w32              2.800 10 10 3640 64% 2.699 36%
07. Komodo 1.2 JA x64            2.799 16 15 1440 65% 2.692 39% +38 to 32bit
--. Komodo 1.0 JA x64            2.791 20 20  840 64% 2.694 40% +75 to 32bit
--. Shredder 12 x64              2.787 15 15 1600 63% 2.691 34% -13 to 32bit
--. Naum 4.0 w32                 2.785 19 19  960 65% 2.682 38%
--. Critter 0.70 w32             2.778 19 19  920 61% 2.704 39%
08. Deep Fritz 12 w32            2.778 15 15 1520 61% 2.704 42% 32bit only
09. GullChess 1.0a x64           2.763 18 18  960 55% 2.731 40%
--. Komodo 1.2 JA w32            2.761 18 18  960 58% 2.709 42%
--. Fritz 12 w32                 2.746 16 16 1160 59% 2.688 44% 32bit only
10. Spark 0.5 x64                2.738 15 15 1440 56% 2.694 38% +24 to 32bit
11. Hiarcs 13.1 w32              2.735 13 13 1920 52% 2.721 41% 32bit only
11. Thinker 5.4d Inert x64       2.735 14 14 1680 55% 2.700 39% +24 to 32bit
--. Stockfish 1.5.1 JA w32       2.732 19 19  840 59% 2.672 43%
13. Zappa Mexico II x64          2.721 14 14 1680 53% 2.701 40% +59 to 32bit
--. Spark 0.4 x64                2.718 20 20  840 53% 2.697 40% +31 to 32bit
--. Komodo 1.0 JA w32            2.716 16 16 1200 53% 2.695 40%
--. Spark 0.5 w32                2.714 18 18  960 51% 2.711 41%
14. Protector 1.3.4 JA x64       2.712 14 14 1640 52% 2.701 37% +33 to 32bit
14. Fruit 09_07_05 x64           2.712 14 14 1680 51% 2.701 35%
--. Thinker 5.4d Inert w32       2.711 13 13 2000 51% 2.703 42%
--. Critter 0.60 x64             2.701 20 20  840 50% 2.698 38% +12 to 32bit
--. Doch 1.3.4 JA w32            2.691 19 19  840 51% 2.687 44%
--. Critter 0.60 w32             2.689 19 19  920 50% 2.689 39%
16. Sjeng WC-2008 x64            2.688 14 14 1680 48% 2.701 36% +23 to 32bit
--. Spark 0.4 w32                2.687 19 19  880 49% 2.692 42%
--. Protector 1.3.5 x64          2.685 20 20  840 47% 2.707 39% +15 to 32bit
17. Hannibal 1.0a x64            2.685 17 17 1120 47% 2.709 35% +44 to 32bit
17. Junior 11.2 w32              2.685 19 19  960 46% 2.712 33%
--. Junior 11.2 x64              2.684 16 16 1440 49% 2.695 31% - 1 to 32bit
--. Protector 1.3.4 JA w32       2.679 15 16 1360 46% 2.707 39%
19. Onno 1.2.70 x64              2.676 15 15 1440 48% 2.695 37% +39 to 32bit
--. Cyclone xTreme Wrath w32     2.676 17 17 1080 47% 2.698 41% 32bit only
--. Protector 1.3.2 w32          2.674 17 17 1160 47% 2.696 41%
--. Onno 1.1.1 x64               2.671 20 20  840 46% 2.699 40% +40 to 32bit
--. Protector 1.3.5 JA w32       2.670 19 19  840 44% 2.713 42%
--. Junior 2010 w32              2.669 16 16 1240 47% 2.691 36%
--. Hiarcs 12.1 w32              2.668 19 19  880 47% 2.690 41% 32bit only
--. Protector 1.3.1b w32         2.668 19 19  840 47% 2.691 42%
--. Doch 1.2 JA w32              2.666 19 19  840 48% 2.679 40%
--. Sjeng WC-2008 w32            2.665 13 13 2000 44% 2.704 37%
--. Hiarcs 12.1 Sharpen PV w32   2.665 16 16 1280 45% 2.699 39% 32bit only
--. Zappa Mexico II w32          2.662 13 13 2000 44% 2.704 42%
--. Spark 0.3a w32               2.656 17 17 1120 44% 2.699 41%
--. Doch 09.980 JA w32           2.653 19 19  840 46% 2.676 42%
--. Junior 11.1a x64             2.648 20 20  840 43% 2.700 32% + 2 to 32bit
--. Junior 11.1a w32             2.646 19 19  960 44% 2.692 36%
--. Spark 0.3 w32                2.644 19 19  880 43% 2.691 42%
--. Hannibal 1.0a w32            2.641 20 20  840 39% 2.715 36%
--. Onno 1.2.70 w32              2.637 18 18  960 39% 2.714 40%
20. Loop 2007 x64                2.632 15 15 1560 39% 2.712 36% +18 to 32bit
--. Onno 1.1.1 w32               2.631 14 15 1520 40% 2.696 41%
--. Loop M1-T x64                2.629 19 20  880 38% 2.718 37%
--. Fruit 05/11/03 w32           2.618 13 13 2000 37% 2.705 41% 32bit only
--. Loop 13.6 w32                2.615 15 15 1520 38% 2.696 39%
--. Loop 2007 w32                2.614 19 19  960 35% 2.715 36%
--. Critter 0.52b w32            2.614 18 18 1040 38% 2.699 37%
--. Twisted Logic 20100131x x64  2.612 18 18 1120 35% 2.717 32% +37 to 32bit
--. Glaurung 2.2 JA w32          2.610 18 18 1080 37% 2.700 36%
21. Ktulu 9.03 w32               2.610 15 16 1520 36% 2.709 30% 32bit only
22. Umko 1.0 x64                 2.605 18 18 1120 35% 2.712 37% (ponder not possible)
23. SmarThink 1.20 x64           2.603 14 15 1680 36% 2.703 35% + 6 to 32bit
24. Equinox 0.83 x64             2.600 18 18 1080 34% 2.720 33%
25. Crafty 23.3 JA x64           2.599 18 18 1120 35% 2.712 35%
--. SmarThink 1.20 w32           2.597 13 13 2000 34% 2.706 37%
--. Twisted Logic 20100131x w32  2.575 15 15 1600 32% 2.708 30%
26. Spike 1.2 Turin w32          2.574 16 16 1480 31% 2.708 34% 32bit only
--. Cipollino 3.25 x64           2.570 20 21  880 30% 2.720 32%
27. BugChess2 1.7 x64            2.558 20 20 1000 27% 2.729 30%
28. Scorpio 2.6 JA x64           2.556 18 18 1120 28% 2.719 32%
--. Crafty 23.2 JA x64           2.555 18 19 1120 28% 2.719 30%
29. Chronos 1.99 x64             2.553 18 18 1120 27% 2.719 33% (ponder not possible)
--. Crafty 23.3 JA x64 NP        2.552 21 21  880 27% 2.721 32% Test: Without ponder = NP for No Ponder)
30. Daydreamer 1.75 JA x64       2.522 19 19 1120 24% 2.720 30%
31. Tornado 3.6.7 x64            2.480 23 24  840 19% 2.727 24%

Date range            = 2009.10.26 - 2010.10.19
Average White ELO     = 2.702,11
Average Black ELO     = 2.702,11
Maximum ELO distance  = 464
Average ELO distance  = 114.628
Number of White wins  = 20338 (36.3%)
Number of draws       = 20541 (36.7%)
Number of Black wins  = 15081 (27.0%)
White score           = 54.7%
Black score           = 45.3%
ECO A games           = 16238 (29.0%)
ECO B games           = 11570 (20.7%)
ECO C games           =  7639 (13.7%)
ECO D games           = 13214 (23.6%)
ECO E games           =  7299 (13.0%)

Best
Frank

[Frank Quisinsky]

Hi there,

here are the SWCR-64 rating list (all played games):

Code: Select all

After 25.600 games, 28 different engines, 43 versions included
ELO are fixed to 2.800 for Shredder 12 32bit. All other engines are derived from that fixed number.
Calculated with:  Bayesian 0056

The separate columns give the (mean) Elo performance, the + and - margins of error given with 95 % confidence,
the number of finished games, the relative score given in percentages, the average opponent ELO and finally the
relative number of draws for each program.

01. Rybka 4 x64                  2.944 18 18 1440 82% 2.688 28%
02. IvanHoe T0.4 x64             2.939 21 21  920 79% 2.720 32%
--. Rybka 3 x64                  2.906 22 22  840 78% 2.688 28%
03. Stockfish 1.8.0 JA x64       2.903 19 19 1120 76% 2.701 31%
--. Stockfish 1.7.1 JA x64       2.897 19 18 1120 76% 2.707 34%
04. Critter 0.80 x64             2.840 18 18 1120 69% 2.703 34%
05. Naum 4.2 x64                 2.834 15 15 1680 69% 2.698 35%
--. Critter 0.70 x64             2.807 20 19  880 65% 2.702 38%
06. Shredder 12 w32              2.800 15 15 1640 64% 2.696 34%
07. Komodo 1.2 JA x64            2.799 15 15 1440 65% 2.692 39%
--. Komodo 1.0 JA x64            2.791 20 20  840 64% 2.693 40%
--. Shredder 12 x64              2.787 15 15 1600 63% 2.690 34%
08. GullChess 1.0a x64           2.763 18 18  960 55% 2.730 40%
09. Spark 0.5 x64                2.738 15 15 1440 56% 2.694 38%
10. Hiarcs 13.1 w32              2.735 18 18  960 50% 2.732 39%
10. Thinker 5.4d Inert x64       2.735 14 14 1680 55% 2.700 39%
12. Zappa Mexico II x64          2.720 14 14 1680 53% 2.701 40%
--. Spark 0.4 x64                2.718 19 19  840 53% 2.697 40%
13. Protector 1.3.4 JA x64       2.712 14 14 1640 52% 2.701 37%
13. Fruit 09_07_05 x64           2.712 14 14 1680 51% 2.701 35%
--. Critter 0.60 x64             2.701 19 19  840 50% 2.698 38%
15. Sjeng WC-2008 x64            2.688 14 14 1680 48% 2.701 36%
--. Protector 1.3.5 x64          2.685 19 20  840 47% 2.707 39%
16. Hannibal 1.0a x64            2.685 17 17 1120 47% 2.708 35%
17. Junior 11.2 x64              2.684 16 16 1440 49% 2.695 31%
18. Onno 1.2.70 x64              2.676 15 15 1440 48% 2.695 37%
--. Onno 1.1.1 x64               2.671 19 19  840 46% 2.699 40%
--. Junior 11.1a x64             2.648 20 20  840 43% 2.700 32%
19. Loop 2007 x64                2.631 15 15 1560 39% 2.712 36%
--. Loop M1-T x64                2.629 19 19  880 38% 2.718 37%
--. Twisted Logic 20100131x x64  2.612 18 18 1120 35% 2.717 32%
20. Umko 1.0 x64                 2.605 17 17 1120 35% 2.711 37% (ponder not possible)
21. SmarThink 1.20 x64           2.603 14 15 1680 36% 2.703 35%
22. Equinox 0.83 x64             2.600 18 18 1080 34% 2.720 33%
23. Crafty 23.3 JA x64           2.599 18 18 1120 35% 2.712 35%
--. Cipollino 3.25 x64           2.570 20 20  880 30% 2.720 32%
24. BugChess2 1.7 x64            2.558 19 20 1000 27% 2.729 30%
25. Scorpio 2.6 JA x64           2.556 18 18 1120 28% 2.719 32%
--. Crafty 23.2 JA x64           2.555 18 18 1120 28% 2.719 30%
26. Chronos 1.99 x64             2.552 18 18 1120 27% 2.719 33% (ponder not possible)
--. Crafty 23.3 JA x64 NP        2.552 20 21  880 27% 2.721 32% Test: Without ponder = NP for No Ponder)
27. Daydreamer 1.75 JA x64       2.522 19 19 1120 24% 2.720 30%
28. Tornado 3.6.7 x64            2.480 23 23  840 19% 2.726 24%

Date range            = 2010.05.12 - 2010.10.19
Average White ELO     = 2.705,72
Average Black ELO     = 2.705,72
Maximum ELO distance  = 464
Average ELO distance  = 135.967
Number of White wins  =  9402 (36.7%)
Number of draws       =  8902 (34.8%)
Number of Black wins  =  7296 (28.5%)
White score           = 54.1%
Black score           = 45.9%
ECO A games           =  9461 (37.0%)
ECO B games           =  5053 (19.7%)
ECO C games           =  3040 (11.9%)
ECO D games           =  5434 (21.2%)
ECO E games           =  2612 (10.2%)

Code: Select all

Conditions:
Windows XP Prof. x64 Edition
SClassic 4, Fritz 11 GUI
S12: Random-Book 4.1
F12: Perfect 2010

40 moves in 10 minutes
ponder = on
each engine = 1 core
resign / learning = off
hashtables = 256Mb
4TB Nalimov, GaviotaB., egbb,
ShredderB., TotalB. & TripleB.

Intel® Core™2 Quad
4x Q9550, 2,83GHz

Best
Frank

[Frank Quisinsky]

Hi there,

and here are the most important SWCR-64 rating list.
Each engine vs. each engine 40 games.
24 different engines are included!

Code: Select all

After 11.040 games, 24 engines included
ELO are fixed to 2.800 for Shredder 12 32bit. All other engines are derived from that fixed number.
Calculated with:  Bayesian 0056

The separate columns give the (mean) Elo performance, the + and - margins of error given with 95 % confidence,
the number of finished games, the relative score given in percentages, the average opponent ELO and finally the
relative number of draws for each program.

01. Rybka 4 x64                  2.939 21 20  920 80% 2.715 31%
02. IvanHoe T0.4 x64             2.934 21 20  920 79% 2.715 32%
03. Stockfish 1.8.0 JA x64       2.894 20 20  920 74% 2.717 34%
04. Critter 0.80 x64             2.833 19 19  920 66% 2.719 36%
05. Naum 4.2 x64                 2.821 19 19  920 65% 2.720 39%
06. Shredder 12 w32              2.800 19 19  920 61% 2.721 35%
07. Komodo 1.2 JA x64            2.790 18 18  920 60% 2.721 41%
08. GullChess 1.0a x64           2.761 18 18  920 56% 2.722 40%
09. Hiarcs 13.1 w32              2.731 18 18  920 51% 2.724 39%
10. Thinker 5.4d Inert x64       2.728 18 18  920 50% 2.724 40%
11. Spark 0.5 x64                2.727 18 18  920 51% 2.724 40%
12. Zappa Mexico II x64          2.717 18 18  920 49% 2.724 40%
13. Protector 1.3.4 JA x64       2.711 18 18  920 48% 2.725 39%
14. Fruit 09_07_05 x64           2.705 18 18  920 47% 2.725 38%
15. Sjeng WC-2008 x64            2.688 18 18  920 45% 2.726 36%
16. Junior 11.2 x64              2.687 19 19  920 45% 2.726 32%
17. Hannibal 1.0a x64            2.678 18 19  920 43% 2.726 36%
18. Onno 1.2.70 x64              2.671 18 18  920 42% 2.726 38%
19. Loop 2007 x64                2.627 19 19  920 36% 2.728 36%
20. Umko 1.0 x64                 2.606 19 19  920 33% 2.729 37% (ponder not possible)
21. Equinox 0.83 x64             2.597 19 19  920 32% 2.730 31%
22. SmarThink 1.20 x64           2.591 19 19  920 31% 2.730 34%
23. Crafty 23.3 JA x64           2.588 19 19  920 31% 2.730 32%
24. BugChess2 1.7 x64            2.552 20 20  920 26% 2.731 31%

Date range            = 2010.05.12 - 2010.10.19
Average White ELO     = 2.724,00
Average Black ELO     = 2.724,00 = Category 19
Maximum ELO distance  = 387
Average ELO distance  = 123.355
Number of White wins  =  3927 (35.6%)
Number of draws       =  3988 (36.1%)
Number of Black wins  =  3125 (28.3%)
White score           = 53.6%
Black score           = 46.4%
ECO A games           =  4374 (39.6%)
ECO B games           =  1998 (18.1%)
ECO C games           =  1426 (12.9%)
ECO D games           =  2310 (20.9%)
ECO E games           =   932 ( 8.4%)

Code: Select all

Conditions:
Windows XP Prof. x64 Edition
SClassic 4, Fritz 11 GUI
S12: Random-Book 4.1
F12: Perfect 2010

40 moves in 10 minutes
ponder = on
each engine = 1 core
resign / learning = off
hashtables = 256Mb
4TB Nalimov, GaviotaB., egbb,
ShredderB., TotalB. & TripleB.

Intel® Core™2 Quad
4x Q9550, 2,83GHz

Best
Frank

[Frank Quisinsky]

Hi there,

I think I have all ...

More information can be found on my webpage. I updated all databases. If you have interest you can download all games (PGN, ZIP file) and the configuration files I used.

Interesting are perhaps my Aktuell / Actual page in German language. Possible to translate it with the Google link in front of this page.

At the moment a bigger SWCR-32 tournament is still running. First LIVE results are available Thursday in the evening. So far Ktulu 9.03 and Deep Fritz 12 are playing vs. the 6 new engines.

Code: Select all

Updates:
103. w32 Jonny 4.00                NEW      Started: 19.10.2010
102. w32 Stockfish 1.9.1 JA        Update   Started: 19.10.2010
101. w32 GullChess 1.0a            NEW      Started: 19.10.2010
100. w32 Equinox 0.83              NEW      Started: 19.10.2010 private status
099. w32 WB Crafty 23.3 JA         NEW      Started: 19.10.2010
098. w32 Bright 0.5c               NEW      Started: 19.10.2010

This tournament with 5.160 new games need around 18 days. After this tournemant 24 engines will be add in SWCR-32 too.

Have fun with SWCR!

Frank's Chess Page, SWCR
http://www.amateurschach.de

Best
Frank

[ernest]

Code: Select all

01. IPP Houdini 1.03a x64        2.948 22 21  920 79% 2.718 29%
02. IPP IvanHoe T0.4 x64         2.938 21 20  920 77% 2.736 34%
02. Rybka 4 x64                  2.938 16 16 1640 78% 2.716 32%

Hi Frank,
Well, indeed IvanHoe T0.4 did well! (better than with my tests...)
I appreciate the individual detail you gave.

[Dr.Wael Deeb]

Hi there,

I think I have all ...

More information can be found on my webpage. I updated all databases. If you have interest you can download all games (PGN, ZIP file) and the configuration files I used.

Interesting are perhaps my Aktuell / Actual page in German language. Possible to translate it with the Google link in front of this page.

At the moment a bigger SWCR-32 tournament is still running. First LIVE results are available Thursday in the evening. So far Ktulu 9.03 and Deep Fritz 12 are playing vs. the 6 new engines.

Code: Select all

Updates:
103. w32 Jonny 4.00                NEW      Started: 19.10.2010
102. w32 Stockfish 1.9.1 JA        Update   Started: 19.10.2010
101. w32 GullChess 1.0a            NEW      Started: 19.10.2010
100. w32 Equinox 0.83              NEW      Started: 19.10.2010 private status
099. w32 WB Crafty 23.3 JA         NEW      Started: 19.10.2010
098. w32 Bright 0.5c               NEW      Started: 19.10.2010

This tournament with 5.160 new games need around 18 days. After this tournemant 24 engines will be add in SWCR-32 too.

Have fun with SWCR!

Frank's Chess Page, SWCR
http://www.amateurschach.de

Best
Frank

Thank you Sir for the great tournaments you run and the games
BTW,Bright 0.5c has achieved a great result in my rating list using it's own opening book....an Elo of 3168 after playing around 800 games at long time controls....and believe me,crossing the 3000 Elo barrier in my rating list is considered to be a huge success....
Dr.D

[Frank Quisinsky]

Hi Ernest,

you know that I am not a fan from Rybka / IPP family engines. I do that because many users wish such a test and I am playing on an very open rating list. Why I should not do that ... at the moment not many new releases of strong engines are available, so I have the time for it.

Now after all the games I saw, IvanHoe is OK for me and I think it's interesting to have one of this IPP family engines in my rating list. So IvanHoe by Ahmed will be updated frequently, compare to the others. I saw that Ahmed do the most, stable engine, strong results and so this engine is qualified. Time mangement can be better but so far a newer version with an other time management is available. A better time management can be around 10-15 ELO I think.

In my next bigger SWCR-64 tourney I will update the compile by Ahmed again.

Thanks for your comment!

And yes, absolutly clear for me that the IPP family is stronger with shorter time controls. I know the results I read about it. But with my conditions and ponder = ON the results are very clear too.

The IvanHoe version by Ahmed and Rybka 4 have around the same playing strength. I believe with more time Rybka 4 will be better because its clear too, that this engine have more endgame knowledge as the IPP family ... think so!

Have a nice day!

Best
Frank

[Frank Quisinsky]

Hi Wael,

all the time I test the Spark versions only. Bright versions missed in SWCR. Bright is 32bit only and after the available information by others is Spark stronger. Spark is my favorite engine so far, so I am very interested on the Bright results too.

Bright is playing as engine 25 as a little experiment.

Tomorrow in the evening the LIVE table is still running for 16-18 days. A long tourney with over 5.000 new games. I am sure I will have a lot of fun with Stockfish 1.9.1 JA, Bright 0.5c, Equinox 0.83, Gullchess 1.0a, Jonny 4.00 and WB Crafty 23.3 JA.

After the tounrney I know the different from 32bit to 64bit for Equinox, Crafty, Gullchess too and in SWCR-32 are also 24 different engines included.

Thanks for your interest.

Best
Frank

[ernest]

In my next bigger SWCR-64 tourney I will update the compile by Ahmed again.

You also wrote (previously):
- qualified for the experimental SWCR-64: IvanHoe T0.4 x64
Does that mean that Houdini is not qualified, and why?