SWCR after 45.640 games ... new Critter 0.8, Hannibal 1.0a

[Frank Quisinsky]

Hi there,

1.960 new games played, new is:
Critter 0.80 w32
Hannibal 1.0a w32
more Protector 1.3.4 JA games (better as version 1.3.5)

After 45.640 games, 25 different engines, 80 versions included
ELO are fixed to 2.800 for Shredder 12 32bit. All other engines are derived from that fixed number.
Calculated with: Bayesian 0056

Code: Select all

01. Rybka 4 x64                  2.946 23 22  880 82% 2.701 29% +52 to 32bit
--. Rybka 3 x64                  2.911 23 22  840 78% 2.694 28% +51 to 32bit
02. Stockfish 1.7.1 JA x64       2.902 19 18 1120 76% 2.712 34% +28 to 32bit
--. Rybka 4 w32                  2.894 20 19 1000 75% 2.708 33% 
--. Stockfish 1.7.1 JA w32       2.874 18 18 1200 75% 2.689 31%
--. Stockfish 1.8.0a JA w32      2.865 21 21  800 74% 2.694 36%
--. Stockfish 1.8.0 JA w32       2.862 20 20  920 74% 2.696 37%
--. Rybka 3 w32                  2.860 16 16 1520 74% 2.689 31%
03. Naum 4.2 x64                 2.834 18 18 1120 67% 2.715 38% + 9 to 32bit
--. Stockfish 1.6.3 JA w32       2.826 18 18 1080 71% 2.679 36%
--. Naum 4.2 w32                 2.825 16 15 1480 67% 2.704 36%
04. Critter 0.80 w32             2.813 21 20  800 66% 2.702 39%
--. Critter 0.70 x64             2.812 20 20  880 65% 2.707 38% +38 to 32bit
--. Naum 4.1 w32                 2.811 20 19  920 68% 2.685 35%
05. Komodo 1.2 JA x64            2.804 19 19  880 64% 2.708 41% +46 to 32bit
--. Stockfish 1.6.0 JA w32       2.801 19 19  960 68% 2.687 39%
06. Shredder 12 w32              2.800 11 10 3120 63% 2.707 38%
--. Komodo 1.0 JA x64            2.797 20 20  840 64% 2.699 40% +82 to 32bit
--. Shredder 12 x64              2.794 18 18 1080 61% 2.713 35% - 6 to 32bit
--. Naum 4.0 w32                 2.784 19 19  960 65% 2.681 38%
07. Deep Fritz 12 w32            2.778 14 14 1560 60% 2.707 43% 32bit only
--. Critter 0.70 w32             2.775 19 18  960 60% 2.709 40%
--. Komodo 1.2 JA w32            2.758 18 18 1000 56% 2.714 42%
--. Fritz 12 w32                 2.745 16 16 1160 59% 2.687 44% 32bit only
08. Thinker 5.4d Inert x64       2.742 17 17 1120 53% 2.718 42% +32 to 32bit
09. Spark 0.5 x64                2.740 19 19  880 54% 2.710 38% +27 to 32bit
10. Hiarcs 13.1 w32              2.735 18 18 1000 53% 2.715 43% 32bit only
--. Stockfish 1.5.1 JA w32       2.731 19 19  840 59% 2.671 43%
11. Zappa Mexico II x64          2.730 17 17 1120 52% 2.718 41% +69 to 32bit
12. Protector 1.3.4 JA x64       2.728 18 18 1080 51% 2.719 37% +50 to 32bit
--. Spark 0.4 x64                2.724 20 20  840 53% 2.703 40% +38 to 32bit
13. Fruit 09_07_05 x64           2.723 17 17 1120 51% 2.718 35%
--. Komodo 1.0 JA w32            2.715 16 16 1200 53% 2.694 40%
--. Spark 0.5 w32                2.713 18 18 1000 50% 2.716 41%
--. Thinker 5.4d Inert w32       2.710 13 13 2040 51% 2.705 42%
--. Critter 0.60 x64             2.706 20 20  840 50% 2.703 38% +18 to 32bit
14. Junior 11.2 x64              2.694 20 20  880 47% 2.713 32% +11 to 32bit
15. Sjeng WC-2008 x64            2.690 17 17 1120 46% 2.720 37% +25 to 32bit
--. Protector 1.3.5 x64          2.690 20 20  840 47% 2.712 39% +22 to 32bit
--. Doch 1.3.4 JA w32            2.690 19 19  840 51% 2.686 44%
--. Critter 0.60 w32             2.688 19 19  920 50% 2.688 39%
--. Spark 0.4 w32                2.686 19 19  880 49% 2.691 43%
--. Junior 11.2 w32              2.683 18 18 1000 45% 2.717 33%
--. Protector 1.3.4 JA w32       2.678 16 16 1360 46% 2.706 39%
16. Onno 1.1.1 x64               2.677 20 20  840 46% 2.705 40% +47 to 32bit
--. Onno 1.2.70 x64              2.676 19 19  880 45% 2.713 39% +43 to 32bit
--. Cyclone xTreme Wrath w32     2.675 17 17 1080 47% 2.697 41% 32bit only
--. Protector 1.3.2 w32          2.674 16 17 1160 47% 2.695 41%
--. Protector 1.3.5 JA w32       2.668 19 19  880 43% 2.718 41%
--. Junior 2010 w32              2.668 16 16 1240 47% 2.690 36%
--. Hiarcs 12.1 w32              2.667 19 19  880 47% 2.689 41% 32bit only
--. Protector 1.3.1b w32         2.667 19 19  840 47% 2.690 42%
--. Doch 1.2 JA w32              2.665 19 19  840 48% 2.678 40%
--. Sjeng WC-2008 w32            2.665 13 13 2040 44% 2.706 37%
--. Hiarcs 12.1 Sharpen PV w32   2.664 16 16 1280 45% 2.698 40% 32bit only
--. Zappa Mexico II w32          2.661 13 13 2040 43% 2.706 42%
--. Spark 0.3a w32               2.655 17 17 1120 44% 2.698 41%
--. Junior 11.1a x64             2.654 20 20  840 43% 2.706 32% + 9 to 32bit
--. Doch 09.980 JA w32           2.652 19 19  840 46% 2.675 42%
--. Junior 11.1a w32             2.645 19 19  960 44% 2.691 36%
--. Spark 0.3 w32                2.643 19 19  880 43% 2.690 42%
17. Hannibal 1.0a w32            2.639 20 20  840 39% 2.714 36%
18. Loop 2007 x64                2.637 17 18 1120 38% 2.722 36% +26 to 32bit
--. Onno 1.2.70 w32              2.633 18 18 1000 38% 2.719 40%
--. Onno 1.1.1 w32               2.630 15 15 1520 40% 2.695 41%
--. Twisted Logic 20100131x x64  2.617 18 18 1120 35% 2.722 32% +43 to 32bit
--. Fruit 05/11/03 w32           2.617 13 13 2040 37% 2.707 40% 32bit only
--. Loop 13.6 w32                2.614 15 15 1520 38% 2.695 39%
--. Critter 0.52b w32            2.613 18 18 1040 38% 2.698 37%
--. Loop 2007 w32                2.611 19 19 1000 34% 2.720 35%
--. Glaurung 2.2 JA w32          2.609 17 18 1080 37% 2.699 36%
19. Ktulu 9.03 w32               2.607 15 15 1560 36% 2.711 30% 32bit only
20. SmarThink 1.20 x64           2.605 18 18 1120 34% 2.723 33% +10 to 32bit
--. SmarThink 1.20 w32           2.595 13 13 2040 34% 2.708 37%
--. Twisted Logic 20100131x w32  2.574 15 15 1640 31% 2.710 30%
21. Spike 1.2 Turin w32          2.572 15 16 1520 30% 2.711 34% 32bit only
22. Scorpio 2.6 JA x64           2.561 18 18 1120 28% 2.724 32%
22. Crafty 23.2 JA x64           2.561 18 19 1120 28% 2.724 30%
24. Chronos 1.99 x64             2.558 18 18 1120 27% 2.724 33% (ponder not possible)
25. Daydreamer 1.75 JA x64       2.527 19 19 1120 24% 2.725 30%

Date range            = 2009.10.26 - 2010.08.18
Average White ELO     = 2.704,44
Average Black ELO     = 2.704,44
Maximum ELO distance  = 419
Average ELO distance  = 107.833
Number of White wins  = 16582 (36.3%)
Number of draws       = 17076 (37.4%)
Number of Black wins  = 11982 (26.3%)
White score           = 55.0%
Black score           = 45.0%
ECO A games           = 11760 (25.8%)
ECO B games           = 10012 (21.9%)
ECO C games           =  6116 (13.4%)
ECO D games           = 11099 (24.3%)
ECO E games           =  6653 (14.6%)

Games and more tables / statistics can be found on my webpage.

Frank's Chess Page (SWCR)
http://www.amateurschach.de

Best
Frank

[Frank Quisinsky]

Hi there,

now 3 new engines and 4 updates started in SWCR-64:

Updates:
Stockfish 1.8.0 JA x64
Crafty 23.3 JA x64
Critter 0.80 x64
Hannibal 1.0a x64

New:
BugChess2 1.7 x64
Tornado 3.6.7 x64
Herrman 2.5.36 x64

If you have interest to know more about the actual results ... this tournament is running in LIVE mode.

This tournament need 17 days (4.760 games to play):

Frank's Chess Page (SWCR)
http://www.amateurschach.de

Best
Frank

[Damir]

Why are you testing old 1.3.4 version of Protector ? There is already newer version of Protector released here :

http://www.mediafire.com/?8cqq5cm810c3b7z

http://good.net/dl/au/b25daf7030e851f4e ... a.zip/info

Damir

[Graham Banks]

Why are you testing old 1.3.4 version of Protector ? There is already newer version of Protector released here :

http://www.mediafire.com/?8cqq5cm810c3b7z

http://good.net/dl/au/b25daf7030e851f4e ... a.zip/info

Damir

I'm told that Protector 1.3.6 hasn't been officially released, but 1.3.5 has.

Cheers,
Graham.

[Frank Quisinsky]

Hi Damir,

I tested version 1.3.5. After this test it was clear that 1.3.4 is stronger. So the version 1.3.4 replaced version 1.3.5 in SWCR-32 and SWCR-64 (go back and some new games with 1.3.4 are to play).

Protector 1.3.6 are around four days later available. For sure, I will test version 1.3.6 32bit and 1.3.6 64bit too but for the moment is enough to do

Have a look on "ToDo selection" on my webpage.

Best
Frank

[Sedat Canbaz]

Hi Damir,

I tested version 1.3.5. After this test it was clear that 1.3.4 is stronger. So the version 1.3.4 replaced version 1.3.5 in SWCR-32 and SWCR-64 (go back and some new games with 1.3.4 are to play).

Protector 1.3.6 are around four days later available. For sure, I will test version 1.3.6 32bit and 1.3.6 64bit too but for the moment is enough to do

Have a look on "ToDo selection" on my webpage.

Best
Frank

Hello Frank,

True...in my testings too,Protector 1.3.5 performed slightly weaker than v1.3.4

Btw,currently i am testing latest version of Protector v1.3.6 (via netchess utility) against the top 10 programs,and so far Protector 1.3.6's results are 27.0/81

Best,
Sedat

[Frank Quisinsky]

Hello Sedat,

the results seems to be not very strong. Perhaps you have a rating for version 1.3.6 in the next days?

If I see a bad rating for version 1.3.6 I will not test the version. Version 1.3.4 JA is great, very interesting chess ... best version so far.

Thanks for your information!

Best
Frank

[Graham Banks]

True...in my testings too,Protector 1.3.5 performed slightly weaker than v1.3.4

Same here too.

[Sedat Canbaz]

Hello Sedat,

the results seems to be not very strong. Perhaps you have a rating for version 1.3.6 in the next days?

If I see a bad rating for version 1.3.6 I will not test the version. Version 1.3.4 JA is great, very interesting chess ... best version so far.

Thanks for your information!

Best
Frank

Hello Frank,

I have started testing Protector 1.3.6 JA x64 T4 (using netchess utility) with time control 5min+5sec and still not sure that is weaker or stronger ,but it seems its performance is equal in strength to 1.3.4

And i plan to publish the results in the next 1-2 weeks

Greetings,
Sedat