SWCR after 50.400 games ...

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Frank Quisinsky
Posts: 7042
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

SWCR after 50.400 games ...

Post by Frank Quisinsky »

Hi there,

today the still running SWCR-64 tournament ended.
4.760 new games played.

NEW:
1. Stockfish 1.8.0 JA x64
2. Critter 0.80 x64
3. Hannibal 1.0a x64
4. Crafty 23.3 JA x64
5. BugChess2 1.7 x64
6. Tornado 3.6.7 x64
7. Umko 1.0 x64 (kann leider nicht pondern)

Code: Select all

After 50.400 games, 28 different engines, 87 versions included
ELO are fixed to 2.800 for Shredder 12 32bit. All other engines are derived from that fixed number.
Calculated with:  Bayesian 0056

01. Rybka 4 x64                  2.940 20 20 1160 82% 2.687 28% +36 to 32bit
--. Rybka 3 x64                  2.904 23 22  840 78% 2.686 28% +45 to 32bit
02. Stockfish 1.8.0 JA x64       2.898 23 22  800 76% 2.701 31% +36 to 32bit
--. Stockfish 1.7.1 JA x64       2.895 19 18 1120 76% 2.705 34% +22 to 32bit
--. Rybka 4 w32                  2.893 20 20 1000 75% 2.708 33%
--. Stockfish 1.7.1 JA w32       2.873 18 18 1200 75% 2.689 31%
--. Stockfish 1.8.0a JA w32      2.865 21 21  800 74% 2.693 36%
--. Stockfish 1.8.0 JA w32       2.862 20 20  920 74% 2.695 37%
--. Rybka 3 w32                  2.859 16 16 1520 74% 2.688 31%
03. Critter 0.80 x64             2.841 22 21  800 69% 2.704 33% +28 to 32bit
04. Naum 4.2 x64                 2.830 16 16 1400 68% 2.699 36% + 5 to 32bit
--. Stockfish 1.6.3 JA w32       2.826 18 18 1080 71% 2.679 36%
--. Naum 4.2 w32                 2.825 16 15 1480 67% 2.704 36%
--. Critter 0.80 w32             2.813 21 20  800 66% 2.701 39%
--. Naum 4.1 w32                 2.810 20 19  920 68% 2.685 35%
--. Critter 0.70 x64             2.805 20 19  880 65% 2.700 38% +30 to 32bit
--. Stockfish 1.6.0 JA w32       2.801 19 19  960 68% 2.686 39%
05. Shredder 12 w32              2.800 10 10 3400 64% 2.701 37%
06. Komodo 1.2 JA x64            2.796 17 17 1160 65% 2.692 39% +39 to 32bit
--. Komodo 1.0 JA x64            2.790 20 20  840 64% 2.692 40% +75 to 32bit
--. Shredder 12 x64              2.787 18 18 1080 61% 2.706 35% -13 to 32bit
--. Naum 4.0 w32                 2.784 19 19  960 65% 2.681 38%
07. Deep Fritz 12 w32            2.778 14 14 1560 60% 2.707 43% 32bit only
--. Critter 0.70 w32             2.775 19 18  960 60% 2.709 40%
--. Komodo 1.2 JA w32            2.757 18 18 1000 56% 2.714 42%
--. Fritz 12 w32                 2.745 16 16 1160 59% 2.687 44% 32bit only
08. Spark 0.5 x64                2.736 17 17 1160 56% 2.694 39% +24 to 32bit
09. Hiarcs 13.1 w32              2.735 18 18 1000 53% 2.714 43% 32bit only
10. Thinker 5.4d Inert x64       2.731 15 15 1400 54% 2.702 40% +21 to 32bit
--. Stockfish 1.5.1 JA w32       2.730 19 19  840 59% 2.671 43%
11. Zappa Mexico II x64          2.723 16 15 1400 53% 2.702 39% +62 to 32bit
--. Spark 0.4 x64                2.717 20 20  840 53% 2.695 40% +32 to 32bit
--. Komodo 1.0 JA w32            2.715 16 16 1200 53% 2.694 40%
12. Protector 1.3.4 JA x64       2.715 16 16 1360 52% 2.703 37% +37 to 32bit
--. Spark 0.5 w32                2.712 18 18 1000 50% 2.715 41%
13. Fruit 09_07_05 x64           2.710 16 16 1400 51% 2.703 34%
--. Thinker 5.4d Inert w32       2.710 13 13 2040 51% 2.705 42%
--. Critter 0.60 x64             2.699 20 20  840 50% 2.696 38% +12 to 32bit
--. Doch 1.3.4 JA w32            2.689 19 19  840 51% 2.685 44%
--. Critter 0.60 w32             2.687 19 19  920 50% 2.687 39%
--. Spark 0.4 w32                2.685 19 19  880 49% 2.691 43%
14. Hannibal 1.0a x64            2.685 20 20  800 46% 2.711 37% +46 to 32bit
14. Sjeng WC-2008 x64            2.685 15 15 1400 48% 2.703 37% +21 to 32bit
16. Junior 11.2 x64              2.684 17 17 1160 49% 2.696 31% + 2 to 32bit
--. Protector 1.3.5 x64          2.683 20 20  840 47% 2.705 39% +15 to 32bit
--. Junior 11.2 w32              2.682 18 18 1000 45% 2.717 33%
--. Protector 1.3.4 JA w32       2.678 16 16 1360 46% 2.705 39%
--. Cyclone xTreme Wrath w32     2.675 17 17 1080 47% 2.697 41% 32bit only
17. Onno 1.2.70 x64              2.674 17 17 1160 47% 2.697 38% +41 to 32bit
--. Protector 1.3.2 w32          2.673 16 17 1160 47% 2.694 41%
--. Onno 1.1.1 x64               2.670 20 20  840 46% 2.698 40% +40 to 32bit
--. Protector 1.3.5 JA w32       2.668 19 19  880 43% 2.718 41%
--. Junior 2010 w32              2.668 16 16 1240 47% 2.690 36%
--. Hiarcs 12.1 w32              2.666 19 19  880 47% 2.688 41% 32bit only
--. Protector 1.3.1b w32         2.666 19 19  840 47% 2.689 42%
--. Doch 1.2 JA w32              2.665 19 19  840 48% 2.678 40%
--. Sjeng WC-2008 w32            2.664 13 13 2040 44% 2.706 37%
--. Hiarcs 12.1 Sharpen PV w32   2.664 16 16 1280 45% 2.698 40% 32bit only
--. Zappa Mexico II w32          2.661 13 13 2040 43% 2.706 42%
--. Spark 0.3a w32               2.655 17 17 1120 44% 2.697 41%
--. Doch 09.980 JA w32           2.651 19 19  840 46% 2.675 42%
--. Junior 11.1a x64             2.647 20 20  840 43% 2.699 32% + 3 to 32bit
--. Junior 11.1a w32             2.644 19 19  960 44% 2.691 36%
--. Spark 0.3 w32                2.642 19 19  880 43% 2.690 42%
--. Hannibal 1.0a w32            2.639 20 20  840 39% 2.713 36%
--. Onno 1.2.70 w32              2.633 18 18 1000 38% 2.719 40%
18. Loop 2007 x64                2.630 16 16 1400 40% 2.705 37% +19 to 32bit
--. Onno 1.1.1 w32               2.630 15 15 1520 40% 2.694 41%
--. Fruit 05/11/03 w32           2.616 13 13 2040 37% 2.707 40% 32bit only
--. Loop 13.6 w32                2.614 15 15 1520 38% 2.695 39%
--. Critter 0.52b w32            2.613 18 18 1040 38% 2.698 37%
--. Loop 2007 w32                2.611 19 19 1000 34% 2.719 35%
--. Twisted Logic 20100131x x64  2.610 18 18 1120 35% 2.715 32% +36 to 32bit
--. Glaurung 2.2 JA w32          2.609 17 18 1080 37% 2.699 36%
19. Ktulu 9.03 w32               2.607 15 15 1560 36% 2.711 30% 32bit only
19. Umko 1.0 x64                 2.607 21 21  800 35% 2.715 36% (ponder not possible)
21. SmarThink 1.20 x64           2.599 16 16 1400 35% 2.706 33% + 4 to 32bit
--. SmarThink 1.20 w32           2.595 13 13 2040 34% 2.707 37%
22. Crafty 23.3 JA x64           2.588 21 21  800 32% 2.716 33%
--. Twisted Logic 20100131x w32  2.574 15 15 1640 31% 2.710 30%
23. Spike 1.2 Turin w32          2.572 15 16 1520 30% 2.711 34% 32bit only
24. BugChess2 1.7 x64            2.562 21 22  800 29% 2.718 33%
25. Scorpio 2.6 JA x64           2.554 18 19 1120 28% 2.717 32%
--. Crafty 23.2 JA x64           2.554 18 19 1120 28% 2.717 30%
26. Chronos 1.99 x64             2.551 18 19 1120 27% 2.717 33% (ponder not possible)
27. Daydreamer 1.75 JA x64       2.520 19 19 1120 24% 2.719 30%
28. Tornado 3.6.7 x64            2.478 24 24  800 19% 2.722 24%

Date range            = 2009.10.26 - 2010.09.06
Average White ELO     = 2.701,16
Average Black ELO     = 2.701,16
Maximum ELO distance  = 462
Average ELO distance  = 112.474
Number of White wins  = 18340 (36.4%)
Number of draws       = 18624 (37.0%)
Number of Black wins  = 13436 (26.6%)
White score           = 54.9%
Black score           = 45.1%
ECO A games           = 13739 (27.3%)
ECO B games           = 10791 (21.4%)
ECO C games           =  6791 (13.5%)
ECO D games           = 12102 (24.0%)
ECO E games           =  6976 (13.8%)
The SWCR-64 rating list with all games and the actual tournament results from the new 7 engines can be found on my webpages. Games can be donwload too.

I started around 18:00 German time the next SWCR-64 tournament.

NEW:
01. Equinox 0.83-2 x64
02. Cipollino 3.25 x64
03. Crafty 23.3 JA x64 NP = without ponder, little test!
04. Loop M1-T x64
05. Fire 1.31 x64 (with 4-pieces Robbo and Totalbases)
06. Houdini 1.03a x64

You can follow the results with the LIVE table. This LIVE table will be updated each 15 minutes. This tournament with 4.960 games will be still running around 18 days. From time to time I will add an actual ELO calculation on my start page. First ELO calcualtion will be available this week friday.

Frank's Chess Page (SWCR)
http://www.amateurschach.de

Have fun with my little SWCR ...

Best
Frank
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SWCR after 50.400 games ...

Post by Sedat Canbaz »

Hello Frank,

Great work... its interesting to see in your list about the strength of many chess programs


Btw,did you test Crafty 23.3 with Ponder OFF ?

Code: Select all

22. Crafty 23.3 JA x64           2.588 21 21  800 32% 2.716 33%  
Best,
Sedat
Frank Quisinsky
Posts: 7042
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: SWCR after 50.400 games ...

Post by Frank Quisinsky »

Hi Sedat,

ranking 22. is Crafty 23.3 JA x64 with ponder = on.
At the moment I test Crafty 23.3 JA x64 NP (for no ponder) with ponder = off. Have a look on the LIVE table on my start page.

1x Crafty 23.3 JA x64
1x Crafty 23.3 JA x64 NP

At the moment Crafty 23.3 JA x64 NP have 35,87% after 46/920 games.

Best
Frank