The Champions 2012 8CPU

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 44629
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Round 49

Post by Graham Banks »

Laskos wrote:
Graham Banks wrote:
chessmann wrote:Also Critter results are poor, compared to both CCRL and CEGT lists it seems that it doesn't utilize many cores too well or maybe it's just bad luck due to insufficient amounts of games. Whatever the reason is, Critter should be strong at least like Stockfish or Rybka. What is your opinion guys ?
Probably a combination of both things that you mentioned, but more so the fact that it's a one off tournament with a limited number of games.
Not so few games, you should be proud of your 8-core tournament.
Thanks Kai. :)
gbanksnz at gmail.com
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Round 49

Post by Laskos »

Graham Banks wrote:
Laskos wrote:
Graham Banks wrote:
chessmann wrote:Also Critter results are poor, compared to both CCRL and CEGT lists it seems that it doesn't utilize many cores too well or maybe it's just bad luck due to insufficient amounts of games. Whatever the reason is, Critter should be strong at least like Stockfish or Rybka. What is your opinion guys ?
Probably a combination of both things that you mentioned, but more so the fact that it's a one off tournament with a limited number of games.
Not so few games, you should be proud of your 8-core tournament.
Thanks Kai. :)
Can you make this tournament as a preliminary tour for selecting the first four, then play a round-robin (20 rounds or so, for a total of 20*6=120 games), then the final with the first two (60 games?) at longer TC? Would be fun.
User avatar
Graham Banks
Posts: 44629
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Round 49

Post by Graham Banks »

Laskos wrote:
Graham Banks wrote:
Laskos wrote:
Graham Banks wrote:
chessmann wrote:Also Critter results are poor, compared to both CCRL and CEGT lists it seems that it doesn't utilize many cores too well or maybe it's just bad luck due to insufficient amounts of games. Whatever the reason is, Critter should be strong at least like Stockfish or Rybka. What is your opinion guys ?
Probably a combination of both things that you mentioned, but more so the fact that it's a one off tournament with a limited number of games.
Not so few games, you should be proud of your 8-core tournament.
Thanks Kai. :)
Can you make this tournament as a preliminary tour for selecting the first four, then play a round-robin (20 rounds or so, for a total of 20*6=120 games), then the final with the first two (60 games?) at longer TC? Would be fun.
Perhaps something I could consider for next time I run an 8 core tournament.

Once this tournament has finished, I have a couple of 4CPU tournaments lined up.
http://kirill-kryukov.com/chess/discuss ... f=7&t=6865
http://kirill-kryukov.com/chess/discuss ... f=7&t=6866
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 44629
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Round 51

Post by Graham Banks »

THE CHAMPIONS 2012 8CPU

Xeon X5430x2 Octal
ChessGUI
2048mb hash per engine where possible
3-4-5 piece tablebases
Ponder off
WorldClass2012-3.cgb book (limited to 8 move depth)
40 moves in 29 minutes repeating (equivalent to CCRL 40/40)
All engines 64-bit 8CPU where available
4 cycles 52 rounds


Round 51

Hannibal 20121202 64-bit 8CPU v Deep Junior 13.3 64-bit 8CPU (1-0)
Chiron 1.5 64-bit 8CPU v Deep Shredder 12 64-bit 8CPU (1-0)
Hiarcs 14 8CPU v Houdini 3 64-bit 8CPU (draw)
RobboLito 0.21Q 64-bit 8CPU v Critter 1.6a 64-bit 8CPU (0-1)
Akkad 0.52b 64-bit 8CPU v Stockfish 2.3.1 64-bit 8CPU (draw)
Bouquet 1.6 64-bit 8CPU v Rybka 4.1 64-bit 8CPU (draw)
Sting SF 2 64-bit 8CPU v Equinox 1.65 64-bit 8CPU (draw)


Standings after Round 51

38.5 - Houdini 3 64-bit 8CPU
31.5 - Stockfish 2.3.1 64-bit 8CPU
31.0 - Sting SF 2 64-bit 8CPU
29.0 - Equinox 1.65 64-bit 8CPU
28.5 - Rybka 4.1 64-bit 8CPU
26.5 - Critter 1.6a 64-bit 8CPU
26.0 - Akkad 0.52b 64-bit 8CPU
24.0 - Hiarcs 14 8CPU
23.0 - RobboLito 0.21Q 64-bit 8CPU
23.0 - Deep Junior 13.3 64-bit 8CPU
23.0 - Bouquet 1.6 64-bit 8CPU
19.5 - Chiron 1.5 64-bit 8CPU
18.5 - Hannibal 20121202 64-bit 8CPU
15.0 - Deep Shredder 12 64-bit 8CPU


Round 51 PGN - http://kirill-kryukov.com/chess/discuss ... p?id=28368

If you install TLCV (Tom's Live Chess Viewer) on your computer, you can watch the games live move by move. You'll also be able to chat to others following the tournament in the chatroom there.
http://home.pacific.net.au/~tommyinoz/client.zip
Host - GrahamCCRL.dyndns.org Port - 16083

There is also a live broadcast in Playchess.
gbanksnz at gmail.com
lech
Posts: 1169
Joined: Sun Feb 14, 2010 10:02 pm

Re: Round 51

Post by lech »

Graham, I think you should remove Sting from your next tournaments.
For many it is not any difference that some engine is able to solve in play mode this, very (VERY!) easy for each chessplayer, position without any tricks.
[d]8/5pKN/5Pp1/5kP1/8/Bb6/8/7q b - -
1...Qxh7
I afraid that your work might lose by Sting. :(
I always wanted to prove that it is possiible to solve this position and to play on a very high level.
Thanks to you I realized it. :D
I don't believe that the case of Sting can change anything, though.
Good luck Graham! Show must go on!
Maybe, I can't be friendly, but let me be useful.
User avatar
Graham Banks
Posts: 44629
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Round 51

Post by Graham Banks »

lech wrote:Graham, I think you should remove Sting from your next tournaments.
For many it is not any difference that some engine is able to solve in play mode this, very (VERY!) easy for each chessplayer, position without any tricks.
[d]8/5pKN/5Pp1/5kP1/8/Bb6/8/7q b - -
1...Qxh7
I afraid that your work might lose by Sting. :(
I always wanted to prove that it is possiible to solve this position and to play on a very high level.
Thanks to you I realized it. :D
I don't believe that the case of Sting can change anything, though.
Good luck Graham! Show must go on!
For me, Sting has been the highlight of the tournament.
It plays very adventurous chess and seems to scale very well. It has certainly performed strongly and it's been no fluke from what I can see.
You should feel pleased with your efforts. :)

Looking forward to Sting 3! :P
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 44629
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Round 52

Post by Graham Banks »

THE CHAMPIONS 2012 8CPU

Xeon X5430x2 Octal
ChessGUI
2048mb hash per engine where possible
3-4-5 piece tablebases
Ponder off
WorldClass2012-3.cgb book (limited to 8 move depth)
40 moves in 29 minutes repeating (equivalent to CCRL 40/40)
All engines 64-bit 8CPU where available
4 cycles 52 rounds


Round 52

Hannibal 20121202 64-bit 8CPU v Deep Shredder 12 64-bit 8CPU (0-1)
Deep Junior 13.3 64-bit 8CPU v Houdini 3 64-bit 8CPU (draw)
Chiron 1.5 64-bit 8CPU v Critter 1.6a 64-bit 8CPU (draw)
Hiarcs 14 8CPU v Stockfish 2.3.1 64-bit 8CPU (draw)
RobboLito 0.21Q 64-bit 8CPU v Rybka 4.1 64-bit 8CPU (draw)
Akkad 0.52b 64-bit 8CPU v Equinox 1.65 64-bit 8CPU (0-1)
Bouquet 1.6 64-bit 8CPU v Sting SF 2 64-bit 8CPU (draw)


Final Standings

39.0 - Houdini 3 64-bit 8CPU
32.0 - Stockfish 2.3.1 64-bit 8CPU
31.5 - Sting SF 2 64-bit 8CPU
30.0 - Equinox 1.65 64-bit 8CPU
29.0 - Rybka 4.1 64-bit 8CPU
27.0 - Critter 1.6a 64-bit 8CPU
26.0 - Akkad 0.52b 64-bit 8CPU
24.5 - Hiarcs 14 8CPU
23.5 - RobboLito 0.21Q 64-bit 8CPU
23.5 - Deep Junior 13.3 64-bit 8CPU
23.5 - Bouquet 1.6 64-bit 8CPU
20.0 - Chiron 1.5 64-bit 8CPU
18.5 - Hannibal 20121202 64-bit 8CPU
16.0 - Deep Shredder 12 64-bit 8CPU


Round 52 PGN - http://kirill-kryukov.com/chess/discuss ... p?id=28380

Complete tournament PGN (zipped) - http://kirill-kryukov.com/chess/discuss ... p?id=28379
gbanksnz at gmail.com
Vinvin
Posts: 5298
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: The Champions 2012 8CPU

Post by Vinvin »

This thread got 8008 views !! 8-)
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Round 52

Post by Adam Hair »

Final crosstable:

Image


Elo rating according to Ordo 0.6:

Code: Select all

   # ENGINE                           : RATING  ERROR   POINTS  PLAYED    (%)
   1 Houdini 3 64-bit 8CPU            :  186.4   97.6     39.0      52   75.0%
   2 Stockfish 2.3.1 64-bit 8CPU      :   80.6   91.2     32.0      52   61.5%
   3 Sting SF 2 64-bit 8CPU           :   73.6   89.5     31.5      52   60.6%
   4 Equinox 1.65 64-bit 8CPU         :   53.1   88.1     30.0      52   57.7%
   5 Rybka 4.1 64-bit 8CPU            :   39.5   90.1     29.0      52   55.8%
   6 Critter 1.6a 64-bit 8CPU         :   12.8   88.4     27.0      52   51.9%
   7 Akkad 0.52b 64-bit 8CPU          :   -0.5   87.7     26.0      52   50.0%
   8 Hiarcs 14 8CPU                   :  -20.5   85.2     24.5      52   47.1%
   9 Bouquet 1.6 64-bit 8CPU          :  -33.9   89.1     23.5      52   45.2%
  10 RobboLito 0.21Q 64-bit 8CPU      :  -33.9   89.8     23.5      52   45.2%
  11 Deep Junior 13.3 64-bit 8CPU     :  -33.9   86.9     23.5      52   45.2%
  12 Chiron 1.5 64-bit 8CPU           :  -81.5   89.2     20.0      52   38.5%
  13 Hannibal 20121202 64-bit 8CPU    : -102.6   93.1     18.5      52   35.6%
  14 Deep Shredder 12 64-bit 8CPU     : -139.2   89.5     16.0      52   30.8%
Vinvin
Posts: 5298
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Round 49

Post by Vinvin »

Graham Banks wrote:
Vinvin wrote:Hello Graham, do you have a pgn file with all the games you played (since 2 years or more) with 8 CPUs, please ?
Here are the links to the PGNs of the previous 8 core tournaments played:
http://kirill-kryukov.com/chess/discuss ... p?id=28135
http://kirill-kryukov.com/chess/discuss ... p?id=27656
http://kirill-kryukov.com/chess/discuss ... p?id=27016
Thanks ! Here's the bayes rating list with this 3 tournaments + the current one (with the 52 games) :
All engines with 8 CPUs
"Houdini 3 64-bit 8CPU" rating set to 3380

Code: Select all

Rank Name                               Elo       +       -    Games  Score     Oppo. 
   1 Houdini 3 64-bit 8CPU           3380.00    75.61   70.64     61  76.23%  3211.80 
   2 Houdini 2.0c 64-bit 8CPU        3355.42   134.20  120.57     17  76.47%  3207.20 
   3 Stockfish 2.2.2 JA              3342.87   193.58  169.21      8  75.00%  3211.83 
   4 IvanHoe 9.46h 64-bit 8CPU       3287.15   166.38  158.08      9  61.11%  3229.53 
   5 Stockfish 2.3.1 64-bit 8CPU     3282.48    63.01   61.47     70  62.86%  3206.63 
   6 Sting SF 2 64-bit 8CPU          3274.22    65.60   64.56     61  61.48%  3209.49 
   7 Equinox 1.65 64-bit 8CPU        3271.15    67.24   65.79     61  59.84%  3212.34 
   8 DeepSaros 3.0 64-bit 8CPU       3268.12   157.01  150.45      9  61.11%  3217.56 
   9 IvanHoe 9.46b x64               3255.64   183.53  172.92      8  62.50%  3176.54 
  10 Rybka 4.1 64-bit 8CPU           3240.94    57.41   57.26     78  56.41%  3203.04 
  11 Vitruvius 1.11C 64-bit 8CPU     3238.83   118.85  115.82     17  58.82%  3196.15 
  12 Critter 1.6a 64-bit 8CPU        3233.03    57.67   57.45     78  55.13%  3203.31 
  13 Bouquet 1.5 64-bit 8CPU         3226.34   174.54  171.71      9  55.56%  3165.64 
  14 Akkad 0.52b 64-bit 8CPU         3212.31    65.20   64.94     61  50.00%  3208.56 
  15 Sting SF PV 120629 64-bit 8CPU  3203.19   120.88  119.58     17  55.88%  3158.62 
  16 Chiron 1.1a 64-bit 8CPU         3201.84   132.10  126.95     17  58.82%  3139.28 
  17 Hiarcs 14 8CPU                  3199.66    62.19   62.19     70  50.00%  3193.76 
  18 Bouquet 1.6 64-bit 8CPU         3198.41    65.60   65.93     61  46.72%  3218.46 
  19 Protector 1.4.0 64-bit 8CPU     3189.46   110.53  110.46     26  51.92%  3152.52 
  20 RobboLito 0.21Q 64-bit 8CPU     3186.99    65.59   65.92     61  46.72%  3207.22 
  21 Deep Junior 13.3 64-bit 8CPU    3175.40    61.79   62.03     78  48.08%  3176.11 
  22 Chiron 1.5 64-bit 8CPU          3174.11    67.17   68.45     61  41.80%  3219.95 
  23 Bouquet _1.3 x64                3170.25   173.39  168.60      8  56.25%  3124.97 
  24 cyclone xTreme Rage             3164.11   169.28  164.70      8  56.25%  3132.07 
  25 Deep Sjeng WC2008 64-bit 8CPU   3161.84   121.56  120.34     17  52.94%  3138.35 
  26 Naum 4.2 64-bit 8CPU            3160.76    98.66   97.72     26  53.85%  3133.95 
  27 Spike 1.4                       3157.68   187.84  184.47      8  56.25%  3099.09 
  28 Hannibal 20121202 64-bit 8CPU   3151.89    69.65   71.68     61  38.52%  3222.50 
  29 IvanHoe 46e 64-bit 8CPU         3134.84   176.18  172.01      9  55.56%  3098.78 
  30 Spark 1.0 64-bit 8CPU           3132.61   103.61  104.49     26  48.08%  3147.49 
  31 Deep Shredder 12 64-bit 8CPU    3130.62    60.65   62.58     78  37.82%  3203.16 
  32 Onno 1.2.70 64-bit 8CPU         3091.37   104.25  105.45     26  48.08%  3089.88 
  33 Zappa Mexico II 64-bit 8CPU     3080.67   126.92  127.67     17  50.00%  3087.22 
  34 HIARCS 13.2 MP                  3079.12   177.72  181.02      8  50.00%  3068.50 
  35 MinkoChess 1.3 64-bit 8CPU      3061.03   104.06  108.51     26  38.46%  3124.62 
  36 Crafty 23.5 64-bit 8CPU         3049.08   129.09  128.97     18  50.00%  3051.60 
  37 DeepSaros ver.3.2               3018.38   189.58  189.60      8  50.00%  3018.58 
  38 Deep Fritz 13                   2997.02   174.14  179.51      8  43.75%  3019.78 
  39 Jonny 4.00 8CPU                 2961.00   108.23  113.50     26  38.46%  3017.89 
  40 BugChess2 1.9 64-bit 8CPU       2952.40   112.06  117.31     26  40.38%  3023.34 
  41 Tornado 4.88 64-bit 8CPU        2946.56   108.77  113.39     26  38.46%  3025.57 
  42 Bright 0.5c 8CPU                2937.72   128.67  133.49     17  41.18%  2988.25 
  43 Arasan 15.1 64-bit 8CPU         2885.93   189.51  223.35      9  27.78%  3051.44 
  44 Arminius 2012-08-14 8CPU        2869.85   128.59  140.07     18  30.56%  3000.94 
  45 Gaviota 0.85.1 64-bit 8CPU      2858.04   114.20  122.47     26  32.69%  2985.15 
  46 Arasan 14.0.1                   2845.01   199.30  208.78      8  43.75%  2904.67 
  47 Arasan 15.0 64-bit 8CPU         2832.41   181.79  216.76      9  22.22%  3039.34 
  48 Delphil 2.9e                    2763.37   188.65  205.27      8  31.25%  2913.68 
  49 Nebula 1.0 64-bit 8CPU          2748.32   190.93  247.58      9  16.67%  2990.52 
  50 Arminius 2012-06-28             2697.51   192.36  237.70      8  18.75%  2899.76 
  51 RedQueen 1.1.1                  2595.94   203.61  288.30      8   6.25%  2907.98