ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Komodo 5 64-bit for CCRL 40/4
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches Flat
View previous topic :: View next topic  
Author Message
Adam Hair



Joined: 06 May 2009
Posts: 1639
Location: Fuquay-Varina, North Carolina
PostPost subject: Komodo 5 64-bit for CCRL 40/4    Posted: Fri Jul 20, 2012 11:54 am Reply to topic Reply with quote
My only reason for posting this is to give additional data for Komodo 5. My testing is at a shorter time control and is missing a few opponents as compared to Ingo's testing. Also, this is being done on a non-SSE 4.2 cpu (E8400). It may or may not be missing a little Elo boost. And finally, this only includes 119 games at the moment.

CPU : Intel E8400
OS : Windows XP 64-bit
Time Control : 40 moves in 3 minutes, repeating (Conforms to CCRL 40/4 reference)
Openings : a pgn of ~18,000 games, truncated to 4 full moves. Positions are not repeated
CPUs : 1
Hash : 128 MB

The opponents (at the moment) are:
Houdini 2.0c, Rybka 4.1, Stockfish 2.2.2, Critter 1.4, Naum 4.2, Gull 1.0a,
Spike 1.4, Spark 1.0, and Hannibal 1.2.

All opponents are 64-bit engines except Spike.

The following ratings are approximately how they would appear on the CCRL 40/4 Single CPU Pure List. I am showing only the top 16 engines, but the ratings were computed using the entire database for that list. I am going to give the ratings based on how the CCRL calculates ratings now, how the CCRL may calculate the ratings in the future, and with a beta version of Ordo that can calculate and use White advantage.

Bayeselo with default values:

Code:
Rank Name                                 Elo    +    - games score oppo. draws
   1 Houdini 2.0c 64-bit                 3205   21   21   883   70%  3050   32%
   2 Komodo 5 64-bit                     3174   57   54   119   69%  3038   30%
   3 Strelka 5.1 64-bit                  3153   25   25   545   66%  3037   43%
   4 Critter 1.4 64-bit                  3144   19   19   976   67%  3019   40%
   5 Komodo 4 64-bit                     3132   17   17  1395   69%  2985   30%
   6 Stockfish 2.2.2 64-bit              3128   21   20   806   60%  3057   39%
   7 Rybka 4.1 64-bit                    3124   17   17  1337   67%  2999   35%
   8 Fritz 13                            2990   18   17  1284   63%  2886   30%
   9 Naum 4.2 64-bit                     2982   17   17  1155   51%  2975   36%
  10 Chiron 1.1a 64-bit                  2980   20   20   890   62%  2893   32%
  11 Deep Shredder 12 64-bit OA On 1CPU  2965   20   19   907   57%  2920   37%
  12 Hannibal 1.2 64-bit                 2948   22   22   687   51%  2940   36%
  13 Hiarcs 13.2                         2929   22   22   714   52%  2920   35%
  14 Gull 1.0a 64-bit                    2928   18   18  1323   65%  2813   27%
  15 Spark 1.0 64-bit                    2921   16   15  1500   52%  2911   34%
  16 Spike 1.4 Leiden                    2919   18   18  1178   52%  2910   33%


Bayeselo using the commands 'elo', 'prior 0.1', 'mm 1 1', and 'scale 1':

Code:
Rank Name                                 Elo    +    - games score oppo. draws
   1 Houdini 2.0c 64-bit                 3268   22   22   883   70%  3103   32%
   2 Komodo 5 64-bit                     3236   62   59   119   69%  3089   30%
   3 Strelka 5.1 64-bit                  3213   27   26   545   66%  3088   43%
   4 Critter 1.4 64-bit                  3203   21   20   976   67%  3069   40%
   5 Komodo 4 64-bit                     3190   18   18  1395   69%  3033   30%
   6 Stockfish 2.2.2 64-bit              3185   22   22   806   60%  3109   39%
   7 Rybka 4.1 64-bit                    3181   18   18  1337   67%  3048   35%
   8 Fritz 13                            3038   19   19  1284   63%  2927   30%
   9 Naum 4.2 64-bit                     3030   19   19  1155   51%  3023   36%
  10 Chiron 1.1a 64-bit                  3028   22   22   890   62%  2934   32%
  11 Deep Shredder 12 64-bit OA On 1CPU  3012   21   21   907   57%  2964   37%
  12 Hannibal 1.2 64-bit                 2993   24   24   687   51%  2985   36%
  13 Hiarcs 13.2                         2973   24   24   714   52%  2964   35%
  14 Gull 1.0a 64-bit                    2972   19   19  1323   65%  2850   27%
  15 Spark 1.0 64-bit                    2965   17   17  1500   52%  2954   34%
  16 Spike 1.4 Leiden                    2962   19   19  1178   52%  2953   33%


Ordo

Code:
                            ENGINE   RATING    POINTS  PLAYED     (%)
               Houdini 2.0c 64-bit   3271.3    622.5       883 70.50%
                   Komodo 5 64-bit   3242.7       82       119 68.90%
                Strelka 5.1 64-bit   3217.9      361       545 66.20%
                Critter 1.4 64-bit   3211.1      654       976 67.00%
                   Komodo 4 64-bit   3190.2    962.5      1395 69.00%
            Stockfish 2.2.2 64-bit   3189.6      482       806 59.80%
                  Rybka 4.1 64-bit   3186.8      894      1337 66.90%
                          Fritz 13   3032.5    812.5      1284 63.30%
                   Naum 4.2 64-bit   3025.4    588.5      1155 51.00%
                Chiron 1.1a 64-bit   3022.6      552       890 62.00%
Deep Shredder 12 64-bit OA On 1CPU   3006.9    512.5       907 56.50%
               Hannibal 1.2 64-bit   2988.5    353.5       687 51.50%
                       Hiarcs 13.2   2969.8      370       714 51.80%
                  Gull 1.0a 64-bit   2967.8      854      1323 64.60%
                  Spark 1.0 64-bit   2959.9    779.5      1500 52.00%
                  Spike 1.4 Leiden   2955.3      607      1178 51.50%


I will update this in 6 to 8 hours.
_________________
Adam's Computer Chess Pages
Back to top
View user's profile Send private message Visit poster's website
Display posts from previous:   
Subject Author Date/Time
Komodo 5 64-bit for CCRL 40/4 Adam Hair Fri Jul 20, 2012 11:54 am
      Re: Komodo 5 64-bit for CCRL 40/4 Adam Hair Fri Jul 20, 2012 6:41 pm
            Re: Komodo 5 64-bit for CCRL 40/4 Larry Kaufman Fri Jul 20, 2012 8:43 pm
                  Re: Komodo 5 64-bit for CCRL 40/4 Maurizio Maglio Sat Jul 21, 2012 12:21 am
                  Re: Komodo 5 64-bit for CCRL 40/4 Adam Hair Sat Jul 21, 2012 4:37 am
            Re: Komodo 5 64-bit for CCRL 40/4 Adam Hair Sat Jul 21, 2012 1:01 pm
                  Re: Komodo 5 64-bit for CCRL 40/4 Adam Hair Sat Jul 21, 2012 8:46 pm
                        Re: Komodo 5 64-bit for CCRL 40/4 Adam Hair Sun Jul 22, 2012 12:00 pm
      Re: Komodo 5 64-bit for CCRL 40/4 George Speight Sat Jul 21, 2012 1:51 am
            Re: Question For You Concerning T.Control, Adam! George Speight Sat Jul 21, 2012 2:05 am
                  Re: Question For You Concerning T.Control, Adam! Adam Hair Sat Jul 21, 2012 3:38 am
                        Re: Question For You Concerning T.Control, Adam! George Speight Sat Jul 21, 2012 4:39 am
            Re: Komodo 5 64-bit for CCRL 40/4 Adam Hair Sat Jul 21, 2012 3:39 am
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads