SWCR LIVE: Komodo 3.0 w32 & Komodo 3.0 x64

[Frank Quisinsky]

Hi Don,

thanks for your information.
Hm, I should switched the hardware?
On the other hand, made no sense to use different hardware for the same ratinglist Better is to used the Q9550 hardware for the next time too.

OK, but here are the final results for Komodo 3.0 x64 and Komodo 3.0 w32. If you like I can send the 40-minutes games with ponder and Shredder GUI comments by mail.

Best
Frank

Code: Select all

  SWCR         : 134.880 games           #Time control: 40/10 "repeatedly"
  Last update  : September 26th, 2011    #Game average: 40 minutes, move average = 85
                                         #Resign      : OFF
  LIVE 1       : ./.                     #Ponder      : ON
  Cores        : ./.                     #Learning    : OFF
  To play      : ./.                     #Endgames    : 4-pieces, 32Mb cache
                                         #Opening book: Own PGN random 5.04 book
  LIVE 2       : ./.                     #GUI         : Shredder Classic 4 / Arena
  Cores        : ./.                     #OS          : Windows XP Pro. x64 Edition
  To play      : ./.                     #Processors  : Intel® Core™2Q, 4xQ9550 2,83GHz
                                                      : Intel® Core™i7, 1x720 1,60GHz
                                         #Cores       : 1 core for each engine
  Database     : 131.493 games           #Hash-Tables : 256Mb  
  Updated      : September 13th, 2011    #Games       : 1.000 per engine minimal



          NAME / version of engine       ELO    +    -   GAM    SC   OP     DR
  -----------------------------------------------------------------------------
   1    1 Houdini 1.5 x64                2999   15   14  2080   78%  2779   29% 
   -    2 Houdini 1.5 w32                2983   20   19  1120   79%  2755   29% 
   2    3 Rybka 4 x64 Exp. 42            2968   20   19  1240   80%  2718   25% 
   -    4 Rybka 4.1 x64 Exp. 79TD v.1    2962   19   19  1240   78%  2742   26% 
   3    5 Komodo 3.0 x64                 2961   19   19  1200   77%  2751   32% Update, + 34
   -    6 Rybka 4 x64 Exp. 61            2960   21   21  1000   78%  2742   27% 
   -    7 Rybka 4.1 x64                  2957   16   16  1560   72%  2786   37% 
   4    8 Critter 1.2 x64                2951   17   17  1400   76%  2750   33% 
   5    9 Stockfish 2.1.1 JA x64 PHQ     2945   17   17  1360   75%  2756   32% 
   -   10 Houdini 1.03a x64              2944   21   21  1000   80%  2710   30% 
   -   11 Rybka 4 x64                    2941   18   17  1480   80%  2697   28% 
   6   12 IvanHoe B47cB x64              2940   16   16  1520   71%  2783   39% 
   7   13 Fire 2.2 xTreme x64            2939   17   17  1360   75%  2745   34% 
   -   14 Fire 1.5 xTreme x64            2936   17   16  1400   73%  2762   36% 
   -   15 Stockfish 2.1.1 JA x64         2934   16   15  1600   72%  2763   36% 
   -   16 Critter 1.2 w32                2933   19   19  1080   75%  2752   36% 
   -   17 IvanHoe B49jA x64              2932   17   17  1360   72%  2767   36% 
   -   18 Komodo 2.03 JA x64             2927   16   16  1600   71%  2763   32% 
   -   19 IvanHoe B52aC x64              2924   18   18  1160   73%  2756   36% 
   -   20 Stockfish 1.8.0 JA x64         2906   19   18  1160   75%  2712   32% 
   -   21 Stockfish 2.0.1 JA x64         2906   18   18  1120   69%  2767   38% 
   -   22 Stockfish 1.9.1 JA x64         2905   18   17  1280   73%  2728   33% 
   -   23 Fire 1.31 x64                  2903   19   19  1040   73%  2733   37% 
   -   24 Rybka 3 x64                    2902   21   21  1000   79%  2675   28% 
   -   25 Stockfish 2.1.1 JA w32         2902   18   18  1120   70%  2758   39% 
   -   26 Fire 2.2 xTreme w32            2901   18   18  1120   70%  2758   40% 
   -   27 Rybka 4.1 w32                  2900   18   18  1120   69%  2758   37% 
   -   28 Critter 1.01 x64               2896   16   16  1360   66%  2780   39% 
   -   29 Stockfish 1.7.1 JA x64         2894   19   19  1080   76%  2703   33% 
   -   30 Stockfish 1.9.1 JA w32         2893   20   20  1000   77%  2693   31% 
   -   31 IvanHoe B47cB w32              2893   18   18  1120   69%  2758   39% 
   -   32 Rybka 4 w32                    2891   18   18  1200   76%  2695   32% 
   -   33 Critter 1.01 w32               2889   18   18  1200   72%  2719   33% 
   -   34 Komodo 3.0 w32                 2887   18   18  1200   72%  2724   32% Update, + 21
   -   35 Stockfish 1.7.1 JA w32         2872   18   18  1200   75%  2688   31% 
   -   36 Stockfish 2.0.1 JA w32         2871   20   19  1000   76%  2678   34% 
   -   37 Critter 0.90 x64               2871   18   17  1200   68%  2741   37% 
   -   38 Critter 0.90 w32               2868   20   20  1000   76%  2679   32% 
   -   39 Komodo 2.03 JA w32             2866   18   18  1080   65%  2754   37% 
   -   40 Stockfish 1.8.0 JA w32         2864   19   19  1000   73%  2702   38% 
   -   41 Rybka 3 w32                    2858   16   16  1520   74%  2687   31% 
   -   42 Komodo 1.3 JA x64              2840   16   16  1280   59%  2772   39% 
   8   43 Naum 4.2 x64                   2833   10   10  3560   62%  2740   36% 
   -   44 Critter 0.80 x64               2830   15   15  1640   67%  2698   32% 
   -   45 Stockfish 1.6.3 JA w32         2824   18   18  1080   71%  2678   36% 
   -   46 Naum 4.2 w32                   2824   11   11  3040   65%  2716   37% 
   -   47 Critter 0.80 w32               2814   18   18  1040   67%  2694   37% 
   -   48 Critter 0.70 x64               2812   19   19  1000   66%  2693   37% 
   -   49 Naum 4.1 w32                   2808   19   19  1000   67%  2692   35% 
   -   50 Komodo 1.2 JA x64              2804   13   13  2240   62%  2711   39% 
   -   51 Stockfish 1.6.0 JA w32         2801   18   18  1000   67%  2689   39% 
   9   52 Shredder 12 w32                2800    7    8  7120   60%  2727   36% 
  10   53 GullChess 1.2 x64              2791   15   15  1560   51%  2782   40% 
  11   54 Sjeng c't 2010 w32             2790    9    9  5000   56%  2742   38% 
   -   55 GullChess 1.1 x64              2786   17   17  1160   56%  2742   37% 
   -   56 Naum 4.0 w32                   2784   18   18  1000   65%  2684   38% 
  12   57 Spike 1.4 Leiden w32           2782    9    9  4840   56%  2735   37% 
   -   58 Komodo 1.0 JA x64              2782   19   18  1000   65%  2680   40% 
  13   59 Deep Fritz 12 w32              2779   14   14  1760   62%  2698   41% 
   -   60 Critter 0.70 w32               2775   18   18  1000   60%  2708   40% 
   -   61 GullChess 1.0a x64             2774   16   16  1440   59%  2708   37% 
   -   62 Komodo 1.3 JA w32              2774   19   19  1000   63%  2682   36% 
  14   63 Protector 1.4.0 JA x64         2770   15   15  1560   48%  2783   38% 
   -   64 GullChess 1.2 w32              2762   17   17  1120   50%  2763   38% 
  15   65 Junior 12.5.0.3 x64            2761   15   14  1680   49%  2766   36% 
  16   66 Spark 1.0 x64                  2759   13   12  2200   48%  2772   40% 
   -   67 Komodo 1.2 JA w32              2758   17   17  1200   58%  2700   41% 
  17   68 Hiarcs 13.2 w32                2758   10   11  3320   51%  2751   39% 
   -   69 Junior 12.5.0.3 w32            2751   18   18  1120   48%  2763   35% 
  18   70 Hannibal 1.1 x64               2747   16   16  1320   49%  2753   39% 
   -   71 GullChess 1.0a w32             2747   18   18  1000   57%  2698   40% 
   -   72 GullChess 1.1 w32              2744   18   18  1000   59%  2684   40% 
   -   73 Fritz 12 w32                   2744   16   16  1160   59%  2686   44% 
   -   74 Spark 0.5 x64                  2739   13   13  2080   55%  2702   36% 
   -   75 Hiarcs 13.1 w32                2737   11   11  2880   53%  2718   38% 
  19   76 Thinker 5.4d Inert x64         2732   10   10  3560   48%  2741   37% 
   -   77 Stockfish 1.5.1 JA w32         2727   18   18  1000   59%  2671   43% 
  20   78 Zappa Mexico II x64            2725   10   10  3560   48%  2741   39% 
   -   79 Spark 1.0 w32                  2717   14   14  1760   49%  2724   35% 
   -   80 Junior 12.0 x64                2716   14   14  1840   45%  2750   32% 
   -   81 Spark 0.4 x64                  2716   18   18  1000   55%  2683   40% 
   -   82 Komodo 1.0 JA w32              2714   16   16  1200   53%  2692   40% 
   -   83 Protector 1.3.4 JA x64         2712   14   14  1680   51%  2708   37% 
   -   84 Protector 1.4.0 JA w32         2711   14   14  1760   48%  2724   37% 
  21   85 Fruit 09_07_05 x64             2710   10   10  3560   46%  2742   33% 
   -   86 Thinker 5.4d Inert w32         2708   10   10  3560   49%  2715   41% 
   -   87 Spark 0.5 w32                  2707   17   16  1200   51%  2702   41% 
   -   88 Protector 1.3.6-370 JA x64     2704   17   17  1280   46%  2734   33% 
   -   89 Critter 0.60 x64               2703   18   18  1000   53%  2683   38% 
   -   90 Hannibal 1.1 w32               2701   18   18  1080   41%  2760   40% 
   -   91 Junior 12.0 w32                2697   18   19  1000   51%  2685   35% 
  22   92 Booot 5.1.0 w32                2697   16   16  1280   44%  2737   36% 
   -   93 Protector 1.3.5 x64            2691   18   18  1000   50%  2692   41% 
  23   94 Equinox 0.97e x64              2690   15   15  1560   40%  2763   34% 
   -   95 Sjeng WC-2008 x64              2688   14   14  1800   48%  2705   36% 
   -   96 Doch 1.3.4 JA w32              2686   18   18  1000   50%  2683   42% 
   -   97 Junior 11.2 w32                2685   17   17  1200   48%  2702   33% 
   -   98 Critter 0.60 w32               2684   18   18  1000   49%  2694   39% 
   -   99 Junior 11.2 x64                2683   16   16  1480   47%  2704   30% 
   -  100 Hannibal 1.0a x64              2682   12   12  2840   40%  2753   34% 
   -  101 Spark 0.4 w32                  2679   18   18  1000   48%  2693   42% 
   -  102 Protector 1.3.4 JA w32         2678   14   14  1600   47%  2699   39% 
  24  103 Onno 1.2.70 x64                2676   11   11  3320   41%  2742   35% 
   -  104 Onno 1.1.1 x64                 2673   18   18  1000   48%  2685   40% 
   -  105 Protector 1.3.5 JA w32         2672   18   18  1000   45%  2705   43% 
   -  106 Protector 1.3.2 w32            2672   16   17  1160   47%  2693   41% 
  25  107 Umko 1.2 x64                   2672   17   17  1280   38%  2759   36% 
  26  108 Cyclone xTreme Wrath w32       2671   13   13  2080   41%  2732   38% 
   -  109 Doch 1.2 JA w32                2669   18   18  1000   49%  2677   38% 
   -  110 Equinox 0.95 x64               2667   17   17  1240   35%  2781   31% 
   -  111 Junior 2010 w32                2667   16   16  1240   47%  2689   36% 
   -  112 Protector 1.3.1b w32           2666   18   18  1000   47%  2686   42% 
   -  113 Hiarcs 12.1 w32                2666   18   18  1000   46%  2691   40% 
   -  114 Sjeng WC-2008 w32              2664   12   12  2240   45%  2699   37% 
   -  115 Hiarcs 12.1 w32 Sharpen PV     2662   16   16  1280   45%  2697   39% 
   -  116 Equinox 0.95 w32               2662   18   18  1000   46%  2687   36% 
   -  117 Zappa Mexico II w32            2659   10   10  3560   42%  2716   39% 
   -  118 Fruit 09_07_05 w32             2658   19   19  1040   37%  2757   32% 
   -  119 Equinox 0.97e w32              2654   18   18  1120   35%  2766   32% 
   -  120 Doch 09.980 JA w32             2654   18   18  1000   47%  2674   41% 
   -  121 Spark 0.3a w32                 2653   17   17  1120   44%  2696   41% 
   -  122 Junior 11.1a x64               2650   19   19  1000   45%  2686   33% 
   -  123 Spark 0.3 w32                  2645   18   18  1000   43%  2691   42% 
   -  124 Junior 11.1a w32               2641   18   18  1000   43%  2693   36% 
   -  125 Hannibal 1.0a w32              2638   14   14  1760   40%  2705   35% 
  27  126 Bright 0.5c w32                2633   14   14  1960   39%  2716   34% 
   -  127 Umko 1.1 x64                   2630   13   13  2240   31%  2773   32% 
   -  128 Onno 1.1.1 w32                 2629   15   15  1520   40%  2693   41% 
  28  129 Loop M1-T x64                  2625   16   17  1400   32%  2765   34% 
   -  130 Onno 1.2.70 w32                2625   12   12  2560   36%  2725   37% 
   -  131 Loop 2007 x64                  2621   12   12  2400   37%  2721   34% 
   -  132 Loop 2007 w32                  2616   14   14  1920   37%  2709   36% 
  29  133 Jonny 4.00 w32                 2616   11   11  3520   34%  2737   29% 
   -  134 Umko 1.2 w32                   2615   18   18  1120   29%  2768   33% 
  30  135 Crafty 23.4 JA x64             2614   13   13  2360   30%  2766   30% 
   -  136 Fruit 05/11/03 w32             2614   11   11  2880   38%  2699   40% 
   -  137 Loop 13.6 w32                  2613   15   15  1520   38%  2694   39% 
   -  138 Equinox 0.87t x64              2612   17   17  1280   33%  2737   31% 
   -  139 Critter 0.52b w32              2611   18   18  1040   38%  2696   37% 
   -  140 Umko 1.0 x64, no ponder        2610   17   18  1160   34%  2722   38% 
   -  141 Glaurung 2.2 JA w32            2608   18   18  1080   37%  2698   36% 
  31  142 Scorpio 2.7 JA x64             2608   16   16  1560   27%  2787   27% 
  32  143 Ktulu 9.03 w32                 2607   14   15  1760   37%  2701   31% 
   -  144 Twisted Logic 20100131x x64    2607   18   18  1120   35%  2713   31% 
  33  145 SmarThink 1.20 x64             2598   12   12  3040   32%  2737   31% 
   -  146 Equinox 0.83 x64               2598   18   18  1120   32%  2731   32% 
  34  147 BugChess2 1.9 x64              2597   16   16  1640   34%  2720   28% 
   -  148 Crafty 23.3 JA x64             2594   18   18  1160   33%  2722   34% 
   -  149 SmarThink 1.20 w32             2592   11   11  2960   34%  2704   35% 
   -  150 Umko 1.1 w32                   2588   19   19  1000   36%  2690   34% 
  35  151 Tornado 4.40 x64               2588   15   15  1960   25%  2781   28% 
   -  152 Crafty 23.4 JA w32             2581   18   18  1120   33%  2702   33% 
   -  153 Scorpio 2.7 JA w32             2578   19   19  1120   25%  2769   28% 
   -  154 Equinox 0.83 w32               2576   19   19  1000   32%  2705   33% 
   -  155 Twisted Logic 20100131x w32    2572   15   15  1600   32%  2705   30% 
   -  156 Spike 1.2 Turin w32            2571   16   16  1480   31%  2706   34% 
  36  157 Cipollino 3.25 x64             2568   19   19  1080   30%  2720   31% 
   -  158 Crafty 23.3 JA w32             2565   19   19  1000   30%  2706   32% 
   -  159 Tornado 4.40 w32               2564   16   16  1480   32%  2696   33% 
   -  160 BugChess2 1.7 x64              2563   18   18  1240   27%  2738   29% 
   -  161 BugChess2 1.9 w32              2562   19   20  1120   24%  2770   25% 
  37  162 ChessTiger 2007 1.0012 w32     2562   12   12  3200   26%  2745   30% 
   -  163 Scorpio 2.6 JA x64             2554   18   18  1160   27%  2724   31% 
   -  164 Crafty 23.2 JA x64             2552   19   19  1080   28%  2715   30% 
  38  165 Chronos 1.99 x64, no ponder    2551   18   18  1200   28%  2718   33% 
  39  166 BobCat 2.75 x64                2549   16   16  1640   25%  2743   30% 
   -  167 Crafty 23.3 JA x64, no ponder  2547   20   20  1000   26%  2729   30% 
   -  168 Tornado 4.25 x64               2539   19   20  1080   27%  2715   25% 
  40  169 Daydreamer 1.75 JA x64         2517   18   19  1160   25%  2704   30% 
   -  170 Tornado 3.67 x64               2476   21   21  1040   21%  2712   25% 
  41  171 Zarkov 6.44 w32                2471   15   15  2120   22%  2697   24% 
  42  172 Gaviota 0.80 x64               2356   25   26  1040   11%  2714   15% 

[Eelco de Groot]

If I add one or two count_1s<Max15>() in evaluate, I immediately can see it in the nodes per second going down. It is not easy to measure because the motherboard can vary the clockspeed of the Athlon chip by itself, but the nodecount is always lower and sometimes much lower with a 32 bit build. You really learn not to depend too much on it that way...

One project that I have in mind is to try to reduce the number of calls to popcount in the evaluation function (which is where Komodo spends almost all it's time.) I have identified several ways to do this but I have not started working on it yet. A typical example is our bonus for having a minor piece behind a pawn, I can do the calculation in parallel with bit boards but then I am left with popcount to see how many of them I found.

So the alternative which will probably be faster is to test for the pawn when I identify each minor piece. A simple shift and test. Of course then I potentially have several separate additions (as well as additional branches) so it's not clear to me but I believe it will be an improvement. It may be that this will speed up non-see4 version but not not the sse version.

Don, you mentioned one of your bonus ideas here, I have not yet tried your bonus for minor piece behind a pawn but I remembered your idea and I just implemented the more obvious penalty for a piece in front of a pawn. I had never tried it yet although it was mentioned in the past that Rybka did not pay enough attention to a knight in front of the pawns in spite of Larry's efforts to tune it. At first glance, I think that Ferrarifish likes the idea ! It uses bit_is_set() that is not as expensive I hope as a bitcount. Thanks for the idea!

Eelco

[Don]

If I add one or two count_1s<Max15>() in evaluate, I immediately can see it in the nodes per second going down. It is not easy to measure because the motherboard can vary the clockspeed of the Athlon chip by itself, but the nodecount is always lower and sometimes much lower with a 32 bit build. You really learn not to depend too much on it that way...

One project that I have in mind is to try to reduce the number of calls to popcount in the evaluation function (which is where Komodo spends almost all it's time.) I have identified several ways to do this but I have not started working on it yet. A typical example is our bonus for having a minor piece behind a pawn, I can do the calculation in parallel with bit boards but then I am left with popcount to see how many of them I found.

So the alternative which will probably be faster is to test for the pawn when I identify each minor piece. A simple shift and test. Of course then I potentially have several separate additions (as well as additional branches) so it's not clear to me but I believe it will be an improvement. It may be that this will speed up non-see4 version but not not the sse version.

Don, you mentioned one of your bonus ideas here, I have not yet tried your bonus for minor piece behind a pawn but I remembered your idea and I just implemented the more obvious penalty for a piece in front of a pawn. I had never tried it yet although it was mentioned in the past that Rybka did not pay enough attention to a knight in front of the pawns in spite of Larry's efforts to tune it. At first glance, I think that Ferrarifish likes the idea ! It uses bit_is_set() that is not as expensive I hope as a bitcount. Thanks for the idea!

Eelco

We have pawn mobility which covers that. Any token in front of a pawn is bad. A knight or bishop immediately behind a pawn is a good thing.