SWCR after 20.500 games ... SF 1.7.1 JA new nr. 1!

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Frank Quisinsky
Posts: 7195
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

SWCR after 20.500 games ... SF 1.7.1 JA new nr. 1!

Post by Frank Quisinsky »

Hi there,

in SWCR 32-Bit we have a new Number 1.

At the moment SF 1.7.1 JA is still running but 700 of 800 games played. Final results on Tuesday.

Here the actual rating list:

Code: Select all

Rank Name                      Elo    +    - games score oppo. draws 
   1 Stockfish 1.7.1 JA       2865   23   22   700   76%  2672   31% 
   2 Rybka 3                  2858   22   21   794   75%  2671   29% 
   3 Naum 4.2                 2830   21   21   794   72%  2672   34% 
   4 Shredder 12              2800   20   20   794   68%  2674   36% 
   5 Deep Fritz 12            2780   20   20   800   65%  2676   39% 
   6 Komodo 1.0 JA            2717   19   19   795   56%  2678   40% 
   7 Thinker 5.4d Inert       2706   19   19   794   54%  2678   39% 
   8 Spark 0.4                2680   19   19   794   50%  2680   42% 
   9 Protector 1.3.4 JA       2675   19   19   795   49%  2680   38% 
  10 Sjeng WC-2008            2664   19   20   794   48%  2680   36% 
  11 Hiarcs 12.1 Sharpen PV   2661   19   19   795   47%  2681   38% 
  12 Zappa Mexico II          2643   19   19   794   45%  2682   42% 
  12 Junior 11.1a             2643   20   20   795   45%  2682   37% 
  14 Onno 1.1.1               2629   19   19   795   42%  2682   40% 
  15 Ktulu 9.03               2614   20   20   800   40%  2684   30% 
  16 Critter 0.52b            2610   20   20   795   39%  2683   37% 
  17 Fruit 05/11/03           2606   19   19   795   39%  2684   41% 
  18 Loop 13.6                2601   20   20   795   38%  2684   38% 
  19 SmarThink 1.20           2580   20   20   794   35%  2685   38% 
  20 Spike 1.2 Turin          2569   20   20   794   33%  2685   35% 
  20 Twisted Logic 20100131x  2569   20   21   794   34%  2685   30%
Here the list after all 20.500 games:

Code: Select all

Stand: 01.05.2010
Nach 20.500 Partien
Alle SWCR Partien, 40 Züge in 10 Minuten

Rank Name                      Elo    +    - games score oppo. draws 
   1 Stockfish 1.7.1 JA       2869   24   23   700   76%  2676   31% 
   2 Rybka 3                  2858   16   16  1474   74%  2689   31% 
   3 Naum 4.2                 2829   20   19   914   71%  2682   34% 
   - Stockfish 1.6.3 JA       2827   18   18  1080   71%  2680   36% 
   - Naum 4.1                 2811   19   19   920   68%  2686   35% 
   - Stockfish 1.6.0 JA       2802   19   18   960   68%  2687   39% 
   4 Shredder 12              2800   15   15  1474   66%  2690   36% 
   - Naum 4.0                 2784   18   18   960   65%  2682   38% 
   5 Deep Fritz 12            2783   18   18  1000   64%  2690   41% 
   - Fritz 12                 2746   16   16  1160   59%  2688   44% 
   - Stockfish 1.5.1 JA       2730   21   21   680   57%  2685   43% 
   6 Komodo 1.0 JA            2717   16   16  1155   54%  2694   40% 
   7 Thinker 5.4d Inert       2712   14   14  1474   53%  2693   42% 
   - Doch 1.3.4 JA            2690   19   19   840   51%  2686   44% 
   8 Spark 0.4                2685   19   19   834   49%  2691   42% 
   9 Protector 1.3.4 JA       2679   19   19   875   48%  2690   39% 
   - Cyclone xTreme Wrath     2676   17   17  1080   47%  2697   41% 
   - Protector 1.3.2          2674   16   16  1160   47%  2696   41% 
  10 Junior 2010              2669   16   16  1240   47%  2691   36% 
   - Doch 1.2 JA              2668   20   21   720   47%  2690   40% 
  11 Hiarcs 12.1              2667   18   19   880   47%  2689   41% 
   - Protector 1.3.1b         2667   19   19   840   47%  2690   42% 
   - Hiarcs 12.1 Sharpen PV   2665   16   16  1235   45%  2699   40% 
  12 Sjeng WC-2008            2659   15   15  1474   45%  2694   36% 
   - Doch 09.980 JA           2656   21   21   680   45%  2690   43% 
   - Spark 0.3a               2656   17   17  1120   44%  2699   41% 
  13 Zappa Mexico II          2656   15   14  1474   44%  2694   43% 
   - Junior 11.1a             2651   19   19   915   45%  2690   37% 
   - Spark 0.3                2643   18   19   880   43%  2690   42% 
  14 Onno 1.1.1               2632   14   15  1475   41%  2695   41% 
  15 Loop 13.6                2617   15   15  1475   38%  2696   39% 
  16 Fruit 05/11/03           2615   15   15  1395   38%  2696   41% 
  17 Critter 0.52b            2613   18   18  1035   38%  2698   37% 
   - Glaurung 2.2 JA          2610   17   17  1080   37%  2700   36% 
  18 Ktulu 9.03               2609   18   19  1000   38%  2697   29% 
  19 SmarThink 1.20           2599   15   15  1474   36%  2696   38% 
  20 Twisted Logic 20100131x  2577   18   18  1034   33%  2699   31% 
  21 Spike 1.2 Turin          2572   20   20   834   32%  2696   34%
Here the results of Stockfish 1.7.1 JA so far:

Code: Select all

Stockfish 1.7.1 JA - Critter 0.52b            30.5 -   4.5  87.14%
Stockfish 1.7.1 JA - Fruit 05_11_03           30.5 -   4.5  87.14%
Stockfish 1.7.1 JA - Hiarcs 12.1 Sharpen PV   26.0 -   9.0  74.29%
Stockfish 1.7.1 JA - Junior 11.1a             29.5 -   5.5  84.29%
Stockfish 1.7.1 JA - Komodo 1.0 JA            26.5 -   8.5  75.71%
Stockfish 1.7.1 JA - Loop 13.6                29.0 -   6.0  82.86%
Stockfish 1.7.1 JA - Naum 4.2                 20.5 -  13.5  60.29%
Stockfish 1.7.1 JA - Onno 1.1.1               30.5 -   4.5  87.14%
Stockfish 1.7.1 JA - Protector 1.3.4 JA       26.5 -   8.5  75.71%
Stockfish 1.7.1 JA - Rybka 3                  15.0 -  19.0  44.12%
Stockfish 1.7.1 JA - Shredder 12              20.5 -  13.5  60.29%
Stockfish 1.7.1 JA - Sjeng WC-2008            25.0 -   9.0  73.53%
Stockfish 1.7.1 JA - SmarThink 1.20           30.5 -   3.5  89.71%
Stockfish 1.7.1 JA - Spark 0.4                24.0 -  10.0  70.59%
Stockfish 1.7.1 JA - Spike 1.2 Turin          31.0 -   3.0  91.18%
Stockfish 1.7.1 JA - Thinker 5.4d Inert       27.0 -   7.0  79.41%
Stockfish 1.7.1 JA - Twisted Logic 20100131x  28.0 -   6.0  82.35%
Stockfish 1.7.1 JA - Zappa Mexico II          28.0 -   6.0  82.35%

Bereits beendet:
Stockfish 1.7.1 JA - Ktulu 9.03               33.5 -   6.5  83,75%
Stockfish 1.7.1 JA - Deep Fritz 12 ( 1Core)   23.0 -  17.0  57,50%

                                             535.0 - 165.0  76.43%
SCHACHWELT ratings:
http://www.schach-welt.de/spezial/compu ... p-20-.html

SCHACHWELT News-Ticker, see News 117:
http://www.schach-welt.de/spezial/compu ... icker.html

Next engine will be Critter 0.60!

Best
Frank
ernest
Posts: 2053
Joined: Wed Mar 08, 2006 8:30 pm

Re: SWCR after 20.500 games ... SF 1.7.1 JA new nr. 1!

Post by ernest »

That's not so surprising for 32-Bit:
Stockfish is known to be optimized for 32-Bit, Rybka 3 not at all.

In 64-Bit you will certainly not have the same ranking!
Frank Quisinsky
Posts: 7195
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: SWCR after 20.500 games ... SF 1.7.1 JA new nr. 1!

Post by Frank Quisinsky »

Hi Ernest,

yes, but I believe that with longer time controls, perhaps with 1 minute pro move, Stockfish will be the number 1 with 64-Bit too. Please not forget, Rybka is an engine which is stronger with faster time controls.

Best
Frank
ernest
Posts: 2053
Joined: Wed Mar 08, 2006 8:30 pm

Re: SWCR after 20.500 games ... SF 1.7.1 JA new nr. 1!

Post by ernest »

Frank Quisinsky wrote:Please not forget, Rybka is an engine which is stronger with faster time controls.
Hi Frank,
Who says that?...
In the matches Rybka 3 against Robbo-Ivan-Fire it has been said that Rybka becomes stronger at LTC! (but I was never able to see it myself: perhaps LTC is many hours for a game, perhaps 1 or 2 months for a significant 200-game match... :o )

Anyway, with Rybka 4 we will soon have new tests :D
Frank Quisinsky
Posts: 7195
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: SWCR after 20.500 games ... SF 1.7.1 JA new nr. 1!

Post by Frank Quisinsky »

Hi Ernest,

that is very easy to see.

I am sure that with longer time controls (good example is CCRL, longer time controls as CEGT, or SWCR longer time controls as CEGT) Stockfish will get in compare to Rybka a little booster.

Furthermore, you can see it if you compare blitz ratings with CEGT, CCRL or SWCR longer time controls. Rybka is stronger with faster time controls.

Not a secret.

Furthermore, SF made more points vs. others as Rybka, not vs. Rybka. If you test clones only vs. SF you can't see it.

All the blitz matches Rybka vs. Clones are not very interesting. I read that the clones of Rybka are 70 ELO points better as Stockfish :-)

The reality is ...
With SWCR time control the clones of Rybka are around 20 ELO stronger as Rybka 3 and around 10 ELO stronger as the Stockfish. In blitz around 35 ELO stronger as Rybka.

So, its clear that around with 1 minute pro game SF will be stronger as Rybka 3, perhaps the same level as the Rybka clones with x64.

I tested Firebird 1.0 Beta with 32-Bit SWCR 40 in 10 with ponder = on. The result after 720 games +21 to Rybka 3.

Best
Frank

I wrote it because I know that this topic is for you interesting.
ernest
Posts: 2053
Joined: Wed Mar 08, 2006 8:30 pm

Re: SWCR after 20.500 games ... SF 1.7.1 JA new nr. 1!

Post by ernest »

Frank Quisinsky wrote:I read that the clones of Rybka are 70 ELO points better as Stockfish :-)
The reality is ...
Thanks, Frank!
But that's my tested reality (64-bit: FB 1.2, latest IvanHoes), even a little more!... :)
Frank Quisinsky
Posts: 7195
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: SWCR after 20.500 games ... SF 1.7.1 JA new nr. 1!

Post by Frank Quisinsky »

Hi Ernest,

think so :-)
And vs. how much other different engines you tested vs. IvanHoe. I think only vs. Rybka and perhaps Stockfish, or? And only in blitz, or?

Very interesting to know this because I hear never other things as I wrote or saw never other things.

So, I am very interested what you have!

Best
Frank

PS: What I have you can see in clear tables, you can download and you can make with it your statistics. But only with words I can nothing do Ernest, sorry ...
Frank Quisinsky
Posts: 7195
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: SF 1.7.1 JA the new nr. 1, final results!

Post by Frank Quisinsky »

Hi there,

Stockfish is the new number 1 in SWCR.

SCHACHWELT SWCR actual:
http://www.schach-welt.de/spezial/compu ... p-20-.html

Final results:

Code: Select all

1 Stockfish 1.7.1 JA        : 2867  800 (+488,=248,- 64), 76.5 %

Deep Fritz 12                 :  40 (+ 12,= 22,-  6), 57.5 %
Critter 0.52b                 :  40 (+ 29,=  7,-  4), 81.2 %
Ktulu 9.03                    :  40 (+ 28,= 11,-  1), 83.8 %
SmarThink 1.20                :  40 (+ 33,=  7,-  0), 91.2 %
Rybka 3                       :  40 (+  9,= 17,- 14), 43.8 %
Shredder 12                   :  40 (+ 15,= 21,-  4), 63.7 %
Junior 11.1a                  :  40 (+ 31,=  7,-  2), 86.2 %
Naum 4.2                      :  40 (+ 14,= 20,-  6), 60.0 %
Hiarcs 12.1 Sharpen PV        :  40 (+ 23,= 15,-  2), 76.2 %
Fruit 05/11/03                :  40 (+ 30,= 10,-  0), 87.5 %
Spark 0.4                     :  40 (+ 18,= 19,-  3), 68.8 %
Spike 1.2 Turin               :  40 (+ 34,=  6,-  0), 92.5 %
Onno 1.1.1                    :  40 (+ 30,=  9,-  1), 86.2 %
Sjeng WC-2008                 :  40 (+ 26,=  9,-  5), 76.2 %
Protector 1.3.4 JA            :  40 (+ 25,= 13,-  2), 78.8 %
Zappa Mexico II               :  40 (+ 29,=  5,-  6), 78.8 %
Loop 13.6                     :  40 (+ 29,=  9,-  2), 83.8 %
Thinker 5.4d Inert            :  40 (+ 22,= 15,-  3), 73.8 %
Komodo 1.0 JA                 :  40 (+ 24,= 14,-  2), 77.5 %
Twisted Logic 20100131x       :  40 (+ 27,= 12,-  1), 82.5 %
SWCR Rating list:

Code: Select all

Rank Name                      Elo    +    - games score oppo. draws 
   1 Stockfish 1.7.1 JA       2867   22   21   800   77%  2673   31% 
   2 Rybka 3                  2859   22   21   800   75%  2673   29% 
   3 Naum 4.2                 2831   21   20   800   72%  2675   34% 
   4 Shredder 12              2800   20   20   800   68%  2676   36% 
   5 Deep Fritz 12            2781   20   20   800   65%  2677   39% 
   6 Komodo 1.0 JA            2717   19   19   800   56%  2680   40% 
   7 Thinker 5.4d Inert       2708   19   19   800   54%  2681   39% 
   8 Spark 0.4                2682   19   19   800   50%  2682   42% 
   9 Protector 1.3.4 JA       2675   19   19   800   49%  2682   38% 
  10 Sjeng WC-2008            2664   20   20   800   48%  2683   36% 
  11 Hiarcs 12.1 Sharpen PV   2662   19   19   800   47%  2683   38% 
  12 Zappa Mexico II          2645   19   19   800   45%  2684   42% 
  13 Junior 11.1a             2643   19   19   800   44%  2684   37% 
  14 Onno 1.1.1               2630   19   19   800   42%  2685   39% 
  15 Ktulu 9.03               2615   20   20   800   40%  2685   30% 
  16 Critter 0.52b            2613   19   20   800   40%  2685   37% 
  17 Fruit 05/11/03           2607   19   19   800   39%  2686   40% 
  18 Loop 13.6                2602   19   20   800   38%  2686   38% 
  19 SmarThink 1.20           2580   20   20   800   35%  2687   38% 
  20 Twisted Logic 20100131x  2570   20   21   800   34%  2688   30% 
  21 Spike 1.2 Turin          2569   20   20   800   33%  2688   35% 
Rating list after all played 20.600 games:

Code: Select all

Stand: 04.05.2010
Nach 20.600 Partien
Alle SWCR Partien, 40 Züge in 10 Minuten

Rank Name                      Elo    +    - games score oppo. draws 
   1 Stockfish 1.7.1 JA       2870   22   22   800   77%  2676   31% 
   2 Rybka 3                  2859   16   16  1480   74%  2690   31% 
   3 Naum 4.2                 2829   20   19   920   71%  2684   34% 
   - Stockfish 1.6.3 JA       2827   18   18  1080   71%  2680   36% 
   - Naum 4.1                 2811   19   19   920   68%  2686   35% 
   - Stockfish 1.6.0 JA       2802   19   18   960   68%  2687   39% 
   4 Shredder 12              2800   15   15  1480   66%  2691   36% 
   - Naum 4.0                 2784   18   18   960   65%  2682   38% 
   5 Deep Fritz 12            2783   18   18  1000   64%  2690   41% 
   - Fritz 12                 2746   16   16  1160   59%  2688   44% 
   - Stockfish 1.5.1 JA       2730   21   21   680   57%  2685   43% 
   6 Komodo 1.0 JA            2716   16   16  1160   53%  2695   40% 
   7 Thinker 5.4d Inert       2713   14   14  1480   53%  2693   42% 
   - Doch 1.3.4 JA            2690   19   19   840   51%  2686   44% 
   8 Spark 0.4                2687   19   19   840   49%  2692   42% 
   9 Protector 1.3.4 JA       2678   19   19   880   48%  2691   39% 
   - Cyclone xTreme Wrath     2675   17   17  1080   47%  2697   41% 
   - Protector 1.3.2          2674   16   16  1160   47%  2696   41% 
  10 Junior 2010              2669   16   16  1240   47%  2691   36% 
   - Doch 1.2 JA              2668   20   21   720   47%  2690   40% 
  11 Hiarcs 12.1              2667   18   19   880   47%  2689   41% 
   - Protector 1.3.1b         2667   19   19   840   47%  2690   42% 
   - Hiarcs 12.1 Sharpen PV   2664   16   16  1240   45%  2699   40% 
  12 Sjeng WC-2008            2659   15   15  1480   45%  2695   36% 
  13 Zappa Mexico II          2657   14   14  1480   44%  2695   43% 
   - Doch 09.980 JA           2656   21   21   680   45%  2690   43% 
   - Spark 0.3a               2656   17   17  1120   44%  2698   41% 
   - Junior 11.1a             2651   18   19   920   44%  2691   37% 
   - Spark 0.3                2643   18   19   880   43%  2690   42% 
  14 Onno 1.1.1               2632   15   15  1480   41%  2696   41% 
  15 Loop 13.6                2616   15   15  1480   38%  2696   39% 
  16 Fruit 05/11/03           2615   15   15  1400   38%  2696   41% 
  17 Critter 0.52b            2614   18   18  1040   38%  2699   37% 
   - Glaurung 2.2 JA          2610   17   17  1080   37%  2700   36% 
  18 Ktulu 9.03               2609   18   19  1000   38%  2697   29% 
  19 SmarThink 1.20           2599   15   15  1480   36%  2697   38% 
  20 Twisted Logic 20100131x  2577   18   18  1040   33%  2700   31% 
  21 Spike 1.2 Turin          2571   20   20   840   32%  2698   34% 
Next one is Critter 0.60!

Best
Frank