Stockfish 3 - interim chess960 results 1,300+ games +23 Elo

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Modern Times
Posts: 3799
Joined: Thu Jun 07, 2012 11:02 pm

Stockfish 3 - interim chess960 results 1,300+ games +23 Elo

Post by Modern Times »

approx. +23 Elo gain over 2.3.1 so far:

http://computerchess.org.uk/ccrl/404FRC/index.html

Code: Select all

Stockfish 3 64-bit in CCRL 404FRC, 2013-05-02
 Shredder GUI, ChessGUI by Matthias Gemuh, Ponder off, 5-men EGTB, 128MB hash, random openings with switched sides
 Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
 Tested by CCRL team, 2005-2013, http://computerchess.org.uk/ccrl/404FRC/

 CCRL 404FRC main list:
 Stockfish 3 64-bit is #3 with rating of 3228 ELO points (+18 -18),
 based on 1336 games: 775 wins, 246 losses and 315 draws
 Score: 69.8%, Average opponent: −162.0, Draws: 23.6%


 Pairwise results:
      Opponent                 ELO     Score                  LOS   Perf
  - Houdini 3 64-bit           3365  36.0-102.0 (+16-82=40)    0.0   -32
  - Critter 1.6a 64-bit        3284  52.5-83.5  (+29-60=47)    0.0   -20
  - Rybka 4.1 64-bit           3161  99.0-57.0  (+67-25=64)  100.0   +17
  - Chiron 1.5 64-bit          3041 113.5-30.5  (+98-15=31)  100.0   +30
  - Naum 4.2 64-bit            3038 106.0-44.0  (+87-25=38)  100.0   -41
  - Shredder 12                3021 112.0-34.0  (+96-18=32)  100.0    -4
  - Spike 1.4 Leiden           2944 133.5-16.5  (+122-5 =23)  100.0   +50
  - Hiarcs 13.2                2920 142.0-16.0  (+130-4 =24)  100.0   +38
  - Deep Sjeng WC2008 64-bit   2876 138.0-20.0  (+130-12=16)  100.0   -16
Modern Times
Posts: 3799
Joined: Thu Jun 07, 2012 11:02 pm

Re: Stockfish 3 - interim chess960 results 1,300+ games +23

Post by Modern Times »

Testing completed now. On Thursday when I made the original post I had +23 Elo after approx 1,300 games, and that didn't change much. After 2,700 games it ended up +24 Elo.

Stockfish 3's score against Houdini is virtually identical to 2.3.1 - the improvement came from its performance against other engines.

http://computerchess.org.uk/ccrl/404FRC/index.html