I have just seen a test in CSS forum comparing SF 3 and SF 130623 (timestamp = 1371986343) by FastGM. Here is the link:gladius wrote:I hope it holds up a longer TC as wellpohl4711 wrote:Interesting. Especially when you compare the Elo-difference between Stockfish 2.3.1 and Stockfish 3 in the IPON (+22 Elo) and the LS-ratinglist (+24 Elo)... And IPON is 5+3...Laskos wrote:This won't be +35 or +30 points, it's at bullet control. +15 is more reasonable to expect at 40/4 or 5+3.Vinvin wrote:IMO, +30 Elo is enough to release a new official version of a freeware chess engine !
Stefan. Who knows though. In self tests against SF 3 at 1min+0.05, the current development version has:
ELO: 35.68 +-2.2 (95%) LOS: 100.0%
Total: 38318 W: 9849 L: 5928 D: 22541
Whereas, SF 3 vs SF 2.3.1 had:
ELO: 30.86 +-2.9 (95%) LOS: 100.0%
Total: 20000 W: 4493 L: 2721 D: 12786
2 Turniere, 60 Sek. + 0.60 Sek. - Vergleich
The measured Elo gain is not negligible! Near +40 ± 25 Elo combining both results, although the number of games is not very high and you can see important variations in other engines ratings (they are not well established). But clearly actual SF development versions are fine improvements over SF 3. I wonder when you will stagnate in comparison of such fast improvement rates of X Elo/week (in average, X > 3 if I am not wrong).
Regards from Spain.
Ajedrecista.
