"The Fight for Place 1" ... will be start soon!

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Frank Quisinsky
Posts: 7228
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

"The Fight for Place 1" ... will be start soon!

Post by Frank Quisinsky »

In around 2 hours ...
"The Fight for Place 1" will be start!


Hi there,

On system 1:
Stockfish 26.04.2015 BMI2 x64 (current dev.)
1.600 games vs. current FCP Top-32
125 games per day ... need around 12,8 days!

On system 2:
Komodo 9 x64
1.600 games vs. current FCP Top-32
125 games per day ... need around 12,8 days!

In this case in both test-runs Stockfish vs. Komodo 50 games.
End of the test both engines have 1.650 games and directly against one another 100 games. Could be interesting ... 2x 50 games SFdev vs. K9.

For K9 and SFdev the same participant. In the future both engines will be sync. The reason I do that because the different could be very small.

Conditions:
http://www.amateurschach.de/main/_conditions.htm

All can be find on one *.html page with current results after 10%, 20%, 30% ... working on the page. At the moment the latest 8 Thinker 5.4d Inert x64 games are still running. URL will be available in around two hours and you can follow the results in FTP-Trigger live mode.

Will be a great event for my visitors but with two systems we have to wait 12 days of the final results and stats. FCP = 45 minutes games on i7 4.3Ghz with SSD hard-disk and fastest available RAM. Both systems are the same and RAM is working with 2.4Ghz.

In the maintime so many others are working on interesting test results and I hope to compare the results will be later interesting because I have very high conditions and many participants.

Have fun with my work and good luck for Komodo and Stockfish lovers!

Frank's Chess Page
http://www.amateurschach.de

Best
Frank
Frank Quisinsky
Posts: 7228
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: "The Fight for Place 1" ... started!

Post by Frank Quisinsky »

Hi there,

here is the LIVE Link:
http://www.amateurschach.de/_start-2900+.htm

In both FTP-Trigger test-run files I set ...
Komodo 9 and Stockfish 260415 to 3.150 Elo.
This should be around the final result after all I read here in testing by others.

First update after 160 games for both engines!
I am not each day 24 hours at home. I try to make in the following 12 days the updates as soon as possible.

Games will be available after 160, 320, 480 games or better after 10%, 20%, 30% ... on the same site.

And now ...
Have fun with it.

I hope both engines find a lot of bad lines in my book. That is really an Event to make my "FCP Live Book" better.

Best
Frank
S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: "The Fight for Place 1" ... will be start soon

Post by S.Taylor »

I hope it did beed start soon
Frank Quisinsky
Posts: 7228
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: "The Fight for Place 1" ... will be start soon

Post by Frank Quisinsky »

Hi,

runs since around 30 minutes ... first two games for both test-runs ended!
K9 vs. SF 1:0 ... have a look in SF test-run!
In K9 test run also two games ended.

All works fine!

:-)

Best
Frank
Frank Quisinsky
Posts: 7228
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: After 320 of 3.200 games = SFdev +15 Elo, K9 +9 Elo

Post by Frank Quisinsky »

Detail Page (live FTP-Trigger links and download games)
http://www.amateurschach.de/_start-2900+.htm

Code: Select all

FCP version   : 2.07.0165.s7+s8
Performance   : Stockfish 26.04.15 BMI2 x64 = +15
Performance   : Komodo 9 x64                = + 9


Calculated with Ordo 1.0
Stats after 100, 200 ... games!       Elo   Games  Score  Draws   White Black Points   w/ d/ l
01. Stockfish 6 BMI2 x64              3135  1.700  Predecessor
--. Stockfish 260415 BMI2 x64         ----  1.650  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Stockfish 260415 BMI2 x64         ----  1.485  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Stockfish 260415 BMI2 x64         ----  1.320  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Stockfish 260415 BMI2 x64         ----  1.155  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Stockfish 260415 BMI2 x64         ----    990  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Stockfish 260415 BMI2 x64         ----    825  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Stockfish 260415 BMI2 x64         ----    660  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Stockfish 260415 BMI2 x64         ----    495  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Stockfish 260415 BMI2 x64         ----    330  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
01. Stockfish 260415 BMI2 x64         3150    165  83.3%  29.7%   73,5  64,0  137,5   113/49/03


Calculated with Ordo 1.0
Stats after 100, 200 ... games!       Elo   Games  Score  Draws   White Black Points   w/ d/ l
02. Komodo 8 x64                      3105  1.700  Predecessor
--. Komodo 9 x64                      ----  1.650  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Komodo 9 x64                      ----  1.485  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Komodo 9 x64                      ----  1.320  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Komodo 9 x64                      ----  1.155  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Komodo 9 x64                      ----    990  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Komodo 9 x64                      ----    825  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Komodo 9 x64                      ----    660  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Komodo 9 x64                      ----    495  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
--. Komodo 9 x64                      ----    330  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
02. Komodo 9 x64                      3114    165  80.3%  30.9%   73,5  59,0  132,5   107/51/07


    Program                           Elo    +    -  Games   Score  Av.Op.  Draw
01. Stockfish 26.04.15 BMI2 x64       3150   53   53   165   83.3%   2841   29.7%
--. Stockfish 6 BMI2 x64              3135   16   16  1700   83.8%   2824   28.9%
02. Komodo 9 x64                      3114   50   50   165   80.3%   2843   30.9%
--. Komodo 8 x64                      3105   15   15  1700   80.9%   2830   31.6%
03. Fire 4 x64                        3046   15   15  1860   76.3%   2821   33.7%
04. GullChess 3.0 BMI2 x64            3038   14   14  1710   74.4%   2834   39.0%
05. Equinox 3.30 x64                  2993   13   13  1860   70.9%   2822   41.3%
06. Sting SF 4.8.4 x64                2931   13   13  1760   62.9%   2831   44.2%
07. Protector 1.7.0 x64               2914   13   13  1560   58.5%   2851   45.9%
08. Critter 0.90 SSE4 x64             2900   13   13  1660   57.9%   2841   45.7%
09. Texel 1.05 x64                    2897   13   13  1760   58.8%   2831   43.9%
09. Hannibal 1.5 x64                  2897   13   13  1710   58.6%   2832   45.3%
11. Chiron 2.0 x64                    2895   11   11  2810   62.8%   2797   40.4%
12. Naum 4.6 x64                      2886   12   12  2010   59.7%   2812   43.4%
--. Hannibal 1.4b x64                 2863   10   10  2500   59.2%   2794   43.3%
--. Texel 1.04 x64                    2848   11   11  2300   57.5%   2793   42.4%
13. Nirvanachess 2.0a x64             2839   11   11  2060   54.0%   2811   46.1%
14. Senpai 1.0 SSE42 x64              2829   10   10  2810   54.3%   2799   42.8%
15. Hiarcs 14 WCSC w32                2825   10   10  2810   53.7%   2800   43.3%
16. Andscacs 0.72 POP x64             2814   12   12  2010   50.5%   2813   43.3%
17. Sjeng c't 2010 w32                2797   12   12  1910   47.9%   2818   43.3%
18. Shredder 12 x64                   2795   12   12  1710   44.5%   2841   43.3%
19. Junior 13.3.00 x64                2783   10   10  2660   47.4%   2807   40.6%
20. Spike 1.4 Leiden w32              2774   13   13  1610   40.7%   2850   42.9%
21. Quazar 0.4 x64                    2761   13   13  1510   39.9%   2845   41.5%
Frank Quisinsky
Posts: 7228
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: SF vs. K9, 1:0 mate after 46 moves!!

Post by Frank Quisinsky »

Very fast mate.
Nice to see that K9 is very aggressive with pawns (normely good) and the counter attack from SF with aggressive pawns too. Good for analysing!

[pgn][Event "FCP, 40/10, p=off, i7-4770k, 4.3GHz"]
[Site "Trier"]
[Date "2015.05.01"]
[Round "11.1"]
[White "Stockfish 26.04.15 BMI2 x64"]
[Black "Komodo 9 x64"]
[Result "1-0"]
[ECO "B51"]
[PlyCount "91"]
[EventDate "2015.??.??"]
[EventType "rapid"]
[EventRounds "50"]
[EventCountry "GER"]
[Source "Frank Quisinsky"]
[SourceDate "2015.05.01"]

1. e4 {[%eval 0,0] [%emt 0:00:00]} c5 {[%eval 0,0] [%emt 0:00:00]} 2. Nf3 {
[%eval 0,0] [%emt 0:00:00]} d6 {[%eval 0,0] [%emt 0:00:00]} 3. d4 {[%eval 0,0]
[%emt 0:00:00]} Nf6 {[%eval 0,0] [%emt 0:00:00]} 4. Bb5+ {[%eval 0,0] [%emt 0:
00:00]} Nbd7 {[%eval 0,0] [%emt 0:00:00]} 5. Nc3 {[%eval 0,0] [%emt 0:00:00]}
a6 {[%eval 0,0] [%emt 0:00:00]} 6. Bxd7+ {[%eval 0,0] [%emt 0:00:00]} Nxd7 {
[%eval 0,0] [%emt 0:00:00]} 7. O-O {[%eval 0,0] [%emt 0:00:00]} e6 {[%eval 0,0]
[%emt 0:00:00]} 8. Bg5 {[%eval 0,0] [%emt 0:00:00]} Qc7 {[%eval 0,0] [%emt 0:
00:00]} 9. a4 {[%eval 0,0] [%emt 0:00:00]} h6 {[%eval 0,0] [%emt 0:00:00]} 10.
Bh4 {[%eval 0,0] [%emt 0:00:00]} cxd4 {[%eval 0,0] [%emt 0:00:00]} 11. Nxd4 {
[%eval 0,0] [%emt 0:00:00]} Ne5 {[%eval 0,0] [%emt 0:00:00]} 12. Kh1 {[%eval 0,
0] [%emt 0:00:00]} g5 {[%eval 0,0] [%emt 0:00:00]} 13. Bg3 {[%eval -22,25]
[%emt 0:00:16]} h5 {[%eval -24,21] [%emt 0:00:24]} 14. h4 {[%eval -28,22]
[%emt 0:00:02] (f4)} Ng6 {[%eval -11,21] [%emt 0:00:44] (g4)} 15. hxg5 {[%eval
17,25] [%emt 0:00:15]} h4 {[%eval -5,21] [%emt 0:00:09]} 16. Bh2 {[%eval 54,23]
[%emt 0:00:14]} h3 {[%eval 13,22] [%emt 0:00:33]} 17. g4 {[%eval 51,24] [%emt
0:00:29] (gxh3)} Bd7 {[%eval 46,19] [%emt 0:00:49] (Se5)} 18. f4 {[%eval 134,
23] [%emt 0:00:23]} Bg7 {[%eval 83,19] [%emt 0:00:30] (Se7)} 19. f5 {[%eval
173,23] [%emt 0:00:15]} Ne5 {[%eval 233,19] [%emt 0:00:19]} 20. g6 {[%eval 183,
21] [%emt 0:00:02]} O-O-O {[%eval 274,21] [%emt 0:00:31] (fxg6)} 21. gxf7 {
[%eval 310,24] [%emt 0:00:18]} Qc4 {[%eval 266,21] [%emt 0:00:08]} 22. g5 {
[%eval 309,22] [%emt 0:00:01]} Nxf7 {[%eval 300,21] [%emt 0:00:27]} 23. f6 {
[%eval 337,25] [%emt 0:00:18]} Bxf6 {[%eval 313,21] [%emt 0:00:10] (Lh6)} 24.
Rxf6 {[%eval 587,25] [%emt 0:00:21] (gxf6)} Nxg5 {[%eval 505,19] [%emt 0:00:16]
} 25. Ndb5 {[%eval 606,22] [%emt 0:00:02]} Bxb5 {[%eval 587,20] [%emt 0:00:27]}
26. axb5 {[%eval 710,25] [%emt 0:00:25]} axb5 {[%eval 664,20] [%emt 0:00:44]
(Kb8)} 27. Bxd6 {[%eval 1006,27] [%emt 0:00:21]} b6 {[%eval 793,23] [%emt 0:00:
14]} 28. Qg1 {[%eval 1080,25] [%emt 0:00:03] (Tg6)} Qc6 {[%eval 907,22] [%emt
0:00:17] (Txd6)} 29. Qxg5 {[%eval 1668,28] [%emt 0:00:24]} Rxd6 {[%eval 991,24]
[%emt 0:00:13]} 30. Rf7 {[%eval 1798,26] [%emt 0:00:03]} Rhd8 {[%eval 1080,26]
[%emt 0:00:14]} 31. Rfa7 {[%eval 5226,36] [%emt 0:00:33]} Rd1+ {[%eval 25000,
25] [%emt 0:00:28] (Kb8)} 32. Rxd1 {[%eval 12340,37] [%emt 0:00:55]} Rxd1+ {
[%eval 25000,25] [%emt 0:00:09]} 33. Nxd1 {[%eval 12341,34] [%emt 0:00:03]}
Qxe4+ {[%eval 25000,26] [%emt 0:00:06]} 34. Kh2 {[%eval 32738,37] [%emt 0:01:
22] (Kg1)} Qxc2+ {[%eval 25000,22] [%emt 0:00:15] (Kb8)} 35. Kxh3 {[%eval
32742,37] [%emt 0:00:27]} Qf5+ {[%eval 25000,23] [%emt 0:00:04]} 36. Qxf5 {
[%eval 32744,34] [%emt 0:00:02]} exf5 {[%eval 32744,25] [%emt 0:00:06]} 37. Kg3
{[%eval 32748,37] [%emt 0:00:25] (b4)} b4 {[%eval 32742,23] [%emt 0:00:01]} 38.
Kf4 {[%eval 32750,36] [%emt 0:00:02] (Tg7)} Kb8 {[%eval 32752,24] [%emt 0:00:
01]} 39. Re7 {[%eval 32752,51] [%emt 0:00:29] (Tg7)} Kc8 {[%eval 32752,24]
[%emt 0:00:03] (b5)} 40. Ne3 {[%eval 32754,89] [%emt 0:00:58] (Kxf5)} Kd8 {
[%eval 32756,29] [%emt 0:00:02] (b5)} 41. Nd5 {[%eval 32756,94] [%emt 0:00:22]}
b3 {[%eval 32758,50] [%emt 0:00:02] (b5)} 42. Ke5 {[%eval 32758,127] [%emt 0:
00:14]} b5 {[%eval 32760,99] [%emt 0:00:00]} 43. Kd6 {[%eval 32760,127] [%emt
0:00:00]} Kc8 {[%eval 32762,99] [%emt 0:00:00]} 44. Nb4 {[%eval 32762,127]
[%emt 0:00:00]} f4 {[%eval 32764,99] [%emt 0:00:00]} 45. Nc6 {[%eval 32764,127]
[%emt 0:00:00]} b4 {[%eval 32766,99] [%emt 0:00:00] (f3)} 46. Rc7# {[%eval
32766,127] [%emt 0:00:00]} 1-0[/pgn]
Frank Quisinsky
Posts: 7228
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: After 640 of 3.200 games = SFdev +13 Elo, K9 +32 Elo

Post by Frank Quisinsky »

Code: Select all

FCP version     : 2.07.0330.s7+s8
Time            : April 28th 2015 - May 11th, 2015

Performance     : Stockfish 26.04.15 BMI2 x64 = +13 Elo
Performance     : Komodo 9 x64                = +32 Elo


 Calculated with Ordo 1.0
 Stats after 100, 200 ... games!       Elo   Games  Score  Draws   White Black Points   w/ d/ l
 01. Stockfish 6 BMI2 x64              3135  1.700  Predecessor
 --. Stockfish 260415 BMI2 x64         ----  1.650  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Stockfish 260415 BMI2 x64         ----  1.485  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Stockfish 260415 BMI2 x64         ----  1.320  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Stockfish 260415 BMI2 x64         ----  1.155  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Stockfish 260415 BMI2 x64         ----    990  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Stockfish 260415 BMI2 x64         ----    825  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Stockfish 260415 BMI2 x64         ----    660  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Stockfish 260415 BMI2 x64         ----    495  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 01. Stockfish 260415 BMI2 x64         3148    330  83.0%  30.9%   73,5  63,0  136,5   110/53/02
 01. Stockfish 260415 BMI2 x64         3150    165  83.3%  29.7%   73,5  64,0  137,5   113/49/03

 Calculated with Ordo 1.0
 Stats after 100, 200 ... games!       Elo   Games  Score  Draws   White Black Points   w/ d/ l
 02. Komodo 8 x64                      3105  1.700  Predecessor
 --. Komodo 9 x64                      ----  1.650  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Komodo 9 x64                      ----  1.485  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Komodo 9 x64                      ----  1.320  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Komodo 9 x64                      ----  1.155  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Komodo 9 x64                      ----    990  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Komodo 9 x64                      ----    825  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Komodo 9 x64                      ----    660  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 --. Komodo 9 x64                      ----    495  --.-%  --.-%   --,-  --,-  ---,-   ---/--/--
 02. Komodo 9 x64                      3137    330  82.1%  29.7%   73,5  65,0  138,5   115/47/03
 02. Komodo 9 x64                      3114    165  80.3%  30.9%   73,5  59,0  132,5   107/51/07
  

     Program                           Elo    +    -  Games   Score  Av.Op.  Draw
 01. Stockfish 26.04.15 BMI2 x64       3148   37   37   330   83.0%   2842   30.9%
 02. Komodo 9 x64                      3137   39   39   330   82.1%   2843   29.7%
 --. Stockfish 6 BMI2 x64              3135   16   16  1700   83.8%   2824   28.9%
 --. Komodo 8 x64                      3105   16   16  1700   80.9%   2830   31.6%
 03. Fire 4 x64                        3046   13   13  1870   76.1%   2822   33.7%
 04. GullChess 3.0 BMI2 x64            3039   14   14  1720   74.2%   2836   39.2%
 05. Equinox 3.30 x64                  2993   13   13  1870   70.7%   2824   41.3%
 06. Sting SF 4.8.4 x64                2932   12   12  1770   62.8%   2833   44.4%
 07. Protector 1.7.0 x64               2914   14   14  1570   58.3%   2853   45.9%
 08. Critter 0.90 SSE4 x64             2900   13   13  1670   57.6%   2843   45.6%
 09. Texel 1.05 x64                    2897   12   12  1770   58.6%   2833   43.8%
 10. Hannibal 1.5 x64                  2896   13   13  1720   58.4%   2834   45.2%
 11. Chiron 2.0 x64                    2895   11   11  2820   62.7%   2798   40.5%
 12. Naum 4.6 x64                      2886   11   11  2020   59.5%   2813   43.4%
 --. Hannibal 1.4b x64                 2863   10   10  2500   59.2%   2794   43.3%
 --. Texel 1.04 x64                    2848   11   11  2300   57.5%   2793   42.4%
 13. Nirvanachess 2.0a x64             2838   12   12  2070   53.7%   2813   45.9%
 14. Senpai 1.0 SSE42 x64              2830   10   10  2820   54.2%   2801   42.8%
 15. Hiarcs 14 WCSC w32                2825   10   10  2820   53.6%   2801   43.3%
 16. Andscacs 0.72 POP x64             2814   11   11  2020   50.4%   2815   43.3%
 17. Sjeng c't 2010 w32                2797   11   11  1920   47.7%   2819   43.1%
 18. Shredder 12 x64                   2795   13   13  1720   44.4%   2843   43.3%
 19. Junior 13.3.00 x64                2783   10   10  2670   47.2%   2808   40.5%
 20. Spike 1.4 Leiden w32              2773   13   13  1620   40.5%   2852   42.7%
 21. Quazar 0.4 x64                    2760   14   14  1520   39.6%   2847   41.3%
Frank Quisinsky
Posts: 7228
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: 3x more draw games for SF dev. up to move number 50

Post by Frank Quisinsky »

Hi there,

games can be found in the detail page.

Each time the same ...
But now 3x more draw games up to move number 50.
I hope this stat will be better with the next games but after all we know ... no chance.

K9 = 8 draw games.
SF dev. 24 draw games.

The main problem SF have!
Many points vs. weaker opponents lost ...

Best
Frank
Frank Quisinsky
Posts: 7228
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: After Round 13 of 50 ... stats!

Post by Frank Quisinsky »

Code: Select all

After round 13 of 50
# PLAYER                        : RATING   ERROR  POINTS   PLAYED (%)
 1. Stockfish 26.04.15 BMI2 x64  : 3146.2   32.8    355.5    429 82.9%  + 10,9 Elo
 2. Komodo 9 x64                 : 3139.2   32.4    353.0    429 82.3%  + 34,0 Elo
 3. Stockfish 6 BMI2 x64         : 3135.3   16.5   1424.0   1700 83.8%
 4. Komodo 8 x64                 : 3105.2   15.5   1375.5   1700 80.9%
Maybe interesting stats:

Draw games up to move number 50:
Komodo 9 x64 = 9 games
Stockfish 26.04.15 BMI2 x64 = 30 games

Clearly the stats to move average:
Komodo 9 x64 = 85 moves
Stockfish 26.04.15 BMI2 x64 = 81 moves (reason are all the fast draw games but also a lot of fast won games).

Won games up to move number 50:
Komodo 9 x64 = 5 games = 5 games
Stockfish 26.04.15 BMI2 x64 = 12 games

It seems that Komodo 9 lost tactical power in the openings in comparing to version 8. Not easy to see because with all the draw games SF lost here too.

Very nice to see if I am looking vs. games vs. tactical strong engines: Good example are the Problems K9 have vs. Fire 4 or Fizbo other strong tactical engines.

It seems that Komodo 9 comes again with changes in "avoid draw" and made here more points vs. weaker opponents later in the games.

Komodo 8 comparing to Stockfish 6: 2x more draws for SF up to move number 50.

Komodo 9 comparing to Stockfish current dev.: 3x more draws for SF up to move number 50.

Komodo 9 won clearly in strength to late middlegame ...
Endgame strength is around the same and here lost Komodo a bit power in comparing to SF dev.

But not sure ... stats after 429 of 1650 games!

At the moment, as fan of analysing opening book moves, I am not happy with K9. After all what I saw K8 is better here. More Elo will not give us the information to use Engine x or y in one of the important phases of a game. An grandmaster will have the feeling in analyzsing his games with many pieces on the board that K8 is better because in the late middlegame no grandmaster have such a high level as SF or K have and I am sure a grandmaster can't see without stats that K9 is here clearly better as K8.

For the moment my opinion after all what I saw.
But again, not enough games!

Best
Frank

PS: After all other stats in comparing with results by others ... it should be clear that with more weaker opponents the playing strenghts is -10 to the others testers (same result I had in Komodo 8 testing or SF 6 testing). Not a secret today that weaker opponets will give us not the high Elo jumpings we can await in comparing testing vs. lesser engines or vs. more derivative with the same style and same level.
Frank Quisinsky
Posts: 7228
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: 15 Elo lesser as SF actually is ...

Post by Frank Quisinsky »

Short Hint:
If I delete 21 draw games from Stockfish ... K9 and SF have the same quantiy of draw games (9 games) ... we can see better the Elo difference between this engines.

I think all the draw games is a big problem in SF development. With better optimations you can see very easy how strong SF can be ...

Code: Select all

   # PLAYER                           : RATING  ERROR   POINTS  PLAYED    (%)
   1 Stockfish 26.04.15 BMI2 x64      : 3170.9   34.3    345.0     408   84.6%
   2 Komodo 9 x64                     : 3142.1   32.3    353.0     429   82.3%
   3 Stockfish 6 BMI2 x64             : 3135.5   16.6   1424.0    1700   83.8%
   4 Komodo 8 x64                     : 3105.3   15.6   1375.5    1700   80.9%
We can see the different is 28,8 Elo and not 9 Elo.

With others words ...
Komodo can make +20 Elo with avoid draw games.

OK, the question is ...
If I avoid draw more lost games will be the result. So I must calculate / simulate all in ratio to more lost games. In this case I must added to the simulation after I delete 21 draw games 2 lost games (will be the ratio result). The differenz is 23 Elo and the final result is the same as with SF predecessor versions ... again and again SF lost 15 Elo.

+ 15 Elo if SF comes with better standard settings in avoid fast draw games.
That result is since a while allways the same. And I am not happy with the contemp settings SF have. I try it out for a while with Contemp = 17 and I can't see a better result as without Contemp.

Best
Frank

Without all the draw games it seems SF actual dev. is around 25 Elo stronger. This should around the results in testing with stronger opponents only ... maybe 20 Elo without to chance anything with avoid short draw games.