stockfish question

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Uri Blass
Posts: 10267
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

stockfish question

Post by Uri Blass »

I downloaded today stockfish and found 2 files when one is default and one is optimistic.

I see no explanation in the readme what is default and what is optimistic
and I also see no explanation which version is best based on testing.

I remember from reading this forum that CEGT tested some version that is probably not the best and I wonder what is the best version.

I wonder what is 1.2def in CEGT and what is the best version.

The file that I downloaded is stockfish-12_ja from the following site
http://www.mediafire.com/?5z2iyoznijm

Uri
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: stockfish question

Post by Graham Banks »

Stockfish 1.2 Default was the one originally recommended for testing first, so both CEGT and CCRL have tested that version first.
Since then, the "author" has recommended the optimistic version as being stronger.
gbanksnz at gmail.com
Uri Blass
Posts: 10267
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: stockfish question

Post by Uri Blass »

Graham Banks wrote:Stockfish 1.2 Default was the one originally recommended for testing first, so both CEGT and CCRL have tested that version first.
Since then, the "author" has recommended the optimistic version as being stronger.
Thanks

Are there result or rating for the optimistic version?

looking at the Glaurung blitz CCRL rating list for 5.3 I cannot even find Stockfish1.2 and there is no 40/40 list for march(the live link even give older list)

http://www.computerchess.org.uk/ccrl/40 ... +opponents


http://www.computerchess.org.uk/ccrl/40 ... t_all.html is only from 14.2 when the non live list is from from 27.2
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: stockfish question

Post by Graham Banks »

Uri Blass wrote:
Graham Banks wrote:Stockfish 1.2 Default was the one originally recommended for testing first, so both CEGT and CCRL have tested that version first.
Since then, the "author" has recommended the optimistic version as being stronger.
Thanks

Are there result or rating for the optimistic version?

looking at the Glaurung blitz CCRL rating list for 5.3 I cannot even find Stockfish1.2 and there is no 40/40 list for march(the live link even give older list)

http://www.computerchess.org.uk/ccrl/40 ... +opponents


http://www.computerchess.org.uk/ccrl/40 ... t_all.html is only from 14.2 when the non live list is from from 27.2
I don't think we've tested the optimistic version yet.

Regarding the live link, Kirill has taken over the updates from Ray and there are only once a week updates at this stage. Try refreshing the live link and you should still get the most recent update?

Cheers, Graham.
gbanksnz at gmail.com
User avatar
Werner
Posts: 2871
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: stockfish question

Post by Werner »

Hi Uri,
we normally test the default version only or the version which the author recommends against engines. Of course this is no rule - testers in CEGT can test the versions they like :wink:

P.S.

any news on Movei?
Are you still working on the engine?

best
Werner
ernest
Posts: 2041
Joined: Wed Mar 08, 2006 8:30 pm

Re: stockfish question

Post by ernest »

I only tested Stockfish 1.2 optimistic, it is stronger than Glaurung 2.2

But in this direct match against Glaurung 2.2,
in Fritz11 GUI, with the 30 Noomen2006 test openings and 4'+2" time control,
Stockfish won +19 -14 =27 32.5-26.5
but lost 3 games through immediate blunders/bugs
(of course none of them were reproducible)

That's why, Graham, I downloaded your "CCRL 40/40" Stockfish_1_2_Default.commented.[164].pgn file but could not find any bugs there.

Here are my 3 buggy games:

[Event "Stockfish 1.2 opt 64-b 2cpu - Glaurung "]
[Site "BONNEM-PC"]
[Date "2009.02.12"]
[Round "17"]
[White "Stockfish 1.2"]
[Black "Glaurung 2.2 JA 64-bit"]
[Result "0-1"]
[ECO "B19"]
[Annotator "0.31;0.27"]
[PlyCount "48"]
[TimeControl "240+2"]

{Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz 3000 MHz W=16.6 plies; 2
492kN/s B=17.0 plies; 3 145kN/s} 1. e4 c6 2. d4 d5 3. Nc3 dxe4 4. Nxe4 Bf5 5.
Ng3 Bg6 6. h4 h6 7. Nf3 Nd7 8. h5 Bh7 9. Bd3 Bxd3 10. Qxd3 e6 11. Bf4 Ngf6 12.
O-O-O Be7 13. Kb1 O-O 14. Ne4 {Both last book move} Nxe4 {[%eval 27,16] [%emt
0:00:11]} 15. Qxe4 {[%eval 31,13] [%emt 0:00:01]} Nf6 {[%eval 21,17] [%emt 0:
00:21]} 16. Qe2 {[%eval 15,16] [%emt 0:00:13] (Qd3)} Qd5 {[%eval 15,16] [%emt
0:00:09]} 17. Ne5 {[%eval 25,16] [%emt 0:00:07]} Qe4 {[%eval 13,17] [%emt 0:00:
10]} 18. Qxe4 {[%eval 15,17] [%emt 0:00:11]} Nxe4 {[%eval 13,15] [%emt 0:00:01]
} 19. Nd3 {[%eval 17,18] [%emt 0:00:13] (Be3)} Nf6 {[%eval 23,18] [%emt 0:00:
09]} 20. c3 {[%eval 19,18] [%emt 0:00:07]} Rfd8 {[%eval 19,18] [%emt 0:00:09]}
21. Kc2 {[%eval 15,17] [%emt 0:00:10] (Be5)} Rac8 {[%eval 13,17] [%emt 0:00:08]
(Rd5)} 22. Bd6 {[%eval -737,18] [%emt 0:00:06] (Be5)} Bxd6 {[%eval -445,17]
[%emt 0:00:07] (a8Q)} 23. d5 {[%eval -1766,16] [%emt 0:00:10] (Rh4)} cxd5 {
[%eval -652,16] [%emt 0:00:09] (a8Q)} 24. Kb1 {[%eval -1907,17] [%emt 0:00:06]
(Nc1)} Rc4 {[%eval -690,18] [%emt 0:00:06] (a8Q)} 0-1

[Event "Stockfish 1.2 opt 64-b 2cpu - Glaurung "]
[Site "BONNEM-PC"]
[Date "2009.02.12"]
[Round "25"]
[White "Stockfish 1.2"]
[Black "Glaurung 2.2 JA 64-bit"]
[Result "0-1"]
[ECO "C13"]
[Annotator "-2.76;-2.76"]
[PlyCount "30"]
[TimeControl "240+2"]

{Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz 3000 MHz W=17.5 plies; 2
508kN/s B=17.5 plies; 3 129kN/s} 1. e4 e6 2. d4 d5 3. Nc3 Nf6 4. Bg5 dxe4 5.
Nxe4 Be7 6. Bxf6 gxf6 7. Nf3 a6 8. g3 b5 9. Bg2 Bb7 10. Qe2 Nd7 11. O-O O-O {
Both last book move} 12. Nxf6+ {[%eval -276,15] [%emt 0:00:11]} Nxf6 {[%eval
-276,15] [%emt 0:00:11]} 13. Ne5 {[%eval -925,18] [%emt 0:00:12] (Rad1)} Bxg2 {
[%eval -386,18] [%emt 0:00:08] (h8Q)} 14. Nxf7 {[%eval -1066,18] [%emt 0:00:10]
(Kxg2)} Bxf1 {[%eval -1078,17] [%emt 0:00:08]} 15. Nxd8 {[%eval -1086,18]
[%emt 0:00:12] (Nh6+)} Bxe2 {[%eval -1086,19] [%emt 0:00:04]} 0-1

[Event "Stockfish 1.2 opt 64-b 2cpu - Glaurung "]
[Site "BONNEM-PC"]
[Date "2009.02.13"]
[Round "29"]
[White "Stockfish 1.2"]
[Black "Glaurung 2.2 JA 64-bit"]
[Result "0-1"]
[ECO "C42"]
[Annotator "0.03;0.17"]
[PlyCount "44"]
[TimeControl "240+2"]

{Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz 3000 MHz W=17.0 plies; 2
253kN/s B=16.9 plies; 2 857kN/s} 1. e4 e5 2. Nf3 Nf6 3. Nxe5 d6 4. Nf3 Nxe4
5. d4 d5 6. Bd3 Nc6 7. O-O Be7 8. c4 Nb4 9. Be2 O-O 10. Nc3 Bf5 11. a3 Nxc3 12.
bxc3 Nc6 13. Re1 Re8 14. cxd5 Qxd5 15. Bf4 Rac8 {Both last book move} 16. c4 {
[%eval 3,16] [%emt 0:00:11]} Qe4 {[%eval 17,16] [%emt 0:00:11]} 17. Bf1 {
[%eval -488,17] [%emt 0:00:10] (Be3)}
Qxf4 {[%eval -449,17] [%emt 0:00:11]
(h8Q)} 18. g3 {[%eval -566,17] [%emt 0:00:11] (d5)} Qd6 {[%eval -476,17] [%emt
0:00:10] (h8Q)} 19. c5 {[%eval -568,16] [%emt 0:00:08] (d5)} Qf6 {[%eval -562,
16] [%emt 0:00:08]} 20. Re6 {[%eval -1370,17] [%emt 0:00:10] (Bg2)} Bxe6 {
[%eval -1376,16] [%emt 0:00:10]} 21. d5 {[%eval -2256,17] [%emt 0:00:09] (Rc1)}
Rcd8 {[%eval -1603,16] [%emt 0:00:10] (h8Q)} 22. dxe6 {[%eval -2133,17] [%emt
0:00:10] (d6)} Rxd1 {[%eval -1735,16] [%emt 0:00:02] (h8Q)} 0-1
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: stockfish question

Post by Graham Banks »

ernest wrote:I only tested Stockfish 1.2 optimistic, it is stronger than Glaurung 2.2

But in this direct match in Fritz11 GUI, with the 30 Noomen2006 test openings and 4'+2" time control,
Stockfish won +19 -14 =27 32.5-26.5
but lost 3 games through immediate blunders/bugs
(of course none of them were reproducible)

That's why, Graham, I downloaded your "CCRL 40/40" Stockfish_1_2_Default.commented.[164].pgn file but could not find any bugs there.
Hi Ernest,

thanks for checking those games. I was pretty confident that they were all okay.
I'm wondering whether Stockfish performs relatively better at blitz than longer time controls?

Cheers, Graham.
gbanksnz at gmail.com
Uri Blass
Posts: 10267
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: stockfish question

Post by Uri Blass »

Werner wrote:Hi Uri,
we normally test the default version only or the version which the author recommends against engines. Of course this is no rule - testers in CEGT can test the versions they like :wink:

P.S.

any news on Movei?
Are you still working on the engine?

best
I did not work lately on movei and based on this forum the author of stockfish recommended the optimistic version.
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: stockfish question

Post by Graham Banks »

Uri Blass wrote:based on this forum the author of stockfish recommended the optimistic version.
Correct in a way. Here is what Marco posted:
Stockfish 1.2 Optimistic is probably the strongest and has an aggressive play but sometime it is weak with lower rated engines.

Stockfish 1.2 Default is my favorite, it has a more solid play and makes less mistakes and my guess is that at longer time controls should be good.
gbanksnz at gmail.com
mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

Re: stockfish question

Post by mcostalba »

Graham Banks wrote:
Uri Blass wrote:based on this forum the author of stockfish recommended the optimistic version.
Correct in a way. Here is what Marco posted:
Stockfish 1.2 Optimistic is probably the strongest and has an aggressive play but sometime it is weak with lower rated engines.

Stockfish 1.2 Default is my favorite, it has a more solid play and makes less mistakes and my guess is that at longer time controls should be good.
Yes, it is.

The point here is that I was NOT able to test al longer time control and with an opponent's pool as Graham and others do.

I have tested at blitz time and in my tests optimistic is stronger. But because the difference between the two versions is that optimistic has a more aggressive futility pruning setup (hence the name) and I had no data at longer time controls AND the previous versions of Stockfish where weaker then expected at these time controls I tried to be conservative and raccomended the default.

Now that "default" has proven at least not worst then previous versions, I am more optimistic also myself :-) and believe "optimistic" could be stronger.

As example in the new version of Stockfish, now in development, I am using the "optimistic" setup.