Stockfish 1.4 in the MGV77 test

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Vinvin
Posts: 5297
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Stockfish 1.4 in the MGV77 test

Post by Vinvin »

The MGV 77 is a test suite from super grand master games, downloadable here : http://www.computerschach.de/index.php? ... info&id=82

Here are the results for Stockfish 1.4 on my AMD 4200+ (2.2 Ghz), 10 min per position (= about 3 min on an Intel Q6600 2.4 Ghz)

50 of 77 solved ! Very good, this test was very hard 2 years ago ...

The complete log is here : http://home.scarlet.be/vincentlejeune/S ... D4200+.log

I plan to run the suite with Grapefruit 1.0beta next night ...

Code: Select all

Analysis from D:\echecs\positions\mgv77\mgv77.epd   
Analyzing engine: Stockfish_14_ja
  1) Ng3-f5             Qf3-d3   
  2) b2-b3              b2-b3   * 6 Seconds
  3) .. Bf8-d6          Ba8xg2   
  4) Ne2-d4             Ne2-d4  * 119 Seconds
  5) .. e6-e5           e6-e5   * 580 Seconds
  6) .. Bf8-h6          Nd7xf6   
  7) Rb1-c1             Rb1-c1  * 1 Second
  8) .. Ra8-a6          Ra8-a6  * 60 Seconds
  9) Bh7-g6             Bh7-g6  * 11 Seconds
 10) Ng4-f6             Ng4-f6  * 35 Seconds
 11) Ne5-g4             Ne5-g4  * 128 Seconds
 12) g3-g4              g3-g4   * 16 Seconds
 13) Re8xe5             Re8-e7   
 14) f4-f5              Bg2-f3   
 15) Be3-c5             Be3-c5  * 12 Seconds
 16) .. f6xg5           Bb7-a8   
 17) Nf3-e5             Nf3-e5  * 1 Second
 18) Bf1-b5             Rd8xe8   
 19) Nc3-b5             Nc3-b5  * 9 Seconds
 20) Qe2-c4             Qe2-c4  * 45 Seconds
 21) Rd4-h4             Rd4-h4  * 236 Seconds
 22) a4-a5              b5xa6    
 23) .. Ne7-d5          Ne7-d5  * 330 Seconds
 24) Nd3-e1             Nd3-e1  * 92 Seconds
 25) Ra4-h4             Ra4-h4  * 139 Seconds
 26) Nh4xg6             Nh4xg6  * 163 Seconds
 27) Ng5xf7             Ng5xf7  * 108 Seconds
 28) b3-b4              a2-a3    
 29) .. g6-g5           Rd6-b6   
 30) Bc1-g5             Bc1-g5  * 292 Seconds
 31) Rf3-f8             Rf3-f8  * 14 Seconds
 32) Qf3-f6             Qf3-f4   
 33) .. Nf6xe4          Nf6xe4  * 58 Seconds
 34) Bd2xg5             Nf3xg5   
 35) Nd4-c6             Nc3-d1   
 36) Ke3-e4             Ke3-e4  * 17 Seconds
 37) .. Nd4xf3          Nd4xf3  * 22 Seconds
 38) Be2xh5             Be2xh5  * 28 Seconds
 39) Nc3-b5             h4-h5    
 40) .. Rd8xd2          Rd8xd2  * 441 Seconds
 41) a5-a6              a5-a6   * 59 Seconds
 42) Rh4-h8             Rh4-h8  * 71 Seconds
 43) b3-b4              Qd5-e6   
 44) Nd4xe6             Nd4xe6  * 50 Seconds
 45) .. Nc6-e5          Qe3xa3   
 46) Bg1-d4             Bg1-d4  * 15 Seconds
 47) f2-f4              f2-f4   * 67 Seconds
 48) .. Rc6xb6          Bd6-h2   
 49) Nb3xc5             Nb3xc5  * 13 Seconds
 50) Ra1-c1             e5-e6    
 51) .. Nf6-g4          Nf6-g4  * 49 Seconds
 52) .. Re4xe3          Re4xd4   
 53) .. e6-e5           e6-e5   * 31 Seconds
 54) e2-e4              e2-e4   * 102 Seconds
 55) .. g5-g4           Nc6-b4   
 56) .. Ra8-a6          Ne7-g8   
 57) Ra2xc2             Qe3-g3   
 58) Bd3xh7             Bd3xh7  * 121 Seconds
 59) Rd6-f6             Rd6-f6  * 18 Seconds
 60) Na4-b6             Na4-b6  * 0 Seconds
 61) .. Rf6xf3          Rf6xf3  * 129 Seconds
 62) Kg1-g2             Rc1-d1   
 63) g3-g4              g3-g4   * 6 Seconds
 64) Bb4-a3             Bb4-a3  * 81 Seconds
 65) Rf1xf7             Rf1xf7  * 355 Seconds
 66) h2-h4              h2-h4   * 32 Seconds
 67) Ne4-c5             Ne4-c5  * 0 Seconds
 68) Bg2-f1             Rc1xa1   
 69) Bf1-c4             a3-a4    
 70) Ne4-f6             Ne4-d6   
 71) Rd4-b4             Nd3-c5   
 72) Nd3-e1             Nd3-e1  * 55 Seconds
 73) Be2-g4             Be2-g4  * 332 Seconds
 74) Bg5xh6             Bg5xh6  * 33 Seconds
 75) c4-c5              c4-c5   * 558 Seconds
 76) .. Ra8-a6          Ra8-a6  * 48 Seconds
 77) h2-h4              h2-h4   * 393 Seconds
50 of 77 matching moves
3/08/2009 14:48:35, Total time: 12:51:16 Rated time: 6:03:01 = 21781 Seconds
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Stockfish 1.4 in the MGV77 test

Post by yanquis1972 »

exactly how does one give an engine a test suite? i have chessbase, arena, & aquarium gui's but i've never been able to figure this out.
Vinvin
Posts: 5297
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Stockfish 1.4 in the MGV77 test

Post by Vinvin »

Take Arena 1.1, go to the menu EPD->analyse, set the file, check EPD/all positions, choose the engine and set the 2 output files !
Very easy with the good tool ;-)

My best,
Vincent
Dann Corbit
Posts: 12792
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Stockfish 1.4 in the MGV77 test

Post by Dann Corbit »

I get an error message trying to download the test suite.
Can someone send me a copy in EPD format via email?
Dann Corbit
Posts: 12792
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Stockfish 1.4 in the MGV77 test

Post by Dann Corbit »

I have a copy now.
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Stockfish 1.4 in the MGV77 test

Post by yanquis1972 »

im also getting an error message of some sort.
Dann Corbit
Posts: 12792
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Stockfish 1.4 in the MGV77 test

Post by Dann Corbit »

yanquis1972 wrote:im also getting an error message of some sort.
Turns out, I already had a copy. Anyway, I refreshed from the file I was sent. Here is a bzip2 compressed version of it:
http://cap.connx.com/EPD/mgv77.epd.bz2
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Stockfish 1.4 in the MGV77 test

Post by yanquis1972 »

hmm, is this similarly easy w/ arena 2? it doesn't have 'analyze' under the epd menu.
Dann Corbit
Posts: 12792
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Stockfish 1.4 in the MGV77 test

Post by Dann Corbit »

yanquis1972 wrote:hmm, is this similarly easy w/ arena 2? it doesn't have 'analyze' under the epd menu.
Try "Engines" / "Automatic Analysis"
BubbaTough
Posts: 1154
Joined: Fri Jun 23, 2006 5:18 am

Re: Stockfish 1.4 in the MGV77 test

Post by BubbaTough »

yanquis1972 wrote:hmm, is this similarly easy w/ arena 2? it doesn't have 'analyze' under the epd menu.
It is under the engine menu: automated Analysis

-Sam