Testing new compiles of Stockfish.

[Tomcass]

201202Stockfish221Ofry(x6b)-1 2012

I7 980 3.33 Ghz.
6 real cores GUI
Stockfish NO SSE
Fritz 12
Book: Perfect 2012
Time control: 2 min + 2 sec/ game.

Stockfish 2.2.1 ofry 64bitx6 - Critter 1.4a 64-bit SSE4(x6) 10.5 - 9.5 +2/=17/-1 52.50%
Stockfish 2.2.1 ofry 64bitx6 - Deep Rybka 4.1 SSE42 x64 (x6) 10.0 - 10.0 +5/=10/-5 50.00%
Stockfish 2.2.1 ofry 64bitx6 - Houdini 2.0c Pro x64(x6) 7.0 - 13.0 +5/=4/-11 35.00%
60 GAMES: mediafire.com 4js7jlhnjtt29wn

201202Stock221Offryb-1 2012

i7 9750 3.33 Ghz.
4 real cores
Stockfish NO SSE
GUI: Fritz 12
Book: Masterbook 3.1
Time control: 2MIN + 2 SEC/game.
Ponder: Off.

Stockfish 2.2.1 ofry 64bitx4 - Critter 1.4 64-bit SSE4(x4) 11.5 - 8.5 +6/=11/-3 57.50%
Stockfish 2.2.1 ofry 64bitx4 - Deep Rybka 4.1 SSE42 x64(x4) 9.0 - 11.0 +3/=12/-5 45.00%
Stockfish 2.2.1 ofry 64bitx4 - Houdini 2.0c Pro x64(x4) 9.0 - 11.0 +5/=8/-7 45.00%

60 GAMES: mediafire.com xaajkes43ou1dbe

GLOBAL RESULTS 120 GAMES AT 2 MIN + 2 SEC /GAME:

Stockfish 2.2.1 ofry 64bitx6 - Critter 1.4 64-bit SSE4 22.0 – 18.0 +8/=28/-4 55.00%
Stockfish 2.2.1 ofry 64bitx6 - Deep Rybka 4.1 SSE42 x64 19.0 - 21.0 +8/=22/-10 47.50%
Stockfish 2.2.1 ofry 64bitx6 - Houdini 2.0c Pro x64 16.0 - 24.0 +10/=12-18 40.00%

ONLY AS A COMPARISON, HERE YOU HAVE THE SAME TEST WITH 120 GAMES AT 5 MINUTES/GAME TIME CONTROL

Stockfish 2.2.1 ofry 64bit - Critter 1.4a 64-bit SSE4 16.5 - 23.5 +6/=21/-13 41.25%
Stockfish 2.2.1 ofry 64bit - Deep Rybka 4.1 SSE42 x64 20.0 - 20.0 +7/=26/-7 50.00%
Stockfish 2.2.1 ofry 64bit - Houdini 2.0c Pro x64 13.5 - 26.5 +4/=19/-17 33.75%

The performance of this compile is much better with incremental time control.

Regards from Barcelona.

Tom.

[geots]

201202Stockfish221Ofry(x6b)-1 2012

I7 980 3.33 Ghz.
6 real cores GUI
Stockfish NO SSE
Fritz 12
Book: Perfect 2012
Time control: 2 min + 2 sec/ game.

Stockfish 2.2.1 ofry 64bitx6 - Critter 1.4a 64-bit SSE4(x6) 10.5 - 9.5 +2/=17/-1 52.50%
Stockfish 2.2.1 ofry 64bitx6 - Deep Rybka 4.1 SSE42 x64 (x6) 10.0 - 10.0 +5/=10/-5 50.00%
Stockfish 2.2.1 ofry 64bitx6 - Houdini 2.0c Pro x64(x6) 7.0 - 13.0 +5/=4/-11 35.00%
60 GAMES: mediafire.com 4js7jlhnjtt29wn

201202Stock221Offryb-1 2012

i7 9750 3.33 Ghz.
4 real cores
Stockfish NO SSE
GUI: Fritz 12
Book: Masterbook 3.1
Time control: 2MIN + 2 SEC/game.
Ponder: Off.

Stockfish 2.2.1 ofry 64bitx4 - Critter 1.4 64-bit SSE4(x4) 11.5 - 8.5 +6/=11/-3 57.50%
Stockfish 2.2.1 ofry 64bitx4 - Deep Rybka 4.1 SSE42 x64(x4) 9.0 - 11.0 +3/=12/-5 45.00%
Stockfish 2.2.1 ofry 64bitx4 - Houdini 2.0c Pro x64(x4) 9.0 - 11.0 +5/=8/-7 45.00%

60 GAMES: mediafire.com xaajkes43ou1dbe

GLOBAL RESULTS 120 GAMES AT 2 MIN + 2 SEC /GAME:

Stockfish 2.2.1 ofry 64bitx6 - Critter 1.4 64-bit SSE4 22.0 – 18.0 +8/=28/-4 55.00%
Stockfish 2.2.1 ofry 64bitx6 - Deep Rybka 4.1 SSE42 x64 19.0 - 21.0 +8/=22/-10 47.50%
Stockfish 2.2.1 ofry 64bitx6 - Houdini 2.0c Pro x64 16.0 - 24.0 +10/=12-18 40.00%

ONLY AS A COMPARISON, HERE YOU HAVE THE SAME TEST WITH 120 GAMES AT 5 MINUTES/GAME TIME CONTROL

Stockfish 2.2.1 ofry 64bit - Critter 1.4a 64-bit SSE4 16.5 - 23.5 +6/=21/-13 41.25%
Stockfish 2.2.1 ofry 64bit - Deep Rybka 4.1 SSE42 x64 20.0 - 20.0 +7/=26/-7 50.00%
Stockfish 2.2.1 ofry 64bit - Houdini 2.0c Pro x64 13.5 - 26.5 +4/=19/-17 33.75%

The performance of this compile is much better with incremental time control.

Regards from Barcelona.

Tom.

Man alive, is this some good work or what? For posting results, I am sort of a neatness junkie- and mine always seem to need something I don't give them to add that touch.

Plus the cores you have available, and always a plan in mind that comes together in the end with good info.

I hope you don't mind if I am just a slight bit jealous, Tom.



Keep it up and best regards,

george

[Tomcass]

Apologies for this long post. I have been testing intensively for the latest weeks, but not found time to post the results untill now.

Testing Stockfish : 720 games.

All tests below have been run under the following conditions:

i7 980 3.33 Ghz.
6 real cores GUI
Fritz 12
Book: Perfect 2012
Time control: 5 minutes and 2 minutes +2 sec/ game.

201202Stockfish12020MING_PP 5min

Stockfish 222h P(x6)M - Critter 1.4a 64-bit SSE4(x6) 8.5 - 11.5 +5/=7/-8 42.50%
Stockfish 222h P(x6)M - Deep Rybka 4.1 SSE42 x64 (x6) 9.0 - 11.0 +3/=12/-5 45.00%
Stockfish 222h P(x6)M - Houdini 2.0c Pro x64(x6) 4.5 - 15.5 +1/=7/-12 22.50%

201202Stockfish120213PP(x6) 2012 5 min.

Stockfish 120213 Px6 - Critter 1.4a 64-bit SSE4(x6) 7.5 - 12.5 +4/=7/-9 37.50%
Stockfish 120213 Px6 - Deep Rybka 4.1 SSE42 x64 (x6) 11.0 - 9.0 +5/=12/-3 55.00%
Stockfish 120213 Px6 - Houdini 2.0c Pro x64(x6) 4.5 - 15.5 +1/=7/-12 22.50%

201202StockfishV7Ofry 2012 5 min.

Stockfish 2.2.1 ofry Px6 - Critter 1.4a 64-bit SSE4(x6) 8.5 - 11.5 +3/=11/-6 42.50%
Stockfish 2.2.1 ofry Px6 - Deep Rybka 4.1 SSE42 x64 (x6) 8.0 - 12.0 +2/=12/-6 40.00%
Stockfish 2.2.1 ofry Px6 - Houdini 2.0c Pro x64(x6) 5.0 - 14.0 +2/=6/-11 26.32%

201202StockfishV7Ofry 2min +2 2012

Stockfish 2.2.1 ofry Px6 - Critter 1.4a 64-bit SSE4(x6) 7.5 - 12.5 +1/=13/-6 37.50%
Stockfish 2.2.1 ofry Px6 - Deep Rybka 4.1 SSE42 x64 (x6) 7.0 - 13.0 +2/=10/-8 35.00%
Stockfish 2.2.1 ofry Px6 - Houdini 2.0c Pro x64(x6) 7.0 - 11.0 +4/=6/-8 38.89%

201202StockfishV9Ofry2+2 2012

Stockfish 2.2.1 ofry Pv9x6 - Critter 1.4a 64-bit SSE4(x6) 6.5 - 13.5 +2/=9/-9 32.50%
Stockfish 2.2.1 ofry Pv9x6 - Deep Rybka 4.1 SSE42 x64 (x6) 7.0 - 13.0 +1/=12/-7 35.00%
Stockfish 2.2.1 ofry Pv9x6 - Houdini 2.0c Pro x64(x6) 9.0 - 11.0 +4/=10/-6 45.00%

201202StockfishV12Ofry2+2 2012

Stockfish 2.2.1 ofry Px6INTEL - Critter 1.4a 64-bit SSE4(x6) 10.0 - 10.0 +5/=10/-5 50.00%
Stockfish 2.2.1 ofry Px6INTEL - Deep Rybka 4.1 SSE42 x64 (x6) 7.5 - 12.5 +3/=9/-8 37.50%
Stockfish 2.2.1 ofry Px6INTEL - Houdini 2.0c Pro x64(x6) 7.5 - 12.5 +2/=11/-7 37.50%

Not great results overall with six real cores, to be honest. The best one obtained by Ofry’s V12 with 25.0 in 60 games. (41,66%) but ...

------------------------------------------------------
All tests below have been run under the following conditions:

i7 9750 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Masterbook 3.1
Time control: 5 MIN and 2MIN + 2 SEC/game.

201202Stock222_MING_PP_SSE 5 min

Stockfish 222h P(x4) - Critter 1.4a 64-bit SSE4x4 8.5 - 11.5 +3/=11/-6 42.50%
Stockfish 222h P(x4) - Deep Rybka 4.1 SSE42 x64(x4) 10.0 - 10.0 +4/=12/-4 50.00%
Stockfish 222h P(x4) - Houdini 2.0c Pro x64(x4) 4.5 - 15.5 +0/=9/-11 22.50%

201202Stock222_MING_PP_120213 5 min.

Stockfish 222h Px4 - Critter 1.4a 64-bit SSE4x4 9.5 - 10.5 +4/=11/-5 47.50%
Stockfish 222h Px4 - Deep Rybka 4.1 SSE42 x64(x4) 10.5 - 9.5 +8/=5/-7 52.50%
Stockfish 222h Px4 - Houdini 2.0c Pro x64(x4) 6.5 - 13.5 +3/=7/-10 32.50%

201202Stock221Offryv7 2012 5 min

Stockfish 2.2.1 ofry v7x4 - Critter 1.4a 64-bit SSE4x4 9.0 - 11.0 +2/=14/-4 45.00%
Stockfish 2.2.1 ofry v7x4 - Deep Rybka 4.1 SSE42 x64(x4) 8.5 - 11.5 +4/=9/-7 42.50%
Stockfish 2.2.1 ofry v7x4 - Houdini 2.0c Pro x64(x4) 6.0 - 14.0 +2/=8/-10 30.00%

201202Stock221Offryv7_2+2 2012

Stockfish 2.2.1 ofry v7x4 - Critter 1.4a 64-bit SSE4x4 8.5 - 11.5 +2/=13/-5 42.50%
Stockfish 2.2.1 ofry v7x4 - Deep Rybka 4.1 SSE42 x64(x4) 9.5 - 10.5 +4/=11/-5 47.50%
Stockfish 2.2.1 ofry v7x4 - Houdini 2.0c Pro x64(x4) 10.0 - 10.0 +3/=14/-3 50.00%

201202Stock221Offryv9AMD_2+2 2012

Stockfish 2.2.1 ofry Pv9AMDx4 - Critter 1.4a 64-bit SSE4x4 10.0 - 10.0 +4/=12/-4 50.00%
Stockfish 2.2.1 ofry Pv9AMDx4 - Deep Rybka 4.1 SSE42 x64(x4) 8.5 - 11.5 +1/=15/-4 42.50%
Stockfish 2.2.1 ofry Pv9AMDx4 - Houdini 2.0c Pro x64(x4) 9.5 - 10.5 +6/=7/-7 47.50%

201202Stock221Offryv12AMD_2+2 2012

Stockfish 2.2.1 ofry Px4AMD - Critter 1.4a 64-bit SSE4x4 10.5 - 9.5 +4/=13/-3 52.50%
Stockfish 2.2.1 ofry Px4AMD - Deep Rybka 4.1 SSE42 x64(x4) 10.0 - 10.0 +5/=10/-5 50.00%
Stockfish 2.2.1 ofry Px4AMD - Houdini 2.0c Pro x64(x4) 9.0 - 11.0 +3/=12/-5 45.00%

... the results are much better with 4 real cores and 2+2 time control. The best one, Ofry's V12 AMD (29.5 in 60 games= 49,16%).

Games not attached, but available to anyone who wanted any specific test.

Regards from Barcelona.

Tom

[Tomcass]

i7 9750 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Masterbook 3.1
Time control: 2 minutes + 2 sec/game.
Ponder: Off.
No tablebases

201202Stock222Ofryv2INT_2+2 2012

Stockfish 2.2.2 ofry Pv2INT - Critter 1.4a 64-bit SSE4x4 10.0 - 10.0 +3/=14/-3 50.00%
Stockfish 2.2.2 ofry Pv2INT - Deep Rybka 4.1 SSE42 x64(x4) 11.0 - 9.0 +4/=14/-2 55.00%
Stockfish 2.2.2 ofry Pv2INT - Houdini 2.0c Pro x64(x4) 9.5 - 10.5 +3/=13/-4 47.50%

games: http://www.mediafire.com/?dbt5kk25a8dyle8

50.83%

201202Stock222Ofryv2AMD_2+2 2012

Stockfish 2.2.2 ofry Pv2AMD - Critter 1.4a 64-bit SSE4x4 9.5 - 10.5 +3/=13/-4 47.50%
Stockfish 2.2.2 ofry Pv2AMD - Deep Rybka 4.1 SSE42 x64(x4) 9.0 - 11.0 +2/=14/-4 45.00%
Stockfish 2.2.2 ofry Pv2AMD - Houdini 2.0c Pro x64(x4) 7.0 - 13.0 +2/=10/-8 35.00%

games: http://www.mediafire.com/?q6kkx7921i1706l

42.50%

GLOBAL RESULTS FOR Stockfish 2.2.2 Ofry P version 2 - 120 games. 4 REAL CORES.

Stockfish 2.2.2 ofry Pv2 - Critter 1.4a 64-bit SSE4x4 19.5 - 20.5 +6/=27/-7 48.75%
Stockfish 2.2.2 ofry Pv2 - Deep Rybka 4.1 SSE42 x64(x4) 20.0 - 20.0 +6/=28/-6 50.00%
Stockfish 2.2.2 ofry Pv2 - Houdini 2.0c Pro x64(x4) 16.5 - 23.5 +5/=23/-12 41.25%

Average result: 46.67%


I7 980 3.33 Ghz.
6 real cores GUI
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 minutes +2 sec/ game.
Ponder: Off
No tablebases



201203StockfishV2OfryAMD2+2 2012

Stockfish 2.2.2 ofry Pv2AMD - Critter 1.4a 64-bit SSE4(x6) 9.5 - 10.5 +5/=9/-6 47.50%
Stockfish 2.2.2 ofry Pv2AMD - Deep Rybka 4.1 SSE42 x64 (x6) 13.0 - 7.0 +9/=8/-3 65.00%
Stockfish 2.2.2 ofry Pv2AMD - Houdini 2.0c Pro x64(x6) 9.0 - 11.0 +3/=12/-5 45.00%

games: http://www.mediafire.com/?nz6qqe44gl8nsr0

52.50%

201203StockfishV2OfryINT2+2 2012

Stockfish 2.2.2 ofry Pv2INT - Critter 1.4a 64-bit SSE4(x6) 6.5 - 13.5 +1/=11/-8 32.50%
Stockfish 2.2.2 ofry Pv2INT - Deep Rybka 4.1 SSE42 x64 (x6) 11.5 - 8.5 +6/=11/-3 57.50%
Stockfish 2.2.2 ofry Pv2INT - Houdini 2.0c Pro x64(x6) 8.5 - 11.5 +2/=13/-5 42.50%

games: http://www.mediafire.com/?kpg66p0d3kc36c7

44.17%

GLOBAL RESULTS FOR Stockfish 2.2.2 Ofry P version 2 - 120 games. 6 REAL CORES.

Stockfish 2.2.2 ofry Pv2 - Critter 1.4a 64-bit SSE4(x6) 16.0 - 24.0 +6/=20/-14 40.00%
Stockfish 2.2.2 ofry Pv2 - Deep Rybka 4.1 SSE42 x64 (x6) 24.5 -15.5 +15/=17/-6 61.25%
Stockfish 2.2.2 ofry Pv2 - Houdini 2.0c Pro x64(x6) 17.5 – 22.5 +3/=12/-5 43.75%

Average result: 48.33%

Some surprising results, with a clear difference between AMD and INTEL versions. In my quad (4 real cores no HT) the Intel version gets a 50.83% against the three top engines, but AMB version is much worse (only 42.50%).

On the other hand, using 6 real cores, the AMD version gets an impressive 52.50%, whereas INTEL gets a mere 44.17%.

I will repeat the tests fot INTEL 4 cores and AMD 6 cores to minimize the statistical effect. But by know, very promising results for the tandem Ofry + Peterpan. Very well done!!.

Regards from Barcelona.

Tom

[Tomcass]

I7 980 3.33 Ghz.
Critter, Houdini, Deep Rybka 6 real cores - NO HT
Stockfish 6 real cores + 2 HT
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 minutes +2 sec/ game.
Ponder: Off
No tablebases

201202StockfishV13OfryINT(x8)2+2.bis120 2012 : 119 GAMES.

Stockfish 2.2.1 ofry v13 PIx8 - Critter 1.4a 64-bit SSE4(x6) 21.5 - 18.5 +10/=23/-7 53.75%
Stockfish 2.2.1 ofry v13 PIx8 - Deep Rybka 4.1 SSE42 x64 (x6) 19.5 - 20.5 +6/=27/-7 48.75%
Stockfish 2.2.1 ofry v13 PIx8 - Houdini 2.0c Pro x64(x6) 17.0 - 22.0 +8/=18/-13 43.59%

Average result: 48,74%

http://www.mediafire.com/?68l4kmrhg5wm0ap

I will repeat the test to confirm -or not!- the result and minimize the statistical noise. Globaly I expect around 50% both against Critter 1.4a and Deep Rybka 4.1 and 42% against the monster Houdini 2.0c Pro.

Best regards from Barcelona.

Tom.

[Tomcass]

120 GAMES

i7 9750 3.33 Ghz.
4 real cores Critter DR and Houdini
4 real cores + 2 HT Stockfish
GUI: Fritz 12
Book: Masterbook 3.1
Time control: 2 minutes + 2 sec/game.
Ponder: Off.
No tablebases

Stockfish 120312 Px6 - Critter 1.4a 64-bit SSE4x4 21.5 - 18.5 +11/=21/-8 53.75%
Stockfish 120312 Px6 - Deep Rybka 4.1 SSE42 x64(x4) 20.5 - 19.5 +10/=21/-9 51.25%
Stockfish 120312 Px6 - Houdini 2.0c Pro x64(x4) 16.0 - 24.0 +5/=22/-13 40.00%

http://www.mediafire.com/?aopd4867ahyyiea


119 GAMES

I7 980 3.33 Ghz.
Critter, Houdini, Deep Rybka 6 real cores - NO HT
Stockfish 6 real cores + 2 HT
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 minutes +2 sec/ game.
Ponder: Off
No tablebases

Stockfish 120312 Px8 - Critter 1.4a 64-bit SSE4(x6) 17.0 - 23.0 +5/=24/-11 42.50%
Stockfish 120312 Px8 - Deep Rybka 4.1 SSE42 x64 (x6) 23.0 - 17.0 +11/=24/-5 57.50%
Stockfish 120312 Px8 - Houdini 2.0c Pro x64(x6) 18.0 - 21.0 +9/=18/-12 46.15%

http://www.mediafire.com/?zlb3e80ucf4y0n5

GLOBAL RESULTS FOR Stockfish 120312 PETERPAN AFTER 239 GAMES:

Stockfish 120312 P - Critter 1.4a 64-bit SSE4x4 38.5 - 41.5 +16/=45/-19 48.12%
Stockfish 120312 P - Deep Rybka 4.1 SSE42 x64(x4) 43.5 - 36.5 +21/=45/-14 54.37%
Stockfish 120312 P - Houdini 2.0c Pro x64(x4) 34.0 - 45.0 +14/=40/-25 43.04%

Average result: 48.54%

Regards from Barcelona.

Tom.

[Tomcass]

Testing Stockfish 120321 compiled by Quocvuong82

60 GAMES

I7 980 3.33 Ghz.
Critter, Houdini, Deep Rybka 6 real cores - NO HT
Stockfish 6 real cores + 2 HT
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 minutes +2 sec/ game.
Ponder: Off
No tablebases

201203StockfishQUO20120321-2 2012

Stockfish 120321 64bit(x8) - Critter 1.4a 64-bit SSE4(x6) 9.5 - 10.5 +3/=13/-4 47.50%
Stockfish 120321 64bit(x8) - Deep Rybka 4.1 SSE42 x64 (x6) 9.5 - 10.5 +5/=9/-6 47.50%
Stockfish 120321 64bit(x8) - Houdini 2.0c Pro x64(x6) 9.5 - 10.5 +5/=9/-6 47.50%

http://www.mediafire.com/?i8m9wtbvd0tqhy4

60 GAMES

i7 9750 3.33 Ghz.
4 real cores Critter DR and Houdini
4 real cores + 2 HT Stockfish
GUI: Fritz 12
Book: Masterbook 3.1
Time control: 2 minutes + 2 sec/game.
Ponder: Off.
No tablebases

201203Stock120321_QUO-1 2012

Stockfish 120321 64bitx6 - Critter 1.4a 64-bit SSE4x4 9.5 - 10.5 +4/=11/-5 47.50%
Stockfish 120321 64bitx6 - Deep Rybka 4.1 SSE42 x64(x4) 10.0 - 10.0 +4/=12/-4 50.00%
Stockfish 120321 64bitx6 - Houdini 2.0c Pro x64(x4) 9.0 - 11.0 +4/=10/-6 45.00%

http://www.mediafire.com/?1af82th1hracw1q

GLOBAL TEST FOR STOCKFISH 120321QUO AFTER 120 GAMES:

Stockfish 120321 64bit - Critter 1.4a 64-bit SSE4 19.0 – 21.0 +7/=24/-9 47.50%
Stockfish 120321 64bit - Deep Rybka 4.1 SSE42 x64 19.5 - 20.5 +9/=21/-10 48.75%
Stockfish 120321 64bit - Houdini 2.0c Pro x64 18.5 - 21.5 +5/=9/-6 46.25%

Average result: 47,50%

The version tested is NO SSE4.2. This is a good result, almost at PeterPan's compiles level. Well done Quocvuong82!.

Regards from Barceloona.

Tom.

[gladius]

Thanks Tom. What version of the source is being used here?

[Tomcass]

I am not sure, Gary. I have asked it to the compiler an I'll tell you as soon as I know it.

Tom.

[Tomcass]

Gary, this is the answer I have received from Quocvuong:

Source is being used in Stockfish 120321: I get from Github Wednesday, ‎March ‎21, ‎2012, Link download (Marco Costalba):

http://www.mediafire.com/?w1km0hkatxyuzkb

Regards,

Tom.