Stockfish 090613 leads Houdini 3 by +12 elo +/- 44 after 130

[mwyoung]

Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 11.5 - 10.5 +6/=11/-5 52.27%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 11.5 - 10.5 +3/=17/-2 52.27%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 12.0 - 10.0 +5/=14/-3 54.55%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 12.0 - 10.0 +5/=14/-3 54.55%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 12.5 - 8.5 +4/=17/-0 59.52%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 11.0 - 10.0 +5/=12/-4 52.38%

[Tomcass]

Hi, Mark!

Thanks for your test. This is good news for Stockfish. I assume you mean "after 22 games" rather than "after 130 games". In my test with this dev. Stockfish 090613 the score against Houdini 3.0 Pro was only 37.81% after 160 games. I suggest you to try Stockfish 220613 64 SSE4.2S (Timestamp: 1371986343). Also after 160 games, the result against H 3.0 Pro was much better: 46.87% (!!).

Could you please post also the time controls, books and number of cores used in your tests?. Thanks in advance!.

Kind regards from Barcelona.

Tom.

[mwyoung]

Hi, Mark!

Thanks for your test. This is good news for Stockfish. I assume you mean "after 22 games" rather than "after 130 games". In my test with this dev. Stockfish 090613 the score against Houdini 3.0 Pro was only 37.81% after 160 games. I suggest you to try Stockfish 220613 64 SSE4.2S (Timestamp: 1371986343). Also after 160 games, the result against H 3.0 Pro was much better: 46.87% (!!).

Could you please post also the time controls, books and number of cores used in your tests?. Thanks in advance!.

Kind regards from Barcelona.

Tom.

No this is not a match against Houdini 3. This is a ratings test. After 130 against the programs in my post. Stockfish is +12 Elo above Houdini 3 on my ratings list. +\- 44 elo

I will publish after the test. This is just a quick snap shot. Have many more games to play before saying how good stockfish might be on its next offial release. Remember this is only a development version. And I dont know if it is the best one.

[mwyoung]

Hi, Mark!

Thanks for your test. This is good news for Stockfish. I assume you mean "after 22 games" rather than "after 130 games". In my test with this dev. Stockfish 090613 the score against Houdini 3.0 Pro was only 37.81% after 160 games. I suggest you to try Stockfish 220613 64 SSE4.2S (Timestamp: 1371986343). Also after 160 games, the result against H 3.0 Pro was much better: 46.87% (!!).

Could you please post also the time controls, books and number of cores used in your tests?. Thanks in advance!.

Kind regards from Barcelona.

Tom.

No this is not a match against Houdini 3. This is a ratings test. After 130 against the programs in my post. Stockfish is +12 Elo above Houdini 3 on my ratings list. +\- 44 elo

I will publish after the test. This is just a quick snap shot. Have many more games to play before saying how good stockfish might be on its next offial release. Remember this is only a development version. And I dont know if it is the best one.

Forgot the comp info you ask for

I7 840
hash 2040mb for each program
TC 40/40
Repeating
Book is 640,000 GM games made with cb 12 from magabase 2013
Same book and settings for each program
Set to normal and 15 moves deep
Tablebase 5 man on solid state drive for program and GUI