Stockfish 090613 beating all Houdini versions @ 40/40

[mwyoung]

A development version of Stockfsih is currently topping all Houdini versions at 50 game mark, 300 to be played. Error bar is now +63 / -62



Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 5.5 - 3.5 +3/=5/-1 61.11%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 4.5 - 3.5 +2/=5/-1 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 4.5 - 3.5 +3/=3/-2 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 5.0 - 3.0 +2/=6/-0 62.50%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 4.5 - 3.5 +1/=7/-0 56.25%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 5.0 - 3.0 +3/=4/-1 62.50%

[S.Taylor]

A development version of Stockfsih is currently topping all Houdini versions at 50 game mark, 300 to be played. Error bar is now +63 / -62



Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 5.5 - 3.5 +3/=5/-1 61.11%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 4.5 - 3.5 +2/=5/-1 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 4.5 - 3.5 +3/=3/-2 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 5.0 - 3.0 +2/=6/-0 62.50%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 4.5 - 3.5 +1/=7/-0 56.25%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 5.0 - 3.0 +3/=4/-1 62.50%

It's nice to know there is movement!
It will be interesting to see how it continues and even more interesting to see how will be vs the next Houdini and other upcoming engine upgrades.

[mwyoung]

A development version of Stockfsih is currently topping all Houdini versions at 50 game mark, 300 to be played. Error bar is now +63 / -62



Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 5.5 - 3.5 +3/=5/-1 61.11%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 4.5 - 3.5 +2/=5/-1 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 4.5 - 3.5 +3/=3/-2 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 5.0 - 3.0 +2/=6/-0 62.50%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 4.5 - 3.5 +1/=7/-0 56.25%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 5.0 - 3.0 +3/=4/-1 62.50%

It's nice to know there is movement!
It will be interesting to see how it continues and even more interesting to see how will be vs the next Houdini and other upcoming engine upgrades.

Stockfish is moving so fast, I can not even keep up. This version I am testing is already many version behind the the current version and I am testing one that is only 3 days old.

I love the fact that the stockfish team is giving the public ever development version. It will keep me busy for some time.

As for Houdini, I hear it will not be out with a new version before next year.

If this is the case it maybe likely Houdini will no longer be the top chess engine.

It is possible going by the current results, that stockfish has already passed Houdini as the top chess engine, but it will take more test games to know for sure. But current results are looking good for Stockfish.

[michiguel]

A development version of Stockfsih is currently topping all Houdini versions at 50 game mark, 300 to be played. Error bar is now +63 / -62



Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 5.5 - 3.5 +3/=5/-1 61.11%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 4.5 - 3.5 +2/=5/-1 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 4.5 - 3.5 +3/=3/-2 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 5.0 - 3.0 +2/=6/-0 62.50%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 4.5 - 3.5 +1/=7/-0 56.25%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 5.0 - 3.0 +3/=4/-1 62.50%

It's nice to know there is movement!
It will be interesting to see how it continues and even more interesting to see how will be vs the next Houdini and other upcoming engine upgrades.

Stockfish is moving so fast, I can not even keep up. This version I am testing is already many version behind the the current version and I am testing one that is only 3 days old.

I love the fact that the stockfish team is giving the public ever development version. It will keep me busy for some time.

As for Houdini, I hear it will not be out with a new version before next year.

If this is the case it maybe likely Houdini will no longer be the top chess engine.

It is possible going by the current results, that stockfish has already passed Houdini as the top chess engine, but it will take more test games to know for sure. But current results are looking good for Stockfish.

You are making this conclusion with only 8 games
(against H3). The error is gigantic.

Miguel

[mwyoung]

A development version of Stockfsih is currently topping all Houdini versions at 50 game mark, 300 to be played. Error bar is now +63 / -62



Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 5.5 - 3.5 +3/=5/-1 61.11%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 4.5 - 3.5 +2/=5/-1 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 4.5 - 3.5 +3/=3/-2 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 5.0 - 3.0 +2/=6/-0 62.50%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 4.5 - 3.5 +1/=7/-0 56.25%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 5.0 - 3.0 +3/=4/-1 62.50%

It's nice to know there is movement!
It will be interesting to see how it continues and even more interesting to see how will be vs the next Houdini and other upcoming engine upgrades.

Stockfish is moving so fast, I can not even keep up. This version I am testing is already many version behind the the current version and I am testing one that is only 3 days old.

I love the fact that the stockfish team is giving the public ever development version. It will keep me busy for some time.

As for Houdini, I hear it will not be out with a new version before next year.

If this is the case it maybe likely Houdini will no longer be the top chess engine.

It is possible going by the current results, that stockfish has already passed Houdini as the top chess engine, but it will take more test games to know for sure. But current results are looking good for Stockfish.

You are making this conclusion with only 8 games
(against H3). The error is gigantic.

Miguel

As always confused by your asinine comments...What conculsion are you talking about. I made no conclusions regarding Houdini 3 with only 8 games. If it were possible I would try typing slower for you, but I think that only works when you are talking.

You may need to look up the meaning of "possible", "if", "current", or the phrase "but it will take more test games to know for sure"

[Laskos]

A development version of Stockfsih is currently topping all Houdini versions at 50 game mark, 300 to be played. Error bar is now +63 / -62



Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 5.5 - 3.5 +3/=5/-1 61.11%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 4.5 - 3.5 +2/=5/-1 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 4.5 - 3.5 +3/=3/-2 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 5.0 - 3.0 +2/=6/-0 62.50%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 4.5 - 3.5 +1/=7/-0 56.25%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 5.0 - 3.0 +3/=4/-1 62.50%

It's nice to know there is movement!
It will be interesting to see how it continues and even more interesting to see how will be vs the next Houdini and other upcoming engine upgrades.

Stockfish is moving so fast, I can not even keep up. This version I am testing is already many version behind the the current version and I am testing one that is only 3 days old.

I love the fact that the stockfish team is giving the public ever development version. It will keep me busy for some time.

As for Houdini, I hear it will not be out with a new version before next year.

If this is the case it maybe likely Houdini will no longer be the top chess engine.

It is possible going by the current results, that stockfish has already passed Houdini as the top chess engine, but it will take more test games to know for sure. But current results are looking good for Stockfish.

You are making this conclusion with only 8 games
(against H3). The error is gigantic.

Miguel

As always confused by your asinine comments...What conculsion are you talking about. I made no conclusions regarding Houdini 3 with only 8 games. If it were possible I would try typing slower for you, but I think that only works when you are talking.

You may need to look up the meaning of "possible", "if", "current", or the phrase "but it will take more test games to know for sure"

The thread topic is Stockfish 090613 beating all Houdini versions @ 40/40, and I was expecting more than 8 games, or if 8 games, 8-0 result.

[mwyoung]

A development version of Stockfsih is currently topping all Houdini versions at 50 game mark, 300 to be played. Error bar is now +63 / -62



Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 5.5 - 3.5 +3/=5/-1 61.11%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 4.5 - 3.5 +2/=5/-1 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 4.5 - 3.5 +3/=3/-2 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 5.0 - 3.0 +2/=6/-0 62.50%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 4.5 - 3.5 +1/=7/-0 56.25%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 5.0 - 3.0 +3/=4/-1 62.50%

It's nice to know there is movement!
It will be interesting to see how it continues and even more interesting to see how will be vs the next Houdini and other upcoming engine upgrades.

Stockfish is moving so fast, I can not even keep up. This version I am testing is already many version behind the the current version and I am testing one that is only 3 days old.

I love the fact that the stockfish team is giving the public ever development version. It will keep me busy for some time.

As for Houdini, I hear it will not be out with a new version before next year.

If this is the case it maybe likely Houdini will no longer be the top chess engine.

It is possible going by the current results, that stockfish has already passed Houdini as the top chess engine, but it will take more test games to know for sure. But current results are looking good for Stockfish.

You are making this conclusion with only 8 games
(against H3). The error is gigantic.

Miguel

As always confused by your asinine comments...What conculsion are you talking about. I made no conclusions regarding Houdini 3 with only 8 games. If it were possible I would try typing slower for you, but I think that only works when you are talking.

You may need to look up the meaning of "possible", "if", "current", or the phrase "but it will take more test games to know for sure"

The thread topic is Stockfish 090613 beating all Houdini versions @ 40/40, and I was expecting more than 8 games, or if 8 games, 8-0 result.

I don't know what to say to this. You did read the post, because all information is posted. And I assume you know the meaning of "all Houdini versions". 24 games have been played in my post against all Houdini versions not 8, with 50 games played.

And even the title makes no conclusions, just states the current outcome at this point in the testing. No conclusions were ever made.

[michiguel]

A development version of Stockfsih is currently topping all Houdini versions at 50 game mark, 300 to be played. Error bar is now +63 / -62



Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 5.5 - 3.5 +3/=5/-1 61.11%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 4.5 - 3.5 +2/=5/-1 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 4.5 - 3.5 +3/=3/-2 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 5.0 - 3.0 +2/=6/-0 62.50%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 4.5 - 3.5 +1/=7/-0 56.25%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 5.0 - 3.0 +3/=4/-1 62.50%

It's nice to know there is movement!
It will be interesting to see how it continues and even more interesting to see how will be vs the next Houdini and other upcoming engine upgrades.

Stockfish is moving so fast, I can not even keep up. This version I am testing is already many version behind the the current version and I am testing one that is only 3 days old.

I love the fact that the stockfish team is giving the public ever development version. It will keep me busy for some time.

As for Houdini, I hear it will not be out with a new version before next year.

If this is the case it maybe likely Houdini will no longer be the top chess engine.

It is possible going by the current results, that stockfish has already passed Houdini as the top chess engine, but it will take more test games to know for sure. But current results are looking good for Stockfish.

You are making this conclusion with only 8 games
(against H3). The error is gigantic.

Miguel

As always confused by your asinine comments...What conculsion are you talking about. I made no conclusions regarding Houdini 3 with only 8 games. If it were possible I would try typing slower for you, but I think that only works when you are talking.

You may need to look up the meaning of "possible", "if", "current", or the phrase "but it will take more test games to know for sure"

No idea where the rudeness come from.

Anyway, based on your current results you are stating, saying, (do not call it concluding if you do not want) that "it is possible...etc". Yes, anything it is possible. My point is that your data cannot support any statement or even speculation about the relative strength between SF and H. Who knows, it is even possible that this version plays worse than the previous one too. Nothing against reporting partial results, but you are making it sound (particularly with the title, as Kai mentioned) more exciting than what it is. I was excited to see the title and then disappointed when I saw the data.

I just pointed out that the critical match to determine the relative strength with Houdini has 8 games. Otherwise, people may not grasp the significance of the data.

Miguel

[mwyoung]

A development version of Stockfsih is currently topping all Houdini versions at 50 game mark, 300 to be played. Error bar is now +63 / -62



Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 5.5 - 3.5 +3/=5/-1 61.11%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 4.5 - 3.5 +2/=5/-1 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 4.5 - 3.5 +3/=3/-2 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 5.0 - 3.0 +2/=6/-0 62.50%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 4.5 - 3.5 +1/=7/-0 56.25%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 5.0 - 3.0 +3/=4/-1 62.50%

It's nice to know there is movement!
It will be interesting to see how it continues and even more interesting to see how will be vs the next Houdini and other upcoming engine upgrades.

Stockfish is moving so fast, I can not even keep up. This version I am testing is already many version behind the the current version and I am testing one that is only 3 days old.

I love the fact that the stockfish team is giving the public ever development version. It will keep me busy for some time.

As for Houdini, I hear it will not be out with a new version before next year.

If this is the case it maybe likely Houdini will no longer be the top chess engine.

It is possible going by the current results, that stockfish has already passed Houdini as the top chess engine, but it will take more test games to know for sure. But current results are looking good for Stockfish.

You are making this conclusion with only 8 games
(against H3). The error is gigantic.

Miguel

As always confused by your asinine comments...What conculsion are you talking about. I made no conclusions regarding Houdini 3 with only 8 games. If it were possible I would try typing slower for you, but I think that only works when you are talking.

You may need to look up the meaning of "possible", "if", "current", or the phrase "but it will take more test games to know for sure"

No idea where the rudeness come from.

Anyway, based on your current results you are stating, saying, (do not call it concluding if you do not want) that "it is possible...etc". Yes, anything it is possible. My point is that your data cannot support any statement or even speculation about the relative strength between SF and H. Who knows, it is even possible that this version plays worse than the previous one too. Nothing against reporting partial results, but you are making it sound (particularly with the title, as Kai mentioned) more exciting than what it is. I was excited to see the title and then disappointed when I saw the data.

I just pointed out that the critical match to determine the relative strength with Houdini has 8 games. Otherwise, people may not grasp the significance of the data.

Miguel

To be clear, you claimed I made a conclusion regarding Stockfish and Houdini 3 which I did not.

And I could determine a rating for Stockfish without ever playing Houdini 3. To be clear again as posted I am playing 6 of the strongest programs a total of 300 games to determine a rating for Stockfish 090613. This is not a head to head match with Houdini 3. Stockfish could still tie or lose against Houdini 3 in this testing, and still have a higher rating.


--------------------------------------------------------------

Miguel A. Ballicora - "My point is that your data cannot support any statement or even speculation".... "Otherwise, people may not grasp the significance of the data."


Your concern is touching for others Miguel, the funny thing is you only hold my post to this standard. I did not hear this concern at anytime in the past or present until now. Here is a recent post by Larry Kaufman that gives partial results and speculation. And Larry is trying to sell Komodo 5.1 on CCC to CCC members Mr. Moderator. Where is your concern here Miguel.

Larry Kaufman - "So samples are still quite small, but it appears likely that Komodo 5.1 will be the number 2 MP engine. Updates later"

Post by Larry Kaufman
Here are some early results for Komodo 5.1 MP. All tests on Windows sse4 machines using Fritz 11 interface, equal number of cores for Komodo and opposing engines.
First, it should be noted that the underlying SP engine is slightly stronger than Komodo 5 but clearly weaker than Komodo CCT. This has been verified by multiple tests including independent testing.
Against Critter 1.6a, at 3' + 2" on 4 cores I got a tied score after 69 games, but at 5'+3" Komodo currently leads by six games out of 45. On 12 cores at 5' + 3" I got a 25 to 25 tie.
Against Stockfish 3.0 at 3'+ 2" on 12 cores Komodo won by 27.5 to 22.5.
Against Deep Rybka 4 on 12 cores at 5' + 3" so far Komodo leads 5 to 2.
Against Houdini 3 on 4 cores at 5' + 3" Komodo is 5 games down after 52 games (-33 elo).

So samples are still quite small, but it appears likely that Komodo 5.1 will be the number 2 MP engine. Updates later

--------------------------------------------

For future reference I don't make conclusions on who has the stronger chess program in my testing. I rely on another person to make those types of determinations.

If you have a problem with his conclusions and the error bars I posted contact him.

http://remi.coulom.free.fr/Bayesian-Elo/

Bye

[geots]

A development version of Stockfsih is currently topping all Houdini versions at 50 game mark, 300 to be played. Error bar is now +63 / -62



Stockfish Test 2013

Stockfish 090613 64 SSE4.2 - Deep Rybka 4.1 SSE42 x64 5.5 - 3.5 +3/=5/-1 61.11%
Stockfish 090613 64 SSE4.2 - Houdini 3 Pro x64 4.5 - 3.5 +2/=5/-1 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 2.0c Pro x64 4.5 - 3.5 +3/=3/-2 56.25%
Stockfish 090613 64 SSE4.2 - Houdini 1.5a x64 5.0 - 3.0 +2/=6/-0 62.50%
Stockfish 090613 64 SSE4.2 - Stockfish 3 JA 64bit SSE4.2 4.5 - 3.5 +1/=7/-0 56.25%
Stockfish 090613 64 SSE4.2 - Critter 1.6a 64-bit 5.0 - 3.0 +3/=4/-1 62.50%

It's nice to know there is movement!
It will be interesting to see how it continues and even more interesting to see how will be vs the next Houdini and other upcoming engine upgrades.

Stockfish is moving so fast, I can not even keep up. This version I am testing is already many version behind the the current version and I am testing one that is only 3 days old.

I love the fact that the stockfish team is giving the public ever development version. It will keep me busy for some time.

As for Houdini, I hear it will not be out with a new version before next year.

If this is the case it maybe likely Houdini will no longer be the top chess engine.

It is possible going by the current results, that stockfish has already passed Houdini as the top chess engine, but it will take more test games to know for sure. But current results are looking good for Stockfish.

You are making this conclusion with only 8 games
(against H3). The error is gigantic.

Miguel

As always confused by your asinine comments...What conculsion are you talking about. I made no conclusions regarding Houdini 3 with only 8 games. If it were possible I would try typing slower for you, but I think that only works when you are talking.

You may need to look up the meaning of "possible", "if", "current", or the phrase "but it will take more test games to know for sure"

Try this asinine remark. You say it is beating all versions of Houdini @ 40/40. To say that with only the few games you have played tells me either you don't know jack about testing- or you are just delusional.