Houdini 2.0b Pro x64 First Test

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Houdini 2.0b Pro x64 First Test

Post by mwyoung »

I7 Q 840
5 man TB
1024 HT
TC 5min 3inc
Generic book to 12 moves.

34 of 60 games played.

Houdini 2.0b Pro x64 - Critter 1.2 64-bit SSE4 ...7.5 - 4.5 ...+4/=7/-1 ...62.50%
Houdini 2.0b Pro x64 - Deep Rybka 4.1 SSE42 x64 ...8.0 - 3.0 ...+5/=6/-0 ...72.73%
Houdini 2.0b Pro x64 - Stockfish 2.1.1 JA 64bit ...7.5 - 3.5 ...+6/=3/-2 ...68.18%
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: Houdini 2.0b Pro x64 First Test

Post by Dr.Wael Deeb »

Impressive results I have to admit 8-)
Dr.D
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Houdini 2.0b Pro x64 First Test

Post by mwyoung »

mwyoung wrote:I7 Q 840
5 man TB
1024 HT
TC 5min 3inc
Generic book to 12 moves.

34 of 60 games played.

Houdini 2.0b Pro x64 - Critter 1.2 64-bit SSE4 ...7.5 - 4.5 ...+4/=7/-1 ...62.50%
Houdini 2.0b Pro x64 - Deep Rybka 4.1 SSE42 x64 ...8.0 - 3.0 ...+5/=6/-0 ...72.73%
Houdini 2.0b Pro x64 - Stockfish 2.1.1 JA 64bit ...7.5 - 3.5 ...+6/=3/-2 ...68.18%


60 of 60 games played.

Houdini 2.0b Pro x64 - Critter 1.2 64-bit SSE4 ...12.0 - 8.0 ...+5/=14/-1 ...60.00%
Houdini 2.0b Pro x64 - Deep Rybka 4.1 SSE42 x64 ...14.5 - 5.5 ...+9/=11/-0 ...72.50%
Houdini 2.0b Pro x64 - Stockfish 2.1.1 JA 64bit ...13.0 - 7.0 ...+10/=6/-4 ...65.00%




First Rating of Houdini 2.0b

1 Houdini 2.0b Pro x64 3381
2 Houdini 2.0 x64 3352
3 Houdini 2.0 Pro x64 3345
4 Houdini 1.5a x64 3322
ernest
Posts: 2053
Joined: Wed Mar 08, 2006 8:30 pm

Re: Houdini 2.0b Pro x64 First Test

Post by ernest »

mwyoung wrote:First Rating of Houdini 2.0b
OMG!!!

3381 +-60 !!! 8-)
Anton
Posts: 3549
Joined: Sun Mar 26, 2006 5:53 pm

Re: Houdini 2.0b Pro x64 First Test

Post by Anton »

Surely a thread about a Robbolito clone belongs in the cloning forum.

btw, would you be interested in a Monet painting I have for sale? for you, just $10,000 if bought before Oct 14, ignore the "printed by Canon" watermark, that is just a hallucination, it is a real genuine original work by Monet.
User avatar
Houdini
Posts: 1471
Joined: Tue Mar 16, 2010 12:00 am

Re: Houdini 2.0b Pro x64 First Test

Post by Houdini »

ernest wrote:
mwyoung wrote:First Rating of Houdini 2.0b
OMG!!!

3381 +-60 !!! 8-)
Correct, it is important to stress the very large confidence interval.
As Houdini 2.0, 2.0 Pro and 2.0b are engines with identical strength, the best Elo estimate is obtained by combining the 3 results given above

1 Houdini 2.0b Pro x64 3381
2 Houdini 2.0 x64 3352
3 Houdini 2.0 Pro x64 3345

into a single rating, with the combined number of games.

Robert
Albert Silver
Posts: 3026
Joined: Wed Mar 08, 2006 9:57 pm
Location: Rio de Janeiro, Brazil

Re: Houdini 2.0b Pro x64 First Test

Post by Albert Silver »

Dr.Wael Deeb wrote:Impressive results I have to admit 8-)
Dr.D
34 games played.... out of a whopping 60.
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Houdini 2.0b Pro x64 First Test

Post by mwyoung »

Houdini wrote:
ernest wrote:
mwyoung wrote:First Rating of Houdini 2.0b
OMG!!!

3381 +-60 !!! 8-)
Correct, it is important to stress the very large confidence interval.
As Houdini 2.0, 2.0 Pro and 2.0b are engines with identical strength, the best Elo estimate is obtained by combining the 3 results given above

1 Houdini 2.0b Pro x64 3381
2 Houdini 2.0 x64 3352
3 Houdini 2.0 Pro x64 3345

into a single rating, with the combined number of games.

Robert
Houdini 2.0b is now being tested at a longer TC in the 2nd group and testing. Houdini 2.0b is still showing better results then 2.0 by a good margin. More games coming.


TC 40moves/15mins

29 of 100 games played

Houdini 2.0b Pro x64 - Critter 1.2 64-bit SSE4 4.5 - 1.5 +3/=3/-0 75.00%
Houdini 2.0b Pro x64 - Deep Rybka 4.1 SSE42 x64 4.0 - 2.0 +3/=2/-1 66.67%
Houdini 2.0b Pro x64 - Stockfish 2.1.1 JA 64bit 4.0 - 2.0 +3/=2/-1 66.67%
Houdini 2.0b Pro x64 - Komodo64 3 4.0 - 2.0 +2/=4/-0 66.67%
Houdini 2.0b Pro x64 - Fire 2.2 xTreme x64 4.0 - 1.0 +3/=2/-0 80.00%


I do know you said the two version are the same strenght, but they are not the same program it seems. As I get different moves and evals and solve times when running the 2 versions side by side in Fritz, no matter the hash lever or CPU cores used.

The ratings gap will come together beween the 2 version if they are the same strength as I log 100's of games.

Robert it is not that I doubt you on your own program, but I always test new versions no matter what the programmer says...most time the programmer is correct, sometime not for what ever reason.

Most times I keep my results to myself, but since no one else was going to test the new version, and some members ask for a test. I made this version test public.