Strelka 5.5 x64- A Double Dose of Trouble!

[geots]

2 Chessboards and 3 Engines


Intel i5 w/4TCs
Fritz 11 gui
1CPU/64bit
128MB hash
Bases=NONE
Ponder_Learning=OFF
Perfect 12.32 book w/12-move limit
40/3 Repeating- Adapted to bmkd 40/4
Match=50 games



Critter 1.4a 64-bit SSE4

Code: Select all

1   Strelka 5.5 x64            +42    +14/-8/=28   56.00%   28.0/50
2   Critter 1.4a 64-bit SSE4   -42    +8/-14/=28   44.00%   22.0/50

Houdini 2.0c x64

Code: Select all

1   Strelka 5.5 x64    +21    +15/-12/=23   53.00%   26.5/50
2   Houdini 2.0c x64   -21    +12/-15/=23   47.00%   23.5/50

PGNs for both matches can be downloaded from the following link:

http://dl.dropbox.com/u/76847541/Strelk ... oudini.rar




And do not forget, the complete sets of PGNs for Ivanhoe versions vs. Komodo and Stockfish can be downloaded from the following links WHICH WILL BE GOOD THRU MAY 23:

http://dl.dropbox.com/u/76847541/Ivanho ... 204%20.zip

http://dl.dropbox.com/u/76847541/Ivanho ... 0SSE42.zip


george

[Strelkaman]

2 Chessboards and 3 Engines


Intel i5 w/4TCs
Fritz 11 gui
1CPU/64bit
128MB hash
Bases=NONE
Ponder_Learning=OFF
Perfect 12.32 book w/12-move limit
40/3 Repeating- Adapted to bmkd 40/4
Match=50 games



Critter 1.4a 64-bit SSE4

Code: Select all

1   Strelka 5.5 x64            +42    +14/-8/=28   56.00%   28.0/50
2   Critter 1.4a 64-bit SSE4   -42    +8/-14/=28   44.00%   22.0/50

Houdini 2.0c x64

Code: Select all

1   Strelka 5.5 x64    +21    +15/-12/=23   53.00%   26.5/50
2   Houdini 2.0c x64   -21    +12/-15/=23   47.00%   23.5/50

PGNs for both matches can be downloaded from the following link:

http://dl.dropbox.com/u/76847541/Strelk ... oudini.rar




And do not forget, the complete sets of PGNs for Ivanhoe versions vs. Komodo and Stockfish can be downloaded from the following links WHICH WILL BE GOOD THRU MAY 23:

http://dl.dropbox.com/u/76847541/Ivanho ... 204%20.zip

http://dl.dropbox.com/u/76847541/Ivanho ... 0SSE42.zip


george

Nice tests George

[geots]

2 Chessboards and 3 Engines


Intel i5 w/4TCs
Fritz 11 gui
1CPU/64bit
128MB hash
Bases=NONE
Ponder_Learning=OFF
Perfect 12.32 book w/12-move limit
40/3 Repeating- Adapted to bmkd 40/4
Match=50 games



Critter 1.4a 64-bit SSE4

Code: Select all

1   Strelka 5.5 x64            +42    +14/-8/=28   56.00%   28.0/50
2   Critter 1.4a 64-bit SSE4   -42    +8/-14/=28   44.00%   22.0/50

Houdini 2.0c x64

Code: Select all

1   Strelka 5.5 x64    +21    +15/-12/=23   53.00%   26.5/50
2   Houdini 2.0c x64   -21    +12/-15/=23   47.00%   23.5/50

PGNs for both matches can be downloaded from the following link:

http://dl.dropbox.com/u/76847541/Strelk ... oudini.rar




And do not forget, the complete sets of PGNs for Ivanhoe versions vs. Komodo and Stockfish can be downloaded from the following links WHICH WILL BE GOOD THRU MAY 23:

http://dl.dropbox.com/u/76847541/Ivanho ... 204%20.zip

http://dl.dropbox.com/u/76847541/Ivanho ... 0SSE42.zip


george

Nice tests George

Thank you. I doubt there is much question about Critter. I am fairly sure he had passed Critter with 5.1 x 64. Houdini is I suppose still the big question mark. One thing for sure- if these guys want to stay on top ahead of Strelka- releasing 1 version a year won't get the job done any longer.


george

[geots]

2 Chessboards and 3 Engines


Intel i5 w/4TCs
Fritz 11 gui
1CPU/64bit
128MB hash
Bases=NONE
Ponder_Learning=OFF
Perfect 12.32 book w/12-move limit
40/3 Repeating- Adapted to bmkd 40/4
Match=50 games



Critter 1.4a 64-bit SSE4

Code: Select all

1   Strelka 5.5 x64            +42    +14/-8/=28   56.00%   28.0/50
2   Critter 1.4a 64-bit SSE4   -42    +8/-14/=28   44.00%   22.0/50

Houdini 2.0c x64

Code: Select all

1   Strelka 5.5 x64    +21    +15/-12/=23   53.00%   26.5/50
2   Houdini 2.0c x64   -21    +12/-15/=23   47.00%   23.5/50

PGNs for both matches can be downloaded from the following link:

http://dl.dropbox.com/u/76847541/Strelk ... oudini.rar




And do not forget, the complete sets of PGNs for Ivanhoe versions vs. Komodo and Stockfish can be downloaded from the following links WHICH WILL BE GOOD THRU MAY 23:

http://dl.dropbox.com/u/76847541/Ivanho ... 204%20.zip

http://dl.dropbox.com/u/76847541/Ivanho ... 0SSE42.zip


george

Nice tests George

Another reply because I forgot to tell you something. This is not my business- but don't take offense at what I say here. If I were you, I would grab the download from the link I gave- and in 1 zip are BOTH 50-game matches. I watched a good bit of both, but mostly I watched the Houdini match. Because the Critter match was in another username so I could run both matches in Fritz 11 gui at the same time on the same box. And I knew he was going to get his butt kicked- the Houdini match was the one that kept me up till I couldn't stay awake. I actually saw what one might say is a blueprint for how you need to play Houdini. I personally think Strelka has the right idea with just 1 core. Because for every doubling of the cores, you are getting closer and closer to testing and rating hardware instead of the engines.


Best,

george

[gerold]

Nice work George. Keep up the good work.

Best,
Gerold.

[bupalo]

Critter and Stockfish are engines still valid. It's true can be defeaten in a match against Houdini and Strelka but can give in analysys original and interesting moves that Houdini and Strelka don't see or see after a very long analysys

[geots]

Nice work George. Keep up the good work.

Best,
Gerold.

Thanks, Gerold. There are some interesting engines out there to test.


Best,

george

[Sedat Canbaz]

Hello dear George,

Thank you...

Really impressive results by Strelka

I have no patience to test this great engine

Best,
Sedat

[Uri Blass]

Hello dear George,

Thank you...

Really impressive results by Strelka

I have no patience to test this great engine

Best,
Sedat

I am not impressed.

After reading that strelka cheated in test suites by having some hidden book then I am afraid that strelka is also cheating in games by having a hidden book.

The only reliable test is from positions that are probably not in strelka's secret book and the way to get them is to make some random moves and start the match after the random moves(for example 1.a3 Na6 2.h3 h6 3.f3 b6 4.e4 e5).

I suspect that this is the only way to stop the cheating of strelka because I am sure the strelka team had not enough memory for a book for something like 10^9 balanced positions that can happen after 8 plies.

Maybe strelka is not cheating by a hidden book but
my default assumption is that it is cheating after I read about the cheating in test suites.

[Sedat Canbaz]

Hello dear George,

Thank you...

Really impressive results by Strelka

I have no patience to test this great engine

Best,
Sedat

I am not impressed.

After reading that strelka cheated in test suites by having some hidden book then I am afraid that strelka is also cheating in games by having a hidden book.

The only reliable test is from positions that are probably not in strelka's secret book and the way to get them is to make some random moves and start the match after the random moves(for example 1.a3 Na6 2.h3 h6 3.f3 b6 4.e4 e5).

I suspect that this is the only way to stop the cheating of strelka because I am sure the strelka team had not enough memory for a book for something like 10^9 balanced positions that can happen after 8 plies.

Maybe strelka is not cheating by a hidden book but
my default assumption is that it is cheating after I read about the cheating in test suites.

Sorry,but i have a different view than you

I don't see anything wrong,in case of storing opening moves in chess engines

In my opinion,(for better engine performance) storing opening moves is quite good idea/method

Actually i can call a real 'cheating' for those new comercial engine releases,when there is no significant Elo improvement

Best,
Sedat