Stockfish 1.6s is a disaster, compared to 1.6

[ernest]

Stockfish Jim Ablett compiles (x64), against Rybka 3 (x64)
100 games, 2'+1", no ponder, 2-cpu, book PB-5moves
Fritz 11 GUI, XP Pro x64.

First stockfish-16-x64-ja.exe (23/12/2009, 267 KB)
Stockfish 1.6 JA - Rybka 3: +20 -41 =39, score 39.5-60.5 (-76 Elo)

Then stockfish-16s-x64-ja.exe (29/12/09, 273 KB)
Stockfish 1.6s JA - Rybka 3: +14 -51 =35, score 31.5-68.5 (-137 Elo)

Only 200 games, but the difference is big enough to call the "s" version a failure!

Sorry, Dann...

[alpha123]

Really? 1.6s seems equal to or slightly better than 1.6. Are you using the correct 1.6s version? Because some are good, and some are terrible.

Peter

[Martin Thoresen]

Only 200 games, but the difference is big enough to call the "s" version a failure!

Sorry, Dann...

Not enough games or something else is wrong with your setup.

Please see my tournament:

http://www.talkchess.com/forum/viewtopi ... 76&t=31379

[ernest]

Are you using the correct 1.6s version? Peter

Well, I have quoted what the version is... It is the correct JA compile!

[ernest]

Please see my tournament:
http://www.talkchess.com/forum/viewtopi ... 76&t=31379

...and what was the direct result of the games between those 3?

Code: Select all

01: Rybka 3 64-bit               112.5/175          64.29         9426.75 
01: Stockfish 1.6s JA 64-bit      91.5/175          52.29         7785.25 
01: Stockfish 1.6.JA 64-bit       90.0/175          51.43         7698.00

Anyway, even your result shows no improvement from the s version

[Martin Thoresen]

...and what was the direct result of the games between those 3?

Code: Select all

01: Rybka 3 64-bit               112.5/175          64.29         9426.75 
01: Stockfish 1.6s JA 64-bit      91.5/175          52.29         7785.25 
01: Stockfish 1.6.JA 64-bit       90.0/175          51.43         7698.00

Anyway, even your result shows no improvement from the s version

That is correct, no improvement to speak of (1.5 point more for "s" version could be statistical deviation). But my point was that it is certainly not worse, which is the impression you give in your original post in this thread.

The games between those 3:

Rybka 3 64-bit - Stockfish 1.6s JA 64-bit: 16.0 - 9.0
Rybka 3 64-bit - Stockfish 1.6 JA 64-bit: 15.5 - 9.5
Stockfish 1.6s JA 64-bit - Stockfish 1.6 JA 64-bit: 14.0 - 11.0

[Dr.Ex]

Stockfish Jim Ablett compiles (x64), against Rybka 3 (x64)
100 games, 2'+1", no ponder, 2-cpu, book PB-5moves
Fritz 11 GUI, XP Pro x64.

I want to do the same test with the 32-bit engines. Where do I get PB-5moves?

[DomLeste]

Make sure you use this version for 32bit

Stockfish-1.6s-DC-(originalSmoothScaling)w32+x64.zip

http://www.mediafire.com/?2nwm1dozmco

[parrish]

Make sure you use this version for 32bit

Stockfish-1.6s-DC-(originalSmoothScaling)w32+x64.zip

http://www.mediafire.com/?2nwm1dozmco

OK, you guys really need to get together and figure out what's going on here. Besides the confusion that this version is also labeled as Stockfish 1.6s, it definitely plays worse than the original Stockfish 1.6s version created by Dann that I obtained from the Stockfish32.exe.bz2 file.
For example, the Stockfish32.exe finds Nb5 here almost immediately:
http://www.talkchess.com/forum/viewtopic.php?t=31394
while this Stockfish-1.6s-DC version does not.

[George Tsavdaris]

Make sure you use this version for 32bit

Stockfish-1.6s-DC-(originalSmoothScaling)w32+x64.zip

http://www.mediafire.com/?2nwm1dozmco

OK, you guys really need to get together and figure out what's going on here. Besides the confusion that this version is also labeled as Stockfish 1.6s, it definitely plays worse than the original Stockfish 1.6s version created by Dann that I obtained from the Stockfish32.exe.bz2 file.
For example, the Stockfish32.exe finds Nb5 here almost immediately:
http://www.talkchess.com/forum/viewtopic.php?t=31394
while this Stockfish-1.6s-DC version does not.

Actually you have not obtained the original Stockfish 1.6s 32 bit. But only the second one.

The original does not find Nb5 immediately. The second "smoother" one Dann provided finds it immediately.
The above link contains the original Stockfish 1.6s 32 bit, the one Dann has posted in the beginning.