Impressive Stockfish 1.4 !!

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Impressive Stockfish 1.4 !!

Post by Tomcass »

According to Ernest test, they are roughly of the same strength. Two fantastic free programmes, no doubt. :)

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Impressive Stockfish 1.4 !! Now Vs. Rybka3 and Naum4...

Post by Tomcass »

Game in 10 minutes each.
Hardware Intel i7 975 quad hyperthread
GUI: Fritz11
Book for Stockfish1.4 : CompBase Beta3
Book for Rybka3 and Naum4: Perfect 15


2009-07Stockfish1.4(2)-4 2009

Stockfish 1.4 JA 64bit(x8) - Rybka 3 9.0 - 11.0 +5/-7/=8 45.00%
Stockfish 1.4 JA 64bit(x8) - Naum 4(x8) 8.5 - 11.5 +4/-7/=9 42.50%


I know that CompBase Beta3 is a fantastic book, but you will agree with me that Stockfish 1.4 is really impressive. Congratulations again, Marco.

Regards,

Tom.
User avatar
AdminX
Posts: 6363
Joined: Mon Mar 13, 2006 2:34 pm
Location: Acworth, GA

Re: Impressive Stockfish 1.4 !!

Post by AdminX »

Today, I decided to do another 50 game Engine Match with Stockfish 1.4 (64-bit) versus Bright 0.4a this time. Each engine only used 2 cores.

Settings:

Intel Core 2 Quad (Q6700)
Dan Corbit's New 3,4, and 5 Man Bitbases
Deep Fritz Opening Book
8 GB Ram
Ponder On
Hash 1024

Image

You can download all games here.
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

Re: Impressive Stockfish 1.4 !!

Post by mcostalba »

AdminX wrote: Ponder On
Hi Ted,

very probably "ponder On" does not work :-(

We are working on this issue, is somehow connected to the broken FRC support.

So actually what happened is that Bright played with ponder on but Stockfish played without pondering at all.
mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

Re: Impressive Stockfish 1.4 !!

Post by mcostalba »

mcostalba wrote:
AdminX wrote: Ponder On
Hi Ted,

very probably "ponder On" does not work :-(

We are working on this issue, is somehow connected to the broken FRC support.

So actually what happened is that Bright played with ponder on but Stockfish played without pondering at all.
I was a bit too pessimistic. Ponder should work as expected is the UCI option "Ponder" that has some issues when is set/reset.

By your point of view you can consider ponder working. There could be some issues in time managment that is a bit different to what should be due to UCI option "Ponder" misbehaviours, but this should not have big impact on real games.

Anyhow we are testing a patch that should fix this and also broken FRC support....
Uri Blass
Posts: 10897
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: Impressive Stockfish 1.4 !!

Post by Uri Blass »

mcostalba wrote:
Eelco de Groot wrote: Werner Schüle has just posted a good result for the single CPU version against Rybka 2.2n2 32-bit on the CEGT 40/20 Coordination forum
Posted: 09 Jul 2009 19:18 Post subject:

--------------------------------------------------------------------------------

My next result:

Code:
1 Stockfish 1.4 x64 1CPU +12/-11/=27 51.00% 25.5/50 2940
2 Rybka 2.2n2 w32 1CPU +11/-12/=27 49.00% 24.5/50


next: Shredder WM Edition 1CPU

Werner
It starts to be scaring :shock:

None of us was expecting something like this....perhaps the hype in the announcement bring good luck :D
Note that even without assuming that stockfish was lucky this still does not suggest that Stockfish 1.4 is the best free engine for the simple reason that stockfish used 64 bits against 32 bits of rybka.

for some reason I do not see
Rybka 2.2n2 w64 1 cpu in the CEGT rating list
Uri Blass
Posts: 10897
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: Impressive Stockfish 1.4 !! Now Vs. Rybka3 and Naum4...

Post by Uri Blass »

Tomcass wrote:Game in 10 minutes each.
Hardware Intel i7 975 quad hyperthread
GUI: Fritz11
Book for Stockfish1.4 : CompBase Beta3
Book for Rybka3 and Naum4: Perfect 15


2009-07Stockfish1.4(2)-4 2009

Stockfish 1.4 JA 64bit(x8) - Rybka 3 9.0 - 11.0 +5/-7/=8 45.00%
Stockfish 1.4 JA 64bit(x8) - Naum 4(x8) 8.5 - 11.5 +4/-7/=9 42.50%


I know that CompBase Beta3 is a fantastic book, but you will agree with me that Stockfish 1.4 is really impressive. Congratulations again, Marco.

Regards,

Tom.
I do not know if Compbase Beta3 is a fantastic book.
The fact is that stockfish lost the match against rybka3 inspite of having 8:1 cores advantage(I also do not know if rybka was 64 bit version or 32 bit version from your post).

Uri
ThatsIt
Posts: 992
Joined: Thu Mar 09, 2006 2:11 pm

Re: Impressive Stockfish 1.4 !!

Post by ThatsIt »

Uri Blass wrote: Note that even without assuming that stockfish was lucky this still does not suggest that Stockfish 1.4 is the best free engine for the simple reason that stockfish used 64 bits against 32 bits of rybka.
I agree.
Ingo Bauer has made a great tournament (6'3").
Link http://forum.computerschach.de/cgi-bin/ ... l?tid=1279.
All engines 64-bit and 1 thread, ponder=off.

Best wishes,
G.S.
mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

Re: Impressive Stockfish 1.4 !!

Post by mcostalba »

ThatsIt wrote:
Uri Blass wrote: Note that even without assuming that stockfish was lucky this still does not suggest that Stockfish 1.4 is the best free engine for the simple reason that stockfish used 64 bits against 32 bits of rybka.
I agree.
I agree too.

Indeed in the Stockfish 1.4 announcement I clearly stated that free Rybka is still on another level.

And, yes, according to our internal tests Stockfish 1.4 has been lucky a bit. But you need also that. For instance SMP version of 1.2 _seems_ stronger then SMP of 1.3 but after extensive internal testing we come up to the conclusion that is not like that. Simply 1.2 was a bit lucky during tests.

CEGT and CCRL tests are very very good and we are proud and honored to be tested there, but you can trigger big changes, small ones in terms of ELO are very difficult to spot also for them...so, at the end of the day, you need a bit of luck 8-)
ThatsIt
Posts: 992
Joined: Thu Mar 09, 2006 2:11 pm

Re: Impressive Stockfish 1.4 !!

Post by ThatsIt »

mcostalba wrote:
ThatsIt wrote:
Uri Blass wrote: Note that even without assuming that stockfish was lucky this still does not suggest that Stockfish 1.4 is the best free engine for the simple reason that stockfish used 64 bits against 32 bits of rybka.
I agree.
I agree too.

Indeed in the Stockfish 1.4 announcement I clearly stated that free Rybka is still on another level.

And, yes, according to our internal tests Stockfish 1.4 has been lucky a bit. But you need also that. For instance SMP version of 1.2 _seems_ stronger then SMP of 1.3 but after extensive internal testing we come up to the conclusion that is not like that. Simply 1.2 was a bit lucky during tests.

CEGT and CCRL tests are very very good and we are proud and honored to be tested there, but you can trigger big changes, small ones in terms of ELO are very difficult to spot also for them...so, at the end of the day, you need a bit of luck 8-)
Hi !

In my mind Stockfish 1.4 is the best open source engine and thats superb !

btw, the test for the CEGT-Blitz-Ratinglist can be seen here:
http://cegt.foren-city.de/topic,262,-te ... -1cpu.html

Best wishes,
G.S.