stockfish 7

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
whereagles
Posts: 561
Joined: Thu Nov 13, 2014 11:03 am

Re: stockfish 7

Post by whereagles » Sat Dec 05, 2015 9:51 am

APassionForCriminalJustic wrote:Oh wow... so clearly with CCRL's hardware and blitz time control Komodo 9.3 is definitely weaker than Stockfish development of November the 25th (Stockfish 251115 64-bit 4CPU).
What K9.3? I see K9.2 there...

Modern Times
Posts: 2417
Joined: Thu Jun 07, 2012 9:02 pm

Re: stockfish 7

Post by Modern Times » Sat Dec 05, 2015 10:11 am

APassionForCriminalJustic wrote: It looks like Komodo has gained nothing on the list though. That's a little discouraging.
Too few games to conclude anything on that. Problem is a +15 Elo gain is within the margins of error for the number of games we typically run. So we may see +15, we may see no gain at all, or we may see slightly negative. In many repects it wasn't a good idea to test it, perhaps testing every second Komodo version may make more sense.
.

Opinions expressed here are my own, and not necessarily those of the CCRL Group.

lkaufman
Posts: 3750
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: stockfish 7

Post by lkaufman » Sat Dec 05, 2015 5:09 pm

Modern Times wrote:
APassionForCriminalJustic wrote: It looks like Komodo has gained nothing on the list though. That's a little discouraging.
Too few games to conclude anything on that. Problem is a +15 Elo gain is within the margins of error for the number of games we typically run. So we may see +15, we may see no gain at all, or we may see slightly negative. In many repects it wasn't a good idea to test it, perhaps testing every second Komodo version may make more sense.
Although so far CCRL shows no gain, CEGT shows a 29 elo gain as of this writing, so on average it's close to our +15 estimate. Due to the margin of error problem, one should always check at least these two lists. I don't think either list should refrain from testing something just because the gain might be less than margin of error; people can look at all lists, and most of the time the error is less than half the margin. As long as there has been a reasonable interval between two versions of any engine, maybe six weeks or perhaps two months, that is enough reason to test. You don't know in advance what the gain may be, unless you take the developer's estimate as fact. We know quite accurately what the gain will be in bullet chess, but we never really know in advance what the gain will be at the intermediate levels like your 40/40.
Komodo rules!

Modern Times
Posts: 2417
Joined: Thu Jun 07, 2012 9:02 pm

Re: stockfish 7

Post by Modern Times » Sat Dec 05, 2015 7:39 pm

whereagles wrote:
Modern Times wrote:Have you checked the blitz list or the FRC list ?
I was only thinking of the 40/40 list, which I feel is the most important TC standard of CCRL.
.
Take a look at the 4040 list now. No later SF version, but Komodo 9.3 is there with a small number of games.
.

Opinions expressed here are my own, and not necessarily those of the CCRL Group.

APassionForCriminalJustic
Posts: 415
Joined: Sat May 24, 2014 7:16 am

Re: stockfish 7

Post by APassionForCriminalJustic » Sun Dec 06, 2015 1:52 am

whereagles wrote:
APassionForCriminalJustic wrote:Oh wow... so clearly with CCRL's hardware and blitz time control Komodo 9.3 is definitely weaker than Stockfish development of November the 25th (Stockfish 251115 64-bit 4CPU).
What K9.3? I see K9.2 there...
Komodo 9.3 is there... but it is slightly lower than K 9.2. Quite a few games have been played also. I strongly doubt that 9.3 matches Stockfish in blitz anyways with only four cores. So it makes sense to me. Stockfish 6 of course is a dead fish now.

User avatar
Graham Banks
Posts: 33236
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: stockfish 7

Post by Graham Banks » Sun Dec 06, 2015 2:01 am

APassionForCriminalJustic wrote:
whereagles wrote:
APassionForCriminalJustic wrote:Oh wow... so clearly with CCRL's hardware and blitz time control Komodo 9.3 is definitely weaker than Stockfish development of November the 25th (Stockfish 251115 64-bit 4CPU).
What K9.3? I see K9.2 there...
Komodo 9.3 is there... but it is slightly lower than K 9.2. Quite a few games have been played also. I strongly doubt that 9.3 matches Stockfish in blitz anyways with only four cores. So it makes sense to me. Stockfish 6 of course is a dead fish now.
http://computerchess.org.uk/ccrl/404/cg ... ons_only=1

http://computerchess.org.uk/ccrl/404/cg ... ons_only=1
My email addresses:
gbanksnz at gmail.com
gbanksnz at yahoo.co.nz

lkaufman
Posts: 3750
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: stockfish 7

Post by lkaufman » Sun Dec 06, 2015 2:59 am

APassionForCriminalJustic wrote:
whereagles wrote:
APassionForCriminalJustic wrote:Oh wow... so clearly with CCRL's hardware and blitz time control Komodo 9.3 is definitely weaker than Stockfish development of November the 25th (Stockfish 251115 64-bit 4CPU).
What K9.3? I see K9.2 there...
Komodo 9.3 is there... but it is slightly lower than K 9.2. Quite a few games have been played also. I strongly doubt that 9.3 matches Stockfish in blitz anyways with only four cores. So it makes sense to me. Stockfish 6 of course is a dead fish now.
On CEGT 40/20 Komodo on 1 thread after 300 games is 66 elo above Stockfish 6, which is more than the likely gain for Stockfish 7 at this level I think. 40/20 is really about 40/10 on modern hardware due to the way they adjust, which is roughly equivalent to four threads in blitz. So we may have a split decision where Komodo tops the CEGT blitz even after SF 7 comes out while SF 7 tops the CCRL blitz list. Of course all of this can change a lot with more games.
Komodo rules!

Jouni
Posts: 2027
Joined: Wed Mar 08, 2006 7:15 pm

Re: stockfish 7

Post by Jouni » Sun Dec 06, 2015 5:13 pm

I bet You can release 9.4 and 9.5 before SF7 :) .
Jouni

stavros
Posts: 138
Joined: Tue Dec 02, 2014 12:29 am

Re: stockfish 7

Post by stavros » Mon Dec 14, 2015 9:42 pm

after latest patches the bugs seems fixed,so is the official sf7 near?

beram
Posts: 1187
Joined: Wed Jan 06, 2010 2:11 pm

Re: stockfish 7

Post by beram » Wed Dec 23, 2015 12:08 pm

lkaufman wrote:
APassionForCriminalJustic wrote:
whereagles wrote:
APassionForCriminalJustic wrote:Oh wow... so clearly with CCRL's hardware and blitz time control Komodo 9.3 is definitely weaker than Stockfish development of November the 25th (Stockfish 251115 64-bit 4CPU).
What K9.3? I see K9.2 there...
Komodo 9.3 is there... but it is slightly lower than K 9.2. Quite a few games have been played also. I strongly doubt that 9.3 matches Stockfish in blitz anyways with only four cores. So it makes sense to me. Stockfish 6 of course is a dead fish now.
On CEGT 40/20 Komodo on 1 thread after 300 games is 66 elo above Stockfish 6, which is more than the likely gain for Stockfish 7 at this level I think. 40/20 is really about 40/10 on modern hardware due to the way they adjust, which is roughly equivalent to four threads in blitz. So we may have a split decision where Komodo tops the CEGT blitz even after SF 7 comes out while SF 7 tops the CCRL blitz list. Of course all of this can change a lot with more games.
Now after some more weeks things have levelled out and the difference between Komodo 9.3 and Stockfish 6 on 1 core is 34 ELo and not anymore the 66 ELO as Larry mentioned above. The difference between them with 4 cores is even smaller 24
Time for 9.4?

http://www.husvankempen.de/nunn/40_40%2 ... liste.html

Post Reply