stockfish 7

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

whereagles
Posts: 565
Joined: Thu Nov 13, 2014 12:03 pm

Re: stockfish 7

Post by whereagles »

APassionForCriminalJustic wrote:Oh wow... so clearly with CCRL's hardware and blitz time control Komodo 9.3 is definitely weaker than Stockfish development of November the 25th (Stockfish 251115 64-bit 4CPU).
What K9.3? I see K9.2 there...
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: stockfish 7

Post by Modern Times »

APassionForCriminalJustic wrote: It looks like Komodo has gained nothing on the list though. That's a little discouraging.
Too few games to conclude anything on that. Problem is a +15 Elo gain is within the margins of error for the number of games we typically run. So we may see +15, we may see no gain at all, or we may see slightly negative. In many repects it wasn't a good idea to test it, perhaps testing every second Komodo version may make more sense.
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: stockfish 7

Post by lkaufman »

Modern Times wrote:
APassionForCriminalJustic wrote: It looks like Komodo has gained nothing on the list though. That's a little discouraging.
Too few games to conclude anything on that. Problem is a +15 Elo gain is within the margins of error for the number of games we typically run. So we may see +15, we may see no gain at all, or we may see slightly negative. In many repects it wasn't a good idea to test it, perhaps testing every second Komodo version may make more sense.
Although so far CCRL shows no gain, CEGT shows a 29 elo gain as of this writing, so on average it's close to our +15 estimate. Due to the margin of error problem, one should always check at least these two lists. I don't think either list should refrain from testing something just because the gain might be less than margin of error; people can look at all lists, and most of the time the error is less than half the margin. As long as there has been a reasonable interval between two versions of any engine, maybe six weeks or perhaps two months, that is enough reason to test. You don't know in advance what the gain may be, unless you take the developer's estimate as fact. We know quite accurately what the gain will be in bullet chess, but we never really know in advance what the gain will be at the intermediate levels like your 40/40.
Komodo rules!
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: stockfish 7

Post by Modern Times »

whereagles wrote:
Modern Times wrote:Have you checked the blitz list or the FRC list ?
I was only thinking of the 40/40 list, which I feel is the most important TC standard of CCRL.
.
Take a look at the 4040 list now. No later SF version, but Komodo 9.3 is there with a small number of games.
APassionForCriminalJustic
Posts: 417
Joined: Sat May 24, 2014 9:16 am

Re: stockfish 7

Post by APassionForCriminalJustic »

whereagles wrote:
APassionForCriminalJustic wrote:Oh wow... so clearly with CCRL's hardware and blitz time control Komodo 9.3 is definitely weaker than Stockfish development of November the 25th (Stockfish 251115 64-bit 4CPU).
What K9.3? I see K9.2 there...
Komodo 9.3 is there... but it is slightly lower than K 9.2. Quite a few games have been played also. I strongly doubt that 9.3 matches Stockfish in blitz anyways with only four cores. So it makes sense to me. Stockfish 6 of course is a dead fish now.
User avatar
Graham Banks
Posts: 41412
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: stockfish 7

Post by Graham Banks »

APassionForCriminalJustic wrote:
whereagles wrote:
APassionForCriminalJustic wrote:Oh wow... so clearly with CCRL's hardware and blitz time control Komodo 9.3 is definitely weaker than Stockfish development of November the 25th (Stockfish 251115 64-bit 4CPU).
What K9.3? I see K9.2 there...
Komodo 9.3 is there... but it is slightly lower than K 9.2. Quite a few games have been played also. I strongly doubt that 9.3 matches Stockfish in blitz anyways with only four cores. So it makes sense to me. Stockfish 6 of course is a dead fish now.
http://computerchess.org.uk/ccrl/404/cg ... ons_only=1

http://computerchess.org.uk/ccrl/404/cg ... ons_only=1
gbanksnz at gmail.com
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: stockfish 7

Post by lkaufman »

APassionForCriminalJustic wrote:
whereagles wrote:
APassionForCriminalJustic wrote:Oh wow... so clearly with CCRL's hardware and blitz time control Komodo 9.3 is definitely weaker than Stockfish development of November the 25th (Stockfish 251115 64-bit 4CPU).
What K9.3? I see K9.2 there...
Komodo 9.3 is there... but it is slightly lower than K 9.2. Quite a few games have been played also. I strongly doubt that 9.3 matches Stockfish in blitz anyways with only four cores. So it makes sense to me. Stockfish 6 of course is a dead fish now.
On CEGT 40/20 Komodo on 1 thread after 300 games is 66 elo above Stockfish 6, which is more than the likely gain for Stockfish 7 at this level I think. 40/20 is really about 40/10 on modern hardware due to the way they adjust, which is roughly equivalent to four threads in blitz. So we may have a split decision where Komodo tops the CEGT blitz even after SF 7 comes out while SF 7 tops the CCRL blitz list. Of course all of this can change a lot with more games.
Komodo rules!
Jouni
Posts: 3278
Joined: Wed Mar 08, 2006 8:15 pm

Re: stockfish 7

Post by Jouni »

I bet You can release 9.4 and 9.5 before SF7 :) .
Jouni
stavros
Posts: 165
Joined: Tue Dec 02, 2014 1:29 am

Re: stockfish 7

Post by stavros »

after latest patches the bugs seems fixed,so is the official sf7 near?
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: stockfish 7

Post by beram »

lkaufman wrote:
APassionForCriminalJustic wrote:
whereagles wrote:
APassionForCriminalJustic wrote:Oh wow... so clearly with CCRL's hardware and blitz time control Komodo 9.3 is definitely weaker than Stockfish development of November the 25th (Stockfish 251115 64-bit 4CPU).
What K9.3? I see K9.2 there...
Komodo 9.3 is there... but it is slightly lower than K 9.2. Quite a few games have been played also. I strongly doubt that 9.3 matches Stockfish in blitz anyways with only four cores. So it makes sense to me. Stockfish 6 of course is a dead fish now.
On CEGT 40/20 Komodo on 1 thread after 300 games is 66 elo above Stockfish 6, which is more than the likely gain for Stockfish 7 at this level I think. 40/20 is really about 40/10 on modern hardware due to the way they adjust, which is roughly equivalent to four threads in blitz. So we may have a split decision where Komodo tops the CEGT blitz even after SF 7 comes out while SF 7 tops the CCRL blitz list. Of course all of this can change a lot with more games.
Now after some more weeks things have levelled out and the difference between Komodo 9.3 and Stockfish 6 on 1 core is 34 ELo and not anymore the 66 ELO as Larry mentioned above. The difference between them with 4 cores is even smaller 24
Time for 9.4?

http://www.husvankempen.de/nunn/40_40%2 ... liste.html