In the big battle Stockfish vs Komodo leads… Gull!

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Sean Evans
Posts: 1777
Joined: Thu Jun 05, 2008 10:58 pm
Location: Canada

In the big battle Stockfish vs Komodo leads… Gull!

Post by Sean Evans »

S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: In the big battle Stockfish vs Komodo leads… Gull!

Post by S.Taylor »

Indeed, if the engines which get the constant updates lose what they earned earlier vs an older engine, Gull, which hasn't been recieving updates, and even a year ago was a lot weaker than the top engines which are supposedly getting even better by the day, then it doesn't say much for chess engine improvement!

Perhaps better leave things as they were a year ago and don't tamper anymore with the good things of yesterday.
User avatar
Graham Banks
Posts: 45781
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: In the big battle Stockfish vs Komodo leads… Gull!

Post by Graham Banks »

S.Taylor wrote:Indeed, if the engines which get the constant updates lose what they earned earlier vs an older engine, Gull, which hasn't been recieving updates, and even a year ago was a lot weaker than the top engines which are supposedly getting even better by the day, then it doesn't say much for chess engine improvement!

Perhaps better leave things as they were a year ago and don't tamper anymore with the good things of yesterday.
Amazing how many people can make judgements based on less than 10 games.
gbanksnz at gmail.com
S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: In the big battle Stockfish vs Komodo leads… Gull!

Post by S.Taylor »

Graham Banks wrote:
S.Taylor wrote:Indeed, if the engines which get the constant updates lose what they earned earlier vs an older engine, Gull, which hasn't been recieving updates, and even a year ago was a lot weaker than the top engines which are supposedly getting even better by the day, then it doesn't say much for chess engine improvement!

Perhaps better leave things as they were a year ago and don't tamper anymore with the good things of yesterday.
Amazing how many people can make judgements based on less than 10 games.
OK let's give it a few more and see if it shows its colors by the end of stage 3!
whereagles
Posts: 565
Joined: Thu Nov 13, 2014 12:03 pm

Re: In the big battle Stockfish vs Komodo leads… Gull!

Post by whereagles »

Seems like Gull scales wonderfully, making it particularly fit for current TCEC conditions.

Halfway up the competition and it leads by a full point. Will be very hard to kick it out of the finals.
shrapnel
Posts: 1339
Joined: Fri Nov 02, 2012 9:43 am
Location: New Delhi, India

Re: In the big battle Stockfish vs Komodo leads… Gull!

Post by shrapnel »

S.Taylor wrote:Indeed, if the engines which get the constant updates lose what they earned earlier vs an older engine, Gull, which hasn't been recieving updates, and even a year ago was a lot weaker than the top engines which are supposedly getting even better by the day, then it doesn't say much for chess engine improvement!
+1
i7 5960X @ 4.1 Ghz, 64 GB G.Skill RipJaws RAM, Twin Asus ROG Strix OC 11 GB Geforce 2080 Tis
Uri Blass
Posts: 11205
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: In the big battle Stockfish vs Komodo leads… Gull!

Post by Uri Blass »

whereagles wrote:Seems like Gull scales wonderfully, making it particularly fit for current TCEC conditions.

Halfway up the competition and it leads by a full point. Will be very hard to kick it out of the finals.
Seems that it is not the case and Fire scales better than Gull based on the CCRL list

Blitz
http://www.computerchess.org.uk/ccrl/40 ... _pure.html

3 Houdini 4 64-bit 4CPU 3350 (+24) +19 −19 70.8% −163.6 36.1% 1027
100.0%
4 Gull 3 64-bit 4CPU 3280 (+17) +18 −18 61.7% −88.1 43.1% 1020
6 Fire 4 64-bit 4CPU 3238 +14 −14 48.3% +9.3 52.1% 1627

Long time control

http://www.computerchess.org.uk/ccrl/4040/

3 Houdini 4 64-bit 4CPU 3263 +13 −13 58.9% −57.7 49.5% 2029
100.0%
4 Fire 4 64-bit 4CPU 3210 +16 −16 46.4% +21.0 60.8% 1068
88.0%
5 Gull 3 64-bit 4CPU 3197 +15 −15 50.2% −3.2 58.4% 1334
whereagles
Posts: 565
Joined: Thu Nov 13, 2014 12:03 pm

Re: In the big battle Stockfish vs Komodo leads… Gull!

Post by whereagles »

I meant scaling with nr. of cores.
User avatar
Leto
Posts: 2151
Joined: Thu May 04, 2006 3:40 am
Location: Dune

Re: In the big battle Stockfish vs Komodo leads… Gull!

Post by Leto »

Graham Banks wrote:
S.Taylor wrote:Indeed, if the engines which get the constant updates lose what they earned earlier vs an older engine, Gull, which hasn't been recieving updates, and even a year ago was a lot weaker than the top engines which are supposedly getting even better by the day, then it doesn't say much for chess engine improvement!

Perhaps better leave things as they were a year ago and don't tamper anymore with the good things of yesterday.
Amazing how many people can make judgements based on less than 10 games.
Agreed.

How about we wait and see how this stage ends up before making any conclusions?

Stockfish of course was hurt by the tc bug that caused it to lose in a completely winning position against Protector and to Gull in a drawn endgame. Komodo got dealt the unlucky card scoring only 1 point against Houdini in three games.

Up to game 46 Gull has 6 wins but of course 1 of those wasn't legit. Komodo has 4 wins, and Stockish has 5 but of course it would have 6 if it weren't for the tc bug.

Just by looking at the scoreboard you might conclude that Gull is outplaying Komodo and Stockfish but that would be incorrect, it's wiser to wait until more games are played.
Sean Evans
Posts: 1777
Joined: Thu Jun 05, 2008 10:58 pm
Location: Canada

Re: In the big battle Stockfish vs Komodo leads… Gull!

Post by Sean Evans »

The part no one seems to be mentioning is both Stockfish and Gull are free engines :D