TCEC superfinal, what will it be like?

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

TCEC superfinal, what will it be like?

Post by S.Taylor »

What upgrades will there be different to stage 3?
And how are they comparable with the same programs in TCEC season 7?

I'm sure SF has made corrections and maybe upgrade of its playing strength. Even if no upgrade in elo, I feel the original SF at the beginning of stage 3, but with clock corrected, may be stronger than Komodo 9.2.

Or is Komodo also submitting a further improved version again?
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: TCEC superfinal, what will it be like?

Post by JJJ »

Stockfish regression test showed +60 ELO from Stockfish 6. I think they improved at least 15 elo recently from dev version and probably a little more with Lazy SMP patch on high number of core.

I don't know how better is now Komodo, so It is tough to say who is favorite. I need to know more about Komodo dev to be sure. And of course, it is a better Komodo who will play.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: TCEC superfinal, what will it be like?

Post by Laskos »

JJJ wrote:Stockfish regression test showed +60 ELO from Stockfish 6. I think they improved at least 15 elo recently from dev version and probably a little more with Lazy SMP patch on high number of core.

I don't know how better is now Komodo, so It is tough to say who is favorite. I need to know more about Komodo dev to be sure. And of course, it is a better Komodo who will play.
These are a bit another ELOs, ultra-bullet and self-games, more like 30-45 ELO points at 5+3 and varied opposition. Roughly similar amount to Komodo improvement during the same period of time. Lazy_SMP at TCEC is a wild card, though. Let's see how it performs.
S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: TCEC superfinal, what will it be like?

Post by S.Taylor »

Now at this very momment, we are awaiting the final stage, "superfinal".
No exact details have been posted.
(I suppose they are much too busy rushing to be ready!)
User avatar
Eelco de Groot
Posts: 4697
Joined: Sun Mar 12, 2006 2:40 am
Full name:   Eelco de Groot

Re: TCEC superfinal, what will it be like?

Post by Eelco de Groot »

S.Taylor wrote:Now at this very momment, we are awaiting the final stage, "superfinal".
No exact details have been posted.
(I suppose they are much too busy rushing to be ready!)
From Fishtest:
Martin stated that the superfinal will start on Nov. 3rd regardless of the finish date of stage 3, so we have still a week.
Yes, at the moment Stockfish is being completely rewritten and maybe even set to autocompile. Komodo team will be entering a version they have been secretely testing in their beta team. So they have the advantage here.

I am just kidding, I hope you understand. None of the above is true :P I do agree with Kai, from a theoretical perspective, Lazy SMP is really just LAZY SMP and should not perform better. Disclaimer: that would be my first reaction without looking at any specific code, so just for the argument here. But then the question is, is Komodo using still Don's version of Lazy SMP (basically I mean, because it was never really finished by Don) and is that why it is so strong at many threads? I don't know. If Lazy SMP for Stockfish means it is searching 'wider', especially at the root then this may be explaining the advantage in that it is correcting the fact that at the very high depths achieved in TCEC you don't really need the Singular Extensions in the PV anymore, or that they are set to extend too much at these depths. Combined with an oversupply of threads for an serial algorithm like alpha beta. Lazy SMP would correct some of that, but in a 'lazy' way. I would expect, Stockfish' Lazy SMP not to be much beter than Toga's version of Lazy SMP: reasonable, but not scaling spectacularly well especially above four threads...
Debugging is twice as hard as writing the code in the first
place. Therefore, if you write the code as cleverly as possible, you
are, by definition, not smart enough to debug it.
-- Brian W. Kernighan
Joerg Oster
Posts: 992
Joined: Fri Mar 10, 2006 4:29 pm
Location: Germany
Full name: Jörg Oster

Re: TCEC superfinal, what will it be like?

Post by Joerg Oster »

Eelco de Groot wrote:
S.Taylor wrote:Now at this very momment, we are awaiting the final stage, "superfinal".
No exact details have been posted.
(I suppose they are much too busy rushing to be ready!)
From Fishtest:
Martin stated that the superfinal will start on Nov. 3rd regardless of the finish date of stage 3, so we have still a week.
Yes, at the moment Stockfish is being completely rewritten and maybe even set to autocompile. Komodo team will be entering a version they have been secretely testing in their beta team. So they have the advantage here.

I am just kidding, I hope you understand. None of the above is true :P I do agree with Kai, from a theoretical perspective, Lazy SMP is really just LAZY SMP and should not perform better. Disclaimer: that would be my first reaction without looking at any specific code, so just for the argument here. But then the question is, is Komodo using still Don's version of Lazy SMP (basically I mean, because it was never really finished by Don) and is that why it is so strong at many threads? I don't know. If Lazy SMP for Stockfish means it is searching 'wider', especially at the root then this may be explaining the advantage in that it is correcting the fact that at the very high depths achieved in TCEC you don't really need the Singular Extensions in the PV anymore, or that they are set to extend too much at these depths. Combined with an oversupply of threads for an serial algorithm like alpha beta. Lazy SMP would correct some of that, but in a 'lazy' way. I would expect, Stockfish' Lazy SMP not to be much beter than Toga's version of Lazy SMP: reasonable, but not scaling spectacularly well especially above four threads...
Well, test results just showed the opposite.
It was difficult to get en par with YBW performance and 3 threads. While Lazy SMP gave better performance right from the beginning with a higher number of threads, iirc.
Jörg Oster
lucasart
Posts: 3243
Joined: Mon May 31, 2010 1:29 pm
Full name: lucasart

Re: TCEC superfinal, what will it be like?

Post by lucasart »

S.Taylor wrote:What upgrades will there be different to stage 3?
And how are they comparable with the same programs in TCEC season 7?

I'm sure SF has made corrections and maybe upgrade of its playing strength. Even if no upgrade in elo, I feel the original SF at the beginning of stage 3, but with clock corrected, may be stronger than Komodo 9.2.

Or is Komodo also submitting a further improved version again?
>80% draws. You can trust Cato for that :lol:
Theory and practice sometimes clash. And when that happens, theory loses. Every single time.
whereagles
Posts: 565
Joined: Thu Nov 13, 2014 12:03 pm

Re: TCEC superfinal, what will it be like?

Post by whereagles »

Cato promised a bloodbath for the SF (superfinal lol). As in, unbalanced dynamical positions in the ~0.40-0.50 eval range.

But keep in mind it's not him choosing the openings this time.
mjlef
Posts: 1494
Joined: Thu Mar 30, 2006 2:08 pm

Re: TCEC superfinal, what will it be like?

Post by mjlef »

I have seen amazingly good results of Komodo 9.2 versus the latest Stockfish. And I have seen equally bad results of newer Komodo versions versus the same Stockfish. And we have good results of the new Komodo versus Komodo 9.2. But no results at all on a tcec-like machine at superfinal time controls. Overall, I make no predictions about the super final.

OK, back to vacation!

Mark
whereagles
Posts: 565
Joined: Thu Nov 13, 2014 12:03 pm

Re: TCEC superfinal, what will it be like?

Post by whereagles »

It's been a long time since season 7 and a lot has happened. K and SF both had many changes.

Hard to call a favourite, but I'd still put my money on Komodo... (which by the way should be renamed to a much more stylish "Dragon" :D).