WCCC: schedule, pairings, live broadcast

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
mclane
Posts: 18911
Joined: Thu Mar 09, 2006 6:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub

Re: WCCC: schedule, pairings, live broadcast

Post by mclane »

in the open tournament you measure the hardware strength !
Gian-Carlo Pascutto
Posts: 1260
Joined: Sat Dec 13, 2008 7:00 pm

Re: WCCC: schedule, pairings, live broadcast

Post by Gian-Carlo Pascutto »

hgm wrote:In general engines get stronger if you give them more time. And they get stronger if you give them more CPUs.

Not all engines benifit equally on in terms of Elo when doublingthe search time or doubling the number of CPUs. How well they can profit depends on the quality of the engine.
Giving an engine more CPUs has much more potential to make the engine weaker if the programmer is not careful.

Conversely, there aren't many engines that get weaker if they get more time.
Gian-Carlo Pascutto
Posts: 1260
Joined: Sat Dec 13, 2008 7:00 pm

Re: WCCC: schedule, pairings, live broadcast

Post by Gian-Carlo Pascutto »

in the open tournament you measure the hardware strength !
Particularly the programmers ability to make use of it.

The "handicap" tournament also measures hardware strength. Some engines are on quads, others are on (much faster) dual Nehalems. You're measuring hardware strength within a completely arbitrary limitation.

The open tournament opens up more possibilities for true innovation.
Last edited by Gian-Carlo Pascutto on Mon May 11, 2009 3:44 pm, edited 2 times in total.
Gian-Carlo Pascutto
Posts: 1260
Joined: Sat Dec 13, 2008 7:00 pm

Re: WCCC: schedule, pairings, live broadcast

Post by Gian-Carlo Pascutto »

Matthias Gemuh wrote: In other words, the Open Tournament is one in which the final standings least reflect the strengths of the engines.
What is strength? If a great engine on single CPU can't even use a dual, does it deserve to be called strong?
User avatar
hgm
Posts: 28387
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: WCCC: schedule, pairings, live broadcast

Post by hgm »

Gian-Carlo Pascutto wrote:Giving an engine more CPUs has much more potential to make the engine weaker if the programmer is not careful.

Conversely, there aren't many engines that get weaker if they get more time.
Buggy engines can easily get weaker when given more time. E.g. if they have a fixed probability for a fatal crash per unit of time. Once the engine gets beyond a certain quality.

For 1 vs 2 CPUs you might have a point. But by the time an engine can ue 8 CPUs, it is beyond the quality level where it would benefit from more. So there is little point in giving it more, just like there is little point in increasing the TC from 2 hours to 2 days.
Gian-Carlo Pascutto
Posts: 1260
Joined: Sat Dec 13, 2008 7:00 pm

Re: WCCC: schedule, pairings, live broadcast

Post by Gian-Carlo Pascutto »

hgm wrote:. But by the time an engine can ue 8 CPUs, it is beyond the quality level where it would benefit from more.
I have absolutely no idea what that is supposed to mean.
User avatar
pedrox
Posts: 1056
Joined: Fri Mar 10, 2006 6:07 am
Location: Basque Country (Spain)

Re: WCCC: schedule, pairings, live broadcast

Post by pedrox »

Asked for someone who is in Pamplona:

Can people enter in the room for see the games?

I will be in Pamplona on Thursday to participate in the Rapid Tournament

Best,

Pedro
User avatar
hgm
Posts: 28387
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: WCCC: schedule, pairings, live broadcast

Post by hgm »

Gian-Carlo Pascutto wrote: I have absolutely no idea what that is supposed to mean.
It is supposed to mean that to beneficially use 8 CPUs, you will need an advanced algorithm, and simple tricks like shared hash with unsynchronized searches won't cut it anymore.
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: WCCC: schedule, pairings, live broadcast

Post by bob »

hgm wrote:
Gian-Carlo Pascutto wrote:Giving an engine more CPUs has much more potential to make the engine weaker if the programmer is not careful.

Conversely, there aren't many engines that get weaker if they get more time.
Buggy engines can easily get weaker when given more time. E.g. if they have a fixed probability for a fatal crash per unit of time. Once the engine gets beyond a certain quality.

For 1 vs 2 CPUs you might have a point. But by the time an engine can ue 8 CPUs, it is beyond the quality level where it would benefit from more. So there is little point in giving it more, just like there is little point in increasing the TC from 2 hours to 2 days.
This is simply wrong. Using 8 is not twice as hard as using 4. It is worse. Using 16 is not twice as hard as using 8. It is worse. Using a cluster with two nodes is not twice as hard as using a single node. It is worse.

The problem is called "scalability" and it is an extremely difficult one to deal with. Past WCCC events have rewarded those that take the time to make this stuff work. Now we have a crippled/irrelevant tournament, and a small "open" tournament that correlates to what has been done in previous events...
Gian-Carlo Pascutto
Posts: 1260
Joined: Sat Dec 13, 2008 7:00 pm

Re: WCCC: schedule, pairings, live broadcast

Post by Gian-Carlo Pascutto »

hgm wrote:
Gian-Carlo Pascutto wrote: I have absolutely no idea what that is supposed to mean.
It is supposed to mean that to beneficially use 8 CPUs, you will need an advanced algorithm, and simple tricks like shared hash with unsynchronized searches won't cut it anymore.
I think that's a great argument to have much more cores rather than less, because the effect is greater on 16 or on clusters.

I always thought computer chess was about advanced algorithms, rather than making the fastest Fruit clone. It's whatever you want to make of it, I guess, I know what my choice is...