A compromise idea for the WCCC hardware limit

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

BubbaTough
Posts: 1154
Joined: Fri Jun 23, 2006 5:18 am

Re: A compromise idea for the WCCC hardware limit

Post by BubbaTough »

Mike S. wrote:Anyway, Levy seems to see that in a similar way, as he does NOT talk about programmers only but also addresses other "interested parties" (although I do not know which groups he has in mind, exactly).
Originally Levy talked about programmers who compete in WCCC as if they were the only ones whose opinions were relevant. Possibly because there is no group more influential on attendance than the program authors. He has since changed his terminology, possibly because that group almost universally disagrees with him.

-Sam
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: A compromise idea for the WCCC hardware limit

Post by bob »

Harvey Williamson wrote:
bob wrote:This event is for the _programmers_. Not for the spectators. Not for the users. Not for the players. For the _programmers_.
I wonder if the sponsors know this?
Is the Soccer World Cup just for the players?
Or as formula 1 is often quoted here is it just for the car makers?
etc etc etc....
The sponsors know it is "the best of the best". Not some watered-down competition that means nothing at all. The event is noteworthy because the hardware is unlimited, and it gets a lot of publicity as a result. A "uniform platform" event gets _nothing_. Most people don't even know that there used to be an annual uniform-platform event. Wonder why? :)
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: A compromise idea for the WCCC hardware limit

Post by bob »

Mike S. wrote:In the other thread are my arguments which point into the other direction and anyone can read them if he wants, or ignore them. Anyway, Levy seems to see that in a similar way, as he does NOT talk about programmers only but also addresses other "interested parties" (although I do not know which groups he has in mind, exactly).

I want that computer chess gets, has and keeps publicity, at least in the general chess world. A WCCC with regulations as the time and circumstances require it (to continue at all) is important for that.

As a long time fan I have tried to contribute some thoughts on this, and that is all I can do. I don't feel like wanting to repeat myself, so I quit here. - Thanks for fairness if you quote me; please no "interpretations", use copy & paste please :mrgreen:
I will ask if I can post an email I just received from David. He has somehow reached the conclusion that the reason WCCC competition is down is because of the hardware issues. I reminded him that hardware restrictions hasn't been an issue in almost 40 years of these events, and that he might look at the format to see the problems:

(1) used to be 3-4 days for a tournament, now two weeks.

(2) used to be held on a weekend + M-T or sometimes M-T-W. Not hard to take 2-3 days from work to attend.

(3) used to cost 1/4 of what the current 2-week format costs, plus 1/2 the time it was in Europe, the other half in North America which further helped control cost, where now it is often held in _neither_ of those, but in some place even farther away and more expensive to reach.

Changing the hardware is a shot in the dark, and it has already been proven that it won't work, just try to play in the old uniform-platform tournament that used to be held at Queen Mary College in London. Died due to lack of interest.
CThinker
Posts: 388
Joined: Wed Mar 08, 2006 10:08 pm

Re: A compromise idea for the WCCC hardware limit

Post by CThinker »

Harvey Williamson wrote:
bob wrote:This event is for the _programmers_. Not for the spectators. Not for the users. Not for the players. For the _programmers_.
I wonder if the sponsors know this?
Is the Soccer World Cup just for the players?
Or as formula 1 is often quoted here is it just for the car makers?
etc etc etc....
I think that, in a way, those events are for the players and automakers. Racing has existed long before there were sponsors.

Also, the comparison is not valid, because WCCC does not get money from spectators. So, I don't think the spectators have a say here. In contrast, the programmers spend effort and money on both the development and the actual tournament.

Now, if the WCCC type of rules will be applied to F1, they would be limited to racing family sedans. That just demonstrates how silly the home PC limit is for the "World Chess Champion".
User avatar
Kirill Kryukov
Posts: 518
Joined: Sun Mar 19, 2006 4:12 am
Full name: Kirill Kryukov

Re: A compromise idea for the WCCC hardware limit

Post by Kirill Kryukov »

Mike S. wrote:Unlike during the 1980s/90s, when there were two tournaments separated from each other, maybe world champion titles in two categories could be awarded in one event, alltogether.

:arrow: (1.) The absolute Computer Chess World Champion
(everything unlimited)

:arrow: (2.) The Uniform Platform Computer Chess World Champion
(consumer-orientated hardware limit; other limits like for opening books are debateable IMO but I won't stress that.)

Some will say, what do we need (2) for, or I am only interested in (1). Others will say, (1) is meaningless for me, or with the equipment I can afford I have no chance in (1). So, this proposal is only for people who can accept, and want to handle compromises. A compromise can provide the chance to include all parties of interest, unlike when an extreme position wins and others are excluded (for whatever reason or in whatever role).

I think it can be done if up to two entries are allowed, per participant. But in that case, one entry would have to play for (2.) with limited hardware. In case of only one entry, he should have the free choice of category. Maybe a long swiss tournament could be done in a way that whenever possible, the category of the opponent is switched, round by round (like the switch of colors).

The idea of uniform platform raises the problem - which maybe also is a chance though - to find a sponsor for the required number of identical computers, on site.

Alternatively, the particpants would need to bring in "very similar" hardware for category (2). But I think that is only the second best choice, because even with adjustments, they can probably not be standardized in the sense of uniform platform. - Or the requirement for / definition of "consumer-orientated hardware limit" is regulated in a way that it allows a certain bandwidth. Limiting the number of cores only, seems very general.

Also, for now - but probably not for the near future - I think 4 cores would be a better limit, because as explained by Jens, there are huge cost and performance differences within an 8 core limit, still. We have had similar thoughts here, because the same topic was being discussed at the Rybka forum some time ago too, where I had suggested u.p. with quads.

As for the verification of how many cores are used: This just cannot be a problem in a place where computer experts gather together. For example, Microsoft's Process Explorer doesn't even need to be installed, so the tournament director could have it on an USB stick. So nobody can hack it to display a faked CPU load (in case if lovers of conspiracy theories had such concerns :mrgreen:). There are also free CPU identification tools, like CPU-Z.

http://technet.microsoft.com/en-us/sysi ... 96653.aspx

(I am almost sure that such ready-to-run tools also exist for Linux and Mac, but I don't know it.)

Anyway, I am aware myself that my proposal is not very realistic, but it should show that a compromise is possible, at least as something "theoretically imaginable"...
This "compromise" is basically identical to just event 1 existing, because no one will care about event 2, unless it has a very attractive prize (which I doubt will happen).

We already know how various engines stand with "consumer-oriented hardware limit", there is enough data accumulated and published online.

"Consumer-oriented" event may at first sound like a good idea, but to just limit hardware is only one step towards the consumer. For an event to be really consumer-oriented, only publicly available engines should be allowed to compete. With publicly available books as well, and on available common hardware.

Then of course there is question how do the consumers actually use a chess engine. If most of the consumers use chess engines for analysis, rather than for playing with them (which I believe to be true), then using a shared shallow opening book would give a better picture about how well various engines are suited to this purpose.

Then there is a question: what conclusion can a consumer draw from a result of such an event? (event 2). Obviously the statistical significance is too low for the result to be of any use for consumer's decision-making. Although world title may be useful for marketing, it is actually misleading (as most people don't know how to interpret tournament results), and therefore is against the interst of the consumer.

So the whole idea of the consumer-oriented event is flawed from about every angle.

Plus, with ongoing testing projects, providing thousands of games under a variety of testing conditions, the consumer already knows all he needs to know about the comparative strength of chess programs.

What consumer in fact wants from a WCCC is the battle of the most advanced computer chess players that could be created. Consumer wants to be thrilled. Uniform Platform even would not thrill anyone. No one will even watch it, other than true fanatics like us.

Clearly the "Uniform Platform", or "Limited Platform" is not interesting for the consumer. As evident from this and other forums, it is also not interesting for the absolute majority of programmers. The natural question is then: who needs a hardware limit?". Probably only ICGA needs it, lobbied by those commercial programmers (are there more than 1?) who already possess an 8-core hardware.

The reason why those commercial programmer(s) would want such limit is not only to weaken the competitors (eg Rybka). I think they foresee that with hardware limit there simply will be much less of competition at all. Because many authors will decide to ignore the event. So those commercial programmers have double benefit. They will play on their fine-tuned 8-core machine, with a few remaining opponents. And with a good probability they will then display "World Champion 2009" in their ads.

Question is: How the ICGA could fall for this, and if there are other factors (unknown to us) that influenced their decision.

Note that form the ICGA point of view the decision is totally stupid, as it destroys the world title, and without the world title, who needs the ICGA? May be ICGA will have more success organizing Hex of Connect 6 tournaments?

Best,
Kirill
User avatar
Harvey Williamson
Posts: 2026
Joined: Sun May 25, 2008 11:12 pm
Location: Whitchurch. Shropshire, UK.
Full name: Harvey Williamson

Re: A compromise idea for the WCCC hardware limit

Post by Harvey Williamson »

CThinker wrote:
Harvey Williamson wrote:
bob wrote:This event is for the _programmers_. Not for the spectators. Not for the users. Not for the players. For the _programmers_.
I wonder if the sponsors know this?
Is the Soccer World Cup just for the players?
Or as formula 1 is often quoted here is it just for the car makers?
etc etc etc....
I think that, in a way, those events are for the players and automakers. Racing has existed long before there were sponsors.

Also, the comparison is not valid, because WCCC does not get money from spectators. So, I don't think the spectators have a say here. In contrast, the programmers spend effort and money on both the development and the actual tournament.

Now, if the WCCC type of rules will be applied to F1, they would be limited to racing family sedans. That just demonstrates how silly the home PC limit is for the "World Chess Champion".
Do you think a sponsor would have any interest in the even if they read Bob's statement above?
User avatar
George Tsavdaris
Posts: 1627
Joined: Thu Mar 09, 2006 12:35 pm

Re: A compromise idea for the WCCC hardware limit

Post by George Tsavdaris »

Mike S. wrote:
George Tsavdaris wrote: No need to wonder. The answer is simple. In his system Hydra has no place. It should not participate in the WCCC. He said that clearly in another post.
Please try to be fair. I NEVER said that, I said it was a wise decision not to participate.
OK then fair enough. I clearly misunderstood what you've said then, but when you say it is wise for Hydra not to participate because of the big hardware, it's logical to presume that you mean Hydra should not participate in WCCC when it is allowed only limited hardware.

And what if WCCC happens only in one format? That of the limited hardware? Should Hydra not be allowed to enter?
Is this an open tournament or what? Is this democracy or what?
Is this promotion and encouragement of computer Chess research or what?
Utilizing graphic card hardware is a different and interesting question, and if "standard" graphics hardware is used - that means, something you can buy from the computer shop on the next corner - than it could be called consumer-like hardware and I would tend to include it into that category.
Are the 40 cores of Rybka NOT a consumer-like hardware? It is being consisted of 4 Skulltrails and 1 Xeon that anyone can buy in any computer store.
Why it is non-consumer-like hardware? (don't forget that your definition of consumer-like is given above and it is something you can buy from the computer chop on the next corner)
So.....?

What about a 40 core cluster consisted of 10 QUAD of QX6600? Its price would be much cheaper than that of a Skulltrail with a cool overclocking system.
What is it more consumer like? The 40 core QX6600 cluster or the Skulltrail? Of course the cluster as it's cheaper.
So....?
After his son's birth they've asked him:
"Is it a boy or girl?"
YES! He replied.....
User avatar
George Tsavdaris
Posts: 1627
Joined: Thu Mar 09, 2006 12:35 pm

Re: A compromise idea for the WCCC hardware limit

Post by George Tsavdaris »

Harvey Williamson wrote: Do you think a sponsor would have any interest in the even if they read Bob's statement above?
Bob's statement is for the current WCCC and the way it's being held until now. (Programmers pay those high prices to enter and spectators contribution is near zero.)

If situation changes and spectators become the main contributor of the event, perhaps Bob's statement becomes that WCCC is for programmers and spectators.
After his son's birth they've asked him:
"Is it a boy or girl?"
YES! He replied.....
User avatar
Harvey Williamson
Posts: 2026
Joined: Sun May 25, 2008 11:12 pm
Location: Whitchurch. Shropshire, UK.
Full name: Harvey Williamson

Re: A compromise idea for the WCCC hardware limit

Post by Harvey Williamson »

George Tsavdaris wrote:
Harvey Williamson wrote: Do you think a sponsor would have any interest in the even if they read Bob's statement above?
Bob's statement is for the current WCCC and the way it's being held until now. (Programmers pay those high prices to enter and spectators contribution is near zero.)

If situation changes and spectators become the main contributor of the event, perhaps Bob's statement becomes that WCCC is for programmers and spectators.
Bob pays nothing to enter as his program is not commercial.
pijl

Re: A compromise idea for the WCCC hardware limit

Post by pijl »

Harvey Williamson wrote: Bob pays nothing to enter as his program is not commercial.
IIRC there is always a fee to pay, also for amateurs. 25 euro. The other costs are of course way higher, like travel and lodging, food, days off from work etc.
Richard.