Have you decided why Vas

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Have you decided why Vas

Post by bob »

frosch wrote:first of all: why are you interested in a node count of another program?
isn't this count just useful for comparing different hardware?

further: you claim a node is a node and this was defined very clearly.
is this really true? just an example: what about transpositions in search? same position occurs in search and hashentry has to be used. is it an additional node or not?
No. A node is produced when the search updates a position by making a move and recursively calling itself to deal with that new position. On a graph, nodes are the things connected by arcs. Arcs are represented by moves here. That is a definition that is given in any good AI textbook dealing with minimax and alpha/beta search. If you are at position A, and make a move that leads to positon B, B counted as a new node. Now that you are at B, you can make moves to lead to other nodes, or you might get a hash hit and not search any further here and produce no further sub-nodes from this node...

even if a node was clearly defined, a node can be treated differently. not every node has to be evaluated by the same algorithm. some nodes can be treated in a cheaper way than others. would it make sense to neglect this? no! it would be impossible to compare the node count on different hardware/positions and it would lose it's only usefulness.
The reason is vocabulary and communication. If we use different definitions of "pi" then how can we ever communicate mathematically? If we use different definitions of nodes, then we can't discuss tree searching and pruning ideas since we won't have a standard set of terms to use.

There is some wriggle room in the definition, as you could just count legal nodes, or you could count all, which might be different between two programs. But to take a normal node count, and divide by 10, is _not_ a reasonable definition of anything, regardless of the nonsensical explanations offered.
oreopoulos
Posts: 110
Joined: Fri Apr 25, 2008 10:56 pm

Re: Have you decided why Vas

Post by oreopoulos »

You have no clue what you talk about here. What has this position to do with Botvinnik's Games?
I have. Have you ever studied Botvinnik's games on French.
This position is about equal. The best player will win.
Black has all the counterplay he typically has in such structures (pressing center with f6 and or g5).
frosch

Re: Have you decided why Vas

Post by frosch »

bob wrote:
frosch wrote:first of all: why are you interested in a node count of another program?
isn't this count just useful for comparing different hardware?

further: you claim a node is a node and this was defined very clearly.
is this really true? just an example: what about transpositions in search? same position occurs in search and hashentry has to be used. is it an additional node or not?
No. A node is produced when the search updates a position by making a move and recursively calling itself to deal with that new position. On a graph, nodes are the things connected by arcs. Arcs are represented by moves here. That is a definition that is given in any good AI textbook dealing with minimax and alpha/beta search. If you are at position A, and make a move that leads to positon B, B counted as a new node. Now that you are at B, you can make moves to lead to other nodes, or you might get a hash hit and not search any further here and produce no further sub-nodes from this node...

even if a node was clearly defined, a node can be treated differently. not every node has to be evaluated by the same algorithm. some nodes can be treated in a cheaper way than others. would it make sense to neglect this? no! it would be impossible to compare the node count on different hardware/positions and it would lose it's only usefulness.
The reason is vocabulary and communication. If we use different definitions of "pi" then how can we ever communicate mathematically? If we use different definitions of nodes, then we can't discuss tree searching and pruning ideas since we won't have a standard set of terms to use.

There is some wriggle room in the definition, as you could just count legal nodes, or you could count all, which might be different between two programs. But to take a normal node count, and divide by 10, is _not_ a reasonable definition of anything, regardless of the nonsensical explanations offered.
maybe it would help yourself, if you awnsered my first question: why are you in the n/s of any program but crafty interested?
the definition of pi is trivial to anyone and there's no way to define it in some other way. it's not the same with n/s, to which you agree slightly yourself (legal/illegal moves).
I think it's less useful for the programmer to define it in your way, than take into account how useful a node is or how long the program spends at a node.

if we agree, that completely different nodecounts are possible, there's no reason to bother about n/s in other programs at all.
rajlich might even do a division by 10 for optical reasons!?
User avatar
Andres Valverde
Posts: 580
Joined: Sun Feb 18, 2007 11:07 pm
Location: Almeria. SPAIN
Full name: Andres Valverde Toresano

Re: Have you decided why Vas

Post by Andres Valverde »

maybe it would help yourself, if you awnsered my first question: why are you in the n/s of any program but crafty interested?
Any programmer (me too) I know is interested in nps of other engines, and also in total nodes to solve a particular position. Both values are useful (among many others though) to compare efficience.

Ferrari is interested in how many r.p.m does McLaren engines reach and the force they gives for a particular r.p.m. interval, doesnt it ? :-).
Saludos, Andres
rdan1987

Re: A new jealousy attack !

Post by rdan1987 »

Dr.Ex wrote:I don't discuss with engine fanboys who feel personal attacked when someone points out certain flaws in a program.
Please tell me what is your ELO...you probably must be GM strenght to assume that Rybka and Toga are stupid in this position..
ozziejoe
Posts: 811
Joined: Wed Mar 08, 2006 10:07 pm

Re: Have you decided why Vas

Post by ozziejoe »

george, this is a little off topic, but can you tell me the formula for converting rybka evalaution to win percentage, as you did in your post
User avatar
M ANSARI
Posts: 3723
Joined: Thu Mar 16, 2006 7:10 pm

Re: Have you decided why Vas

Post by M ANSARI »

kgburcham wrote:Has anyone here decided why Vas has chosen not to show the true kns in Rybka? Some of the Vas salesmen here are saying that Rybka 3 is showing even a slower kns than Rybka 2.3.2a. We all know 3 has more knowledge thus slower but Vas has still chosen to mask the kns. Does anyone have any idea why Vas decided to deceive us?

5250 kns Deep Fritz
4780kns Glaurung 2.0.1
4000 kns Deep Sjeng
2300 kns Deep Shredder 11 x64
1740 kns Zappa Mexico II
1450 kns Deep Hiarcs Paderborn
425 kns Rybka 2.3.2a mp x64
375 kns Rybka 3

[d] rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq -


You show 6 other commercial engines ... all with different Kns. Which one of them would you like Vas to emulate? Or which one do you think is showing "real" Kns? Why do you choose only Rybka as the one not showing the "true" Kns? Do you think Hiarcs and Zappa and DS 11 also are hiding their "true" Kns?
User avatar
Rolf
Posts: 6081
Joined: Fri Mar 10, 2006 11:14 pm
Location: Munster, Nuremberg, Princeton

Re: Have you decided why Vas

Post by Rolf »

M ANSARI wrote:
kgburcham wrote:Has anyone here decided why Vas has chosen not to show the true kns in Rybka? Some of the Vas salesmen here are saying that Rybka 3 is showing even a slower kns than Rybka 2.3.2a. We all know 3 has more knowledge thus slower but Vas has still chosen to mask the kns. Does anyone have any idea why Vas decided to deceive us?

5250 kns Deep Fritz
4780kns Glaurung 2.0.1
4000 kns Deep Sjeng
2300 kns Deep Shredder 11 x64
1740 kns Zappa Mexico II
1450 kns Deep Hiarcs Paderborn
425 kns Rybka 2.3.2a mp x64
375 kns Rybka 3

[d] rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq -


You show 6 other commercial engines ... all with different Kns. Which one of them would you like Vas to emulate? Or which one do you think is showing "real" Kns? Why do you choose only Rybka as the one not showing the "true" Kns? Do you think Hiarcs and Zappa and DS 11 also are hiding their "true" Kns?

Perhaps this is the best way to question a professor of computational sciences but I tried to do it from an interdisciplinary angle. My actual summary is that Bob needlessly entered this strange debate well arguing that people had asked him, but instead of telling them the illogic of the KN questioning as such, he supported all these anti-Vas allegations as if Vas had done something thatg smells fishy. Science wise it isnt fishy at all.

And I can even top this by showing how Bob assisted his friends of the IBM team against Kasparov when they went into completely fishy modes of psycho war when they had pretended that they just wanted to know if their machine could do anything against the World's best human chessplayer.

Bob is incapable to realise the internal contradiction when he seemingly answers people's questions who basically only want to nitpick Vas Rajlich. Like one wrote in CCC that Vas has "cheated all his clients" by showing false KN in the display. Here the simple and basic clarification from our reference guy number one, Prof. Hyatt, would have the necessary effects in such a mean propaganda war. Treating such nasty questions as if they were practically justified is basically supporting the nasty propaganda itself. Period.
-Popper and Lakatos are good but I'm stuck on Leibowitz
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: Have you decided why Vas

Post by Dr.Wael Deeb »

M ANSARI wrote:
kgburcham wrote:Has anyone here decided why Vas has chosen not to show the true kns in Rybka? Some of the Vas salesmen here are saying that Rybka 3 is showing even a slower kns than Rybka 2.3.2a. We all know 3 has more knowledge thus slower but Vas has still chosen to mask the kns. Does anyone have any idea why Vas decided to deceive us?

5250 kns Deep Fritz
4780kns Glaurung 2.0.1
4000 kns Deep Sjeng
2300 kns Deep Shredder 11 x64
1740 kns Zappa Mexico II
1450 kns Deep Hiarcs Paderborn
425 kns Rybka 2.3.2a mp x64
375 kns Rybka 3

[d] rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq -


You show 6 other commercial engines ... all with different Kns. Which one of them would you like Vas to emulate? Or which one do you think is showing "real" Kns? Why do you choose only Rybka as the one not showing the "true" Kns? Do you think Hiarcs and Zappa and DS 11 also are hiding their "true" Kns?
Exactly the point,following this logic,the author of Deep Junior is in the other side of the scale showing the biggest number of Kn/s and that's is absolutely ok with the users as it's not toping the rating lists by a big margin....
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Have you decided why Vas

Post by bob »

frosch wrote:
bob wrote:
frosch wrote:first of all: why are you interested in a node count of another program?
isn't this count just useful for comparing different hardware?

further: you claim a node is a node and this was defined very clearly.
is this really true? just an example: what about transpositions in search? same position occurs in search and hashentry has to be used. is it an additional node or not?
No. A node is produced when the search updates a position by making a move and recursively calling itself to deal with that new position. On a graph, nodes are the things connected by arcs. Arcs are represented by moves here. That is a definition that is given in any good AI textbook dealing with minimax and alpha/beta search. If you are at position A, and make a move that leads to positon B, B counted as a new node. Now that you are at B, you can make moves to lead to other nodes, or you might get a hash hit and not search any further here and produce no further sub-nodes from this node...

even if a node was clearly defined, a node can be treated differently. not every node has to be evaluated by the same algorithm. some nodes can be treated in a cheaper way than others. would it make sense to neglect this? no! it would be impossible to compare the node count on different hardware/positions and it would lose it's only usefulness.
The reason is vocabulary and communication. If we use different definitions of "pi" then how can we ever communicate mathematically? If we use different definitions of nodes, then we can't discuss tree searching and pruning ideas since we won't have a standard set of terms to use.

There is some wriggle room in the definition, as you could just count legal nodes, or you could count all, which might be different between two programs. But to take a normal node count, and divide by 10, is _not_ a reasonable definition of anything, regardless of the nonsensical explanations offered.
maybe it would help yourself, if you awnsered my first question: why are you in the n/s of any program but crafty interested?
the definition of pi is trivial to anyone and there's no way to define it in some other way. it's not the same with n/s, to which you agree slightly yourself (legal/illegal moves).
I think it's less useful for the programmer to define it in your way, than take into account how useful a node is or how long the program spends at a node.

if we agree, that completely different nodecounts are possible, there's no reason to bother about n/s in other programs at all.
rajlich might even do a division by 10 for optical reasons!?
Because the question is not important. Since I am _not_ interested in the NPS of Rybka or any other program. If you just look back to my first post, someone asked the question "why would someone obfuscate their node counts and search depths?" And I answered that. I don't need to be interested in Calculus to answer the question "what is the first derivative of X^2". If I respond "2X" does that deserve a follow-up on "why are you interested in the first derivative of X^2?

As far as the rest of your comments, I will again simply reply with "common vocabulary". With the classic definition of "node", from which follows a consistend definition of NPS, one can compare two different programs and draw reasonable conclusions. We've been doing this for 20 years now. You can find numerous references to NPS values for Fritz vs (say) Hiarcs. And when one program has 10x the nps of another, then the second has to be doing far more work per node than the first. Almost certainly time spent in the evaluation in the case of Hiarcs. Or time spent in analyzing search extension possibilties in the case of "the King".

And if (big IF) I were to buy that, then how would one justify reporting a mangled depth value as well? Depth has _always_ been defined as the number of full-width plies you search, before you start becoming more selective. Not the average number of full-width plies. Not the maximum number of full width plies. But the minimum number. yes, it is very hard to compare this value between programs when there are so many variables such as extensions, reductions, and raw forward pruning.

And since _nobody_ else fudges both depth and node counts, even though there are some admittedly possible variances in how programs behave, one would have to wonder "everybody else does it this way, why would one programmer be different?" And I specifically and precisely answered that question, whether you like the answer or not was not a consideration when framing the answer.