Asking to people who believe Leela NN is a book, what they think about SF NN now?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: Asking to people who believe Leela NN is a book, what they think about SF NN now?

Post by Ovyron »

AndrewGrant wrote: Sun Sep 13, 2020 11:52 pmYou've gone from arguing the idea, to arguing the semantics.
"Leela NN is a book" has always been about semantics. It depends of your definition of "book."

Your side just can't refute the argument that if Leela could memorize moves, she could play them from memory instantly.

Checkmate.
jhellis3
Posts: 546
Joined: Sat Aug 17, 2013 12:36 am

Re: Asking to people who believe Leela NN is a book, what they think about SF NN now?

Post by jhellis3 »

Somehow a leela style net that never saw positions with more than 18 pieces was able to “memorize” opening moves. Yet somehow people arguing this tired old argument are unable to memorize this refutation. :D
I'm quite sure myself and others have pointed out the logical flaw in this reasoning, yet you continue to post it.

B containing b and A containing b does not imply that A is a subset of B.
AndrewGrant
Posts: 1754
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: Asking to people who believe Leela NN is a book, what they think about SF NN now?

Post by AndrewGrant »

Ovyron wrote: Mon Sep 14, 2020 12:08 am
AndrewGrant wrote: Sun Sep 13, 2020 11:52 pmYou've gone from arguing the idea, to arguing the semantics.
"Leela NN is a book" has always been about semantics. It depends of your definition of "book."

Your side just can't refute the argument that if Leela could memorize moves, she could play them from memory instantly.

Checkmate.
No, lol. You boldly claimed that NNs don't memorize things. I refuted that by providing a paper that demonstrates under broad conditions that NNs can achieve the same error rate with correctly labeled data as they can with randomly labeled data, which is akin to memorization. I'm not making any statements about Leela, I'm pointing out that your presuppositions of what an NN can and cannot do is wrong.

Is Leela memorizing openings? I don't know. Depends on the data shes given.
Is it possible for Leela to have memorized the openings via training? Yes

Words are important. I choose mine carefully.
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Asking to people who believe Leela NN is a book, what they think about SF NN now?

Post by dkappe »

jhellis3 wrote: Mon Sep 14, 2020 12:14 am
Somehow a leela style net that never saw positions with more than 18 pieces was able to “memorize” opening moves. Yet somehow people arguing this tired old argument are unable to memorize this refutation. :D
I'm quite sure myself and others have pointed out the logical flaw in this reasoning, yet you continue to post it.

B containing b and A containing b does not imply that A is a subset of B.
Ah, if only this argument was an exercise in elementary set theory. It’s not. Yet you still don’t get it.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
jhellis3
Posts: 546
Joined: Sat Aug 17, 2013 12:36 am

Re: Asking to people who believe Leela NN is a book, what they think about SF NN now?

Post by jhellis3 »

I get it quite well. And I have explained it explicitly before and am fine to do it again.

Just because one can train a NN to play "theory" without ever seeing an opening position does not mean that a NN when provided such data and the features/tools to identify and make use of such data will not do so. Period.

You think that what you have is a counter example. It isn't.

And quite frankly, you are not doing your reputation any favors here... not that it is any of my business.
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Asking to people who believe Leela NN is a book, what they think about SF NN now?

Post by dkappe »

jhellis3 wrote: Mon Sep 14, 2020 12:42 am I get it quite well. And I have explained it explicitly before and am fine to do it again.

Just because one can train a NN to play "theory" without ever seeing an opening position does not mean that a NN when provided such data and the features/tools to identify and make use of such data will not do so. Period.

You think that what you have is a counter example. It isn't.

And quite frankly, you are not doing your reputation any favors here... not that it is any of my business.
You are clearly not familiar with how convolutional neural nets function. You remind me of that guy who prattles on and on about Hopfield networks, believing that just because they have “neural network” in their name, they have anything to do with ResNets.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
jhellis3
Posts: 546
Joined: Sat Aug 17, 2013 12:36 am

Re: Asking to people who believe Leela NN is a book, what they think about SF NN now?

Post by jhellis3 »

Ah, the ad hominem, the bastion of the well reasoned....
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: Asking to people who believe Leela NN is a book, what they think about SF NN now?

Post by Ovyron »

AndrewGrant wrote: Mon Sep 14, 2020 12:18 am Words are important. I choose mine carefully.
No, you don't. You're using the word "can", but should be use the word "could":

NNs could solve world hunger, and they could heal any illness, and they could help you build a time machine.

And NNs could memorize opening positions, and their best moves. NNs could be a book. Sure.

But I was very careful with my word choice, all the times I mentioned NNs, I said "that NN" (you can go back an see how often I used the word "that") not "an NN", I was specifically talking about *that* NN.

And THAT NN does NOT memorize openings.

You're talking about what it's capable of doing, sure, anyone can program an NN to do anything, memorizing opening positions could be trivial (you just let it overfit the data), I'm taking about what it DOES, in the PRESENT, at the CURRENT TIME.

And it's not memorizing opening positions, nor doing anything akin to it. It could do it, and then it'd be a book, but it's not.
Last edited by Ovyron on Mon Sep 14, 2020 1:20 am, edited 1 time in total.
Alayan
Posts: 550
Joined: Tue Nov 19, 2019 8:48 pm
Full name: Alayan Feh

Re: Asking to people who believe Leela NN is a book, what they think about SF NN now?

Post by Alayan »

It's pointless to argue with people who don't care about making gross logical mistakes in their reasoning.
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Asking to people who believe Leela NN is a book, what they think about SF NN now?

Post by dkappe »

jhellis3 wrote: Mon Sep 14, 2020 1:06 am Ah, the ad hominem, the bastion of the well reasoned....
Pot, kettle and so on, Mr. Reputation.

Unfortunately you’ve got a vacuous hypothesis on your hands. If it isn’t vacuous, it must be possible, with the proper evidence, to disprove it. So, Mr. Reputation, what kind of evidence would disprove your hypothesis?
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".