Gemini

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, chrisw, Rebel

smatovic
Posts: 2937
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: Gemini

Post by smatovic »

towforce wrote: Tue Oct 01, 2024 7:53 pm [...]
Regarding your point (5): a lot of what LLMs do is stochastic parroting, but it's also easy to show that they build, via language, sophisticated models of the world. Were this not so, they wouldn't be able to intelligently answer a wide range of prompts that aren't in their training material, and they wouldn't be able to play chess.
[...]
Well, this is something to ponder on. The stochastic parrot fraction is in concord with the Chinese room argument, but when there is an object as mental model, is there a subject too? And is there an subject<->object relation? Robo-philoshopy ;)

--
Srdja
User avatar
towforce
Posts: 11883
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK

Re: Gemini

Post by towforce »

smatovic wrote: Tue Oct 01, 2024 9:27 pm
towforce wrote: Tue Oct 01, 2024 7:53 pm [...]
Regarding your point (5): a lot of what LLMs do is stochastic parroting, but it's also easy to show that they build, via language, sophisticated models of the world. Were this not so, they wouldn't be able to intelligently answer a wide range of prompts that aren't in their training material, and they wouldn't be able to play chess.
[...]
Well, this is something to ponder on. The stochastic parrot fraction is in concord with the Chinese room argument, but when there is an object as mental model, is there a subject too? And is there an subject<->object relation? Robo-philoshopy ;)

A chatbot which contains models of the world is still a Chinese Room: spreadsheets often contain models (e.g. a model of a company's finances), but the spreadsheet itself knows nothing: it's just doing calculations (Gemini Advanced can actually discuss your Google Sheets spreadsheets with you, of course, but that's a chatbot, and hence 100% Chinese room IMO).

Chess engines are 100% Chinese room, even though we often (thoughtlessly!) attribute intelligence and understanding to them.

Given that, as far as we know, a biological brain is just a bunch of nerve cells, where is consciousness coming from, then? That's a "hard problem"!

https://en.wikipedia.org/wiki/Hard_prob ... sciousness
The simple reveals itself after the complex has been exhausted.
smatovic
Posts: 2937
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: Gemini

Post by smatovic »

nevermind, self-deleted, off topic.

--
Srdja
smatovic
Posts: 2937
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: Gemini

Post by smatovic »

towforce wrote: Tue Oct 01, 2024 11:49 pm A chatbot which contains models of the world is still a Chinese Room: spreadsheets often contain models (e.g. a model of a company's finances), but the spreadsheet itself knows nothing: it's just doing calculations (Gemini Advanced can actually discuss your Google Sheets spreadsheets with you, of course, but that's a chatbot, and hence 100% Chinese room IMO).

Chess engines are 100% Chinese room, even though we often (thoughtlessly!) attribute intelligence and understanding to them.

Given that, as far as we know, a biological brain is just a bunch of nerve cells, where is consciousness coming from, then? That's a "hard problem"!

https://en.wikipedia.org/wiki/Hard_prob ... sciousness
Now we are off topic, let me just say that you are contradicting yourself. You claim 100% Chinese room for the machines, then ask the "hard problem question", where does consciousness in our biological brains come from ;)

--
Srdja
User avatar
towforce
Posts: 11883
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK

Re: Gemini

Post by towforce »

smatovic wrote: Wed Oct 02, 2024 6:15 am
towforce wrote: Tue Oct 01, 2024 11:49 pm A chatbot which contains models of the world is still a Chinese Room: spreadsheets often contain models (e.g. a model of a company's finances), but the spreadsheet itself knows nothing: it's just doing calculations (Gemini Advanced can actually discuss your Google Sheets spreadsheets with you, of course, but that's a chatbot, and hence 100% Chinese room IMO).

Chess engines are 100% Chinese room, even though we often (thoughtlessly!) attribute intelligence and understanding to them.

Given that, as far as we know, a biological brain is just a bunch of nerve cells, where is consciousness coming from, then? That's a "hard problem"!

https://en.wikipedia.org/wiki/Hard_prob ... sciousness
Now we are off topic, let me just say that you are contradicting yourself. You claim 100% Chinese room for the machines, then ask the "hard problem question", where does consciousness in our biological brains come from ;)

--
Srdja

I agree: we'd all agree that mechanical calculators have no idea what they're doing, and for me, the same applies to chatbots. But if we start discussing the "hard problem" (the title of the WIki article I previously linked), it's a 100% certainty that we'll go off topic. Personally, I don't really have anything useful to say about the "hard problem" anyway (apart from the opinion that chatbots don't have consciousness).
The simple reveals itself after the complex has been exhausted.
User avatar
towforce
Posts: 11883
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK

Re: Gemini

Post by towforce »

If anyone wants to discuss this, the moderators would probably allow a thread discussing when chess engines (or even chatbots) will become conscious: don't be inhibited about starting such a thread!
The simple reveals itself after the complex has been exhausted.
User avatar
towforce
Posts: 11883
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK

Re: Gemini

Post by towforce »

Nvidia has launched an LLM which is said to leapfrog the competition straight to the top. However, the video below, while making a good introduction, doesn't really show anything that enables comparison (except that, unlike most LLMs, it can correctly tell you how many Rs there are in the word strawberry - a test that LLMs fail because they receive your prompt in tokenised format, and don't have access to the original text). There's a growing need for a good LLM comparison chart!


The simple reveals itself after the complex has been exhausted.
Werewolf
Posts: 1899
Joined: Thu Sep 18, 2008 10:24 pm

Re: Gemini

Post by Werewolf »

towforce wrote: Fri Oct 18, 2024 2:56 pm Nvidia has launched an LLM which is said to leapfrog the competition straight to the top. However, the video below, while making a good introduction, doesn't really show anything that enables comparison (except that, unlike most LLMs, it can correctly tell you how many Rs there are in the word strawberry - a test that LLMs fail because they receive your prompt in tokenised format, and don't have access to the original text). There's a growing need for a good LLM comparison chart!


Thanks for this, I'll take a good look later. Can you clarify if the LLM runs locally like their previous models or on their huge servers which is probably the case here?
User avatar
towforce
Posts: 11883
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK

Re: Gemini

Post by towforce »

Werewolf wrote: Fri Oct 18, 2024 3:50 pm...It's also available at https://openrouter.ai/chat (search "Nemotron" on the search field).

That site has a rankings page - and you can select categories on that page as well:

https://openrouter.ai/rankings

I'm bookmarking that one!
The simple reveals itself after the complex has been exhausted.
User avatar
towforce
Posts: 11883
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK

Re: Gemini

Post by towforce »

Werewolf wrote: Fri Oct 18, 2024 3:50 pmThanks for this, I'll take a good look later. Can you clarify if the LLM runs locally like their previous models or on their huge servers which is probably the case here?

The 70B version is available on HuggingChat - link.

Full list of models available on HuggingChat - link.

It's also available at https://openrouter.ai/chat (search "Nemotron" on the search field).

Looks as though you have to jump through some hoops to download the model - link.
The simple reveals itself after the complex has been exhausted.