How to measure human-like intelligence...modern Turing test proposed

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
towforce
Posts: 12527
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK
Full name: Graham Laight

Re: How to measure human-like intelligence...modern Turing test proposed

Post by towforce »

Uri Blass wrote: Wed Jun 21, 2023 10:29 pmIf somebody is going to develop this type of bot then I fully expect him to earn money again and again and not to tell the public that it is thanks to a bot.

Maybe there is already some bot that does it for some rich person.

I am close to 100% confident that this has been happening for a long time. The people who do it rationalise it as "harvesting". As an example, poker web sites have had to take steps to prevent bots from "harvesting" their customers.

A quick tip: if you get an email offering a "great" investment, it's already been offered to a large number of professional investors who have turned it down. Avoid!
Human chess is partly about tactics and strategy, but mostly about memory
smatovic
Posts: 3347
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: How to measure human-like intelligence...modern Turing test proposed

Post by smatovic »

There you go with the Suleyman Test:

ChatGPT tool could be abused by scammers and hackers
https://www.yahoo.com/news/finance/news ... 16408.html

"WolfGPT", I like it :)

--
Srdja
User avatar
towforce
Posts: 12527
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK
Full name: Graham Laight

Re: How to measure human-like intelligence...modern Turing test proposed

Post by towforce »

smatovic wrote: Tue Dec 19, 2023 8:54 pm There you go with the Suleyman Test:

ChatGPT tool could be abused by scammers and hackers
https://www.yahoo.com/news/finance/news ... 16408.html

"WolfGPT", I like it :)

--
Srdja

For me, this is a really difficult situation: the only realistic defence we're got against this aggressive AI is a protective wall of defensive AI.

The chess moves the top programs produce are now are only understandable to a small proportion of players: the same will happen in the game of, "Protect the human from malicious AI": there will be a war going on, and 99% of people will have no understanding of it.
Human chess is partly about tactics and strategy, but mostly about memory
smatovic
Posts: 3347
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Yet Another Turing Test

Post by smatovic »

...now with context generative AIs, the switch from pattern recognition to pattern creation with neural networks, I would like to propose my own kind of Turing Test:

An AI which is able to code a chess engine and outperforms humans in this task.

1A) With hand-crafted eval. 1B) With neural networks.

2A) Outperforms non-programmers. 2B) Outperforms average chess-programmers. 2C) Outperforms top chess-programmers.

3A) An un-self-aware AI, the "RI", restricted intelligence. 2B) A self-aware AI, the "SI", sentient intelligence.

The Chinese Room Argument applied onto this test would claim that there is no conscious in need to perform such a task, hence this test is not meant to measure self-awareness, consciousness or sentience, but what we call human intelligence.

https://en.wikipedia.org/wiki/Chinese_room

The first test candidate was already posted by Thomas Zipproth, Dec 08, 2022:

Provide me with a minimal working source code of a chess engine
viewtopic.php?f=2&t=81097&start=20#p939245

--
Srdja