YATT - Yet Another Turing Test

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

smatovic
Posts: 3330
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: YATT - Yet Another Turing Test

Post by smatovic »

towforce wrote: Sat Sep 20, 2025 2:27 pm [...]
I disagree. Humans have a certain mental capacity and a certain mental performance, there is a limit.

--
Srdja
chrisw
Posts: 4638
Joined: Tue Apr 03, 2012 4:28 pm
Location: Midi-Pyrénées
Full name: Christopher Whittington

Re: YATT - Yet Another Turing Test

Post by chrisw »

smatovic wrote: Sat Sep 20, 2025 2:36 pm
towforce wrote: Sat Sep 20, 2025 2:27 pm [...]
I disagree. Humans have a certain mental capacity and a certain mental performance, there is a limit.

--
Srdja
He’s also got it wrong that the explainer has to do all the work. That’s nonsense, the receiver has to do the work in order to understand. That’s why your teacher tells you bla di bla about history and tells you to go away and write an essay about it. Or the maths teacher shows you some algorithm and then gives you a bunch of examples to work on. It’s doing that work that brings the understanding, just raw passive receiving does nothing.
And doing the work is probably less connected to intelligence than to personality, determination, getting repeat dopamine rewards because repeating success etc.
Hence, btw, passive receipt via the TV or regurgitating ChatGPT does nothing for you, it gives the semblance you know something but in reality is dumbness. As US and western electorates prove again and again.
User avatar
towforce
Posts: 12511
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK
Full name: Graham Laight

Re: YATT - Yet Another Turing Test

Post by towforce »

smatovic wrote: Sat Sep 20, 2025 2:36 pmI disagree. Humans have a certain mental capacity and a certain mental performance, there is a limit.

Your fellow German, Sabine Hossenfelder, who has a high intellect and a large YouTube following, is in agreement with you: in today's video, she points out that a vital part of the brain has a horrendous data throughput bottleneck that even Elon Musk's brain chips won't fix:


Human chess is partly about tactics and strategy, but mostly about memory
smatovic
Posts: 3330
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: YATT - Yet Another Turing Test

Post by smatovic »

chrisw wrote: Sat Sep 20, 2025 4:01 pm
smatovic wrote: Sat Sep 20, 2025 2:36 pm
towforce wrote: Sat Sep 20, 2025 2:27 pm [...]
I disagree. Humans have a certain mental capacity and a certain mental performance, there is a limit.

--
Srdja
He’s also got it wrong that the explainer has to do all the work. That’s nonsense, the receiver has to do the work in order to understand. That’s why your teacher tells you bla di bla about history and tells you to go away and write an essay about it. Or the maths teacher shows you some algorithm and then gives you a bunch of examples to work on. It’s doing that work that brings the understanding, just raw passive receiving does nothing.
Agreed, I had to figure AlphaBeta pruning with pen and paper to grasp it as example.
chrisw wrote: Sat Sep 20, 2025 4:01 pm And doing the work is probably less connected to intelligence than to personality, determination, getting repeat dopamine rewards because repeating success etc.
Agreed, highly skilled underachievers for example.
chrisw wrote: Sat Sep 20, 2025 4:01 pm Hence, btw, passive receipt via the TV or regurgitating ChatGPT does nothing for you, it gives the semblance you know something but in reality is dumbness. As US and western electorates prove again and again.
Agreed, studies show mental degeneration since 2010s with smartphone/internet/social-media, now studies show mental degeneration by ChatBot usage...

--
Srdja
chrisw
Posts: 4638
Joined: Tue Apr 03, 2012 4:28 pm
Location: Midi-Pyrénées
Full name: Christopher Whittington

Re: YATT - Yet Another Turing Test

Post by chrisw »

smatovic wrote: Sat Sep 20, 2025 5:26 pm
chrisw wrote: Sat Sep 20, 2025 4:01 pm
smatovic wrote: Sat Sep 20, 2025 2:36 pm
towforce wrote: Sat Sep 20, 2025 2:27 pm [...]
I disagree. Humans have a certain mental capacity and a certain mental performance, there is a limit.

--
Srdja
He’s also got it wrong that the explainer has to do all the work. That’s nonsense, the receiver has to do the work in order to understand. That’s why your teacher tells you bla di bla about history and tells you to go away and write an essay about it. Or the maths teacher shows you some algorithm and then gives you a bunch of examples to work on. It’s doing that work that brings the understanding, just raw passive receiving does nothing.
Agreed, I had to figure AlphaBeta pruning with pen and paper to grasp it as example.
chrisw wrote: Sat Sep 20, 2025 4:01 pm And doing the work is probably less connected to intelligence than to personality, determination, getting repeat dopamine rewards because repeating success etc.
Agreed, highly skilled underachievers for example.
chrisw wrote: Sat Sep 20, 2025 4:01 pm Hence, btw, passive receipt via the TV or regurgitating ChatGPT does nothing for you, it gives the semblance you know something but in reality is dumbness. As US and western electorates prove again and again.
Agreed, studies show mental degeneration since 2010s with smartphone/internet/social-media, now studies show mental degeneration by ChatBot usage...

--
Srdja
AB good example, although there are several depths of understanding AB which I would guess GEN Z never bothers with, it's just a line of C (or whatever) that gives Elo. Why? Who cares etc. Underlying understandings get lost, and why not, they're kind of redundant.

Mental degeneration? Argument by Youtube video. They lose the power of speech, but, so? Replace own speech with ChatGPT.
smatovic
Posts: 3330
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: YATT - Yet Another Turing Test

Post by smatovic »

What happened before...
smatovic wrote: Wed Jun 19, 2024 8:22 am The first test candidate was posted by Thomas Zipproth, December 08, 2022, generated by GPT-3:

Provide me with a minimal working source code of a chess engine
forum3/viewtopic.php?f=2&t=81097&start=20#p939245

[...]
smatovic wrote: Wed Jun 19, 2024 8:22 am Second test candidate was posted by Darko Markovic, June 08, 2024, generated by GPT-4o:

GPT-4o made a chess engine
viewtopic.php?t=83882

[...]
smatovic wrote: Fri Aug 15, 2025 9:23 am Third test candidate was posted by Werewolf, August 14, 2025, generated by GPT-5 Pro:

The Dawn of Skynet
viewtopic.php?t=85356

[...]
smatovic
Posts: 3330
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: YATT - Yet Another Turing Test

Post by smatovic »

Fourth test candidate was posted by Giovanni Lavorgna, September 23, 2025, generated by Gemini 2.5-pro:

GeminiChess, an LLM built engine
viewtopic.php?t=85490

- C++17 source code
- UCI protocol
- Bitboard board representation
- Magic Bitboard pseudo legal move generator
- AlphaBeta search as negamax
- move ordering with MVV-LVA and SEE
- Quiescence Search with Stand Pat
- check extension
- repetition detection
- Iterative Deepening Framework
- single thread search
- time control
- eval with material, passed pawns, PSQT middle and endgame
- Zobrist hashing
- Transposition Tables
- Killer and Counter Move Heuristic
- Null Windows
- Razoring
- Null Move Pruning
- Internal Iterative Deepening
- Late Move Pruning / Futility Pruning

"Vibe coded" over a weekend, automated via interactive test scripts.

--
Srdja
User avatar
towforce
Posts: 12511
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK
Full name: Graham Laight

Re: YATT - Yet Another Turing Test

Post by towforce »

smatovic wrote: Wed Jun 19, 2024 8:21 am1A) With hand-crafted eval. 1B) With neural networks.

2A) Outperforms non-programmers. 2B) Outperforms average chess-programmers. 2C) Outperforms top chess-programmers.

3A) An un-self-aware AI, the "RI", restricted intelligence. 2B) A self-aware AI, the "SI", sentient intelligence.

4A) An AI based on expert-systems. 4B) An AI based on neural networks. 4C) A merger of both.

The Turing test really asks for a machine to pretend to be human - which is setting the bar far too low on the intelligence scale.

Your above tests, apart from the sentience test, aren't really Turing tests, but they do make a lot more sense in terms of testing a chatbot.
Human chess is partly about tactics and strategy, but mostly about memory