I declare that HCE is dead...

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
Rebel
Posts: 7403
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: I declare that HCE is dead...

Post by Rebel »

When will search be declared dead?

Can search be put in a NN as well?
90% of coding is debugging, the other 10% is writing bugs.
connor_mcmonigle
Posts: 544
Joined: Sun Sep 06, 2020 4:40 am
Full name: Connor McMonigle

Re: I declare that HCE is dead...

Post by connor_mcmonigle »

Rebel wrote: Wed Jun 30, 2021 9:55 am When will search be declared dead?

Can search be put in a NN as well?
It's unlikely that a neural network will replace search. However, move ordering heuristics as well as some LMR, pruning and extension decisions are likely to be replaced with something akin to a policy network in the immediate future in alpha beta search engines in my opinion. FWIW, HCE were effectively one layer networks anyways so the distinction is somewhat meaningless.
User avatar
towforce
Posts: 12602
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK
Full name: Graham Laight

Re: I declare that HCE is dead...

Post by towforce »

Rebel wrote: Wed Jun 30, 2021 9:55 am When will search be declared dead? Can search be put in a NN as well?

The problem with chess for AI study is that for decades search has been killing all other techniques.

The REAL answer to chess will be to solve it: then EVERYTHING ELSE (search, NN, HCE etc) will ALL be dead! :D
Human chess is partly about tactics and strategy, but mostly about memory
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: I declare that HCE is dead...

Post by Milos »

Rebel wrote: Wed Jun 30, 2021 9:55 am When will search be declared dead?

Can search be put in a NN as well?
That 100% equivalent question to "Can one encode 32-men TBs into NN?"
I guess you know the answer.
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: I declare that HCE is dead...

Post by Milos »

towforce wrote: Wed Jun 30, 2021 10:17 am The REAL answer to chess will be to solve it: then EVERYTHING ELSE (search, NN, HCE etc) will ALL be dead! :D
We know how to do it for quite some time, i.e. we know the algorithm (Turing machine) that 100% provides an answer. We know how to generate 32-men TBs. We "just" don't have enough resources for this task ;).
User avatar
towforce
Posts: 12602
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK
Full name: Graham Laight

Re: I declare that HCE is dead...

Post by towforce »

Milos wrote: Wed Jun 30, 2021 10:45 am
towforce wrote: Wed Jun 30, 2021 10:17 am The REAL answer to chess will be to solve it: then EVERYTHING ELSE (search, NN, HCE etc) will ALL be dead! :D
We know how to do it for quite some time, i.e. we know the algorithm (Turing machine) that 100% provides an answer. We know how to generate 32-men TBs. We "just" don't have enough resources for this task ;).

As discussed previously, I think it can be done with today's technology and without the 32 piece tablebase. If you want to discuss it again, probably should start a new thread, but, briefly, might be possible by recursively calculating what conditions must be true to win material (assuming that the king is "just" high value material), and discarding the outcome each time a generated condition is found to already exist in the condition list. The recursion finishes when no new conditions are found. Alternatively, might be possible by the following iterative process:

1. Get a set of positions and correct evaluations
2. Use curve fitting to find the simplest algorithm that provides the correct evaluation for all positions
3. Find a position that the algorithm evaluates incorrectly
4. Add it to the set of positions and correct evaluations
5. Repeat

This would require curve fitting in a large number of dimensions, for which existing software isn't great right now, but I think I can come up with a way of doing that.
Human chess is partly about tactics and strategy, but mostly about memory
User avatar
Rebel
Posts: 7403
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: I declare that HCE is dead...

Post by Rebel »

Milos wrote: Wed Jun 30, 2021 10:43 am
Rebel wrote: Wed Jun 30, 2021 9:55 am When will search be declared dead?

Can search be put in a NN as well?
That 100% equivalent question to "Can one encode 32-men TBs into NN?"
I guess you know the answer.
Not necessarily, there are different questions, such as, is it possible to train a NN for a safe number of reductions for each position.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
towforce
Posts: 12602
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK
Full name: Graham Laight

Re: I declare that HCE is dead...

Post by towforce »

Quick demonstration that you don't always have to check every permutation: the travelling salesman problem has been solved to 85900 towns. If every combination had been tested, that would be 85900!=9.6*10^386526 combinations. That didn't happen: instead, the overwhelming majority of combinations were eliminated mathematically without having to be individually checked.

We don't yet know how to do that for chess. However, as stated in a previous thread, for me the evidence strongly suggests that relatively small algorithms could evaluate most chess positions well (this is, of course, well short of saying that chess could easily be solved).
Human chess is partly about tactics and strategy, but mostly about memory
Madeleine Birchfield
Posts: 512
Joined: Tue Sep 29, 2020 4:29 pm
Location: Dublin, Ireland
Full name: Madeleine Birchfield

Re: I declare that HCE is dead...

Post by Madeleine Birchfield »

towforce wrote: Wed Jun 30, 2021 12:08 pm Quick demonstration that you don't always have to check every permutation: the travelling salesman problem has been solved to 85900 towns. If every combination had been tested, that would be 85900!=9.6*10^386526 combinations. That didn't happen: instead, the overwhelming majority of combinations were eliminated mathematically without having to be individually checked.

We don't yet know how to do that for chess.
Yes, we do, it is called using minimax search and alpha-beta from the starting position instead of iterating through every position in a 32 piece tablebase. There are many positions with 32 pieces that are simply impossible to reach from the starting position, such as most chess960 starting positions, and many others that are a result of blunders, which would be eliminated in minimax and alpha-beta.

Minimax and alpha-beta could be used in any weighted directed graph, such as those found in the travelling salesman problem.
User avatar
towforce
Posts: 12602
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK
Full name: Graham Laight

Re: I declare that HCE is dead...

Post by towforce »

Madeleine Birchfield wrote: Wed Jun 30, 2021 1:22 pm
towforce wrote: Wed Jun 30, 2021 12:08 pm Quick demonstration that you don't always have to check every permutation: the travelling salesman problem has been solved to 85900 towns. If every combination had been tested, that would be 85900!=9.6*10^386526 combinations. That didn't happen: instead, the overwhelming majority of combinations were eliminated mathematically without having to be individually checked.

We don't yet know how to do that for chess.
Yes, we do, it is called using minimax search and alpha-beta from the starting position instead of iterating through every position in a 32 piece tablebase. There are many positions with 32 pieces that are simply impossible to reach from the starting position, such as most chess960 starting positions, and many others that are a result of blunders, which would be eliminated in minimax and alpha-beta.

Minimax and alpha-beta could be used in any weighted directed graph, such as those found in the travelling salesman problem.

Good point, Madeleine! 8-)

However, I don't think these tree pruning methods are likely to be enough to crunch out chess from the starting position (it is interesting, though, that in the 64 years of computer chess nobody has yet found a way to force the win of material from the starting position - and some programs are now searching quite deeply from it).

Also, the goal I have in mind is to be able to evaluate any position quickly and accurately: the "quick" part of that would preclude search: I have suggested it might be possible to generate a set of rules to say whether material can be won, or to create a smallish algorithm which produces the correct answer for all positions for which the correct value is known.
Human chess is partly about tactics and strategy, but mostly about memory