How to test if MCTS is working?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

chessica
Posts: 672
Joined: Thu Aug 11, 2022 11:30 pm
Full name: Esmeralda Pinto

How to test if MCTS is working?

Post by chessica »

Hello, I just stumbled across MCTS. I have a simple question. How do you check whether MCTS really works?
I haven't found anything about that yet. Are there special tests that can provide information about this?
Christopher Martin
Posts: 30
Joined: Tue Apr 02, 2024 7:24 pm
Full name: Christopher Martin

Re: How to test if MCTS is working?

Post by Christopher Martin »

Hello. I hear you. I can give you instructions on how to proceed
chessica
Posts: 672
Joined: Thu Aug 11, 2022 11:30 pm
Full name: Esmeralda Pinto

Re: How to test if MCTS is working?

Post by chessica »

Christopher Martin wrote: Thu May 30, 2024 8:17 pm Hello. I hear you. I can give you instructions on how to proceed
Hello my friend, please tell me what you can say about it. I am very interested because I have not found anything about it.
Christopher Martin
Posts: 30
Joined: Tue Apr 02, 2024 7:24 pm
Full name: Christopher Martin

Re: How to test if MCTS is working?

Post by Christopher Martin »

Yes
chessica
Posts: 672
Joined: Thu Aug 11, 2022 11:30 pm
Full name: Esmeralda Pinto

Re: How to test if MCTS is working?

Post by chessica »

Christopher Martin wrote: Fri May 31, 2024 11:52 am Yes
joker, you :shock:
chessica
Posts: 672
Joined: Thu Aug 11, 2022 11:30 pm
Full name: Esmeralda Pinto

Re: How to test if MCTS is working?

Post by chessica »

Checking the Monte Carlo Tree Search (MCTS) in a chess program can be an interesting task. Here are some approaches to test whether MCTS is working properly: Comparison with other engines: Compare the MCTS engine's ratings and moves with other strong chess engines like Stockfish or Komodo. If the engines agree at great depths, that's a good sign. Otherwise, play the displayed variations back and forth and see if the engine ratings converge. If not, either go deeper or decide based on your own chess understanding that the engine is wrong.
JacquesRW
Posts: 69
Joined: Sat Jul 30, 2022 12:12 pm
Full name: Jamie Whiting

Re: How to test if MCTS is working?

Post by JacquesRW »

chessica wrote: Thu May 30, 2024 7:41 pm Hello, I just stumbled across MCTS. I have a simple question. How do you check whether MCTS really works?
I haven't found anything about that yet. Are there special tests that can provide information about this?
Well firstly what do you mean by “works”?

I’m going to take Pure MCTS = The Wikipedia definition of MCTS + UCT.
Pure MCTS should be able to resolve (very) simple tactics if given enough time. It is hard to overstate how terrible pure MCTS is relative to your bog-standard minimax engine.
chessica
Posts: 672
Joined: Thu Aug 11, 2022 11:30 pm
Full name: Esmeralda Pinto

Re: How to test if MCTS is working?

Post by chessica »

JacquesRW wrote: Fri May 31, 2024 12:20 pm
chessica wrote: Thu May 30, 2024 7:41 pm Hello, I just stumbled across MCTS. I have a simple question. How do you check whether MCTS really works?
I haven't found anything about that yet. Are there special tests that can provide information about this?
Well firstly what do you mean by “works”?
...
"works" ---> means that the engine does exactly what it is supposed to do, and does it correctly.
JacquesRW
Posts: 69
Joined: Sat Jul 30, 2022 12:12 pm
Full name: Jamie Whiting

Re: How to test if MCTS is working?

Post by JacquesRW »

chessica wrote: Fri May 31, 2024 3:24 pm "works" ---> means that the engine does exactly what it is supposed to do, and does it correctly.
This is the emptiest statement ever made. You can't give an answer to a question like that. What exactly, in your view, is the MCTS engine meant to do?
chessica
Posts: 672
Joined: Thu Aug 11, 2022 11:30 pm
Full name: Esmeralda Pinto

Re: How to test if MCTS is working?

Post by chessica »

chessica wrote: Fri May 31, 2024 12:01 pm Checking the Monte Carlo Tree Search (MCTS) in a chess program can be an interesting task. Here are some approaches to test whether MCTS is working properly: Comparison with other engines: Compare the MCTS engine's ratings and moves with other strong chess engines like Stockfish or Komodo. If the engines agree at great depths, that's a good sign. Otherwise, play the displayed variations back and forth and see if the engine ratings converge. If not, either go deeper or decide based on your own chess understanding that the engine is wrong.
No, that was not an answer from me, but comes from artificial intelligence, also called AI. :shock: