Any MCTS chess rating?

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Kohflote
Posts: 240
Joined: Wed Sep 19, 2007 11:07 am
Location: Singapore

Any MCTS chess rating?

Post by Kohflote »

Dear all,

Is there any MCTS chess engine rating for Windows platform available?

Is Shashchess MCTS stronger than Komodo Dragon 3.3 MCTS?

Thank you & regards,
Koh, Kah Huat
peter
Posts: 3415
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Any MCTS chess rating?

Post by peter »

Kohflote wrote: Tue Nov 28, 2023 1:30 pm Is Shashchess MCTS stronger than Komodo Dragon 3.3 MCTS?
2 CPU- threads (3.5GHz) each, ShashChess with 1MCTS- thread out of these 2 , TC 3'+1", openings UHO 6mvs 110-119 cp:

Score of ShashChess34.5MCTS vs Dragon3.3MCTS: 44 - 0 - 56 [0.720]
Elo difference: 164.1 +/- 42.2, LOS: 100.0 %, DrawRatio: 56.0 %
100 of 100 games finished.

As for such STC with 2 threads only, Brainlearn will be performing a little better than ShashChess, which is meant preferably for LTC and analysis.
Same condidtions as above:

Score of Stockfish231105 vs Brainlearn26.4MCTS: 105 - 90 - 305 [0.515]
Elo difference: 10.4 +/- 19.0, LOS: 85.9 %, DrawRatio: 61.0 %
500 of 500 games finished.

1MCTS- thread out of only 2 of CPU (minimal number of threads to use MCTS at all, "pure" MCTS doesn't work with ShashChess/Brainlearn) isn't as strong as e.g. 2 MCTS- threads out of 8 of CPU or 6 out of 30, yet with more CPU- threads I couldn't run as many concurrencies with cutechess to get as many games with comparably little hardware- time, regards
Peter.
Joerg Oster
Posts: 982
Joined: Fri Mar 10, 2006 4:29 pm
Location: Germany
Full name: Jörg Oster

Re: Any MCTS chess rating?

Post by Joerg Oster »

peter wrote: Tue Nov 28, 2023 3:16 pm
Kohflote wrote: Tue Nov 28, 2023 1:30 pm Is Shashchess MCTS stronger than Komodo Dragon 3.3 MCTS?
2 CPU- threads (3.5GHz) each, ShashChess with 1MCTS- thread out of these 2 , TC 3'+1", openings UHO 6mvs 110-119 cp:

Score of ShashChess34.5MCTS vs Dragon3.3MCTS: 44 - 0 - 56 [0.720]
Elo difference: 164.1 +/- 42.2, LOS: 100.0 %, DrawRatio: 56.0 %
100 of 100 games finished.

As for such STC with 2 threads only, Brainlearn will be performing a little better than ShashChess, which is meant preferably for LTC and analysis.
Same condidtions as above:

Score of Stockfish231105 vs Brainlearn26.4MCTS: 105 - 90 - 305 [0.515]
Elo difference: 10.4 +/- 19.0, LOS: 85.9 %, DrawRatio: 61.0 %
500 of 500 games finished.

1MCTS- thread out of only 2 of CPU (minimal number of threads to use MCTS at all, "pure" MCTS doesn't work with ShashChess/Brainlearn) isn't as strong as e.g. 2 MCTS- threads out of 8 of CPU or 6 out of 30, yet with more CPU- threads I couldn't run as many concurrencies with cutechess to get as many games with comparably little hardware- time, regards
When will you finally accept that ShashChess is still running AB search, even if you switch MCTS on?
The contribution of the MCTS running in the background is miniscule, if noticeable at all!

Here the result of a quick test, tc 30+0.3, Shashchess-AB vs ShashChess-MCTS

Code: Select all

Finished game 49 (Shashchess-AB vs Shashchess-MCTS): 1-0 {White mates}
Score of Shashchess-AB vs Shashchess-MCTS: 50 - 0 - 0  [1.000] 50
Elo difference: inf +/- nan, LOS: 100.0 %, DrawRatio: 0.0 %
Jörg Oster
Joerg Oster
Posts: 982
Joined: Fri Mar 10, 2006 4:29 pm
Location: Germany
Full name: Jörg Oster

Re: Any MCTS chess rating?

Post by Joerg Oster »

Kohflote wrote: Tue Nov 28, 2023 1:30 pm Dear all,

Is there any MCTS chess engine rating for Windows platform available?

Is Shashchess MCTS stronger than Komodo Dragon 3.3 MCTS?
No.
Jörg Oster
peter
Posts: 3415
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Any MCTS chess rating?

Post by peter »

Joerg Oster wrote: Wed Nov 29, 2023 10:24 am When will you finally accept that ShashChess is still running AB search, even if you switch MCTS on?
I know and knew so, Jörg, I even wrote about it by myself in the posting you answered to
:)
But how did you then run ShashChessMCTS ("pure"?) in your match?
Peter.
Joerg Oster
Posts: 982
Joined: Fri Mar 10, 2006 4:29 pm
Location: Germany
Full name: Jörg Oster

Re: Any MCTS chess rating?

Post by Joerg Oster »

peter wrote: Wed Nov 29, 2023 1:10 pm
Joerg Oster wrote: Wed Nov 29, 2023 10:24 am When will you finally accept that ShashChess is still running AB search, even if you switch MCTS on?
I know and knew so, Jörg, I even wrote about it by myself in the posting you answered to
:)
But how did you then run ShashChessMCTS ("pure"?) in your match?
With a tiny change in the code.
Jörg Oster
abgursu
Posts: 92
Joined: Thu May 14, 2020 3:34 pm
Full name: A. B. Gursu

Re: Any MCTS chess rating?

Post by abgursu »

Care to share, Jörg?

Deleting stuff like if(MCTSThreads=Threads)
MCTSThreads=MCTSThreads-1 won't work, it crashes.

I believe it requires a good complete rewrite to have a pure MCTS.