Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

ThatsIt
Posts: 991
Joined: Thu Mar 09, 2006 2:11 pm

Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Post by ThatsIt »

sainzlei
Posts: 29
Joined: Thu Oct 27, 2011 12:20 am

Re: Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Post by sainzlei »

will you test lc0 engine ?
ThatsIt
Posts: 991
Joined: Thu Mar 09, 2006 2:11 pm

Re: Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Post by ThatsIt »

@ Larry !

Under the Shredder Classic GUI i get very often:

Image

This causes crashes.

Best wishes,
G.S.
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Post by lkaufman »

Thanks. This tells us that the crashes in CCC and TCEC were probably not due to any changes since 12.3. We're trying to find the problem. Have there been any crashes in CEGT non-ponder testing? Are there any common elements in the positions where it crashes, or any illegal moves displayed?

Larry
Komodo rules!
ThatsIt
Posts: 991
Joined: Thu Mar 09, 2006 2:11 pm

Re: Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Post by ThatsIt »

Hi Larry,
lkaufman wrote: Fri Dec 28, 2018 6:01 pm Have there been any crashes in CEGT non-ponder testing?
I've made no tests with ponder=off so far.
lkaufman wrote: Fri Dec 28, 2018 6:01 pm Are there any common elements in the positions where it crashes, or any illegal moves displayed?

No pattern so far, but no illegal moves.
There must be a change, Komodo 12.2.1 (MCTS) does not show this behavior !

Best wishes,
G.S.
ThatsIt
Posts: 991
Joined: Thu Mar 09, 2006 2:11 pm

Re: Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Post by ThatsIt »

lkaufman wrote: Fri Dec 28, 2018 6:01 pm Have there been any crashes in CEGT non-ponder testing?

I've started the test for our 40/4 + ... list (ponder=off).

http://cegt.forumieren.com/t1069-testin ... -mcts#2230

Best wishes,
G.S.
(CEGT team)
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Post by Modern Times »

I had some crashes in CCRL 4040 4CPU testing. Not many, 4 in just over 300 games.
User avatar
pohl4711
Posts: 2432
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Post by pohl4711 »

lkaufman wrote: Fri Dec 28, 2018 6:01 pm Thanks. This tells us that the crashes in CCC and TCEC were probably not due to any changes since 12.3. We're trying to find the problem. Have there been any crashes in CEGT non-ponder testing? Are there any common elements in the positions where it crashes, or any illegal moves displayed?

Larry
If this helps: I played 5000 games with Komodo 12.3 MCTS with LittleBlitzerGui, singlecore, ponder off, 3'+1“, without any problems. No crashes, no timelosses, no illegal moves.

https://www.sp-cc.de
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Post by lkaufman »

It seems that with multiple threads (and perhaps also with ponder?) 12.3 MCTS is subject to occasional crashes and time forfeits, with the frequency increasing with thread count. We have made progress towards a fix, but we want to avoid multiple bugfixes so we want to be reasonably sure we have fixed the issue before releasing anything. Basically, the problem was that our tester didn't report crashes/forfeits so we weren't aware of the problem, but now it does so this should not be an issue in the future once we have a bugfix to release. As long as current 40/4 testing on one thread doesn't show crashes or forfeits it should be valid.
Komodo rules!
ThatsIt
Posts: 991
Joined: Thu Mar 09, 2006 2:11 pm

Re: Komodo 12.3 x64 (MCTS) @ CEGT 3'+1" ponder=on

Post by ThatsIt »

Hi !

400 games played for our CEGT 40/4 + ... list.
No issues at all !

Best wishes,
G.S.
(CEGT team)