Cutechess-cli draw adjudication Bug

[Bjoern]

While testing a threaded version of my engine feligres, I am using cutechess-cli with the parameters

-draw movenumber=20 movecount=3 score=0

and I get 100% draw rate....

Below is an examplary output, I already made some changes (Thread 1 -> Thread a, removed Ponder & Stop-Command information),
but still no success.

What is cutechess-cli using ? There's no output of scores with "0"....

Any hints welcome.

Thanks

30292 >W0097f6(1): position fen rq2kb1r/p2p1ppp/1pb1pn2/8/2P1P3/P1N5/1PQ1BPPP/R1B1K2R w KQkq - 0 1 moves c1g5 b8b7 e2f3 f8d6 b2b4 d6e5 b4b5 e5c3 c2c3 c6e4 g5f6 e4f3 g2f3 g7f6 h1g1 e6e5 a1d1 a7a6 c3b3 b7a7 c4c5 a6b5 c5b6 a7b6 g1g7 h8f8 g7h7 b6c5 b3d3 a8a7 h2h3 f8g8 e1f1 c5c4 d3c4 b5c4 h7h4 a7a4 d1d5
30292 >W0097f6(1): isready
30293 <W0097f6(1): readyok
30293 >W0097f6(1): go wtime 10033 btime 10197 winc 200 binc 200 movestogo 980
30296 <W0097f6(1): info depth 1 seldepth 1 currmovenumber 1 multipv 1 thread a score cp 136 nodes 192 nps 64 time 3 pv e8e7 f1e2 g8c8
30297 <W0097f6(1): info depth 2 seldepth 1 currmovenumber 1 multipv 1 thread a score cp 148 nodes 1242 nps 310 time 4 pv e8e7 d5b5 g8c8 b5b4
30300 <W0097f6(1): info depth 3 seldepth 3 currmovenumber 1 multipv 1 thread a score cp 149 nodes 2563 nps 366 time 7 pv e8e7 d5c5 a4a3 h4c4 a3f3
30307 <W0097f6(1): info depth 4 seldepth 3 currmovenumber 1 multipv 1 thread a score cp 146 nodes 5940 nps 456 time 13 pv e8e7 h4c4 a4c4 f1e2 g8g2 e2e3
30320 <W0097f6(1): info depth 5 seldepth 5 currmovenumber 1 multipv 1 thread a score cp 140 nodes 13501 nps 519 time 26 pv e8e7 d5c5 a4a3 h4c4 a3f3 h3h4 f3d3
30322 <W0097f6(1): info depth 5 seldepth 4 currmovenumber 2 multipv 1 thread a score cp 140 nodes 14957 nps 515 time 29 pv a4a3 h4c4 a3a1 f1e2 g8g2 c4c7
30358 <W0097f6(1): info depth 6 seldepth 6 currmovenumber 1 multipv 1 thread a score cp 112 nodes 36810 nps 575 time 64 pv a4a3 h4c4 a3a1 f1e2 a1a2 e2f1 e8e7 c4c7
30367 <W0097f6(1): info depth 6 seldepth 4 currmovenumber 2 multipv 1 thread a score cp 174 nodes 42170 nps 569 time 74 pv e8e7 d5c5 a4a3 c5c4 f6f5
30418 <W0097f6(1): info depth 7 seldepth 7 currmovenumber 1 multipv 1 thread a score cp 186 nodes 71502 nps 576 time 124 pv e8e7 d5b5 a4a3 h4c4 a3f3 h3h4 f3a3 c4c7
30496 <W0097f6(1): info depth 8 seldepth 7 currmovenumber 1 multipv 1 thread a score cp 180 nodes 118333 nps 585 time 202 pv e8e7 d5c5 a4a3 h4c4 a3f3 h3h4 f3b3 f1e2
30660 <W0097f6(1): info depth 9 seldepth 9 currmovenumber 1 multipv 1 thread a score cp 184 nodes 215756 nps 589 time 366 pv e8e7 d5c5 a4a3 h4c4 a3f3 c4c3 g8g3 c3f3 g3f3 h3h4 f3d3
30697 <W0097f6(1): info thread a nodes 1023801 depth 9 bestmove e8e7 score 184 ( 147381)
30697 <W0097f6(1): info nodes 1023801 nps 2534 time 404 allotted time 529
30697 <W0097f6(1): bestmove e8e7 ponder d5c5
30697 >W0095c56(0): position fen rq2kb1r/p2p1ppp/1pb1pn2/8/2P1P3/P1N5/1PQ1BPPP/R1B1K2R w KQkq - 0 1 moves c1g5 b8b7 e2f3 f8d6 b2b4 d6e5 b4b5 e5c3 c2c3 c6e4 g5f6 e4f3 g2f3 g7f6 h1g1 e6e5 a1d1 a7a6 c3b3 b7a7 c4c5 a6b5 c5b6 a7b6 g1g7 h8f8 g7h7 b6c5 b3d3 a8a7 h2h3 f8g8 e1f1 c5c4 d3c4 b5c4 h7h4 a7a4 d1d5 e8e7
30697 >W0095c56(0): isready
30699 <W0095c56(0): readyok
30699 >W0095c56(0): go wtime 10033 btime 9994 winc 200 binc 200 movestogo 979
30703 <W0095c56(0): info depth 1 seldepth 1 currmovenumber 6 multipv 1 thread 2 score cp -149 pv d5c5 a4a3 h4c4
30707 <W0095c56(0): info depth 1 seldepth 1 currmovenumber 6 multipv 1 thread 2 score cp -149 pv d5c5 a4a3 h4c4
30708 <W0095c56(0): info depth 2 seldepth 3 currmovenumber 1 multipv 1 thread 2 score cp -149 pv d5c5 a4a3 h4c4 a3f3
30721 <W0095c56(0): info depth 3 seldepth 4 currmovenumber 1 multipv 1 thread 2 score cp -146 pv d5c5 a4a3 h4c4 a3f3 h3h4
30731 <W0095c56(0): info depth 4 seldepth 5 currmovenumber 1 multipv 1 thread 2 score cp -177 pv d5c5 a4a3 c5c4 d7d5
30751 <W0095c56(0): info depth 5 seldepth 6 currmovenumber 1 multipv 1 thread 2 score cp -146 pv d5c5 a4a3 h4c4 a3f3 h3h4 f3b3 c5c7
30780 <W0095c56(0): info depth 6 seldepth 7 currmovenumber 1 multipv 1 thread 2 score cp -166 pv d5c5 a4a3 h4c4 a3f3 h3h4 f3b3 h4h5 b3h3
30880 <W0095c56(0): info depth 7 seldepth 7 currmovenumber 1 multipv 1 thread 2 score cp -183 pv d5c5 a4a3 h4c4 a3f3 h3h4 e7e6 c5c7 d7d5
30999 <W0095c56(0): info depth 8 seldepth 9 currmovenumber 1 multipv 1 thread 2 score cp -196 pv d5c5 a4a3 h4c4 a3f3 h3h4 f3a3 c5c7 a3a1 c4c1
31089 <W0095c56(0): info thread 0 bestmove d5b5 score -199 (-159353)
31089 <W0095c56(0): info thread 1 bestmove d5d1 score -270 (-216392)
31089 <W0095c56(0): info thread 2 bestmove d5c5 score -191 (-153593)
31089 <W0095c56(0): info nodes 1665866 nps 4271 time 390 allotted time 505 trend 1 ponder 0 stop 1
31089 <W0095c56(0): bestmove d5c5 ponder a4a3
31089 >W0097f6(1): position fen rq2kb1r/p2p1ppp/1pb1pn2/8/2P1P3/P1N5/1PQ1BPPP/R1B1K2R w KQkq - 0 1 moves c1g5 b8b7 e2f3 f8d6 b2b4 d6e5 b4b5 e5c3 c2c3 c6e4 g5f6 e4f3 g2f3 g7f6 h1g1 e6e5 a1d1 a7a6 c3b3 b7a7 c4c5 a6b5 c5b6 a7b6 g1g7 h8f8 g7h7 b6c5 b3d3 a8a7 h2h3 f8g8 e1f1 c5c4 d3c4 b5c4 h7h4 a7a4 d1d5 e8e7 d5c5
31089 >W0095c56(0): isready
31089 >W0097f6(1): isready
31090 <W0095c56(0): readyok
31091 <W0097f6(1): readyok
Finished game 1 (W0095c56 vs W0097f6): 1/2-1/2 {Draw by adjudication}

[Bjoern]

No more ZERO's in the output, but still a draw adjudication ?

35270 >W0097f6(1): position fen rq2kb1r/p2p1ppp/1pb1pn2/8/2P1P3/P1N5/1PQ1BPPP/R1B1K2R w KQkq - 0 1 moves c1g5 b8b7 e2f3 f8d6 b2b4 b7c7 g2g4 d6h2 g5d2 h7h5 g4h5 f6h5 e1c1 h5f4 b4b5 c6b7 c1b1 f7f5 d2f4 c7f4 c2e2 a8c8 e2d3 d7d5 c4d5 f5e4 f3e4 e8g8 d3h3 c8c3 h3h7 g8f7 d5e6 f7e6 h7g6 e6e7 e4b7 f4f5 g6f5 f8f5 h1h2 f5b5 b1a2 b5a5 b7d5 a5a3 a2b2 c3d3 d1g1
35270 >W0097f6(1): isready
35272 <W0097f6(1): readyok
35272 >W0097f6(1): go wtime 8527 btime 8730 winc 200 binc 200 movestogo 975
35274 <W0097f6(1): info depth 1 seldepth 2 currmovenumber 1 multipv 1 thread a score cp -103 nodes 140 nps 70 time 2 pv e7f6 h2h7 f6e5
35274 <W0097f6(1): info depth 2 seldepth 1 currmovenumber 1 multipv 1 thread a score cp -137 nodes 411 nps 137 time 3 pv e7f6 h2h8 a3c3 g1h1
35279 <W0097f6(1): info depth 3 seldepth 2 currmovenumber 1 multipv 1 thread a score cp -103 nodes 2590 nps 370 time 7 pv e7f6 h2h7 f6e5 g1g5 e5d4
35285 <W0097f6(1): info depth 4 seldepth 3 currmovenumber 1 multipv 1 thread a score cp -135 nodes 5222 nps 401 time 13 pv e7f6 h2h7 a3a4 d5b7 d3d2
35297 <W0097f6(1): info depth 5 seldepth 7 currmovenumber 1 multipv 1 thread a score cp -166 nodes 11413 nps 438 time 26 pv e7f6 h2h7 a3a4 d5b7 a4f4 g1g7 f4f2
35354 <W0097f6(1): info depth 6 seldepth 4 currmovenumber 1 multipv 1 thread a score cp -143 nodes 42211 nps 514 time 82 pv e7f6 g1c1 a7a5 c1c6
35435 <W0097f6(1): info depth 7 seldepth 6 currmovenumber 1 multipv 1 thread a score cp -146 nodes 87501 nps 533 time 164 pv e7f6 g1c1 g7g5 h2h5 f6g6 h5h8 g6f5
35603 <W0097f6(1): info depth 8 seldepth 8 currmovenumber 1 multipv 1 thread a score cp -182 nodes 181995 nps 548 time 332 pv e7f6 g1c1 f6e7 c1c6 e7d7 d5e4 d3b3 b2c2 a7a5
35733 <W0097f6(1): info thread a nodes 1353021 depth 9 bestmove e7f6 score -182 (-145821)
35733 <W0097f6(1): info nodes 1353021 nps 2928 time 462 allotted time 461
35733 <W0097f6(1): bestmove e7f6 ponder g1c1
35733 >W0095c61(0): position fen rq2kb1r/p2p1ppp/1pb1pn2/8/2P1P3/P1N5/1PQ1BPPP/R1B1K2R w KQkq - 0 1 moves c1g5 b8b7 e2f3 f8d6 b2b4 b7c7 g2g4 d6h2 g5d2 h7h5 g4h5 f6h5 e1c1 h5f4 b4b5 c6b7 c1b1 f7f5 d2f4 c7f4 c2e2 a8c8 e2d3 d7d5 c4d5 f5e4 f3e4 e8g8 d3h3 c8c3 h3h7 g8f7 d5e6 f7e6 h7g6 e6e7 e4b7 f4f5 g6f5 f8f5 h1h2 f5b5 b1a2 b5a5 b7d5 a5a3 a2b2 c3d3 d1g1 e7f6
35733 >W0095c61(0): isready
35735 <W0095c61(0): readyok
35735 >W0095c61(0): go wtime 8527 btime 8469 winc 200 binc 200 movestogo 974
35739 <W0095c61(0): info depth 1 seldepth 1 currmovenumber 11 multipv 1 thread b score cp 117 nodes 8296 nps 1382 time 6 pv h2h5 a7a5 d1d3
35740 <W0095c61(0): info depth 1 seldepth 1 currmovenumber 10 multipv 1 thread b score cp 103 nodes 5396 nps 1349 time 4 pv h2h7 f6e5 g1g5
35740 <W0095c61(0): info depth 1 seldepth 1 currmovenumber 10 multipv 1 thread b score cp 103 nodes 5396 nps 1349 time 4 pv h2h7 f6e5 g1g5
35741 <W0095c61(0): info depth 2 seldepth 3 currmovenumber 1 multipv 1 thread b score cp 117 nodes 16518 nps 2753 time 6 pv h2h7 g7g5 g1e1 a7a5
35746 <W0095c61(0): info depth 3 seldepth 5 currmovenumber 1 multipv 1 thread b score cp 143 nodes 42203 nps 4689 time 9 pv h2h7 g7g5 d5c6 a3c3 g1g5
35759 <W0095c61(0): info depth 4 seldepth 6 currmovenumber 1 multipv 1 thread c score cp 150 nodes 134571 nps 6408 time 21 pv h2g2 f6e5 d5f7 a3c3
35800 <W0095c61(0): info depth 5 seldepth 6 currmovenumber 1 multipv 1 thread c score cp 193 nodes 347470 nps 7091 time 49 pv h2g2 a3a5 g2g6 f6f5 d5c6
35986 <W0095c61(0): info depth 6 seldepth 7 currmovenumber 1 multipv 1 thread c score cp 229 nodes 710925 nps 7644 time 93 pv h2g2 a3a5 d5c4 d3d4 g2g6 f6f5
36169 <W0095c61(0): info thread a bestmove g1g4 score 110 ( 88064)
36169 <W0095c61(0): info thread b bestmove g1c1 score 179 ( 143829)
36169 <W0095c61(0): info thread c bestmove h2g2 score 227 ( 182374)
36169 <W0095c61(0): info nodes 3582757 nps 8255 time 434 allotted time 433
36169 <W0095c61(0): bestmove h2g2 ponder a3a5
36169 >W0097f6(1): position fen rq2kb1r/p2p1ppp/1pb1pn2/8/2P1P3/P1N5/1PQ1BPPP/R1B1K2R w KQkq - 0 1 moves c1g5 b8b7 e2f3 f8d6 b2b4 b7c7 g2g4 d6h2 g5d2 h7h5 g4h5 f6h5 e1c1 h5f4 b4b5 c6b7 c1b1 f7f5 d2f4 c7f4 c2e2 a8c8 e2d3 d7d5 c4d5 f5e4 f3e4 e8g8 d3h3 c8c3 h3h7 g8f7 d5e6 f7e6 h7g6 e6e7 e4b7 f4f5 g6f5 f8f5 h1h2 f5b5 b1a2 b5a5 b7d5 a5a3 a2b2 c3d3 d1g1 e7f6 h2g2
36170 >W0095c61(0): isready
36170 >W0097f6(1): isready
36170 <W0095c61(0): readyok
36172 <W0097f6(1): readyok
Finished game 1 (W0095c61 vs W0097f6): 1/2-1/2 {Draw by adjudication}

[Guenther]

While testing a threaded version of my engine feligres, I am using cutechess-cli with the parameters

-draw movenumber=20 movecount=3 score=0

and I get 100% draw rate....

Below is an examplary output, I already made some changes (Thread 1 -> Thread a, removed Ponder & Stop-Command information),
but still no success.

What is cutechess-cli using ? There's no output of scores with "0"....

I think score=0 always ajudicates as draw, because (read help txt) it compares the given draw score to zero.
You should at least set score=1 (1 means centipawns, which is an eval of 0.01). I never used anything below 10.

[Bjoern]

Indeed, score=0 should adjudicate as draw after 3 moves by both engines with this score after a movecount=20.

This is not the case here.

I found a way around this bug from cutechess:

engine info other than beginning with "info depth" "bestmove" start with "info string" (UCI Protocoll = Debug info).

This solves it, but is in my opinion a work-around and there's still a bug in cutechess-cli.