Test programs

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

I'm playing an LCO versus Ethereal match. I have a question for the developer of the Ethereal chess engine. What is the reason the program loses games over time. I am using version 13.25.

Test - https://www.sendspace.com/file/xkjsjo
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Krzysztof Grzelak wrote: Sat Dec 11, 2021 2:01 pm I'm playing an LCO versus Ethereal match. I have a question for the developer of the Ethereal chess engine. What is the reason the program loses games over time. I am using version 13.25.

Test - https://www.sendspace.com/file/xkjsjo
Sorry, topic is out of date.
AndrewGrant
Posts: 1819
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: Test programs

Post by AndrewGrant »

You would have to provide more information. I seldom, if ever, receive reports of Ethereal losing on time. If you see time losses, you should simply increase the MoveOverhead UCI paramater. If you are playing sudden death, then I suppose you might see some.

Otherwise, the system is too bogged down to be playing at the current MoveOverhead level, which would surprise me, but it possible. Particularly if you are playing with tablebases on an HDD and not SDD, or if you are pondering while using hyperthreads.
Friendly reminder that stealing is a crime, is wrong, and makes you a thief.
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

AndrewGrant wrote: Sat Dec 11, 2021 9:18 pm You would have to provide more information. I seldom, if ever, receive reports of Ethereal losing on time. If you see time losses, you should simply increase the MoveOverhead UCI paramater. If you are playing sudden death, then I suppose you might see some.

Otherwise, the system is too bogged down to be playing at the current MoveOverhead level, which would surprise me, but it possible. Particularly if you are playing with tablebases on an HDD and not SDD, or if you are pondering while using hyperthreads.
Sorry, the problem has already been resolved. I interrupted the game due to not using my opening book and an unusual problem, and I don't know how to solve it. Engines repeat openings and opening codes- for example A20, E10, E00, E15.
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Revenge 2.0 x64 - Ethereal 13.25 x64

Match result 16 - 8 - 76 (100 games)


The match was played on the following equipment:

processor - AMD Ryzen Threadripper 1950X 3.4GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - Razer DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit PL

During the match I was using the Noomen 3-move Testsuite debut book, time for the game - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon

Tournament type:
Round Robin= On

Rounds:
Rounds= 100
Save unfinished games= On
Swap sides= On

Games:
Time Control:
Time= 5,00
Increment= 3,00sec

Opening suite:
PGN/EPD file= D:/Book/Noomen 3-move Testsuite.pgn
Depth= 6 plies
Opening book= Random

Draw adjudication:
Move number= 35
Move count= 5
Score= 15 cp

Resign adjudication:
Move count= 5
Score= 1000 cp
Two-Sided= On

Game Length:
Limit= Off

Tablebase adjudication= On


Setting the engines during the game.

Revenge 2.0 x64
Protocol= uci
Hash= 16384
Threads= 16
MoveOverhead= 100
MultiPV= 1
SyzygyPath= D:/Syzygy
Syzygy50MoveRule= On
SyzygyProbeLimit= 6
SyzygyProbeDepth= 2

Ethereal 13.25 x64
Protocol= uci
Hash= 16384
Threads= 16
EvalFile= e1325.standard.nnue
MultiPV= 1
MoveOverhead= 500
SyzygyPath= D:/Syzygy
SyzygyProbeDepth=2

Parties of the match Revenge 2.0 - Ethereal 13.25 https://files.fm/u/2zt4hkexz
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match LCZero 0.28.2-dev x64-610711 - Berserk 8.5.1 x64

Match result 9 - 2 - 89 (100 games)


The match was played on the following equipment:

processor - AMD Ryzen Threadripper 1950X 3.4GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - Razer DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit PL

During the match, the opening book was not used, time for the game - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon

Tournament type:
Round Robin= On

Rounds:
Rounds= 100
Save unfinished games= On
Swap sides= On

Games:
Time Control:
Time= 5,00
Increment= 3,00sec

Draw adjudication:
Move number= 35
Move count= 5
Score= 15 cp

Resign adjudication:
Move count= 5
Score= 1000 cp
Two-Sided= On

Game Length:
Limit= Off

Tablebase adjudication= On


Setting the engines during the game.

LCZero 0.28.2-dev x64-610711
Protocol= uci
Network IDs= 610711
backend= cuda-fp16
backend-optsions= multi_stream=true
threads= 3
minibatch-size= 256
nncache= 50000000
verbose-move-stats= true
fpu-value= 0.279
cpuct= 1.473
cpuct-base= 45669
cpuct-factor= 3.973
max-prefetch= 37
policytemperature= 1.206
movesleftmaxeffect= 0.020000
movesleftslope= 0.002000
smartpruningfactor= 1.470
the rest of the options remain unchanged

Berserk 8.5.1 x64
Protocol= uci
Hash= 16384
Threads= 16
MultiPV= 1
MoveOverhead= 300
SyzygyPath= D:/Syzygy


Parties of the match LCZero 0.28.2-dev-610711 - Berserk 8.5.1 https://files.fm/u/czxsee4ky
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Unfortunately, my fears have been confirmed. Programs do not know how to play without a book of debits and very often repeat the same debits. During the next tests, I will be using the opening book - Noomen 3-move Testsuite.
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match RubiChess 2021 x64 - Koivisto 7.9 x64

Match result 6 - 9 - 85 (100 games)

The match was played on the following equipment:

processor - AMD Ryzen Threadripper 1950X 3.4GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
graphics card - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - Razer DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit PL

During the match, the opening book was not used,time for the game - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon

Tournament type:
Round Robin= On

Rounds:
Rounds= 100
Save unfinished games= On
Swap sides= On

Games:
Time Control:
Time= 5,00
Increment= 3,00sec

Draw adjudication:
Move number= 35
Move count= 5
Score= 15 cp

Resign adjudication:
Move count= 5
Score= 1000 cp
Two-Sided= On

Game Length:
Limit= Off

Tablebase adjudication= On


Setting the engines during the game.

RubiChess 2021 x64
Protocol= uci
Hash= 16384
Threads= 16
Move_Overhead= 100
MultiPV= 1
SyzygyPath= D:/Syzygy
Syzygy50MoveRule= On
SyzygyProbeLimit= 6
SyzygyProbeDepth= 2
NNUENetpath= nn-fb50f1a2b1-20210705.nnue
Use_NNUE= On

Koivisto 7.9 x64
Protocol= uci
Hash= 16384
Threads= 16
Slow Mover= 100
MultiPV= 1
Move Overhead= 10
SyzygyPath= D:/Syzygy
Syzygy50MoveRule= On
SyzygyProbeDepth= 2
SyzygyProbeLimit= 6

Parties of the match RubiChess 2021 - Koivisto 7.9 https://files.fm/u/cvavvgms3
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Minic 3.18 x64 - Halogen 10.22 x64

Match result 26 - 5 - 69 (100 games)

The match was played on the following equipment:

processor - AMD Ryzen Threadripper 1950X 3.4GHz
graphics card - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - Razer DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit PL

During the match I was using the Noomen 3-move Testsuite debut book, time for the game - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon

Tournament type:
Round Robin= On

Rounds:
Rounds= 100
Save unfinished games= On
Swap sides= On

Games:
Time Control:
Time= 5,00
Increment= 3,00sec

Opening suite:
PGN/EPD file= D:/Book/Noomen 3-move Testsuite.pgn
Depth= 6 plies
Opening book= Random

Draw adjudication:
Move number= 35
Move count= 5
Score= 15 cp

Resign adjudication:
Move count= 5
Score= 1000 cp
Two-Sided= On

Game Length:
Limit= Off

Tablebase adjudication= On


Setting the engines during the game.

Minic 3.18 x64
Protocol= uci
Hash= 16384
Threads= 16
MinMoveOverHead= 50
Contempt= 12
ContemptMG= 12
MultiPV= 1
SyzygyPath= D:/Syzygy
NNUEFile= embedded
NNUEScaling= 80
NNUEThreshold= 600
The other options in the program remain unchanged

Halogen 10.22 x64
Protocol= uci
Hash= 16384
Threads= 16
MultiPV= 1
SyzygyPath= D:/Syzygy

Parties of the match Minic 3.18 - Halogen 10.22 https://files.fm/u/ughe89bzw
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Dragon 2 x64 - LCZero 0.28.2-dev x64-610711

Match result 1-16-83 (100 games)


The match was played on the following equipment:

processor - AMD Ryzen Threadripper 1950X 3.4GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - Razer DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit PL

During the match I was using the Noomen 3-move Testsuite debut book - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon

Tournament type:
Round Robin= On

Rounds:
Rounds= 100
Save unfinished games= On
Swap sides= On

Games:
Time Control:
Time= 5,00
Increment= 3,00sec

Opening suite:
PGN/EPD file= D:/Book/Noomen 3-move Testsuite.pgn
Depth= 6 plies
Opening book= Random

Draw adjudication:
Move number= 35
Move count= 5
Score= 15 cp

Resign adjudication:
Move count= 5
Score= 1000 cp
Two-Sided= On

Game Length:
Limit= Off

Tablebase adjudication= On


Setting the engines during the game.

Dragon 2 x64
Protocol=uci
Hash=16384
Threads=16
Contempt=0
Overhead ms=100
SyzygyPath=D:/Syzygy
Time Usage=0
Table Memory=256
Syzygy Probe Limit=6
Syzygy Probe Depth=2
Smart Syzygy=false
OwnBook=false
Ponder=false

LCZero 0.28.2 x64-610711
Protocol=uci
Network IDs=610711
backend=cuda-fp16
backend-optsions=multi_stream=true
threads=3
minibatch-size=256
nncache=50000000
verbose-move-stats=true
fpu-value=0.279
cpuct=1.473
cpuct-base=45669
cpuct-factor=3.973
max-prefetch=37
policytemperature=1.206
movesleftmaxeffect=0.020000
movesleftslope=0.002000
smartpruningfactor=1.470
Syzygypath=D:\Syzygy
MoveOverheadMs=1000
TimeManager=alphazero
the rest of the options remain unchanged

Parties of the match Dragon 2 - LCZero 0.28.2-610711 https://files.fm/u/kwgpqbkjw