Test programs

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Krzysztof Grzelak
Posts: 1584
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Caissa 1.20 x64 - Clover 7.0 x64

Match result 4 - 0 - 96 (100 games)

The match was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit


During the match I was using the Balsa 270423 book - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon.


Tournament type:
Round Robin - On

Rounds:
Rounds - 100
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 5,00
Increment - 3,00sec

Opening suite:
PGN/EPD file - D:/Book/Balsa_270423.pgn
Depth - 16 plies
Opening book - Random

Draw adjudication:
Move number - 60
Move count - 5
Score - 15 cp

Resign adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Setting the engines during the game.


Caissa 1.20 x64

Protocol - Uci
Hash - 16384
Threads - 32
MoveOverhead - 10
SyzygyPath - D:\Syzygy
SyzygyProbleLimit - 6


Clover 7.0 x64

Protocol - Uci
Hash - 16384
Threads - 32
SyzygyPath - D:\Syzygy
MultiPV - 1


Games of the match Caissa 1.20 - Clover 7.0 https://pixeldrain.com/u/ibn8quYU
Krzysztof Grzelak
Posts: 1584
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Obsidian 14.0 x64 - RubiChess 20240817 x64

Match result 7 - 0 - 193 (200 games)

The match was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit


During the match I was using the Balsa 270423 book - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon.


Tournament type:
Gauntlet - On

Rounds:
Rounds - 200
Play each opening - 2 times
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 5,00
Increment - 3,00sec

Opening suite:
PGN/EPD file - D:/Book/Balsa_270423.pgn
Depth - 16 plies
Opening book - Random

Draw adjudication:
Move number - 60
Move count - 5
Score - 15 cp

Resign adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Setting the engines during the game.


Obsidian 14.0 x64

Protocol - Uci
Hash - 16384
Threads - 32
Move Overhead - 10
SyzygyPath - D:\Syzygy
MultiPV - 1


RubiChess 20240817 x64

Protocol - uci
Hash - 16384
Threads - 32
Allow Large Pages - On
Contempt - 0
ContemptRatio - 4
Move_Overhead - 100
MultiPV - 1
NNUENetpath - nn-bc638d5ec9-20240730.nnue
Syzygy50MoveRule - On
SyzygyPath - D:\Syzygy
SyzygyProbleLimit - 6
Use_NNUE - On


Games of the match Obsidian 14.0 - RubiChess 20240817 https://pixeldrain.com/u/Xm4S8bPA
Krzysztof Grzelak
Posts: 1584
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Tournament Engines

The following chess engines took part in the tournament:

Booot 7.4 x64
Caissa 1.21 x64
Clover 8.0.1 x64
Igel 3.6.0 x64
Integral 7 x64
LCZero 0.32 dag-7fc8547b-BT4-6147500-it332 x64
Obsidian 15.0 x64
Revenge 4.0 x64


The engine tournament was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit

During the tournament I was using the Balsa 270423 debut book, time - 15 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon

Tournament type:
Round Robin - On

Rounds:
Rounds - 3
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 15,00
Increment - 3,00sec

Opening suite:
PGN/EPD file - D:/Book/Balsa 270423.pgn
Depth - 8 plies
Opening order - Random

Draw adjudication:
Move number - 60
Move count - 5
Score - 15 cp

Adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Setting engines during the tournament.

Booot 7.4 x64

Protocol - Uci
Hash - 4096
Threads - 32

Caissa 1.21 x64

Protocol - Uci
Hash - 4096
Threads - 32
MultiPv - 1
MoveOverhead - 10
SyzygyPath - D:/Syzygy
SyzygyProbleLimit - 6

Clover 8.0.1 x64

Protocol - Uci
Hash - 4096
Threads - 32
MultiPV - 1
SyzygyPath - D:/Syzygy

Igel 3.6.0 x64

Protocol - uci
Hash - 4096
Threads - 32
SyzygyPath - D:/Syzygy
SyzygyProbeDepth - 2
Skill Level - 20

Integral 7 x64

Protocol - uci
Hash - 4096
MultiPV - 1
SyzygyPath - D:/Syzygy
SyzygyProbeDepth - 2
Threads - 32

LCZero 0.32 dag-7fc8547b-BT4-6147500-it332 x64

Protocol - Uci
WeightsFile - BT4-332.pb
Backend - demux
BackendOptions - backend=cuda-fp16(gpu=0),(gpu=1)
Threads - 2
MinibatchSize - 160
VerboseMoveStats - true
FpuValue - 0.325
CPuct - 1.43
CPuctBase - 45000
CPuctFactor - 2.1
PolicyTemperature - 1.285
MoveRuleBucketing - true
MovesLeftSlope - 0.0027
MovesLeftThreshold - 0.8
Contempt - Stockfish=0
ContemptMaxValue - 600
Ponder - false
ScoreType - WDL_mu
SmartPruningFactor - 2
SmartPruningMinimumBatches - 300
TaskWorkers - 3
SyzygyPath - D:/Syzygy
MoveOverheadMs - 1000
StrictTiming - true
TimeManager - legacy
WDLCalibrationElo - 3600
WDLContemptAttenuation - 0.55
WDLDrawRateReference - 0.64
WDLEvalObjectivity - 0

Tournament Engines ended with victory of the program LCZero 0.32 dag by Gary Linscott and many others, second and third place was programs
Igiel 3.6.0 by Volodymyr Shcherbyna and Obsidian 15.0 by Gabriele Lombardo.Thanks to the other tournament participants.

Tournament table and other information from the tournament.

Image

Tournament games " Tournament Engines " - https://pixeldrain.com/u/1y6kJ4o2
chesskobra
Posts: 343
Joined: Thu Jul 21, 2022 12:30 am
Full name: Chesskobra

Re: Test programs

Post by chesskobra »

Each engine has played 21 games - 3 games against every other engine. Are the matches not played as game pairs?
Krzysztof Grzelak
Posts: 1584
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

chesskobra wrote: Tue Mar 04, 2025 12:08 pm Each engine has played 21 games - 3 games against every other engine. Are the matches not played as game pairs?
Sorry, I think I was wrong, there should be 4 rounds 21x4=84.
Krzysztof Grzelak
Posts: 1584
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Tournament Engines

The following chess engines took part in the tournament:

Alexandria 8.0 x64
Berserk 13 x64
Booot 7.4 x64
Caissa 1.21 x64
Clover 8.1 x64
Ethereal 14.25 x64
Horsie 1.0 x64
Igel 3.6.0 x64
Integral 7 x64
KomodoDragon 3.3 x64
LCZero 0.32 dag-7fc8547b-BT4-6147500-it332 x64
Obsidian 15.0 x64
Rebel 16.3 x64
Revenge 4.0 x64
rofChade 3.1 x64
RubiChess 20240817 x64
Samllbrain 7 x64
Seer 2.8 x64
Stormphrax 6.0.0 x64
Texel 1.12 x64
Uralochka 3.41a x64
Viridithas 16.0.0 x64


The engine tournament was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit

During the tournament I was using the SuperGM_4mvs debut book, time - 1 minutes + 1 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon

Tournament type:
Round Robin - On

Rounds:
Rounds - 4
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 1,00
Increment - 1,00sec

Opening suite:
PGN/EPD file - D:/Book/SuperGM_4mvs.pgn
Depth - 8 plies
Opening order - Random

Draw adjudication:
Move number - 60
Move count - 5
Score - 15 cp

Adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Setting engines during the tournament.

All engines were set up as follows:

Protocol - Uci
Hash - 1024
Threads - 32

Tournament Engines ended with victory of the program Obsidian 15.0 by Gabriele Lombardo, second and third place was programs
Berserk 13 by Jay Honnold and KomodoDragon 3.3 by Don Dailey, Larry Kaufman, and Mark Lefler.Thanks to the other tournament participants.

Tournament table and other information from the tournament.

Image

Player: Alexandria 8.0 x64

"Draw by 3-fold repetition": 32
"Draw by adjudication": 28
"Draw by adjudication: SyzygyTB": 13
"Win: Black wins by adjudication": 1
"Win: White wins by adjudication": 10

Player: Berserk 13 x64

"Draw by 3-fold repetition": 14
"Draw by adjudication": 26
"Draw by adjudication: SyzygyTB": 25
"Loss: White wins by adjudication": 1
"Win: Black mates": 1
"Win: Black wins by adjudication": 2
"Win: Black wins by adjudication: SyzygyTB": 2
"Win: White wins by adjudication": 13

Player: Booot 7.4 x64

"Draw by 3-fold repetition": 28
"Draw by adjudication": 24
"Draw by adjudication: SyzygyTB": 16
"Loss: White wins by adjudication": 6
"Loss: White wins by adjudication: SyzygyTB": 1
"Win: Black wins by adjudication": 2
"Win: White mates": 1
"Win: White wins by adjudication": 6

Player: Caissa 1.21 x64

"Draw by 3-fold repetition": 32
"Draw by adjudication": 20
"Draw by adjudication: SyzygyTB": 16
"Loss: White wins by adjudication": 5
"Win: Black wins by adjudication": 1
"Win: White wins by adjudication": 10

Player: Clover 8.1 x64

"Draw by 3-fold repetition": 25
"Draw by adjudication": 28
"Draw by adjudication: SyzygyTB": 14
"Draw by fifty moves rule": 1
"Loss: White wins by adjudication": 7
"Win: White wins by adjudication": 7
"Win: White wins by adjudication: SyzygyTB": 2

Player: Ethereal 14.25 x64

"Draw by 3-fold repetition": 18
"Draw by adjudication": 28
"Draw by adjudication: SyzygyTB": 26
"Loss: Black wins by adjudication": 2
"Loss: Black wins by adjudication: SyzygyTB": 1
"Loss: White wins by adjudication": 1
"Win: Black wins by adjudication": 1
"Win: White wins by adjudication": 7

Player: Horsie 1.0 x64

"Draw by 3-fold repetition": 45
"Draw by adjudication": 11
"Draw by adjudication: SyzygyTB": 17
"Draw by fifty moves rule": 1
"Loss: White wins by adjudication": 1
"Loss: White wins by adjudication: SyzygyTB": 4
"Win: Black wins by adjudication": 1
"Win: White wins by adjudication": 2
"Win: White wins by adjudication: SyzygyTB": 2

Player: Igel 3.6.0 x64

"Draw by 3-fold repetition": 36
"Draw by adjudication": 22
"Draw by adjudication: SyzygyTB": 14
"Loss: White wins by adjudication": 5
"Win: Black wins by adjudication": 3
"Win: White wins by adjudication": 4

Player: Integral 7 x64

"Draw by 3-fold repetition": 29
"Draw by adjudication": 21
"Draw by adjudication: SyzygyTB": 20
"Loss: White wins by adjudication": 3
"Win: Black mates": 1
"Win: Black wins by adjudication": 1
"Win: White wins by adjudication": 7
"Win: White wins by adjudication: SyzygyTB": 2

Player: KomodoDragon 3.3 x64

"Draw by 3-fold repetition": 16
"Draw by adjudication": 43
"Draw by adjudication: SyzygyTB": 8
"Loss: Black wins by adjudication": 1
"Win: Black wins by adjudication": 5
"Win: White wins by adjudication": 11

Player: LCZero 0.32-dag-7fc8547b-BT4-6147500-it332 x64

"Draw by 3-fold repetition": 24
"Draw by adjudication": 28
"Draw by adjudication: SyzygyTB": 19
"Win: Black wins by adjudication": 3
"Win: White mates": 1
"Win: White wins by adjudication": 8
"Win: White wins by adjudication: SyzygyTB": 1

Player: Obsidian 15.0 x64

"Draw by 3-fold repetition": 31
"Draw by adjudication": 17
"Draw by adjudication: SyzygyTB": 19
"Win: Black wins by adjudication": 2
"Win: White mates": 1
"Win: White wins by adjudication": 11
"Win: White wins by adjudication: SyzygyTB": 3

Player: Rebel 16.3 x64

"Draw by 3-fold repetition": 26
"Draw by adjudication": 25
"Draw by adjudication: SyzygyTB": 18
"Loss: Black wins by adjudication": 1
"Loss: Black wins by adjudication: SyzygyTB": 1
"Loss: White wins by adjudication": 5
"Loss: White wins by adjudication: SyzygyTB": 4
"Win: Black wins by adjudication": 1
"Win: White wins by adjudication": 3

Player: Revenge 4.0 x64

"Draw by 3-fold repetition": 31
"Draw by adjudication": 23
"Draw by adjudication: SyzygyTB": 10
"Loss: Black wins by adjudication": 1
"Loss: White wins by adjudication": 11
"Loss: White wins by adjudication: SyzygyTB": 2
"Win: Black wins by adjudication": 2
"Win: White mates": 1
"Win: White wins by adjudication": 3

Player: rofChade 3.1 x64

"Draw by 3-fold repetition": 21
"Draw by adjudication": 21
"Draw by adjudication: SyzygyTB": 27
"Draw by fifty moves rule": 1
"Loss: Black wins by adjudication": 2
"Loss: White mates": 1
"Loss: White wins by adjudication": 5
"Loss: White wins by adjudication: SyzygyTB": 2
"Win: White wins by adjudication": 4

Player: RubiChess 20240817 x64

"Draw by 3-fold repetition": 37
"Draw by adjudication": 20
"Draw by adjudication: SyzygyTB": 14
"Loss: White mates": 1
"Loss: White wins by adjudication": 3
"Win: Black wins by adjudication": 1
"Win: White wins by adjudication": 5
"Win: White wins by adjudication: SyzygyTB": 3

Player: Samllbrain 7 x64

"Draw by 3-fold repetition": 7
"Draw by adjudication": 11
"Draw by adjudication: SyzygyTB": 15
"Draw by fifty moves rule": 1
"Loss: Black wins by adjudication": 16
"Loss: Black wins by adjudication: SyzygyTB": 1
"Loss: White wins by adjudication": 32
"Loss: White wins by adjudication: SyzygyTB": 1

Player: Seer 2.8 x64

"Draw by 3-fold repetition": 29
"Draw by adjudication": 22
"Draw by adjudication: SyzygyTB": 17
"Loss: Black wins by adjudication": 3
"Loss: White wins by adjudication": 9
"Win: Black wins by adjudication": 1
"Win: White wins by adjudication": 3

Player: Stormphrax 6.0.0 x64

"Draw by 3-fold repetition": 10
"Draw by adjudication": 46
"Draw by adjudication: SyzygyTB": 13
"Loss: Black wins by adjudication": 1
"Loss: White wins by adjudication": 9
"Loss: White wins by adjudication: SyzygyTB": 1
"Win: Black wins by adjudication": 1
"Win: White wins by adjudication": 3

Player: Texel 1.12 x64

"Draw by 3-fold repetition": 25
"Draw by adjudication": 23
"Draw by adjudication: SyzygyTB": 11
"Draw by fifty moves rule": 1
"Loss: Black wins by adjudication": 4
"Loss: White wins by adjudication": 17
"Loss: White wins by adjudication: SyzygyTB": 1
"Win: Black wins by adjudication": 1
"Win: White wins by adjudication": 1

Player: Uralochka 3.41a x64

"Draw by 3-fold repetition": 24
"Draw by adjudication": 20
"Draw by adjudication: SyzygyTB": 23
"Draw by fifty moves rule": 1
"Loss: Black mates": 2
"Loss: White mates": 2
"Loss: White wins by adjudication": 3
"Loss: White wins by adjudication: SyzygyTB": 2
"Win: Black wins by adjudication: SyzygyTB": 1
"Win: White wins by adjudication": 2
"Win: White wins by adjudication: SyzygyTB": 4

Player: Viridithas 16.0.0 x64

"Draw by 3-fold repetition": 30
"Draw by adjudication": 27
"Draw by adjudication: SyzygyTB": 15
"Loss: White wins by adjudication": 3
"Win: Black wins by adjudication": 2
"Win: White wins by adjudication": 6
"Win: White wins by adjudication: SyzygyTB": 1


Tournament games " Tournament Engines " - https://pixeldrain.com/u/dovevgZn