Test programs

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

cpeters
Posts: 128
Joined: Wed Feb 17, 2021 7:44 pm
Full name: Christian Petersen

Re: Test programs

Post by cpeters »

Krysztof,

the pgn of not only this:
viewtopic.php?p=941732#p941732
has been autodeleted (two weeks default) already by that shitty hoster - there are better ones around (also free). Or one could also use pastebin (up to 512 kb)...

greetings!
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Berserk 13 x64 - Obsidian 12.0 x64

Match result 3 - 3 - 94 (100 games)

The match was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit


During the match I was using the 2600+8moves book - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon.


Tournament type:
Round Robin - On

Rounds:
Rounds - 100
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 5,00
Increment - 3,00sec

Opening suite:
PGN/EPD file - D:/Book/2600+8moves.pgn
Depth - 16 plies
Opening book - Random

Draw adjudication:
Move number - 65
Move count - 5
Score - 15 cp

Resign adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Setting the engines during the game.


Berserk 13 x64

Protocol - Uci
Hash - 16384
Threads - 32
SyzygyPath - D:\Syzygy
MultiPV - 1
MoveOverhead - 50
EvalFile - berserk - d43206fe90e4.nn


Obsidian 12.0 x64

Protocol - Uci
Hash - 16384
Threads - 32
Move Overhead - 10
SyzygyPath - D:\Syzygy
MultiPV - 1


Games of the match Berserk 13 - Obsidian 12.0 https://pixeldrain.com/u/eatojJER
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Alexandria 7.0 x64 - Caissa 1.18 x64

Match result 1 - 2 - 97 (100 games)

The match was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit


During the match I was using the Balsa 270423 book - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon.


Tournament type:
Round Robin - On

Rounds:
Rounds - 100
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 5,00
Increment - 3,00sec

Opening suite:
PGN/EPD file - D:/Book/Balsa_270423.pgn
Depth - 16 plies
Opening book - Random

Draw adjudication:
Move number - 60
Move count - 5
Score - 15 cp

Resign adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Setting the engines during the game.


Alexandria 7.0 x64

Protocol - Uci
Hash - 16384
Threads - 32


Caissa 1.18 x64

Protocol - Uci
Hash - 16384
Threads - 32
MoveOverhead - 10
SyzygyPath - D:\Syzygy
SyzygyProbleLimit - 6


Games of the match Alexandria 7.0 - Caissa 1.18 https://pixeldrain.com/u/LnxVZEQ2
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

I have an irresistible impression that the author of the Alexandria engine needs to work on the engine rating, because with some games it was too high.
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Cheng 4.48 x64 - Marvin 6.3.0 x64

Match result 5 - 8 - 87 (100 games)

The match was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit


During the match I was using the Balsa 270423 book - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon.


Tournament type:
Round Robin - On

Rounds:
Rounds - 100
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 5,00
Increment - 3,00sec

Opening suite:
PGN/EPD file - D:/Book/Balsa_270423.pgn
Depth - 16 plies
Opening book - Random

Draw adjudication:
Move number - 60
Move count - 5
Score - 15 cp

Resign adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Setting the engines during the game.


Cheng 4.48 x64

Protocol - Uci
Hash - 16384
Threads - 32
MultiPV - 1
NullMove - On
Contempt - 0
MoveOverheadMsec - 100
SyzygyPath - D:\Syzygy
SyzygyEnable - On


Marvin 6.3.0 x64

Protocol - Uci
Hash - 16384
SyzygyPath - D:\Syzygy
Threads - 32
MultiPV - 1
MoveOverhead - 50
Use NNUE - On


Games of the match Cheng 4.48 - Marvin 6.3.0 https://pixeldrain.com/u/SKX21dr2
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Clover 6.1 x64 - Uralochka 3.41a x64

Match result 1 - 1 - 98 (100 games)

The match was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit


During the match I was using the Balsa 270423 book - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon.


Tournament type:
Round Robin - On

Rounds:
Rounds - 100
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 5,00
Increment - 3,00sec

Opening suite:
PGN/EPD file - D:/Book/Balsa_270423.pgn
Depth - 16 plies
Opening book - Random

Draw adjudication:
Move number - 60
Move count - 5
Score - 15 cp

Resign adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Setting the engines during the game.


Clover 6.1 x64

Protocol - Uci
Hash - 16384
Threads - 32
MultiPV - 1
SyzygyPath - D:\Syzygy

remaining engine options remain unchanged.


Uralochka 3.41a x64

Protocol - Uci
Threads - 32
Hash - 16384
SyzygyPath - D:\Syzygy
SyzygyProbleDepth - 2
TimeMargin - 200


Games of the match Clover 6.1 - Uralochka 3.41a https://pixeldrain.com/u/iWCkFwjy
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Arasan 24.2.2 x64 - Booot 7.3 x64

Match result 10 - 3 - 87 (100 games)

The match was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit


During the match I was using the Balsa 270423 book - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon.


Tournament type:
Round Robin - On

Rounds:
Rounds - 100
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 5,00
Increment - 3,00sec

Opening suite:
PGN/EPD file - D:/Book/Balsa_270423.pgn
Depth - 16 plies
Opening book - Random

Draw adjudication:
Move number - 60
Move count - 5
Score - 15 cp

Resign adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Setting the engines during the game.


Arasan 24.2.2 x64

Protocol - Uci
Hash - 16384
Contempt - 0
Use tablebases - On
SyzygyPath - D:\Syzygy
SyzygyProbleDepth - 2
MultiPV - 1
Threads - 32
Position learning - On
Use NNUE - On
NNUE file - arasan-d9-SFv4-20231228.nnue
Move overhead - 30


Booot 7.3 x64

Protocol - Uci
Hash - 16384
Threads - 32


Games of the match Arasan 24.2.2 - Booot 7.3 https://pixeldrain.com/u/MxD7hGG4
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Ethereal 14.25 x64 - Seer 2.8 x64

Match result 3 - 0 - 97 (100 games)

The match was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit


During the match I was using the Balsa 270423 book - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon.


Tournament type:
Round Robin - On

Rounds:
Rounds - 100
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 5,00
Increment - 3,00sec

Opening suite:
PGN/EPD file - D:/Book/Balsa_270423.pgn
Depth - 16 plies
Opening book - Random

Draw adjudication:
Move number - 60
Move count - 5
Score - 15 cp

Resign adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Setting the engines during the game.


Ethereal 14.25 x64

Protocol - Uci
Hash - 16384
Threads - 32
EvalFile - ethy.v1425.std.nn
MultiPV - 1
SyzygyPath - D:\Syzygy
SyzygyProbleDepth - 2
Normalize - On


Seer 2.8 x64

Protocol - Uci
QuantizedWeights - EMBEDDED
Weights - UNUSED
Hash - 16384
Threads - 32
SyzygyPath - D:\Syzygy


Games of the match Ethereal 14.25 - Seer 2.8 https://pixeldrain.com/u/W8TLTUpa
Krzysztof Grzelak
Posts: 1554
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Tournament of Programs

The tournament was played on the following equipment:

processor - AMD Ryzen Threadripper 2990WX 3.0 GHz
hard drive - Samsung 970 EVO Plus NVMe M.2 SSD 2 TB
memory ram - Kingston HyperX Fury 128 GB DDR4 2400MHz CL15
graphics card - Two graphics cards - ASUS Tuf GeForce RTX 3080Ti Gaming LHR 12GB
monitor - Nec MultiSync EA245WMi
keyboard - A4Tech KV-300H Slim
mouse - DeathAdder Essential
operating system - Microsoft Windows 10 Professional 64 bit


I didn't use any debut book during the tournament - game time - 15 minutes + 3 seconds. I have used 6-men Syzygy tablebases. The tournament was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting GUI Cutochess 1.2 by Guenther Simon.


Tournament type:
Round Robin - On

Rounds:
Rounds - 2
Save unfinished games - On
Swap sides - On

Games:
Time Control:
Time - 15,00
Increment - 3,00sec

Draw adjudication:
Move number - 60
Move count - 5
Score - 15 cp

Resign adjudication:
Move count - 5
Score - 1000 cp
Two-Sided - On

Game Length:
Limit - Off

Tablebase adjudication - On

Engine setting during tournament play.


Berserk 13 x64

Protocol - Uci
Hash - 16384
Threads - 32
SyzygyPath - D:\Syzygy
MultiPV - 1
MoveOverhead - 50
Contempt - 0
EvalFile - berserk - d43206fe90e4.nn

Caissa 1.19 x64

Protocol - Uci
Hash - 16384
MultiPV - 1
MoveOverhead - 10
Threads - 32
SyzygyPath - D:\Syzygy
SyzygyProbleLimit - 6

Ethereal 14.25 x64

Protocol - Uci
Hash - 16384
Threads - 32
EvalFile - ethy.v1425.std.nn
MultiPV - 1
MoveOverhead - 300
SyzygyPath - D:\Syzygy
SyzygyProbleDepth - 2
Normalize - On


LCZero 0.31-dag-5350a2e0-BT4-6147500 x64

Protocol - Uci
Network IDs - BT4-6147500
Backend - demux
BackendOptions - backendcuda-fp16,(gpu0,policy_head=optimistic,value_head=winner),(gpu1,policy_head=optimistic,value_head=winner)
Threads - 3
MinibatchSize - 160
VerboseMoveStats - true
FpuValue - 0.98416
CPuct - 2.897
CPuctBase - 45669
CPuctFactor - 3.973
PolicyTemperature - 1.4
MoveRuleBucketing - true
MovesLeftSlope - 0.0027
MovesLeftThreshold - 0.8
Contempt - Stockfish=0
ContemptMaxValue - 600
Ponder - false
RamLimitMb -16384
ScoreType - WDL_mu
SmartPruningFactor - 2
SmartPruningMinimumBatches - 300
TaskWorkers - 3
SyzygyPath - D:\Syzygy
MoveOverheadMs - 1000
StrictTiming - true
TimeManager - legacy
WDLCalibrationElo - 3600
WDLContemptAttenuation - 0.55
WDLDrawRateReference - 0.64
WDLEvalObjectivity - 0


Obsidian 13.0 x64

Protocol - Uci
Hash - 16384
Threads - 32
Move Overhead - 10
SyzygyPath - D:\Syzygy
MultiPV - 1


Stockfish 20240706-4d6e1225 x64

Protocol - Uci
Threads - 32
Hash - 16384
MultiPV - 1
Skil Level - 20
Move Overhead - 1000
SyzygyPath - D:\Syzygy
SyzygyProbleDepth - 2
Syzygy50MoveRule - On
SyzygyProbleLimit - 6


Final tournament table

Image

Parties of the Tournament of Programs https://www.transfernow.net/dl/20240708 ... s/US1kGAtc