Download my Testing Framework...

[Steve Maughan]

I've managed to get CuteChess-Cli working and running tests on Maverick.

I created a blog post which won't be of interest to the seasoned testers but may be interesting for anyone wanting to set up such a framework.

Here's the link:

http://www.chessprogramming.net/compute ... framework/

At the end of the post there is a link to download the whole framework as one big 7-zip file.

Best,

Steve

[asanjuan]

I have a similar framework, and I recommend you to use a json file for cutechess. It is very easy to use, and after configuring, the cutechess command is easy to read and to change.

For example: in my engines.json file:

Code: Select all

[
{
"command":"fruit_21.exe",
"name":"fruit",
"protocol":"uci",
"workingDirectory":"C:\\chess\\fruit_21"
},
{
"command":"Gull 1_0a.exe",
"name":"gull",
"protocol":"uci",
"workingDirectory":"C:\\chess\\Gull 1_0a"
},
{
"command":"Dirty.exe",
"name":"dirty",
"protocol":"xboard",
"workingDirectory":"C:\\chess\\dirty_acca3"
},
{
"command":"eveann.exe",
"name":"eveann",
"protocol":"xboard",
"workingDirectory":"C:\\chess\\eveann171a"
},
{
"command":"rhetoric_lite.exe",
"name":"lite",
"protocol":"uci",
"workingDirectory":"C:\\chess\\rhetoric_lite"
},
{
"command":"rhetoric_x64.exe",
"name":"rhetoric",
"protocol":"uci",
"workingDirectory":"C:\\chess\\Rhetoric_1.0"
}
,{
"command":"SOS-51_Arena.exe",
"name":"sos",
"protocol":"uci",
"workingDirectory":"C:\\chess\\arena_3.0\\Engines\\SOS"
}
]

the command inside my batch file that runs the tournament is easier to write.

Code: Select all

del match.pgn
cutechess-cli -engine conf=rhetoric -engine conf=sos -each tc=40/10+0.2 book=gmbook.bin -rounds 80 -games 2 -repeat -pgnout match.pgn -draw 5 0 -resign 4 500
pause

Just my two cents.

[asanjuan]

Also, I have bayeselo.exe on the same folder, and two more files:
A txt with the commands to send to baseselo,

Code: Select all

readpgn match.pgn
players
elo
mm
offset 0 rhetoric
ratings
los
x
x

and a BayesElo.Bat file to see the results of the match (even if it is running):

Code: Select all

bayeselo.exe < bayeselo.txt
pause

The output produced is somehow weird, because the "enter" chars between commands are lost, but, ok, is enough for me.

Regards.

[Steve Maughan]

Thanks Alberto -

I'll give the json approach a try. It looks to simplify the process.

Steve

[emadsen]

use a json file for cutechess

Or just use the caret character (^) in your .bat script to break lines.

Code: Select all

cutechess-cli.exe -tournament gauntlet -event "MadChess Gauntlet" -site "Cute Chess" -games 2 -rounds 50 -repeat ^
  -pgnin "..\..\Opening Books\Arasan.pgn" -pgnout "MadChessBullet.pgn" ^
  -concurrency 4 -recover ^
  -each restart=on tc=120+1 ^
  -engine cmd=MadChessEngine.exe dir="..\..\Engines\MadChess\MadChess 1.3.04" proto=uci ^
  -engine cmd=BigLion.exe dir="..\..\Engines\Big Lion\Big Lion 2.23" proto=uci ^
  -engine cmd=bikjump.exe dir="..\..\Engines\BikJump\BikJump 2.01" name="BikJump v2.01" proto=uci ^