Official Release of Ethereal 11.75, supporting MultiPV

[drj4759]

This is the actual contents of the shell file to execute cutechess:

#/bin/bash
./cutechess-cli1.1 \
-event "Ethereal 11.75 vs. Top Chess Engines" \
-pgnout "./Out/Ethereal 11.75 vs. Top Chess Engines.pgn" \
-engine conf="Ethereal 11.75 x64" \
-engine conf="Xiphos 0.6 x64" \
-engine conf="Demolito 2019-11-03 x64" \
-engine conf="Vajolet 2.2.8.0 x64" \
-engine conf="Rubi 1.6 x64" \
-engine conf="Houdini 6.02 x64" \
-engine conf="Stockfish 10 x64" \
-engine conf="Komodo 11.2.2 x64" \
-engine conf="Fire 7.1 x64" \
-engine conf="Shredder 13 x64" \
-engine conf="Rofchade 2.2 x64" \
-engine conf="Andscacs 0.95 x64" \
-engine conf="Schooner 2.1 x64" \
-engine conf="Laser 1.7 x64" \
-engine conf="Defen 2.2 x64" \
-engine conf="Nemorino 5.00 x64" \
-engine conf="ICE 4.0.853 x64" \
-engine conf="Texel 1.07 x64" \
-engine conf="Equinox 3.30 x64" \
-engine conf="Senpai 2.0 x64" \
-engine conf="Nirvana 2.4 x64" \
-engine conf="Hannibal 1.7 x64" \
-engine conf="Arasan 21.4 x64" \
-site "Chessowl" \
-each tc=60/60+1 proto=uci timemargin=5000 \
-openings file=./Books/opening50-2ply.pgn format=pgn order=sequential plies=4 start=1 \
-resign movecount=1 score=200 twosided=true \
-draw movenumber=40 movecount=1 score=20 \
-maxmoves 80 \
-concurrency 32 \
-games 1 \
-rounds 100 \
-repeat \
-tournament gauntlet \
-recover

[Guenther]

This is the actual contents of the shell file to execute cutechess:

#/bin/bash
./cutechess-cli1.1 \
-event "Ethereal 11.75 vs. Top Chess Engines" \
-pgnout "./Out/Ethereal 11.75 vs. Top Chess Engines.pgn" \
-engine conf="Ethereal 11.75 x64" \
-engine conf="Xiphos 0.6 x64" \
...
-site "Chessowl" \
-each tc=60/60+1 proto=uci timemargin=5000 \
-openings file=./Books/opening50-2ply.pgn format=pgn order=sequential plies=4 start=1 \
-resign movecount=1 score=200 twosided=true \
-draw movenumber=40 movecount=1 score=20 \
-maxmoves 80 \
-concurrency 32 \
-games 1 \
-rounds 100 \
-repeat \
-tournament gauntlet \
-recover

What are your hardware specs and what hash is configured for each participant?
With concurrency 32 you need to be very careful here.

Did Ethereal 11.73 play the exact same 23 opponents with the same configs and also at concurrency 32?
It is also possible a program was'nt closed after a game.

[drj4759]

Hardware/Software specs: AMD 4 cores, 16GB RAM, Linux PClinuxOS, cutechess-cli v1.1
Only one computer was used in my recent rating list tests since last year.
So far, there is no problem with 32 concurrencies even with other programs running such as Chrome or Mozilla and programs to create my rating list. I've tested for 64 concurrencies which still worked but opted not to overuse it.

Ethereal 11.73 have the same opponents as Ethereal 11.75. In fact, the last tournament was with Ethereal 11.73 and it was normal.
There are no runaway/malfunctioning programs or zombies while running the gauntlet.

[drj4759]

There is no specific hash configured for each engine but let cutechess-cli get the default hash values for each engine.
This is the sample engine configuration which is bare from my engines.json file. Only 4 parameters are used consistenly for all the engines.
[
{
"name": "Ethereal 11.75 x64",
"command": "Ethereal11.75-x64-popcnt.exe",
"protocol": "uci",
"workingDirectory": "Engines"
},
{
"name": "Laser 1.7 x64",
"command": "./Laser-1_7.exe",
"protocol": "uci",
"workingDirectory": "Engines"
}
]

[the_real_greco]

Ethereal Hype

[Guenther]

Ethereal Hype

Typical for a detected troll - why are you here?

Since post 1 you are in my foe list.

viewtopic.php?f=2&t=71820&p=815109#p815109

[Dann Corbit]

I suggest adding the bottom lines as shown in file uci.c:

Code: Select all

int main(int argc, char **argv) {

    Board board;
    char str[8192];
    Thread *threads;
    pthread_t pthreadsgo;
    UCIGoStruct uciGoStruct;

    int chess960 = 0;
    int multiPV  = 1;
    setvbuf(stdin, NULL, _IONBF, 0);
    setvbuf(stdout, NULL, _IONBF, 0);
    fflush(NULL);

I guess that you test on a Posix platform, which has a much more sensible buffering default than Windows.
The stderr file is already non-buffered, but the stdin and stdout are fully buffered.
Using character strings for an API is therefore fraught with peril on Windows. It might work, it might not work, it might work for a while.

[AndrewGrant]

Err, I have a few questions.

Concurrency=32, on a 4 core machine. Is cutechess actually launching 32 games in parallel under those conditions? If so its a wonder that not every engine is having issues communicating with cutechess.

You also said you are using a Linux machine, but your config has the Ethereal11.75-x86-popcnt.exe, which was the windows binary I provided.

There are no changes to how output is done between 11.73 and 11.75. Is is possible you tried to use a windows binary at first, and then when you went to compile your own failed to replace the original binary?

[drj4759]

Yes, cutechess executed 32 instances in random sequence. Here is the initial screen display after executing the script which also showed the abnormal messages pointing to Ethereal 11.75:

[root@localhost143 cutechess]# ./gauntlet.sh
Warning: 2 opening repetitions vs 1 games per encounter
Started game 24 of 2200 (Demolito 2019-11-03 x64 vs Ethereal 11.75 x64)
Started game 20 of 2200 (Ethereal 11.75 x64 vs Nirvana 2.4 x64)
Started game 2 of 2200 (Ethereal 11.75 x64 vs Demolito 2019-11-03 x64)
Started game 11 of 2200 (Ethereal 11.75 x64 vs Andscacs 0.95 x64)
Started game 14 of 2200 (Ethereal 11.75 x64 vs Defen 2.2 x64)
Started game 25 of 2200 (Vajolet 2.2.8.0 x64 vs Ethereal 11.75 x64)
Started game 3 of 2200 (Ethereal 11.75 x64 vs Vajolet 2.2.8.0 x64)
Started game 19 of 2200 (Ethereal 11.75 x64 vs Senpai 2.0 x64)
Started game 27 of 2200 (Houdini 6.02 x64 vs Ethereal 11.75 x64)
Started game 22 of 2200 (Ethereal 11.75 x64 vs Arasan 21.4 x64)
Started game 5 of 2200 (Ethereal 11.75 x64 vs Houdini 6.02 x64)
Started game 9 of 2200 (Ethereal 11.75 x64 vs Shredder 13 x64)
Started game 17 of 2200 (Ethereal 11.75 x64 vs Texel 1.07 x64)
Started game 31 of 2200 (Shredder 13 x64 vs Ethereal 11.75 x64)
Started game 26 of 2200 (Rubi 1.6 x64 vs Ethereal 11.75 x64)
Started game 4 of 2200 (Ethereal 11.75 x64 vs Rubi 1.6 x64)
Started game 15 of 2200 (Ethereal 11.75 x64 vs Nemorino 5.00 x64)
Started game 7 of 2200 (Ethereal 11.75 x64 vs Komodo 11.2.2 x64)
Started game 29 of 2200 (Komodo 11.2.2 x64 vs Ethereal 11.75 x64)
Started game 8 of 2200 (Ethereal 11.75 x64 vs Fire 7.1 x64)
Started game 6 of 2200 (Ethereal 11.75 x64 vs Stockfish 10 x64)
Started game 30 of 2200 (Fire 7.1 x64 vs Ethereal 11.75 x64)
Started game 28 of 2200 (Stockfish 10 x64 vs Ethereal 11.75 x64)
Started game 23 of 2200 (Xiphos 0.6 x64 vs Ethereal 11.75 x64)
Started game 21 of 2200 (Ethereal 11.75 x64 vs Hannibal 1.7 x64)
Started game 1 of 2200 (Ethereal 11.75 x64 vs Xiphos 0.6 x64)
Started game 16 of 2200 (Ethereal 11.75 x64 vs ICE 4.0.853 x64)
Started game 13 of 2200 (Ethereal 11.75 x64 vs Laser 1.7 x64)
Started game 12 of 2200 (Ethereal 11.75 x64 vs Schooner 2.1 x64)
Started game 18 of 2200 (Ethereal 11.75 x64 vs Equinox 3.30 x64)
Started game 32 of 2200 (Rofchade 2.2 x64 vs Ethereal 11.75 x64)
Started game 10 of 2200 (Ethereal 11.75 x64 vs Rofchade 2.2 x64)
Finished game 25 (Vajolet 2.2.8.0 x64 vs Ethereal 11.75 x64): 0-1 {Black wins by adjudication}
Terminating process of engine Ethereal 11.75 x64(10)
Finished game 6 (Ethereal 11.75 x64 vs Stockfish 10 x64): 0-1 {White's connection stalls}
Started game 33 of 2200 (Andscacs 0.95 x64 vs Ethereal 11.75 x64)
Started game 34 of 2200 (Schooner 2.1 x64 vs Ethereal 11.75 x64)
Terminating process of engine Ethereal 11.75 x64(57)
Finished game 29 (Komodo 11.2.2 x64 vs Ethereal 11.75 x64): 1-0 {Black's connection stalls}
Started game 35 of 2200 (Laser 1.7 x64 vs Ethereal 11.75 x64)
Terminating process of engine Ethereal 11.75 x64(40)
Finished game 21 (Ethereal 11.75 x64 vs Hannibal 1.7 x64): 0-1 {White's connection stalls}
Started game 36 of 2200 (Defen 2.2 x64 vs Ethereal 11.75 x64)
Terminating process of engine Ethereal 11.75 x64(53)
Finished game 27 (Houdini 6.02 x64 vs Ethereal 11.75 x64): 1-0 {Black's connection stalls}
Terminating process of engine Ethereal 11.75 x64(18)
Finished game 10 (Ethereal 11.75 x64 vs Rofchade 2.2 x64): 0-1 {White's connection stalls}
Started game 37 of 2200 (Nemorino 5.00 x64 vs Ethereal 11.75 x64)
Started game 38 of 2200 (ICE 4.0.853 x64 vs Ethereal 11.75 x64)
Terminating process of engine Ethereal 11.75 x64(8)
Finished game 5 (Ethereal 11.75 x64 vs Houdini 6.02 x64): 0-1 {White's connection stalls}

[drj4759]

All chess engines I used in my tournament are windows executables with an .exe extension. I don't include Linux executables because they are normally stronger than the windows compiled equivalent which will skew the rating score. The cutechess-cli version I use for this gauntlet is a Linux version but could run chess engine windows executables because WINE is installed in my machine.

I am sure that the Ethereal 11.75 version residing in my cutechess directory is compiled by me with a filesize of 697.7kb whereas the one in your compiled package is 220.0kb. This version was compiled with mingw in Ubuntu with "make release" command where the makefile was changed first to point to the mingw executable instead of the default CC=gcc.