List of bugfree, opensource Linux and MacOSX engines

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Dann Corbit, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
OliverBr
Posts: 668
Joined: Tue Dec 18, 2007 8:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch
Contact:

Re: List of bugfree, opensource Linux and MacOSX engines

Post by OliverBr » Wed Nov 11, 2020 12:22 pm

hgm wrote:
Mon Nov 09, 2020 10:29 pm
This should be cured in version 5, which invalidates its hash table before any search where the use of null move was switched.

The latest source of Fairy-Max can be found in my git repository:

http://hgm.nubati.net/cgi-bin/gitweb.cgi

Just download the latest snapshot of the main branch. Same for KingSlayer / simple.
I have another game with Fairy-Max 5.0b, when it is stalling. It is quite a large game, perhaps it can help you:

Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink

OliverBr
Posts: 668
Joined: Tue Dec 18, 2007 8:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch
Contact:

Re: List of bugfree, opensource Linux and MacOSX engines

Post by OliverBr » Wed Nov 11, 2020 4:55 pm

RubiChess wrote:
Wed Nov 11, 2020 7:46 am
I also want to make it on your list.

With latest commit Rubi should compile and run in MacOS. I don't have a Mac but I could compile and run it in a VM.
If you still have problems with latest master, please report here: https://github.com/Matthies/RubiChess/issues/248

Regards, Andreas
I have just pulled the newest version and it compiles smoothly and will be added to the list:

Code: Select all

make
rm -f RubiChess-BMI2 RubiChess-AVX2 RubiChess RubiChess-Legacy *.o
rm -f -rf OPT
rm -f *.clangprof-raw *.profdata
  Compiling RubiChess...
g++ -std=c++11 -Wall -O3 -flto -pedantic -Wextra -Wshadow  -mssse3 -msse2 -mmmx -mpopcnt *.cpp -pthread  -D GITVER=\"20201111084233\" -D GITID=\"99e2c8f\" -DUSE_SSSE3 -DUSE_SSE2 -DUSE_MMX -DUSE_POPCNT -o RubiChess
EDIT: It's no issue, maybe a hint: the name is quite large:

Code: Select all

Score of RubiChess 1.9-dev 20201111084233 (popcnt) vs OliThink 5.9.0: 1291 - 22 - 101  [0.949] 1414
Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink

OliverBr
Posts: 668
Joined: Tue Dec 18, 2007 8:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch
Contact:

Re: List of bugfree, opensource Linux and MacOSX engines

Post by OliverBr » Wed Nov 11, 2020 8:02 pm

abulmo2 wrote:
Wed Nov 11, 2020 7:34 am
I am afraid that cutechess-cli is often the one at fault in your tests, not the engines you analysed.
No, this is not correct.
I let Cutechess-cli play many millions (literally!) games with OlIThink and other engines like Stockfish, Glaurung, Fruit, Weiss (since 1.0) and others and they did not crash even once.
So, no, cutechess-cli is not faulty in the sense that engines fail the test because of it.
Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink

OliverBr
Posts: 668
Joined: Tue Dec 18, 2007 8:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch
Contact:

Re: List of bugfree, opensource Linux and MacOSX engines

Post by OliverBr » Wed Nov 11, 2020 8:12 pm

George Sobala wrote:
Wed Nov 11, 2020 8:01 am
I presume you are excluding Stockfish derivatives, though you did not put that into your criteria. Otherwise you could include Cfish and corchess (at least). Also lc0 of course.
This is true, too and I forget to mention it. Thank you.
My tests run on a Linux 32-core server without any GPU and Leela can't play her full potential there, so I had to to skip GPU engines, too. Unfortunately.
Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink

User avatar
mvanthoor
Posts: 598
Joined: Wed Jul 03, 2019 2:42 pm
Full name: Marcel Vanthoor

Re: List of bugfree, opensource Linux and MacOSX engines

Post by mvanthoor » Thu Nov 12, 2020 3:37 pm

Well... to some extend, I know how you feel with regard to other engines. I've been trying to find engines in the 1500 to 1900 range to create my first testing pool for Rustic.

I've tried many (after having to actually find them in a very round-about way, because all the download links are broken), and most of them are severely lacking. It often seems they've just been developed so the author could have his own engine a rating list, and then abandoned.

They either:
- crash during games or stop responding
- have massive bugs in their uci/xboard output (or no output at all except for their best move)
- dont comply to specs (not even reacting to "uci" for example)
- have glaring bugs (claiming to have a TT but no indication of using it because search depth is lower than Rustic, who doesn't have a TT yet, and no options to set it, repetition detection bugs, evaluation bugs that make it do strange moves)

Lots of junk in the 1500 - 1900 category, I'm sorry to say; but I have found a few good ones. Against some Rustic greatly overperforms (for example, against Pulse 1.7.2 it can draw games it should have lost because Pulse has a bug in its repetition detection), and against some it underperforms (such as against TSCP, where Rustic loses because it has no evaluation yet, but also not a search depth advantage.)

I'll have to keep trying engines until I find about 10-15 that are stable enough to run some tournaments against, to establish my baseline; before I can start upgrading to the better, more developed engines in 1800-2300 and later 2000-2500 categories.

OliverBr
Posts: 668
Joined: Tue Dec 18, 2007 8:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch
Contact:

Re: List of bugfree, opensource Linux and MacOSX engines

Post by OliverBr » Thu Nov 12, 2020 5:25 pm

mvanthoor wrote:
Thu Nov 12, 2020 3:37 pm
against Pulse 1.7.2 it can draw games it should have lost because Pulse has a bug in its repetition detection)
Oh, I like Pulse. Pulse 2.0.0 ist quite nice, but has a bug that it crashes, when any player has exactly time == 0.


See here: I hope it will be repaired soon: https://github.com/fluxroot/pulse/issues/84
Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink

User avatar
hgm
Posts: 25573
Joined: Fri Mar 10, 2006 9:06 am
Location: Amsterdam
Full name: H G Muller
Contact:

Re: List of bugfree, opensource Linux and MacOSX engines

Post by hgm » Thu Nov 12, 2020 5:39 pm

Thanks for the Fairy-Max games. I try to reproduce the error now, but so far without success. What hash-table size are you using?

What does CuteChess mean anyway when it says 'connection stalled'? Does it mean the engine process terminated unexpectedly, or is it just a time forfeit?

I sometimes do see pathologic behavior w.r.t. time usage, but I have never seen a crash. E.g. for move 109 of the game above (a KPK position) starting with an empty hash table, it finishes the PV at depth 22 in 0.64 sec, but then takes 45 sec to get that PV at 23 ply. (And needs 4 min to finish the 23-ply iteration, after changin the PV there after 1:36.)

Code: Select all

 23	+0.28 	772.3M	4:00.25	109. Kg4 Kf8 110. h6 Kg8 111. Kg5 Kh7 112. Kh5 Kh8 
 23	+0.13 	306.0M	1:36.23	109. Kf2 Kf7 110. Kg3 Ke7 
 23	+0.12 	149.2M	0:45.33	109. Kg3 Ke7 110. Kh3 Kf6 111. Kg4 Ke6 
 22	+0.27 	1.89M  	0:00.64	109. Kg3 Ke7 110. Kg4 Kf7 111. Kg3 
 22	+0.26 	1.88M  	0:00.64	109. Kf2 Kf7 110. Kg3 Ke7 
 21	+0.26 	1.47M  	0:00.51	109. Kf2 Kf7 110. Kg3 Ke7 
 21	+0.25 	1.46M  	0:00.50	109. Kg3 Ke7 110. Kg4 Kf7 111. Kg5 Ke7 112. h6 Kf7 
 20	+0.20 	1.07M  	0:00.37	109. Kg3 Ke7 110. Kh3 Ke6 111. Kg4 Kf7 112. Kg3 
 20	+0.18 	1.06M  	0:00.37	109. Kf2 Kf7 110. Kg3 Ke7 
So it can apparently happen that there is an extreme factor between the time usage in one iteration and the next, while on all previous iterations the EBF was only 1.3 or so. This makes the "always finish the iteration" time management a bust; you cannot possibly prepare for that. But it would cause forfeits, not real crashes.

I guess I really have to abort thinking, through some 'cold-turkey timeout' to make this problem go away.

Ras
Posts: 1697
Joined: Tue Aug 30, 2016 6:19 pm
Full name: Rasmus Althoff
Contact:

Re: List of bugfree, opensource Linux and MacOSX engines

Post by Ras » Thu Nov 12, 2020 5:51 pm

hgm wrote:
Thu Nov 12, 2020 5:39 pm
What does CuteChess mean anyway when it says 'connection stalled'? Does it mean the engine process terminated unexpectedly, or is it just a time forfeit?
From https://github.com/cutechess/cutechess/ ... sult.h#L56:

Code: Select all

//! Loser's connection stalls (doesn't respond to ping).
StalledConnection,
That might even be related to the time problem if the engine forfeits and Cutechess tries to ping it, to which the engine doesn't answer because it doesn't evaluate input during search.
Last edited by Ras on Thu Nov 12, 2020 5:53 pm, edited 1 time in total.
Rasmus Althoff
https://www.ct800.net

Guenther
Posts: 3674
Joined: Wed Oct 01, 2008 4:33 am
Location: Regensburg, Germany
Full name: Guenther Simon
Contact:

Re: List of bugfree, opensource Linux and MacOSX engines

Post by Guenther » Thu Nov 12, 2020 5:53 pm

hgm wrote:
Thu Nov 12, 2020 5:39 pm
Thanks for the Fairy-Max games. I try to reproduce the error now, but so far without success. What hash-table size are you using?

What does CuteChess mean anyway when it says 'connection stalled'? Does it mean the engine process terminated unexpectedly, or is it just a time forfeit?
Generally, this either means, it timed out before the first move, or it did not respond anymore during a game (probably crashed,
or unresponsive). Time forfeit itself would be a different termination tag for cutechess.

BTW I am a bit confused about the version number, because the latest compilation you offered yourself calls itself 5.0b3,
while the repo seems still to say 5.0b. No idea how I should call it, if I compile it myself?

your compilation 2016-09

Code: Select all

tellics say     Fairy-Max 5.0b3
tellics say     by H.G. Muller
Edit: In case you forgot about it - it is from here ;-)
http://hgm.nubati.net/Fairy-Max.zip
Last edited by Guenther on Thu Nov 12, 2020 6:00 pm, edited 2 times in total.

jdart
Posts: 4074
Joined: Fri Mar 10, 2006 4:23 am
Location: http://www.arasanchess.org

Re: List of bugfree, opensource Linux and MacOSX engines

Post by jdart » Thu Nov 12, 2020 5:54 pm

Arasan is very stable and bugfree, but unfortunately I am having problems to compile it in MacOSX and clang.
"make CC=clang" should work.

Post Reply