Linux chess engines ratings page

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
rkl
Posts: 6
Joined: Tue Jan 01, 2019 9:19 am
Full name: Richard Lloyd

Linux chess engines ratings page

Post by rkl » Sat Jan 05, 2019 12:12 pm

Windows chess engines tend to hog the glory (most commercial engines are Windows-only and many tournaments are run only on Windows machines), so to redress the balance for Linux users, I've taken the top 50 or so CCRL 40/4 engines (cutoff point, for fun, is those stronger than Carlsen's human blitz ELO rating) and produced a Linux-centric version of the list:

https://linuxchess.richardlloyd.org.uk/

Some "extra" features on there:

* Stockfish latest development version info is displayed rather than Stockfish 10 (rating calculated by linear interpolation as explained in the page notes) and is auto-updated when the abrok.eu builds are updated.

* Links to source code, Linux binaries (or Windows binaries if Wine has to be used), engine home page and Chess Programming Wiki page. Also an indicator if the Linux version is native, needs Wine, doesn't work on Linux or is unknown (i.e. a commercial engine I don't have).

* When CCRL 40/4 is updated, the page will auto-update within 8 hours and include positional/rating/version/new engine indicators between the last two CCRL 40/4 lists (shown in green for an improvement and pink for a worsening).

* The current human blitz leader (the cut-off point w.r.t. ratings) is shown as the last entry in the table and is auto-updated whenever the rating/leader at https://2700chess.com/ changes.

* The ratings table can be downloaded as a CSV should you want to do some processing on it yourself.

Many thanks to the CCRL folks for providing such a great list I could derive my page from.

pferd
Posts: 113
Joined: Thu Jul 24, 2014 12:49 pm

Re: Linux chess engines ratings page

Post by pferd » Sat Jan 05, 2019 2:27 pm

This is a nice overview over the engines running on Linux. :D

A couple of remarks:

Senpai requires a ucinewgame command before go infinite. Protector can be compiled from source, but you need to do some small modifications to the makefile.

Spark is closed source, but the author provided binaries for linux, too.

Unfortunately some closed source engines like Hiarcs, Rybka and some earlier Houdini versions will not work properly using wine. (After typing go infinite, the engines will run forever and not respond to input).

Ras
Posts: 1087
Joined: Tue Aug 30, 2016 6:19 pm
Contact:

Re: Linux chess engines ratings page

Post by Ras » Sat Jan 05, 2019 2:29 pm

The source code for Carlsen is not available, what a pity. :wink:
Rasmus Althoff
https://www.ct800.net

rkl
Posts: 6
Joined: Tue Jan 01, 2019 9:19 am
Full name: Richard Lloyd

Re: Linux chess engines ratings page

Post by rkl » Sat Jan 05, 2019 5:54 pm

I've tried building and running Senpai 2.0 on both CentOS 7 and Fedora 29 (they have different g++ and clang++ compiler versions) both with g++ and clang++, plus tried "ucinewgame" before "go inifinite" - all attempts ended up with a segmentation violation and core dump. Now I know someone's got it running on Linux, I'll try a few more Linux distros in VMs to see if I can get it working too (Ubuntu being an obvious first one to try).

I had real trouble trying to find any reference to Spark 1.0 on the internet. SparkChess at https://www.sparkchess.com/ seemed to dominate my Google searches, but is commercial and not at version 1.0. Does anyone have a URL for Spark 1.0 (ideally a home page, but a Linux binary download link would be OK too)?

As for a Magnus source/binary, the closest you can get is "Play Magnus" but unfortunately only available as an iOS and Android app (yes, I got Linux Stockfish to beat every single Magnus age level available just to make sure it was a weaker engine :-) ).

For pedants amongst you, there are still some engines in the list that don't correctly run on Linux (either natively or via Wine), but I felt that leaving them out would create gaps in the list, causing position misalignments if someone compared the original CCRL list with the one I created. I've also already had someone question why engines that need Wine are included - as far as I'm concerned, if they run properly with Wine, that makes them a binary that runs on Linux, so that means that they should be included.

User avatar
Guenther
Posts: 2699
Joined: Wed Oct 01, 2008 4:33 am
Location: Regensburg, Germany
Full name: Guenther Simon
Contact:

Re: Linux chess engines ratings page

Post by Guenther » Sat Jan 05, 2019 6:03 pm

rkl wrote:
Sat Jan 05, 2019 5:54 pm
I had real trouble trying to find any reference to Spark 1.0 on the internet. SparkChess at https://www.sparkchess.com/ seemed to dominate my Google searches, but is commercial and not at version 1.0. Does anyone have a URL for Spark 1.0 (ideally a home page, but a Linux binary download link would be OK too)?
You should always look here first:

http://www.computer-chess.org/doku.php? ... ngine_list

or at my XB/UCI chronology (link in my signature), its intention was exactly to find all infos and links in one place when I set it up in 2002

well, the link you looked for still exists at wayback
https://web.archive.org/web/20120302103 ... ink/spark/

rkl
Posts: 6
Joined: Tue Jan 01, 2019 9:19 am
Full name: Richard Lloyd

Re: Linux chess engines ratings page

Post by rkl » Sat Jan 05, 2019 7:02 pm

I'd seen the Chess Engines List before and really should have gone to visit that again to look for engines like Spark. I've now updated my list to include Spark's home page/download and that it works natively on Linux.

I'd only been testing engines from the command line and it looks like some engines only initialise properly when particular UCI commands are issued (i.e. they don't work straight away with just "go infinite"). The two commands I found I needed weren't "ucinewgame", but actually "uci" (for Alfil) and "isready" (for Senpai). I've therefore updated my list w.r.t. Alfil and Senpai.

I did eventually get Protector built on Linux using g++, removing -static and -lstdc++ from the linking and adding "typedef volatile int pthread_spinlock_t;" to tablebase.c. Hence, Protector info has been updated on the list too.

Jesse Gersenson
Posts: 572
Joined: Sat Aug 20, 2011 7:43 am
Contact:

Re: Linux chess engines ratings page

Post by Jesse Gersenson » Tue Jan 08, 2019 2:32 am

Thanks for this list, I have been looking for such a list for months!

Are those all engines which you have run on Linux?

rkl
Posts: 6
Joined: Tue Jan 01, 2019 9:19 am
Full name: Richard Lloyd

Re: Linux chess engines ratings page

Post by rkl » Sun Jan 13, 2019 2:23 am

Everything in the list with "Native" or "Wine" in the Linux? column will run on Linux. You may need a recent distro and the very latest Wine though for some of the binaries. You may need to compile source code in some cases too where the binary isn't supplied - again, some source may need a fairly recent gcc/g++. All engines marked Native/Wine have been personally checked by me to ensure they work (CentOS 7 or, where necessary, Fedora 29).

I have a cut-off of Carlsen's human ELO blitz rating (yes, I know, it's not the same as computer ELO) w.r.t. the list, so there's obviously going to be weaker engines that aren't listed that can run on Linux.

Interesting to see that the latest CCRL 40/4 list has Komodo MCTS jumping a huge 95 ELO and has caused a top 5 change for the first time in a while. I'm assuming CCRL will switch to testing the "normal" Komodo (12.3) at some point because 11.2 is 18 months old now.

tpoppins
Posts: 842
Joined: Tue Nov 24, 2015 8:11 pm
Location: upstate

Re: Linux chess engines ratings page

Post by tpoppins » Mon Jan 14, 2019 5:53 am

rkl wrote:
Sun Jan 13, 2019 2:23 am
I'm assuming CCRL will switch to testing the "normal" Komodo (12.3) at some point because 11.2 is 18 months old now.
Several newer versions have been tested since v11.2:

Code: Select all

CCRL 40/4 Rating List - Custom engine selection
1905958 games played by 2223 programs, run by 21 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), 
about 1.5 minutes on a modern Intel CPU.
Computed on January 12, 2019 with Bayeselo based on 1'905'958 games
Tested by CCRL team, 2005-2019, http://computerchess.org.uk/ccrl/404/

          Engine                      Elo   +    -   Score  AvOp  Games
  Komodo 11.3.1 64-bit               3423  +25  -25  63.9%  -98.9   509
  Komodo 11.2 64-bit                 3421   +9   -9  68.2% -137.2  4979
  Komodo 11.01 64-bit                3412  +19  -19  74.8% -175.5  1055
  Komodo 12.3 64-bit                 3411  +25  -25  59.7%  -61.7   475
  Komodo 12 64-bit                   3410  +11  -11  67.3% -121.6  2841
  Komodo 10.4 64-bit                 3398  +14  -14  70.1% -149.7  1809
  Komodo 10.3 64-bit                 3386  +12  -12  61.6%  -89.8  2491
These are just single-core versions. For the complete list see the Komodo family page here. The MCTS versions now have their own family page.
Tirsa Poppins
CCRL

rkl
Posts: 6
Joined: Tue Jan 01, 2019 9:19 am
Full name: Richard Lloyd

Re: Linux chess engines ratings page

Post by rkl » Mon Jan 14, 2019 7:25 pm

Apologies for missing that Komodo 12 had indeed been tested at 40/4. What's very surprising is that Komodo 12 actually shows a slight ELO drop compared to Komodo 11! In fact, 11.31 dropped compared to 11.2 as well - not great if you're trying to get people to upgrade :-( It also explains why I missed it - CCRL lists the strongest version, not the latest one.

Post Reply