+100 elo breakthrough in new rewritten Lco engine ( Ceres)

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Nay Lin Tun
Posts: 708
Joined: Mon Jan 16, 2012 6:34 am

+100 elo breakthrough in new rewritten Lco engine ( Ceres)

Post by Nay Lin Tun »

Announcement from Leela discord.

Long time community member and developer @dje has created a new chess engine that uses Leela Chess Zero networks. It appears much stronger than lc0 (see the performance test below). The build process is currently being worked on so please be patient while the community helps to make executables available to all for further testing.
We are likely to make this the new official Leela Chess Zero project engine if all goes well so feel free to ask questions about it in #help or aid development in #dev-public.
Link to source code on GitHub: https://discord.com/channels/4254194825 ... 0299791370
Quick performance test: https://discord.com/channels/4254194825 ... 9669066784
Thanks to dje for this wonderful late Christmas gift! gift


FYI, new engine is approx 2.3x faster than Lco!
Top
Nay Lin Tun
Posts: 708
Joined: Mon Jan 16, 2012 6:34 am

Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)

Post by Nay Lin Tun »

Match of LC0 vs. Ceres (a new MCTS engine leveraging the LC0 backend)
LC0 version: lc0-v0.26.3, backend=cuda-fp16
LC0 options: 703810 with nncache=5000000, deumux backend (2 GPUs)
Ceres version: 0.8
Ceres options: default (also with 703810)
Hardware: dual Intel 6142 CPU with 2 A100 GPU
Time control: 120s+0.5s
Book: TCEC19
Tablebases: Syzygy 5+6 man
Adjudication: tablebases or 4 consecutive play both 350cp
Software: Ceres integrated tournament manager
Comment: These first published results for Ceres require independent community verification.
Comment: The realized NPS ratio of Ceres vs LC0 was 2.3 in this test.
Comment: Ceres strength is massively exaggerated in this unrealistic combination of small nets and big hardware.
Comment: Ceres will be released under GPL3 on Github on Dec 31, 2020 (today).

# PLAYER : RATING ERROR POINTS PLAYED (%) CFS(%) W D L D(%)
1 Ceres1 : 0.0 ---- 67.5 102 66 100 33 69 0 68
2 LC0_0 : -128.6 38.4 34.5 102 34 --- 0 69 33 68

White advantage = 107.97 +/- 20.04
Top
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)

Post by Vinvin »

Very good news for the chess community. Let s wait for more test.
Top
Andrew
Posts: 231
Joined: Thu Mar 09, 2006 12:51 am
Location: Australia

Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)

Post by Andrew »

Very nice/interesting news! Please post on the normal Leela forum as more becomes clearer!

Andrew
Top
User avatar
jshriver
Posts: 1342
Joined: Wed Mar 08, 2006 9:41 pm
Location: Morgantown, WV, USA

Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)

Post by jshriver »

That's wonderful news, my main concern is that lc0 is relatively portable. Heck you can compile it on a Raspberry Pi.
When I looked at Ceres earlier it was VERY much Windows only.

Can it not exist as its own engine and let lc0 continue its efforts?
Top
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)

Post by Dann Corbit »

I collected and built Ceres on my system (after installing git and .NET SDK 5.0.1).
Any help on configuration?
I am not sure I understand the questions it is asking me, like "path to LC0"
I thought this thing was a replacement for LC0.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Top
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)

Post by Dann Corbit »

BTW, if you thought SF nnue versions were bloated with the embedded net, 500MB+ in the binary folder, and I did not even download a net yet.

Code: Select all

C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0>dir/s
 Volume in drive C is Windows
 Volume Serial Number is 9C44-3903

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM            24,520 Ceres.Base.deps.json
01/01/2021  01:40 AM           110,592 Ceres.Base.dll
01/01/2021  01:40 AM            56,728 Ceres.Base.pdb
01/01/2021  01:40 AM            83,479 Ceres.Chess.deps.json
01/01/2021  01:40 AM           550,400 Ceres.Chess.dll
01/01/2021  01:40 AM           152,364 Ceres.Chess.pdb
01/01/2021  01:40 AM            91,386 Ceres.deps.json
01/01/2021  01:40 AM            48,128 Ceres.dll
01/01/2021  01:40 AM           142,848 Ceres.exe
01/01/2021  01:40 AM            84,175 Ceres.Features.deps.json
01/01/2021  01:40 AM            73,728 Ceres.Features.dll
01/01/2021  01:40 AM            30,200 Ceres.Features.pdb
01/01/2021  01:40 AM            86,233 Ceres.MCTS.deps.json
01/01/2021  01:40 AM           178,688 Ceres.MCTS.dll
01/01/2021  01:40 AM            81,100 Ceres.MCTS.pdb
01/01/2021  01:40 AM            21,584 Ceres.pdb
01/01/2021  01:40 AM               214 Ceres.runtimeconfig.dev.json
01/01/2021  01:40 AM               300 Ceres.runtimeconfig.json
08/14/2020  03:35 PM           390,128 Google.Protobuf.dll
02/22/2015  02:00 PM           323,072 Google.ProtocolBuffers.dll
02/22/2015  02:00 PM            57,856 Google.ProtocolBuffers.Serialization.dll
11/11/2020  01:02 AM           160,768 HtmlAgilityPack.dll
12/11/2019  08:49 AM           420,352 LibGit2Sharp.dll
03/27/2020  04:46 AM        22,514,088 LINQPad.Runtime.dll
10/19/2020  05:48 PM            20,360 Microsoft.Extensions.Configuration.Abstractions.dll
10/19/2020  05:48 PM            28,040 Microsoft.Extensions.Configuration.Binder.dll
10/19/2020  05:49 PM            22,912 Microsoft.Extensions.Configuration.CommandLine.dll
10/19/2020  05:48 PM            30,600 Microsoft.Extensions.Configuration.dll
10/19/2020  05:49 PM            19,848 Microsoft.Extensions.Configuration.EnvironmentVariables.dll
10/19/2020  05:50 PM            25,480 Microsoft.Extensions.Configuration.FileExtensions.dll
10/19/2020  05:51 PM            24,960 Microsoft.Extensions.Configuration.Json.dll
10/19/2020  05:48 PM            44,416 Microsoft.Extensions.DependencyInjection.Abstractions.dll
10/19/2020  05:48 PM            74,120 Microsoft.Extensions.DependencyInjection.dll
10/19/2020  05:48 PM            16,776 Microsoft.Extensions.FileProviders.Abstractions.dll
10/19/2020  05:49 PM            35,720 Microsoft.Extensions.FileProviders.Physical.dll
10/19/2020  05:48 PM            39,304 Microsoft.Extensions.FileSystemGlobbing.dll
10/19/2020  05:48 PM            52,616 Microsoft.Extensions.Logging.Abstractions.dll
10/19/2020  05:50 PM            20,360 Microsoft.Extensions.Logging.Configuration.dll
10/19/2020  05:53 PM            49,544 Microsoft.Extensions.Logging.Console.dll
10/19/2020  05:49 PM            16,776 Microsoft.Extensions.Logging.Debug.dll
10/19/2020  05:53 PM            42,376 Microsoft.Extensions.Logging.dll
10/19/2020  05:53 PM            30,592 Microsoft.Extensions.Logging.EventSource.dll
10/19/2020  05:49 PM            18,816 Microsoft.Extensions.Options.ConfigurationExtensions.dll
10/19/2020  05:48 PM            54,664 Microsoft.Extensions.Options.dll
10/19/2020  05:48 PM            39,296 Microsoft.Extensions.Primitives.dll
10/12/2020  08:37 PM           106,376 Microsoft.ML.OnnxRuntime.dll
07/08/2020  06:26 AM           255,488 protobuf-net.Core.dll
07/08/2020  06:26 AM           255,488 protobuf-net.dll
01/01/2021  01:40 AM    <DIR>          ref
01/01/2021  01:40 AM    <DIR>          runtimes
07/26/2020  12:47 PM           539,136 SharpCompress.dll
11/15/2019  05:31 PM         2,318,920 System.Private.ServiceModel.dll
05/15/2018  12:29 PM           186,504 System.Security.Cryptography.Pkcs.dll
05/15/2018  12:29 PM           167,568 System.Security.Cryptography.Xml.dll
05/15/2018  12:29 PM            96,400 System.Security.Permissions.dll
11/15/2019  05:31 PM            23,624 System.ServiceModel.dll
11/15/2019  05:31 PM            21,576 System.ServiceModel.Primitives.dll
              55 File(s)     30,361,587 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\ref

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM            48,640 Ceres.Base.dll
01/01/2021  01:40 AM           201,728 Ceres.Chess.dll
01/01/2021  01:40 AM            12,288 Ceres.dll
01/01/2021  01:40 AM            18,432 Ceres.Features.dll
01/01/2021  01:40 AM            61,952 Ceres.MCTS.dll
               5 File(s)        343,040 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          alpine-x64
01/01/2021  01:40 AM    <DIR>          alpine.3.9-x64
01/01/2021  01:40 AM    <DIR>          debian-arm64
01/01/2021  01:40 AM    <DIR>          debian.9-x64
01/01/2021  01:40 AM    <DIR>          fedora-x64
01/01/2021  01:40 AM    <DIR>          linux-x64
01/01/2021  01:40 AM    <DIR>          osx
01/01/2021  01:40 AM    <DIR>          rhel-x64
01/01/2021  01:40 AM    <DIR>          ubuntu.16.04-arm64
01/01/2021  01:40 AM    <DIR>          ubuntu.18.04-x64
01/01/2021  01:40 AM    <DIR>          win
01/01/2021  01:40 AM    <DIR>          win-x64
01/01/2021  01:40 AM    <DIR>          win-x86
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\alpine-x64

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\alpine-x64\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         1,376,152 libgit2-106a5f2.so
               1 File(s)      1,376,152 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\alpine.3.9-x64

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\alpine.3.9-x64\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         1,332,656 libgit2-106a5f2.so
               1 File(s)      1,332,656 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\debian-arm64

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\debian-arm64\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         1,168,720 libgit2-106a5f2.so
               1 File(s)      1,168,720 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\debian.9-x64

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\debian.9-x64\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         1,353,824 libgit2-106a5f2.so
               1 File(s)      1,353,824 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\fedora-x64

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\fedora-x64\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         1,198,160 libgit2-106a5f2.so
               1 File(s)      1,198,160 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\linux-x64

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\linux-x64\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         1,351,713 libgit2-106a5f2.so
10/12/2020  03:03 PM       126,725,944 libonnxruntime.so
               2 File(s)    128,077,657 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\osx

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\osx\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         2,015,296 libgit2-106a5f2.dylib
               1 File(s)      2,015,296 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\rhel-x64

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\rhel-x64\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         1,283,600 libgit2-106a5f2.so
               1 File(s)      1,283,600 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\ubuntu.16.04-arm64

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\ubuntu.16.04-arm64\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         1,200,152 libgit2-106a5f2.so
               1 File(s)      1,200,152 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\ubuntu.18.04-x64

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\ubuntu.18.04-x64\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         1,394,448 libgit2-106a5f2.so
               1 File(s)      1,394,448 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          lib
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win\lib

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          netcoreapp2.1
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win\lib\netcoreapp2.1

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
05/15/2018  12:29 PM           211,088 System.Security.Cryptography.Pkcs.dll
               1 File(s)        211,088 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win-x64

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win-x64\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM         1,208,832 git2-106a5f2.dll
12/11/2019  07:38 AM         7,262,208 git2-106a5f2.pdb
10/12/2020  11:11 PM       160,691,592 onnxruntime.dll
10/12/2020  10:30 PM             2,478 onnxruntime.lib
10/12/2020  10:33 PM       187,215,872 onnxruntime.pdb
               5 File(s)    356,380,982 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win-x86

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
01/01/2021  01:40 AM    <DIR>          native
               0 File(s)              0 bytes

 Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win-x86\native

01/01/2021  01:40 AM    <DIR>          .
01/01/2021  01:40 AM    <DIR>          ..
12/11/2019  07:38 AM           940,544 git2-106a5f2.dll
12/11/2019  07:38 AM         7,270,400 git2-106a5f2.pdb
               2 File(s)      8,210,944 bytes

     Total Files Listed:
              79 File(s)    535,908,306 bytes
              89 Dir(s)  598,914,244,608 bytes free

C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0>
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Top
JohnS
Posts: 215
Joined: Sun Feb 24, 2008 2:08 am

Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)

Post by JohnS »

Nay Lin Tun wrote: ↑Fri Jan 01, 2021 5:34 am Announcement from Leela discord.

Long time community member and developer @dje has created a new chess engine that uses Leela Chess Zero networks. It appears much stronger than lc0 (see the performance test below). The build process is currently being worked on so please be patient while the community helps to make executables available to all for further testing.
We are likely to make this the new official Leela Chess Zero project engine if all goes well so feel free to ask questions about it in #help or aid development in #dev-public.
Link to source code on GitHub: https://discord.com/channels/4254194825 ... 0299791370
Quick performance test: https://discord.com/channels/4254194825 ... 9669066784
Thanks to dje for this wonderful late Christmas gift! gift


FYI, new engine is approx 2.3x faster than Lco!
Is there a link to github thanks.
Top
Jhoravi
Posts: 291
Joined: Wed May 08, 2013 6:49 am

Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)

Post by Jhoravi »

JohnS wrote: ↑Fri Jan 01, 2021 10:48 am Is there a link to github thanks.
https://github.com/dje-dev/Ceres
Top
Pi4Chess
Posts: 253
Joined: Mon Nov 16, 2020 12:13 pm
Full name: Manuel Rivera

Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)

Post by Pi4Chess »

jshriver wrote: ↑Fri Jan 01, 2021 9:27 am That's wonderful news, my main concern is that lc0 is relatively portable. Heck you can compile it on a Raspberry Pi.
When I looked at Ceres earlier it was VERY much Windows only.

Can it not exist as its own engine and let lc0 continue its efforts?
+1

Hope we'll get a Linux version soon.
Top

Return to “Computer Chess Club: General Topics”