Leela Zero Cpu rating?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Dann Corbit, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
h1a8
Posts: 455
Joined: Fri Jun 04, 2010 5:23 am

Leela Zero Cpu rating?

Post by h1a8 » Fri Mar 06, 2020 2:51 pm

1. Are there any rating lists that shows how strong Leela Zero is (cpu version) on various hardware? I have an i7 10510u laptop with 16gb ram.

2. Is the formula about doubling the nps to give about 60 elo still valid with the cpu version of Leela?


3. Which net files can I use for Leela to get 1700-2000 elo play? I want to play against a Leela about that strength.
Top
ThatsIt
Posts: 979
Joined: Thu Mar 09, 2006 1:11 pm
Contact:
Contact ThatsIt

Re: Leela Zero Cpu rating?

Post by ThatsIt » Fri Mar 06, 2020 7:28 pm

Just have a look @

CEGT 40/20
http://www.cegt.net/40_40%20Rating%20Li ... s/287.html

CEGT 40/4
http://www.cegt.net/40_4_Ratinglist/40_ ... n/594.html

CEGT 5'+3" ponder=on
http://www.cegt.net/5Plus3Rating/BestVe ... EW/32.html

Best wishes,
G.S.
(CEGT team)
Top
h1a8
Posts: 455
Joined: Fri Jun 04, 2010 5:23 am

Re: Leela Zero Cpu rating?

Post by h1a8 » Sat Mar 07, 2020 12:30 am

Thanks I didnt know Blas meant cpu.
Top
fastgm
Posts: 674
Joined: Mon Aug 19, 2013 4:57 pm
Contact:
Contact fastgm

Re: Leela Zero Cpu rating?

Post by fastgm » Sat Mar 07, 2020 12:57 am

http://www.fastgm.de

60 sec + 0.6 sec
10 min + 6 sec
60 min + 15 sec

are three cpu rating lists with Leela Zero cpu versions.
Top
dkappe
Posts: 860
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: Leela Zero Cpu rating?

Post by dkappe » Sat Mar 07, 2020 1:26 am

h1a8 wrote: ↑
Fri Mar 06, 2020 2:51 pm
 3. Which net files can I use for Leela to get 1700-2000 elo play? I want to play against a Leela about that strength.
Ah, now the hard bit. All of the nets mentioned above are way stronger than what you require. There are basically two ways of weakening lc0 (the engine that uses the networks):

1. Use a small or minimally trained network
2. Reduce the size of the search tree
3. Both of the above

Unlike crippled ab engines which basically play like a drunk GM, some of these small nets on limited nodes can play a very entertaining brand of chess.

You can try out two small nets on limited nodes playing at lichess here:
The first is a 32x4 net (typically cpu nets are 128x10, gpu 256x20 or larger) running on a raspberry pi 3. It’s pretty strong for a human and may be stronger than what you require. The second is a 16x2 net distilled from the old t10 nets. It may be around 2200 lichess? They were trained from different data and should have a very different style from one another.

Anyhow, try those out and see where you end up.
Top
dkappe
Posts: 860
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: Leela Zero Cpu rating?

Post by dkappe » Sat Mar 07, 2020 1:30 am

A recent game that may give you a taste. I think it’s looking at 4000 nodes, which even on cpu is instant.

Top
Zenmastur
Posts: 919
Joined: Sat May 31, 2014 6:28 am

Re: Leela Zero Cpu rating?

Post by Zenmastur » Tue Mar 10, 2020 4:03 am

dkappe wrote: ↑
Sat Mar 07, 2020 1:26 am
h1a8 wrote: ↑
Fri Mar 06, 2020 2:51 pm
 3. Which net files can I use for Leela to get 1700-2000 elo play? I want to play against a Leela about that strength.
Ah, now the hard bit. All of the nets mentioned above are way stronger than what you require. There are basically two ways of weakening lc0 (the engine that uses the networks):

1. Use a small or minimally trained network
2. Reduce the size of the search tree
3. Both of the above

Unlike crippled ab engines which basically play like a drunk GM, some of these small nets on limited nodes can play a very entertaining brand of chess.

You can try out two small nets on limited nodes playing at lichess here:
The first is a 32x4 net (typically cpu nets are 128x10, gpu 256x20 or larger) running on a raspberry pi 3. It’s pretty strong for a human and may be stronger than what you require. The second is a 16x2 net distilled from the old t10 nets. It may be around 2200 lichess? They were trained from different data and should have a very different style from one another.

Anyhow, try those out and see where you end up.
Can these nets be downloaded?
Only 2 defining forces have ever offered to die for you.....Jesus Christ and the American Soldier. One died for your soul, the other for your freedom.
Top
User avatar
Graham Banks
Posts: 35093
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: Leela Zero Cpu rating?

Post by Graham Banks » Tue Mar 10, 2020 4:14 am

CCRL 40/15

Code: Select all

CCRL 40/15 Rating List - Custom engine selection
1127982 games played by 2628 programs, run by 23 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on March 7, 2020 with Bayeselo based on 1'127'982 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/4040/

Rank                 Engine                   Elo   +    -   Score  AvOp  Games
1 Lc0 0.21.3 wLD2 64-bit                  3095  +33  -33  51.2%  -15.7   284
  Lc0 0.22.0 wLD2 64-bit                  3095  +50  -49  57.9%  -54.6   126
  Lc0 0.23.2 wLD2 64-bit                  3070  +56  -56  47.2%  +11.0    88
  Lc0 0.20.1 w36089 64-bit                3054  +21  -21  57.5%  -57.0   829
  Lc0 0.21.1 w11258 64-bit                2963  +51  -50  56.0%  -38.2   126
  Lc0 0.20.1 w11258 64-bit                2953  +34  -34  50.2%   -4.2   274
  Lc0 0.20.2 w32930 64-bit                2907  +33  -33  52.8%  -21.1   282
  Lc0 0.19.1 w11248 64-bit                2863  +35  -35  50.6%   -5.1   254
  Leela Chess 0.10 w323 64-bit            2651  +18  -18  52.2%  -17.6  1102
CCRL 40/2

Code: Select all

CCRL Blitz Rating List - Custom engine selection
2205595 games played by 2595 programs, run by 22 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: From Jan 2020, equivalent to 2'+1" on an Intel i7-4770K. See the "about" page.
Computed on March 7, 2020 with Bayeselo based on 2'205'595 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/404/

Rank               Engine                Elo   +    -   Score  AvOp  Games
1 Lc0 0.20.1 w36089 64-bit           2798  +19  -19  55.1%  -41.6   982
  Lc0 0.21.0 w32930 64-bit           2757  +80  -94  12.8% +319.9    82
  Lc0 0.20.2 w32930 64-bit           2679  +80  -90  18.8% +239.0    64
  Leela Chess 0.10 w483 64-bit       2607  +22  -22  48.6%  +11.1   725
  Leela Chess 0.10 w323 64-bit       2538  +23  -22  57.2%  -55.7   754
  Leela Chess 0.10 w272 64-bit       2309  +33  -32  56.1%  -46.9   350
  Leela Chess 0.9 w272 64-bit        2272  +33  -33  51.3%   -9.8   352
  Leela Chess 0.7 w187 64-bit        2236  +22  -22  63.3% -104.8   814
  Leela Chess 0.5 w123 64-bit        1964  +32  -32  46.9%  +24.7   373
gbanksnz at gmail.com
Top
dkappe
Posts: 860
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: Leela Zero Cpu rating?

Post by dkappe » Tue Mar 10, 2020 3:10 pm

The distilled networks can be found here: https://github.com/dkappe/leela-chess-w ... d-Networks

The mean girl nets can be found here: https://github.com/dkappe/leela-chess-w ... -style-net
Top
dkappe
Posts: 860
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: Leela Zero Cpu rating?

Post by dkappe » Tue Mar 10, 2020 6:07 pm

Graham Banks wrote: ↑
Tue Mar 10, 2020 4:14 am
 CCRL 40/15

Code: Select all

CCRL 40/15 Rating List - Custom engine selection
1127982 games played by 2628 programs, run by 23 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on March 7, 2020 with Bayeselo based on 1'127'982 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/4040/

Rank                 Engine                   Elo   +    -   Score  AvOp  Games
1 Lc0 0.21.3 wLD2 64-bit                  3095  +33  -33  51.2%  -15.7   284
  Lc0 0.22.0 wLD2 64-bit                  3095  +50  -49  57.9%  -54.6   126
  Lc0 0.23.2 wLD2 64-bit                  3070  +56  -56  47.2%  +11.0    88
  Lc0 0.20.1 w36089 64-bit                3054  +21  -21  57.5%  -57.0   829
  Lc0 0.21.1 w11258 64-bit                2963  +51  -50  56.0%  -38.2   126
  Lc0 0.20.1 w11258 64-bit                2953  +34  -34  50.2%   -4.2   274
  Lc0 0.20.2 w32930 64-bit                2907  +33  -33  52.8%  -21.1   282
  Lc0 0.19.1 w11248 64-bit                2863  +35  -35  50.6%   -5.1   254
  Leela Chess 0.10 w323 64-bit            2651  +18  -18  52.2%  -17.6  1102
CCRL 40/2

Code: Select all

CCRL Blitz Rating List - Custom engine selection
2205595 games played by 2595 programs, run by 22 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: From Jan 2020, equivalent to 2'+1" on an Intel i7-4770K. See the "about" page.
Computed on March 7, 2020 with Bayeselo based on 2'205'595 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/404/

Rank               Engine                Elo   +    -   Score  AvOp  Games
1 Lc0 0.20.1 w36089 64-bit           2798  +19  -19  55.1%  -41.6   982
  Lc0 0.21.0 w32930 64-bit           2757  +80  -94  12.8% +319.9    82
  Lc0 0.20.2 w32930 64-bit           2679  +80  -90  18.8% +239.0    64
  Leela Chess 0.10 w483 64-bit       2607  +22  -22  48.6%  +11.1   725
  Leela Chess 0.10 w323 64-bit       2538  +23  -22  57.2%  -55.7   754
  Leela Chess 0.10 w272 64-bit       2309  +33  -32  56.1%  -46.9   350
  Leela Chess 0.9 w272 64-bit        2272  +33  -33  51.3%   -9.8   352
  Leela Chess 0.7 w187 64-bit        2236  +22  -22  63.3% -104.8   814
  Leela Chess 0.5 w123 64-bit        1964  +32  -32  46.9%  +24.7   373
Looking at these, it’s not clear which networks are used. The 32930 and 11258 nets themselves would be terrible on cpu. Are these distilled networks?
Top
Post Reply

Return to “Computer Chess Club: General Topics”