Leela Zero Cpu rating?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 41455
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Leela Zero Cpu rating?

Post by Graham Banks »

dkappe wrote: Tue Mar 10, 2020 7:07 pm
Graham Banks wrote: Tue Mar 10, 2020 5:14 am CCRL 40/15

Code: Select all

CCRL 40/15 Rating List - Custom engine selection
1127982 games played by 2628 programs, run by 23 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on March 7, 2020 with Bayeselo based on 1'127'982 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/4040/

Rank                 Engine                   Elo   +    -   Score  AvOp  Games
1 Lc0 0.21.3 wLD2 64-bit                  3095  +33  -33  51.2%  -15.7   284
  Lc0 0.22.0 wLD2 64-bit                  3095  +50  -49  57.9%  -54.6   126
  Lc0 0.23.2 wLD2 64-bit                  3070  +56  -56  47.2%  +11.0    88
  Lc0 0.20.1 w36089 64-bit                3054  +21  -21  57.5%  -57.0   829
  Lc0 0.21.1 w11258 64-bit                2963  +51  -50  56.0%  -38.2   126
  Lc0 0.20.1 w11258 64-bit                2953  +34  -34  50.2%   -4.2   274
  Lc0 0.20.2 w32930 64-bit                2907  +33  -33  52.8%  -21.1   282
  Lc0 0.19.1 w11248 64-bit                2863  +35  -35  50.6%   -5.1   254
  Leela Chess 0.10 w323 64-bit            2651  +18  -18  52.2%  -17.6  1102
CCRL 40/2

Code: Select all

CCRL Blitz Rating List - Custom engine selection
2205595 games played by 2595 programs, run by 22 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: From Jan 2020, equivalent to 2'+1" on an Intel i7-4770K. See the "about" page.
Computed on March 7, 2020 with Bayeselo based on 2'205'595 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/404/

Rank               Engine                Elo   +    -   Score  AvOp  Games
1 Lc0 0.20.1 w36089 64-bit           2798  +19  -19  55.1%  -41.6   982
  Lc0 0.21.0 w32930 64-bit           2757  +80  -94  12.8% +319.9    82
  Lc0 0.20.2 w32930 64-bit           2679  +80  -90  18.8% +239.0    64
  Leela Chess 0.10 w483 64-bit       2607  +22  -22  48.6%  +11.1   725
  Leela Chess 0.10 w323 64-bit       2538  +23  -22  57.2%  -55.7   754
  Leela Chess 0.10 w272 64-bit       2309  +33  -32  56.1%  -46.9   350
  Leela Chess 0.9 w272 64-bit        2272  +33  -33  51.3%   -9.8   352
  Leela Chess 0.7 w187 64-bit        2236  +22  -22  63.3% -104.8   814
  Leela Chess 0.5 w123 64-bit        1964  +32  -32  46.9%  +24.7   373
Looking at these, it’s not clear which networks are used. The 32930 and 11258 nets themselves would be terrible on cpu. Are these distilled networks?
The 11258 nets were the ones that you advised me to use.
Not sure about the 32930, as I think that either Tirsa or Sergio ran those.
gbanksnz at gmail.com
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Leela Zero Cpu rating?

Post by dkappe »

Graham Banks wrote: Tue Mar 10, 2020 9:54 pm
dkappe wrote: Tue Mar 10, 2020 7:07 pm
Graham Banks wrote: Tue Mar 10, 2020 5:14 am CCRL 40/15

Code: Select all

CCRL 40/15 Rating List - Custom engine selection
1127982 games played by 2628 programs, run by 23 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on March 7, 2020 with Bayeselo based on 1'127'982 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/4040/

Rank                 Engine                   Elo   +    -   Score  AvOp  Games
1 Lc0 0.21.3 wLD2 64-bit                  3095  +33  -33  51.2%  -15.7   284
  Lc0 0.22.0 wLD2 64-bit                  3095  +50  -49  57.9%  -54.6   126
  Lc0 0.23.2 wLD2 64-bit                  3070  +56  -56  47.2%  +11.0    88
  Lc0 0.20.1 w36089 64-bit                3054  +21  -21  57.5%  -57.0   829
  Lc0 0.21.1 w11258 64-bit                2963  +51  -50  56.0%  -38.2   126
  Lc0 0.20.1 w11258 64-bit                2953  +34  -34  50.2%   -4.2   274
  Lc0 0.20.2 w32930 64-bit                2907  +33  -33  52.8%  -21.1   282
  Lc0 0.19.1 w11248 64-bit                2863  +35  -35  50.6%   -5.1   254
  Leela Chess 0.10 w323 64-bit            2651  +18  -18  52.2%  -17.6  1102
CCRL 40/2

Code: Select all

CCRL Blitz Rating List - Custom engine selection
2205595 games played by 2595 programs, run by 22 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: From Jan 2020, equivalent to 2'+1" on an Intel i7-4770K. See the "about" page.
Computed on March 7, 2020 with Bayeselo based on 2'205'595 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/404/

Rank               Engine                Elo   +    -   Score  AvOp  Games
1 Lc0 0.20.1 w36089 64-bit           2798  +19  -19  55.1%  -41.6   982
  Lc0 0.21.0 w32930 64-bit           2757  +80  -94  12.8% +319.9    82
  Lc0 0.20.2 w32930 64-bit           2679  +80  -90  18.8% +239.0    64
  Leela Chess 0.10 w483 64-bit       2607  +22  -22  48.6%  +11.1   725
  Leela Chess 0.10 w323 64-bit       2538  +23  -22  57.2%  -55.7   754
  Leela Chess 0.10 w272 64-bit       2309  +33  -32  56.1%  -46.9   350
  Leela Chess 0.9 w272 64-bit        2272  +33  -33  51.3%   -9.8   352
  Leela Chess 0.7 w187 64-bit        2236  +22  -22  63.3% -104.8   814
  Leela Chess 0.5 w123 64-bit        1964  +32  -32  46.9%  +24.7   373
Looking at these, it’s not clear which networks are used. The 32930 and 11258 nets themselves would be terrible on cpu. Are these distilled networks?
The 11258 nets were the ones that you advised me to use.
Not sure about the 32930, as I think that either Tirsa or Sergio ran those.
The 112x9 distillations? If so it would be good to note the dimensions in the name.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
User avatar
Graham Banks
Posts: 41455
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Leela Zero Cpu rating?

Post by Graham Banks »

dkappe wrote: Wed Mar 11, 2020 4:59 amThe 112x9 distillations?
Yes.
gbanksnz at gmail.com