Distilled Networks for Lc0

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
Eduard
Posts: 116
Joined: Fri Oct 26, 2018 10:58 pm
Location: Germany
Full name: Eduard Nemeth
Contact:

Distilled Networks for Lc0

Post by Eduard » Fri Jan 18, 2019 9:06 pm

It seems that the newer networks like eg. 32585 are better than the 11.xxx (my analysis). It would be cool to have one as distilled. Is that possible? Thanks.

Werewolf
Posts: 1139
Joined: Thu Sep 18, 2008 8:24 pm

Re: Distilled Networks for Lc0

Post by Werewolf » Fri Jan 18, 2019 9:08 pm

What do you mean by “distilled”?

User avatar
Eduard
Posts: 116
Joined: Fri Oct 26, 2018 10:58 pm
Location: Germany
Full name: Eduard Nemeth
Contact:

Re: Distilled Networks for Lc0

Post by Eduard » Fri Jan 18, 2019 9:12 pm


dkappe
Posts: 79
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: Distilled Networks for Lc0

Post by dkappe » Fri Jan 18, 2019 9:19 pm

Right now I’m trying to find the optimal size. Once found I will distill the best of t30, Ender, and whatever else doesn’t get out of the way fast enough.

User avatar
Werner
Posts: 2312
Joined: Wed Mar 08, 2006 9:09 pm

Re: Distilled Networks for Lc0

Post by Werner » Sun Jan 20, 2019 9:52 am

Hi Dietrich,
thanks a lot for your work.

When I compare your list with our CEGT results I see a difference with Crafty. Does it run on 1CPU?

1 ethereal : 3262 35 (CEGT 3187)
2 ID11258-112x9-se : 2965
3 crafty25.2 : 2948 26 (CEGT 2790)
Werner

User avatar
Eduard
Posts: 116
Joined: Fri Oct 26, 2018 10:58 pm
Location: Germany
Full name: Eduard Nemeth
Contact:

Re: Distilled Networks for Lc0

Post by Eduard » Thu Jan 24, 2019 10:05 pm

I see that D. Kappe has released a new distilled Network 11258-200x20-se. Thank You!

dkappe
Posts: 79
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: Distilled Networks for Lc0

Post by dkappe » Fri Jan 25, 2019 2:25 am

The 200x20-se is more a failed attempt at a gpu turbo net. :-)

dkappe
Posts: 79
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: Distilled Networks for Lc0

Post by dkappe » Sat Jan 26, 2019 9:31 pm

Added another.

https://github.com/dkappe/leela-chess-w ... d-Networks

This is 128x10. I know we had another, but not based on the same net and distillation process. Testing ongoing. If it slots in below 112x9, then we'll see how 104x9, 112x10, 120x9 and so on perform.

dkappe
Posts: 79
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: Distilled Networks for Lc0

Post by dkappe » Sat Jan 26, 2019 9:45 pm

I've also added a link to a pb.gz version of the 598 old main line net. They are probably available elsewhere, but hard to track down.

dkappe
Posts: 79
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: Distilled Networks for Lc0

Post by dkappe » Sat Jan 26, 2019 9:54 pm

Also worth mentioning is that I am almost done with a 24x3 net. Not sure where that will come in handy, but I'll make them and let other people figure out what they're good for.

Post Reply