Page 1 of 3

Distilled Networks for Lc0

Posted: Fri Jan 18, 2019 10:06 pm
by Eduard
It seems that the newer networks like eg. 32585 are better than the 11.xxx (my analysis). It would be cool to have one as distilled. Is that possible? Thanks.

Re: Distilled Networks for Lc0

Posted: Fri Jan 18, 2019 10:08 pm
by Werewolf
What do you mean by “distilled”?

Re: Distilled Networks for Lc0

Posted: Fri Jan 18, 2019 10:12 pm
by Eduard

Re: Distilled Networks for Lc0

Posted: Fri Jan 18, 2019 10:19 pm
by dkappe
Right now I’m trying to find the optimal size. Once found I will distill the best of t30, Ender, and whatever else doesn’t get out of the way fast enough.

Re: Distilled Networks for Lc0

Posted: Sun Jan 20, 2019 10:52 am
by Werner
Hi Dietrich,
thanks a lot for your work.

When I compare your list with our CEGT results I see a difference with Crafty. Does it run on 1CPU?

1 ethereal : 3262 35 (CEGT 3187)
2 ID11258-112x9-se : 2965
3 crafty25.2 : 2948 26 (CEGT 2790)

Re: Distilled Networks for Lc0

Posted: Thu Jan 24, 2019 11:05 pm
by Eduard
I see that D. Kappe has released a new distilled Network 11258-200x20-se. Thank You!

Re: Distilled Networks for Lc0

Posted: Fri Jan 25, 2019 3:25 am
by dkappe
The 200x20-se is more a failed attempt at a gpu turbo net. :-)

Re: Distilled Networks for Lc0

Posted: Sat Jan 26, 2019 10:31 pm
by dkappe
Added another.

https://github.com/dkappe/leela-chess-w ... d-Networks

This is 128x10. I know we had another, but not based on the same net and distillation process. Testing ongoing. If it slots in below 112x9, then we'll see how 104x9, 112x10, 120x9 and so on perform.

Re: Distilled Networks for Lc0

Posted: Sat Jan 26, 2019 10:45 pm
by dkappe
I've also added a link to a pb.gz version of the 598 old main line net. They are probably available elsewhere, but hard to track down.

Re: Distilled Networks for Lc0

Posted: Sat Jan 26, 2019 10:54 pm
by dkappe
Also worth mentioning is that I am almost done with a 24x3 net. Not sure where that will come in handy, but I'll make them and let other people figure out what they're good for.