Distilled Networks for Lc0
Moderators: hgm, Rebel, chrisw
-
Eduard
- Posts: 1439
- Joined: Sat Oct 27, 2018 12:58 am
- Location: Germany
- Full name: N.N.
Distilled Networks for Lc0
It seems that the newer networks like eg. 32585 are better than the 11.xxx (my analysis). It would be cool to have one as distilled. Is that possible? Thanks.
-
Werewolf
- Posts: 1796
- Joined: Thu Sep 18, 2008 10:24 pm
Re: Distilled Networks for Lc0
What do you mean by “distilled”?
-
Eduard
- Posts: 1439
- Joined: Sat Oct 27, 2018 12:58 am
- Location: Germany
- Full name: N.N.
-
dkappe
- Posts: 1631
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: Distilled Networks for Lc0
Right now I’m trying to find the optimal size. Once found I will distill the best of t30, Ender, and whatever else doesn’t get out of the way fast enough.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
Werner
- Posts: 2871
- Joined: Wed Mar 08, 2006 10:09 pm
- Location: Germany
- Full name: Werner Schüle
Re: Distilled Networks for Lc0
Hi Dietrich,
thanks a lot for your work.
When I compare your list with our CEGT results I see a difference with Crafty. Does it run on 1CPU?
1 ethereal : 3262 35 (CEGT 3187)
2 ID11258-112x9-se : 2965
3 crafty25.2 : 2948 26 (CEGT 2790)
thanks a lot for your work.
When I compare your list with our CEGT results I see a difference with Crafty. Does it run on 1CPU?
1 ethereal : 3262 35 (CEGT 3187)
2 ID11258-112x9-se : 2965
3 crafty25.2 : 2948 26 (CEGT 2790)
Werner
-
Eduard
- Posts: 1439
- Joined: Sat Oct 27, 2018 12:58 am
- Location: Germany
- Full name: N.N.
Re: Distilled Networks for Lc0
I see that D. Kappe has released a new distilled Network 11258-200x20-se. Thank You!
-
dkappe
- Posts: 1631
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: Distilled Networks for Lc0
The 200x20-se is more a failed attempt at a gpu turbo net. 
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
dkappe
- Posts: 1631
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: Distilled Networks for Lc0
Added another.
https://github.com/dkappe/leela-chess-w ... d-Networks
This is 128x10. I know we had another, but not based on the same net and distillation process. Testing ongoing. If it slots in below 112x9, then we'll see how 104x9, 112x10, 120x9 and so on perform.
https://github.com/dkappe/leela-chess-w ... d-Networks
This is 128x10. I know we had another, but not based on the same net and distillation process. Testing ongoing. If it slots in below 112x9, then we'll see how 104x9, 112x10, 120x9 and so on perform.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
dkappe
- Posts: 1631
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: Distilled Networks for Lc0
I've also added a link to a pb.gz version of the 598 old main line net. They are probably available elsewhere, but hard to track down.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
dkappe
- Posts: 1631
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: Distilled Networks for Lc0
Also worth mentioning is that I am almost done with a 24x3 net. Not sure where that will come in handy, but I'll make them and let other people figure out what they're good for.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".