First Win by Leela Chess Zero against Stockfish dev

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
CMCanavessi
Posts: 835
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: First Win by Leela Chess Zero against Stockfish dev

Post by CMCanavessi » Sat Jun 09, 2018 8:38 pm

Ozymandias wrote:
Sat Jun 09, 2018 7:15 pm
CMCanavessi wrote:
Sat Jun 09, 2018 4:08 pm
the perception by the community might well be that nothing is happening and that progress has stalled, which is completely understandable.
My perception is that maybe too much is happening at once, and that probably because of that, progress has nearly stalled.
Well, I'm currently testing ID 25 of the 1st test run, and it's already proving to be around 2900. That's impressive, a 2900 network made in 3 days and only 1 million games. Oh, and it's still 64x6 size. I'm just speechless at that. A0 was trained on 44 million games for comparison, and the 1st (and bugged) Leela run got to around that level of performance after like 320 networks.
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

Werewolf
Posts: 1193
Joined: Thu Sep 18, 2008 8:24 pm

Re: First Win by Leela Chess Zero against Stockfish dev

Post by Werewolf » Sat Jun 09, 2018 8:44 pm

CMCanavessi wrote:
Sat Jun 09, 2018 8:38 pm


Well, I'm currently testing ID 25 of the 1st test run, and it's already proving to be around 2900. That's impressive, a 2900 network made in 3 days and only 1 million games. Oh, and it's still 64x6 size. I'm just speechless at that. A0 was trained on 44 million games for comparison, and the 1st (and bugged) Leela run got to around that level of performance after like 320 networks.
Yes that is...remarkable. The next week will be fascinating.

User avatar
Ozymandias
Posts: 1126
Joined: Sun Oct 25, 2009 12:30 am

Re: First Win by Leela Chess Zero against Stockfish dev

Post by Ozymandias » Sat Jun 09, 2018 9:26 pm

CMCanavessi wrote:
Sat Jun 09, 2018 8:38 pm
I'm currently testing ID 25 of the 1st test run, and it's already proving to be around 2900. That's impressive, a 2900 network made in 3 days and only 1 million games.
Did you test the old id45? Also around 1 million games.

User avatar
CMCanavessi
Posts: 835
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: First Win by Leela Chess Zero against Stockfish dev

Post by CMCanavessi » Sat Jun 09, 2018 10:04 pm

ID 45 was around 1500 elo (I tested 44 and got 1496.7). Must account for different software though, which made a huge progress.
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

User avatar
Ozymandias
Posts: 1126
Joined: Sun Oct 25, 2009 12:30 am

Re: First Win by Leela Chess Zero against Stockfish dev

Post by Ozymandias » Sun Jun 10, 2018 4:27 am

That's indeed some difference.

David Xu
Posts: 47
Joined: Mon Oct 31, 2016 8:45 pm

Re: First Win by Leela Chess Zero against Stockfish dev

Post by David Xu » Sun Jun 10, 2018 5:04 am

CMCanavessi wrote:
Sat Jun 09, 2018 8:38 pm
Ozymandias wrote:
Sat Jun 09, 2018 7:15 pm
CMCanavessi wrote:
Sat Jun 09, 2018 4:08 pm
the perception by the community might well be that nothing is happening and that progress has stalled, which is completely understandable.
My perception is that maybe too much is happening at once, and that probably because of that, progress has nearly stalled.
Well, I'm currently testing ID 25 of the 1st test run, and it's already proving to be around 2900. That's impressive, a 2900 network made in 3 days and only 1 million games. Oh, and it's still 64x6 size. I'm just speechless at that. A0 was trained on 44 million games for comparison, and the 1st (and bugged) Leela run got to around that level of performance after like 320 networks.
A very strong indicator that DeepMind put basically zero effort into optimizing A0 for chess. After all, chess is a simpler game than Go, so theoretically speaking, it makes sense that a smaller net would be able to achieve more in chess than it could in Go. (A fully optimized A0 would presumably have been much stronger than the version of A0 we saw.) Sadly, the bugs in Leela's first "trial run" obscured that fact, making many people think that the 6-block net reached its ceiling prematurely. Looking forward to seeing what the true ceiling of the 64x6 net is! 8-)

shrapnel
Posts: 1198
Joined: Fri Nov 02, 2012 8:43 am
Location: New Delhi, India

Re: First Win by Leela Chess Zero against Stockfish dev

Post by shrapnel » Sun Jun 10, 2018 12:22 pm

Well, I hope this new Leela is better than the old one at least in the End-game.
In two 2 minute/move games (which took up a lot of time), lc0 let slip the advantage against Komodo and was forced to concede Draws.
lc0 was showing Scores like +3.40 and for once even the opponent Komodo seemed to agree by showing Scores like -1.85 to -1.95 .
Against Stockfish, Komodo would have caved in, but it held on for Draws against lc0.
Disappointing.
The wait just got longer.
i7 5960X @ 4.1 Ghz, 64 GB G.Skill RipJaws RAM, Twin Asus ROG Strix OC 11 GB Geforce 2080 Tis

Leo
Posts: 832
Joined: Fri Sep 16, 2016 4:55 pm
Location: USA/Minnesota
Full name: Leo

Re: First Win by Leela Chess Zero against Stockfish dev

Post by Leo » Sun Jun 10, 2018 3:41 pm

Brianfish defeats lczero


1. e4 c5
2. Nf3 d6
3. d4 cxd4
4. Nxd4 Nf6
5. Nc3 Nc6
6. Nxc6 bxc6
7. Be2 e5
8. O-O Be7
9. Qd3 O-O
10. Qg3 Be6
11. f4 exf4
12. Bxf4 Qb6+
13. Kh1 Qxb2
14. Rab1 Qxc2
15. Bh6 g6
16. Bxf8 Bxf8
17. Rxf6 Bg7
18. e5 Bxf6
19. exf6 Bxa2
20. Qe3 Bxb1
21. Qh6 Qxc3
22. Qg7#
Advanced Micro Devices fan.

yanquis1972
Posts: 1762
Joined: Tue Jun 02, 2009 10:14 pm

Re: First Win by Leela Chess Zero against Stockfish dev

Post by yanquis1972 » Sun Jun 10, 2018 5:55 pm

i'm only getting 50-70% GPU usage with the testserver net, is that due to the smaller size or changes in the .exe's (https://crem.xyz/lc0/)?

User avatar
CMCanavessi
Posts: 835
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: First Win by Leela Chess Zero against Stockfish dev

Post by CMCanavessi » Sun Jun 10, 2018 7:24 pm

yanquis1972 wrote:
Sun Jun 10, 2018 5:55 pm
i'm only getting 50-70% GPU usage with the testserver net, is that due to the smaller size or changes in the .exe's (https://crem.xyz/lc0/)?
How many threads? You need a beefy CPU to feed a fast GPU and make it work at 100%
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

Post Reply