LCZero update

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Dann Corbit, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Locked
jkiliani
Posts: 143
Joined: Wed Jan 17, 2018 12:26 pm

Re: LCZero update

Post by jkiliani » Fri Mar 16, 2018 7:16 pm

noobpwnftw wrote:One thing to mention about the NN approach is when it works it works, but when it doesn't, you usually can't fix it. There is an example in recent Go engines recreated from AG paper that would fall for some particular position every single time and the amount of training samples wouldn't be enough correct it, not to mention that doing human intervene contradicts the philosophy of "learning on its own", so maybe this is what they choose not to tell you and we probably will never see any A-series gets published for public use.

Sounds funny when you think of their medical plan, do the AI need to kill enough patients before learning not to, if so, how many, a zillion?
Care to share what that specific Go engine and the specific weakness is?

noobpwnftw
Posts: 436
Joined: Sun Nov 08, 2015 10:10 pm

Re: LCZero update

Post by noobpwnftw » Fri Mar 16, 2018 7:31 pm

jkiliani wrote: Care to share what that specific Go engine and the specific weakness is?
Fine Art, discussions in Chinese here.

jpqy
Posts: 532
Joined: Thu Apr 24, 2008 7:31 am
Location: Belgium

Re: LCZero update

Post by jpqy » Fri Mar 16, 2018 7:39 pm

Is someone using Lczero already into FritzGui ,cutechess or any Gui already?

jkiliani
Posts: 143
Joined: Wed Jan 17, 2018 12:26 pm

Re: LCZero update

Post by jkiliani » Fri Mar 16, 2018 7:45 pm

noobpwnftw wrote:
jkiliani wrote: Care to share what that specific Go engine and the specific weakness is?
Fine Art, discussions in Chinese here.
OK thanks, I guess I can't follow that discussion then. Thought you were talking Leela Zero + ladders

noobpwnftw
Posts: 436
Joined: Sun Nov 08, 2015 10:10 pm

Re: LCZero update

Post by noobpwnftw » Fri Mar 16, 2018 7:55 pm

jkiliani wrote: OK thanks, I guess I can't follow that discussion then.
The discussion was about the lack of variations played by Fine Art might because of some over-fitting and the engine will always fall for it as shown by the images, several games were identical and was done intentionally just to prove it.
Last edited by noobpwnftw on Fri Mar 16, 2018 7:56 pm, edited 1 time in total.

pferd
Posts: 126
Joined: Thu Jul 24, 2014 12:49 pm

Re: LCZero update

Post by pferd » Fri Mar 16, 2018 8:00 pm

jpqy wrote:Is someone using Lczero already into FritzGui ,cutechess or any Gui already?
I am running it in xboard via:

xboard -fcp "./lczero --weights get_network -p50000 --noponder" -fUCI and can play games against or let it play against other engines.

Does anybody know how strength increases when the number of playouts is raised?

User avatar
CMCanavessi
Posts: 916
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: LCZero update

Post by CMCanavessi » Fri Mar 16, 2018 8:05 pm

jpqy wrote:Is someone using Lczero already into FritzGui ,cutechess or any Gui already?
I'm using it in Arena.
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

User avatar
CMCanavessi
Posts: 916
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: LCZero update

Post by CMCanavessi » Fri Mar 16, 2018 8:08 pm

pferd wrote:
jpqy wrote:Is someone using Lczero already into FritzGui ,cutechess or any Gui already?
I am running it in xboard via:

xboard -fcp "./lczero --weights get_network -p50000 --noponder" -fUCI and can play games against or let it play against other engines.

Does anybody know how strength increases when the number of playouts is raised?
Playouts play a HUGE role in strenght. All the games I've been running use the default 800, which makes it rather weak but is good for the training purposes, as it provides more games/time. I see you use 50000, that's a nice number and should make it much stronger.

Time control is coming, so playouts will be automatically calculated based on time left / time per move.
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

Leo
Posts: 993
Joined: Fri Sep 16, 2016 4:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: LCZero update

Post by Leo » Fri Mar 16, 2018 9:02 pm

Werewolf wrote:
Milos wrote:
The similar matches have already been run resulting in strength difference of more than 100Elo.
The whole experiment lacked fairness, which coming from a world-leading organisation is deeply disturbing.
I agree. Its been a while but its always nice to hammer on Google. I am sure their engine has made possible many bad things over the years. They sure as heck host a lot of porn.
Advanced Micro Devices fan.

pferd
Posts: 126
Joined: Thu Jul 24, 2014 12:49 pm

Re: LCZero update

Post by pferd » Fri Mar 16, 2018 9:28 pm

CMCanavessi wrote:
pferd wrote: Does anybody know how strength increases when the number of playouts is raised?
Playouts play a HUGE role in strenght. All the games I've been running use the default 800, which makes it rather weak but is good for the training purposes, as it provides more games/time. I see you use 50000, that's a nice number and should make it much stronger.
I upped the playouts to 150000 (equals 30-40s/move on my machine) and had a quick match against TSCP 1.81b which was using 1 min/game. The network in use was 1aa02cb1. The game with Leela using the white pieces did not look too bad for :

[pgn]
[Event "Computer Chess Game"]
[Site "brutus"]
[Date "2018.03.16"]
[Round "1"]
[White "lczero"]
[Black "tscp"]
[Result "0-1"]
[TimeControl "60"]
[Annotator "1. -0.04 1... -0.30"]

1.d4
{-0.04/25}
1...d5
{-0.30/6 2.0}
2.Nf3
{-0.10/26 34}
2...Nf6
{-0.25/6 1.9}
3.c3
{-0.12/26 33}
3...Nc6
{+0.02/6 1.9}
4.b4
{-0.34/26 39}
4...e6
{+0.27/6 1.8}
5.a4
{-0.18/26 38}
5...Bd6
{+0.89/5 1.7}
6.Qd2
{-0.01/26 40}
6...O-O
{+1.02/6 1.7}
7.Qb2
{-0.05/26 41}
7...Bd7
{+0.92/6 1.6}
8.b5
{+0.03/26 41}
8...Ne7
{+0.81/6 1.6}
9.Ne5
{-0.04/26 41}
9...Bxe5
{+1.47/6 1.5}
10.dxe5
{-0.14/26 40}
10...Ng4
{+1.48/6 1.5}
11.Na3
{-0.49/26 39}
11...Nxe5
{+1.92/5 1.4}
12.g3
{-0.53/26 34}
12...c5
{+2.06/5 1.4}
13.f4
{+0.05/26 37}
13...Ng4
{+1.94/6 1.3}
14.e3
{+0.23/26 40}
14...e5
{+2.00/5 1.3}
15.Be2
{+0.17/26 40}
15...Qa5
{+1.83/6 1.2}
16.Nb1
{+0.84/26 40}
16...exf4
{+2.06/5 1.2}
17.exf4
{+1.21/26 42}
17...Rfe8
{+1.93/5 1.2}
18.Nd2
{+1.73/26 40}
18...Nf5
{+1.82/5 1.1}
19.Nb3
{+2.56/26 41}
19...Qb6
{+1.87/5 1.1}
20.O-O
{+1.40/26 40}
20...c4+
{+3.67/5 1.1}
21.Nd4
{+1.31/26 42}
21...Nxd4
{+3.67/5 1.0}
22.Bxg4
{-1.92/26 41}
22...Ne2+
{+4.80/5 1.0}
23.Kg2
{-1.64/26 40}
23...Bxg4
{+4.92/5 0.9}
24.Re1
{-1.53/26 40}
24...d4
{+5.55/5 0.9}
25.cxd4
{-2.47/26 40}
25...c3
{+5.59/4 0.9}
26.Qb3
{-2.54/26 39}
26...Qxd4
{+5.96/4 0.9}
27.Rd1
{-3.52/26 40}
27...Qe4+
{+99.93/5 0.4}
28.Kf2
{-28.77/20 2.2}
28...Qf3+
{+99.95/4 0.1}
29.Ke1
{-36.14/19 0.7}
29...Nxc1+
{+99.97/3 0.1}
30.Qe6
{-41.03/18 0.5}
30...Rxe6#
{Xboard adjudication: Checkmate}
0-1
[/pgn]

The reverse game however, was very hard to watch with Leela blundering a knight on move 2.

[pgn][Event "Computer Chess Game"]
[Site "brutus"]
[Date "2018.03.16"]
[Round "2"]
[White "tscp"]
[Black "lczero"]
[Result "1-0"]
[TimeControl "60"]
[Annotator "1. +0.13 1... +0.26"]

1.e4
{+0.13/6}
1...Nc6
{+0.26/25 36}
2.d4
{+0.22/6 1.9}
2...Nxd4
{+0.28/26 37}
3.Qxd4
{+2.30/6 1.9}
3...Nf6
{-0.09/26 31}
4.e5
{+3.00/5 1.8}
4...Ng8
{-0.74/26 38}
5.Nc3
{+2.90/5 1.7}
5...f6
{-0.47/26 36}
6.Bc4
{+2.93/5 1.7}
6...b5
{-0.27/26 38}
7.Bxg8
{+5.41/5 1.6}
7...Bb7
{-1.66/26 38}
8.Bd5
{+5.55/5 1.6}
8...c6
{-1.40/26 38}
9.Bf3
{+5.52/5 1.5}
9...Qb8
{-1.74/26 35}
10.Bf4
{+5.93/5 1.5}
10...d6
{-1.74/26 41}
11.exd6
{+6.05/5 1.4}
11...exd6
{-1.75/26 40}
12.O-O-O
{+6.24/4 1.4}
12...h5
{-2.49/26 39}
13.Qe4+
{+6.73/4 1.3}
13...Kf7
{-1.77/26 42}
14.Nxb5
{+6.82/5 1.3}
14...d5
{-3.61/26 40}
15.Qf5
{+7.32/5 1.2}
15...Qd8
{-3.88/26 40}
16.Nc7
{+7.88/5 1.2}
16...Bc5
{-3.90/26 40}
17.Bxh5+
{+9.43/4 1.2}
17...Kg8
{-7.72/26 40}
18.Qe6+
{+9.59/5 1.1}
18...Kh7
{-7.84/26 41}
19.Bf7
{+9.59/4 1.1}
19...g5
{-6.83/26 38}
20.Qf5+
{+13.27/5 1.0}
20...Kg7
{-8.59/26 39}
21.Qg6+
{+13.32/5 1.0}
21...Kf8
{-12.91/26 34}
22.Ne6+
{+13.37/5 1.0}
22...Ke7
{-13.06/26 33}
23.Nxd8
{+16.17/5 0.9}
23...Bxf2
{-13.17/26 32}
24.Qg7
{+17.10/5 0.9}
24...Be3+
{-13.91/25 36}
25.Bxe3
{+21.65/5 0.9}
25...Raxd8
{-14.22/25 37}
26.Bxd5+
{+23.96/4 0.9}
26...Kd6
{-17.83/25 36}
27.Bg8+
{+23.96/4 0.8}
27...Ke5
{-18.43/25 34}
28.Bd4+
{+25.32/5 0.8}
28...Rxd4
{-17.34/25 33}
29.Re1+
{+99.93/5 0.4}
29...Kf4
{-23.48/24 16}
30.Qxf6+
{+99.95/4 0.1}
30...Kg4
{-26.04/23 1.4}
31.Qf3+
{+99.97/3 0.1}
31...Kh4
{-40.26/18 1.1}
32.Qh3#
{Xboard adjudication: Checkmate}
1-0
[/pgn]

Maybe I was bit too optimistic, but let's see where this will go. Interesting days ahead for us.

Locked