how will Leela fare at the WCCC?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

mjlef
Posts: 1494
Joined: Thu Mar 30, 2006 2:08 pm

Re: how will Leela fare at the WCCC?

Post by mjlef »

Gian-Carlo Pascutto wrote: Wed Jul 18, 2018 11:33 pm
reasons?
hgm wrote: Wed Jul 18, 2018 9:42 pm Before every WCCC there is a players meeting, which basically decides everything. As a former participant I have often been approached by e-mail for my opinion on some proposed rule change.
As a former participant, I quite vividly remember a sudden rule change that invalidated at least one year of my work, hadn't been presented to the participants beforehand and when pointed out how silly it was, the response was that the comments would be considered for the next year.

Obviously, I never played again after that.
Gian-Carlo,

Do you remember what the rule change was? I would like to see if it is still a problem.

Mark
mjlef
Posts: 1494
Joined: Thu Mar 30, 2006 2:08 pm

Re: how will Leela fare at the WCCC?

Post by mjlef »

Laskos wrote: Wed Jul 18, 2018 11:14 pm
George Tsavdaris wrote: Wed Jul 18, 2018 11:07 pm
hgm wrote: Wed Jul 18, 2018 10:45 pm
tiptongrange wrote: Wed Jul 18, 2018 10:34 pm Laskos, what do you mean by "... and another game of Leela where she did not played..."?
One Leela game was postponed, because its operator was absent due to a domestic emergency.
Postponed but it was played. Leela had a time penalty because of that so it played with time odds.
Instead of 105'+15" for both players, it was Leela 30'+15" versus 45'+15" for opponent if i recall correctly.
Ah, yes? Didn't know. I am not sure whether to include it as a regular game.
I was there when the TD and GridGinko operator and Leela operator negotiated the time difference. By being late for the game Leela would normally have forfeited the game. To discourage people being late, and wanting the game to be played, I think a 15 minute time penalty quite reasonable. Note Leela had a lot of time at game end, so it did not get into time trouble even with the 15 minute penalty. Although people might not like the decisions of the TD and operators, the game happened and should be counted.

I might note all the programmers were very nice about this. All agreed to a delay for the next round so Leela would play. I lent the Leela operator a CAT-5 Ethernet to USB adapter since his laptop had no CAT-5 port. People buy each other candy. It is not a cuthroat tournament. People get along.
Gian-Carlo Pascutto
Posts: 1243
Joined: Sat Dec 13, 2008 7:00 pm

Re: how will Leela fare at the WCCC?

Post by Gian-Carlo Pascutto »

mjlef wrote: Thu Jul 19, 2018 7:45 am Do you remember what the rule change was? I would like to see if it is still a problem.
Hi Mark,

I'll tell the story in a private message.

The rule itself is irrelevant, as the point was about the (non-democratic) procedure.
Gian-Carlo Pascutto
Posts: 1243
Joined: Sat Dec 13, 2008 7:00 pm

Re: how will Leela fare at the WCCC?

Post by Gian-Carlo Pascutto »

Meanwhile Leela didn't manage to win a single game and finished near the bottom. Probably a disappointing result. On the upside: I am sure the Leela Chess Zero people have learned many important lessons about tournament preparation.
User avatar
hgm
Posts: 27788
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: how will Leela fare at the WCCC?

Post by hgm »

Gian-Carlo Pascutto wrote: Thu Jul 19, 2018 12:50 pm
mjlef wrote: Thu Jul 19, 2018 7:45 am Do you remember what the rule change was? I would like to see if it is still a problem.
Hi Mark,

I'll tell the story in a private message.

The rule itself is irrelevant, as the point was about the (non-democratic) procedure.
The rule was to max the number of cores to 8. That excluded custer programs. This rule was subsequently revoked for WCCC on programmer's demand, and the WCSC was spun off to keep the rule (and refine it to totally equal hardware).
Gian-Carlo Pascutto
Posts: 1243
Joined: Sat Dec 13, 2008 7:00 pm

Re: how will Leela fare at the WCCC?

Post by Gian-Carlo Pascutto »

hgm wrote: Thu Jul 19, 2018 2:17 pm The rule was to max the number of cores to 8. That excluded custer programs. This rule was subsequently revoked for WCCC on programmer's demand, and the WCSC was spun off to keep the rule (and refine it to totally equal hardware).
There was also this case where Vincent was arbitrarily banned, and then someone pointed out that by the same reasoning used, Harvey Williamson should also have been banned...

I had forgotten about this, but this discussion lead me to an email from you about that situation. I have mixed memories of my time in computer chess, but that email thread was a positive highlight. Even if it didn't lead to much of anything in the end.
IanO
Posts: 496
Joined: Wed Mar 08, 2006 9:45 pm
Location: Portland, OR

Re: how will Leela fare at the WCCC?

Post by IanO »

I'm curious about Leela's final game against Jonny. In their blog, they characterize it as "Leela blunders its queen to a discovered attack" but to my eyes it was neglecting king safety to try trapping a piece with g5-f6, and actually gaining material in the end (RBN-Q) but those pieces were uncoordinated. Is this a well-known trap in the Catalan?

[pgn][Event "World Computer Chess Championship 2018"] [Site "Stockholm"] [Date "2018.07.19"] [Round "7.4"] [White "Jonny"] [Black "Leela Chess Zero"] [Result "1-0"] [ECO "E00"] [TimeControl "1:45 + 15 seconds"] 1.d4 { [%clk 01:45:27] [%emt 00:00:03] } 1...Nf6 { [%clk 01:42:58] [%emt 00:02:32] } 2.c4 { [%clk 01:45:38] [%emt 00:00:04] } 2...e6 { [%clk 01:41:56] [%emt 00:01:17] } 3.Nf3 { [%clk 01:45:51] [%emt 00:00:03] } 3...d5 { [%clk 01:38:58] [%emt 00:03:13] } 4.g3 { [%clk 01:46:04] [%emt 00:00:03] } 4...Bb4+ { [%clk 01:37:01] [%emt 00:02:10] } 5.Bd2 { [%clk 01:46:16] [%emt 00:00:04] } 5...Be7 { [%clk 01:36:02] [%emt 00:01:14] } 6.Bg2 { [%clk 01:46:29] [%emt 00:00:03] } 6...O-O { [%emt 00:02:41] } 7.O-O { [%clk 01:46:40] [%emt 00:00:01] } 7...Nbd7 { [%clk 01:31:14] [%emt 00:02:39] } 8.Qc2 { [%clk 01:44:59] [%emt 00:01:57] } 8...c6 { [%clk 01:31:16] [%emt 00:00:12] } 9.Rc1 { [%clk 01:42:10] [%emt 00:03:04] [%emt 00:03:04] } 9...a5 { [%clk 01:28:15] [%emt 00:03:16] } 10.Bf4 { [%clk 01:37:09] [%emt 00:05:16] } 10...Nh5 { [%clk 01:25:36] [%emt 00:02:54] } 11.Be3 { [%clk 01:34:26] [%emt 00:02:59] } ( 11.Bd2 Nhf6 12.Bf4 Nh5 13.Bd2 Nhf6 14.a4 h6 15.Be1 b6 16.cxd5 cxd5 17.Nc3 Bb7 18.Nb5 Rc8 19.Qd1 Rxc1 20.Rxc1 Qb8 21.Bd2 Rc8 22.Bf4 Rxc1 23.Qxc1 Qc8 24.Qxc8+ Bxc8 25.Ne5 Nxe5 26.Bxe5 Ne8 27.e3 Bd7 $10 ) 11...h6 { [%clk 01:22:09] [%emt 00:03:42] } 12.Nbd2 { [%clk 01:29:08] [%emt 00:05:33] } 12...Nhf6 { [%clk 01:19:38] [%emt 00:02:45] } 13.Bf4 { [%clk 01:29:22] [%emt 00:00:02] } 13...Nh5 { [%clk 01:17:53] [%emt 00:02:00] } 14.e3 { [%clk 01:29:34] [%emt 00:00:04] } 14...g5 { [%clk 01:16:10] [%emt 00:01:58] } 15.Be5 { [%clk 01:27:29] [%emt 00:02:20] } 15...f6 $2 { [%clk 01:16:14] [%emt 00:00:09] } 16.cxd5 { [%clk 01:24:11] [%emt 00:03:34] } 16...exd5 { [%clk 01:14:32] [%emt 00:01:57] } 17.Bc7 $1 { [%clk 01:22:14] [%emt 00:02:12] } 17...Qxc7 { [%clk 01:12:44] [%emt 00:02:02] } 18.Qg6+ { [%clk 01:21:14] [%emt 00:01:16] } 18...Ng7 { [%clk 01:11:07] [%emt 00:01:52] } 19.Nxg5 $1 { [%clk 01:21:25] [%emt 00:00:04] } 19...fxg5 { [%clk 01:10:28] [%emt 00:00:52] } 20.Bxd5+ $1 { [%clk 01:20:42] [%emt 00:01:00] } 20...cxd5 { [%clk 01:10:34] [%emt 00:00:08] } ( 20...Rf7 21.Qxf7+ Kh7 22.Qg8+ Kg6 23.Bf7+ Kf6 24.Ne4+ Kf5 25.Qh7+ Kg4 26.Kg2 ) 21.Rxc7 { [%clk 01:20:54] [%emt 00:00:03] } 21...Bd8 { [%clk 01:10:37] [%emt 00:00:12] } 22.Rac1 { [%clk 01:21:07] [%emt 00:00:03] } 22...Bxc7 { [%clk 01:10:43] [%emt 00:00:08] } 23.Rxc7 { [%clk 01:21:01] [%emt 00:00:22] } 23...Rf6 { [%clk 01:10:46] [%emt 00:00:12] } 24.Qc2 { [%clk 01:17:38] [%emt 00:03:38] } 24...Nb6 { [%clk 01:10:46] [%emt 00:00:14] } 25.Qc5 { [%clk 01:17:51] [%emt 00:00:03] } 25...Bd7 { [%clk 01:09:01] [%emt 00:02:00] } 26.Rxb7 { [%clk 01:18:03] [%emt 00:00:03] } 26...Rc6 { [%clk 01:06:30] [%emt 00:02:46] } 27.Qa3 { [%clk 01:13:52] [%emt 00:04:26] } 27...Ne8 $2 { [%clk 01:06:33] [%emt 00:00:12] } 28.Qd3 { [%clk 01:14:04] [%emt 00:00:03] } 28...Rac8 { [%clk 01:03:53] [%emt 00:02:54] } 29.Nb3 { [%clk 01:14:16] [%emt 00:00:04] } 29...Ng7 { [%clk 01:02:16] [%emt 00:01:52] } 30.Nc5 { [%clk 01:11:18] [%emt 00:03:13] } 30...Bh3 { [%clk 01:01:33] [%emt 00:00:57] } 31.e4 { [%clk 01:10:19] [%emt 00:01:15] } 31...h5 $2 { [%clk 01:01:38] [%emt 00:00:09] } 32.Qb3 { [%clk 01:05:34] [%emt 00:05:00] } 32...a4 { [%clk 00:59:14] [%emt 00:02:39] } 33.Qb5 { [%clk 01:05:47] [%emt 00:00:02] } 33...Ne6 { [%clk 00:57:24] [%emt 00:02:05] } 34.Rxb6 { [%clk 01:05:57] [%emt 00:00:06] } 34...Nxd4 { [%clk 00:56:15] [%emt 00:01:23] } 35.Qa6 { [%clk 01:06:09] [%emt 00:00:03] } 35...dxe4 { [%clk 00:55:12] [%emt 00:01:18] } 36.Rxc6 { [%clk 01:06:21] [%emt 00:00:03] } 36...Rxc6 { [%clk 00:54:51] [%emt 00:00:36] } 37.Qxa4 { [%clk 01:05:39] [%emt 00:00:57] } 37...Nf3+ { [%clk 00:54:57] [%emt 00:00:09] } 38.Kh1 { [%clk 01:05:51] [%emt 00:00:03] } 38...Ne5 { [%clk 00:54:28] [%emt 00:00:44] } 39.Nb3 { [%clk 01:02:14] [%emt 00:03:53] } 39...e3 { [%clk 00:52:35] [%emt 00:02:08] } 40.fxe3 { [%clk 01:02:26] [%emt 00:00:03] } 40...Kf7 { [%clk 00:50:04] [%emt 00:02:46] } 41.Qe4 { [%clk 01:00:40] [%emt 00:02:01] } 41...Rf6 { [%clk 00:49:34] [%emt 00:00:43] } 42.Qh7+ { [%clk 01:00:51] [%emt 00:00:05] } 42...Kf8 { [%clk 00:47:33] [%emt 00:02:16] } 43.Nd2 { [%clk 01:01:02] [%emt 00:00:05] } 43...Ng4 { [%clk 00:46:04] [%emt 00:01:44] } 44.Qxh5 { [%clk 01:01:13] [%emt 00:00:04] } 44...Rc6 { [%clk 00:44:45] [%emt 00:01:34] } 45.Qh8+ { [%clk 01:01:20] [%emt 00:00:09] } 45...Ke7 { [%clk 00:43:52] [%emt 00:01:08] } 46.Qh7+ { [%clk 01:01:32] [%emt 00:00:03] } 46...Kd8 { [%clk 00:42:00] [%emt 00:02:06] } 47.Qb1 { [%clk 01:01:44] [%emt 00:00:04] } 47...Rf6 { [%clk 00:39:42] [%emt 00:02:32] } 48.Qd3+ { [%clk 01:00:18] [%emt 00:01:42] } 48...Kc7 { [%clk 00:37:34] [%emt 00:02:22] } 49.Qh7+ { [%clk 00:59:12] [%emt 00:01:21] } 49...Kb6 { [%clk 00:36:01] [%emt 00:01:49] } 50.Kg1 { [%clk 00:57:37] [%emt 00:01:50] } 50...Rh6 { [%clk 00:36:07] [%emt 00:00:09] } 51.Nc4+ { [%clk 00:57:49] [%emt 00:00:03] } 51...Kc5 { [%clk 00:34:37] [%emt 00:01:45] } 52.Qc7+ { [%clk 00:51:34] [%emt 00:06:30] } 52...Kd5 { [%clk 00:34:44] [%emt 00:00:07] } 53.Qf7+ { [%clk 00:51:46] [%emt 00:00:04] } 1-0[/pgn]

An obvious improvement for future competitions without betraying their "zero knowledge" principles would be to construct their own opening book from self-play, simply to avoid losing time on the clock during the opening.
jdart
Posts: 4366
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: how will Leela fare at the WCCC?

Post by jdart »

IanO wrote: Thu Jul 19, 2018 10:41 pmIs this a well-known trap in the Catalan?
No. It looks like 9. Rc1 was Johnny's first move out of book, and that is a very rare move (normal is 9. Rd1 or 9. Bf4). So book knowledge would not have helped Leela here.

13. .. Nh5 looks bad. Stockfish prefers 13. .. g5. And 15. .. f6? was also bad, but Black is gaining material, so it is easy to see how this is tempting.

--Jon
Last edited by jdart on Fri Jul 20, 2018 12:06 am, edited 1 time in total.
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: how will Leela fare at the WCCC?

Post by yanquis1972 »

pretty sure its just a straight up blunder, leela can occasionally recover brilliantly from them. if there was no book, it seems to me leela did awfully well in the opening.
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: how will Leela fare at the WCCC?

Post by bob »

one famous one was a limit on number of processors, were the limit was completely arbitrary and announced at the last minute. Never understood that and it was eliminated the next year...