Not so fast.
Now I see that Leela Go Zero is stupid too. Top Go pros are stupid, Leela Go is stupid, only I am smart.
I thought that setting komi (KM) in the SGF file is enough to make Leela play with desired komi. Wrong! Leela engine doesn't support komi setting, it is designed with fixed komi 7.5 and no handicap. Not only that, all the networks are trained to play well only with this komi of 7.5 and no handicap. Again, like in Leela Chess, the engine and the weights are very specific in what they do well. Traditional MCTS Go engines had no problems dealing with various komi values and various handicaps. This specialization of NN-approach (DCNN) is really annoying, as it surely won't bring us closer to human-like abstraction and adaptation.
I took the pre komi era "The Game of the Century" between Honinbo Shusai (white) and Go Seigen (black), which lasted for about 100 days (!!!) in the years 1933-34. Shusai was the master of the Go world, as he was the head of Honinbo Go school, the most prestigious of the schools founded at the behest of Shōgun Tokugawa Ieyasu at the start of the 17th century. Go Seigen was famed as a prodigy, first among a generation of young new brilliant players, and would go on to become the most celebrated player of the 20th century. So, no komi, and the favorite (master) Shushai takes white as a favor to the candidate Seigen (black).
The SGF of the game is here:
Code: Select all
(;
PB[Go Seigen]
BR[5d]
PW[Honinbo Shusai]
WR[Meijin]
RE[W+2]
DT[1933-10-16..1934-01-29]KM[0]
SZ[19];
B[qc];W[cd];B[dp];W[pq];B[jj];W[pd];B[qd];W[pe];B[ob];W[qn];B[jp];W[lq];B[dj];W[ed];B[lo];W[nq];B[kq];W[lp];B[ko];W[ch];B[gj];W[fq];B[fo];W[iq];B[gp];W[cq];B[cp];W[dq];B[nd];W[ph];B[pj];W[ne];B[me];W[mf];B[nf];W[ng];B[oe];W[of];B[ne];W[nj];B[om];W[mg];B[ke];W[hc];B[qm];W[rm];B[rn];W[rl];B[ro];W[pm];B[ql];W[qk];B[pl];W[pn];B[pk];W[qj];B[nl];W[pi];B[qp];W[on];B[nn];W[no];B[mo];W[op];B[qr];W[qq];B[rq];W[pr];B[rr];W[mn];B[nm];W[lm];B[ll];W[kp];B[mp];W[mq];B[ip];W[jq];B[kk];W[cn];B[ep];W[cj];B[ck];W[dk];B[cl];W[dl];B[ci];W[bj];B[bi];W[di];B[ej];W[bh];B[dm];W[ei];B[fj];W[cm];B[ak];W[ai];B[el];W[bp];B[rf];W[co];B[qg];W[rh];B[jc];W[gq];B[eq];W[en];B[fn];W[er];B[fr];W[dr];B[hq];W[hr];B[hp];W[gr];B[fc];W[ic];B[dc];W[cc];B[gd];W[he];B[ge];W[je];B[hd];W[id];B[hf];W[kd];B[le];W[kc];B[og];W[oh];B[pg];W[em];B[ek];W[fm];B[gm];W[mb];B[cb];W[ec];B[eb];W[dd];B[db];W[gb];B[bc];W[bd];B[bb];W[nb];B[oa];W[fb];B[ea];W[gh];B[jf];W[ie];B[ff];W[hi];B[hg];W[eo];B[fp];W[hl];B[il];W[jh];B[fh];W[fi];B[hj];W[if];B[ih];W[ii];B[ig];W[jg];B[ji];W[fg];B[kf];W[ij];B[ik];W[hh];B[gf];W[mk];B[df];W[ml];B[sm];W[sk];B[mm];W[dg];B[li];W[ol];B[ln];W[nk];B[km];W[fl];B[gl];W[oj];B[qh];W[ri];B[cf];W[ef];B[gi];W[eh];B[ee];W[eg];B[de];W[bf];B[bq];W[br];B[ps];W[os];B[qs];W[oq];B[bo];W[aq];B[an];W[bn];B[am];W[ao];B[rg];W[mi];B[qi];W[lh];B[kh];W[lj];B[rj];W[rk];B[sh];W[sj];B[bg];W[ae];B[cg];W[ag];B[fe];W[gc];B[fd];W[ce];B[kg];W[mc];B[ki];W[fk];B[ld];W[lc];B[gk];W[bk];B[bl];W[na];B[nc];W[gg];B[fa];W[ga];B[ac];W[ad];B[lg];W[mh];B[qo];W[lk])
Do they plan in some future to train on komi 0 self-games?
Do they plan in some future to train using not the winning probability as the goal but the number of stones at the end of the game? This will automatically make the nets universal to various komi (but not to various handicaps). Yes, the resulting nets would be a bit weaker as winning probability goes, but for the sake of some generality, this effort seems worth taking.
I will post two crucial moves of the game the modified Leela with the latest weights misses in >1 million playouts, but after I make the moves, the eval slowly, steadily soars.