Something goes wrong with lc0 since yesterday?

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Something goes wrong with lc0 since yesterday?

Post by Laskos »

Uri Blass wrote: Fri Jun 29, 2018 11:09 pm
Laskos wrote: Fri Jun 29, 2018 10:47 pm
Laskos wrote: Fri Jun 29, 2018 8:52 pm They do seem to suffer from some Elo rating inflation.
Against one AB engine, Predateur 2.2.1, the performances are (in 200 games):

ID10004
shown: 1500
CCRL: 1300-1350

ID10005
shown: 1900
CCRL: about 1500

Still, for only 5th net, a very strong performance.
ID10006 seems to have seriously improved, in agreement to their reported improvement in self-games, but only 60 games as of now.

ID10006
shown: 2100
CCRL: about 1700

Pretty remarkable for 6th net.

Edit: to repeat what this "CCRL" rating means --- on GTX 1060 GPU at 40/4' time control against an AB engine rated on CCRL 40/4', playing on one i7 core at same 40/4' time control. Also, for now against only one engine, so some skewness might appear, although Leela is so different that it doesn't care much.
Is this better than other 6th net?

from their graph

http://testserver.lczero.org/?full_elo=1

ID10006 rating 2090.85
ID 9006 rating 2472.17
ID 4006 rating 2440.85
Will have to see, I was not testing such recent lc0 weak nets, only the initial Leela project weak nets.
Ron Langeveld
Posts: 140
Joined: Tue Jan 05, 2010 8:02 pm

Re: Something goes wrong with lc0 since yesterday?

Post by Ron Langeveld »

Uri Blass wrote: Fri Jun 29, 2018 11:09 pm Is this better than other 6th net?

from their graph

http://testserver.lczero.org/?full_elo=1

ID10006 rating 2090.85
ID 9006 rating 2472.17
ID 4006 rating 2440.85
The 20x256 nets are progressing slow in more than one way, not only in producing 2 nets each day.
Iteration 6 (id10006) scores 24,8% on the 1500 position STS test.
Compared to for example iteration 9 of run 4 with the smaller 6x64 net (id4009) that scored 57,7%
this indicates that it is going to take much more iterations (nets) than I expected to get somewhere near the strength of current 15x192 nets like id395.
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Something goes wrong with lc0 since yesterday?

Post by yanquis1972 »

how much time/position? i'm curious what happens (if feasible) if you increase x10.
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Something goes wrong with lc0 since yesterday?

Post by yanquis1972 »

this may be the best game i've witnessed from the 'cleaned' mainserver net during my test matches; i think it's one of those that gives a glimpse of end-result potential:

[pgn]
[Event "Lc0 id452 vs SF5-1CPU 3min + 4s/move"]
[Site "PC"]
[Date "2018.06.29"]
[Round "13"]
[White "Lc0"]
[Black "Stockfish 5-1CPU"]
[Result "1-0"]
[BlackElo "3244"]
[ECO "A87"]
[Opening "Dutch"]
[Time "19:00:43"]
[Variation "Leningrad, Main Line, 7.Nc3 Qe8 8.d5 Na6"]
[WhiteElo "3275"]
[TimeControl "180+4"]
[Termination "adjudication"]
[PlyCount "128"]
[WhiteType "program"]
[BlackType "program"]

1. d4 f5 2. g3 Nf6 3. Bg2 g6 4. Nf3 Bg7 5. O-O O-O 6. c4 d6 7. Nc3 Qe8 8.
d5 Na6 (Na6 Be3 c6 b3 Bd7 Rc1 Nc5 Ne5 dxe5 Bxc5 e4 Be3 Ng4 Bf4 e5 Bg5 h6
Bd2 Qe7 h3 Nf6) {-0.29/20 7} 9. Nd4 (Nd4 Bd7 Rb1 c6 b4 Rc8 dxc6 bxc6 b5
cxb5 cxb5 Rxc3 bxa6 Ne4 Rb7 Qc8 Bb2 Rc4 Rxa7) {+0.51/2 10} Bd7 (Bd7 Bg5 c6
Rc1 Nc7 b4 cxd5 cxd5 Qf7 e3 Rac8 Bxf6 Bxf6 a3 Bxd4 Qxd4 Nb5 Nxb5 Bxb5)
{-0.20/19 6} 10. Rb1 (Rb1 c6 b3 Nc7 Bb2 c5 Ne6 Nxe6 dxe6 Bxe6 Bxb7 Rb8 Bg2
Qf7 Qd2 Bd7 Rbd1 a5 Rfe1) {+0.42/2 16} c6 (c6 Bg5 Rc8 b3 Nc5 Bxf6 Bxf6 b4
Na6 e3 Nc7 Qd3 Bg7 a3 cxd5 Nxd5 Ne6 Nc3 Nxd4 exd4) {-0.16/21 19} 11. Bg5
(Bg5 Rc8 Bxf6 Bxf6 e4 cxd5 cxd5 Rc4 Ne6 Bxe6 dxe6 Bxc3 bxc3 fxe4 Rxb7 Nc5
Rxa7 Rf5 Bh3 Re5 Qd2 Qf8) {+0.39/2 13} Rc8 (Rc8 b3 Nc7 a4 Ng4 e4 h6 Bc1
fxe4 Bxe4 Nf6 dxc6 bxc6 Bg2 Ng4) {-0.10/20 4} 12. Qd2 (Qd2 Qf7 Bxf6 Qxf6 e3
Kh8 Rbd1 Nc5 b4 Na6 dxc6 bxc6 b5 cxb5 cxb5 Nc5 a4 e5 Nc6) {+0.39/2 12} Nc7
(Nc7 a4 a6 a5 Ng4 Bf4 cxd5 cxd5 Qf7 Rbd1 Nf6 Nf3 Ng4 h3 Nf6 Ng5 Qe8 Be3 Kh8
Rc1 h6 Nf3 Ne4 Nxe4 fxe4 Nh4) {-0.11/22 12} 13. b3 (b3 Kh8 Rbc1 c5 Bxf6
Bxf6 Nf3 b5 e4 b4 Ne2 fxe4 Ng5 Bxg5 Qxg5 e6 dxe6 Nxe6 Qd2 Bc6 Qxd6 Ng5
Qxc5) {+0.43/2 8} c5 (c5 Ne6 Bxe6 dxe6 Rb8 Nd5 Nxe6 Nxf6 exf6 Be3 Qf7 Bd5
Rbd8 Rfd1 Rfe8 b4 b6 Bc6 Re7 b5 Rc7 Bf4 Nxf4 Qxf4 Qe7 e4 fxe4 Bd5)
{-0.09/23 7} 14. Ne6 (Ne6 Bxe6 dxe6 b6 Nd5 Nxe6 Nxf6 exf6 Be3 Rd8 Qd3 Kh8
Rbd1 Qd7 Bc1 Rfe8 e3 Ng5 Bb2 Ne4) {+0.38/2 9} Bxe6 (Bxe6 dxe6 b6 Nd5 Nxe6
Nxf6 exf6 Be3 Rd8 Rfd1 Kh8 Rbc1 Ng5 Bd5 Nf7 f4 Qe7 Rc3 Nh6 h3 Qd7 Rd3 Rfe8
Bf2 Nf7 Re3) {-0.10/25 7} 15. dxe6 (dxe6 b6 Nd5 Nxe6 Nxf6 exf6 Be3 Rd8 Qd3
Kh8 Rbd1 Qe7 Bc1 f4 gxf4 f5 e3 g5 fxg5 Nxg5 Kh1 Ne4) {+0.40/2 6} b6 (b6 Nd5
Nxe6 Nxf6 exf6 Be3 Rd8 Rfd1 Ng5 Rbc1 Nf7 Qd5 Kh8 Bd2 Qe7 f4 Rfe8 Re1 Qd7
Qd3 a6 Bc3 b5 cxb5 Qxb5 Qd5 Re7 e4) {-0.11/25 8} 16. Nd5 (Nd5 Nxe6 Nxf6
exf6 Be3 Rd8 Qd3 Kh8 Rbd1 Ng5 Bc1 Nf7 Bb2 Qe7 Qc2 Ng5 e3 Nf7) {+0.43/2 6}
Nxe6 (Nxe6 Nxf6 exf6 Be3 Rd8 Rbd1 Kh8 Qc1 Qe7 Rd3 Ng5 Rfd1 Ne4 Rd5 Rfe8
Bxe4 fxe4 Bf4 f5) {-0.18/25 9} 17. Nxf6+ (Nxf6 exf6 Be3 Rd8 Qd3 h5 Rbd1 Kh7
Bc1 Qd7 e3 Ng5 Bb2 Rfe8 Rd2 Ne4 Rdd1) {+0.44/2 4} exf6 (exf6 Be3 Rd8 Rbd1
Kh8 Qc1 Qe7 Rd3 Ng5 Rfd1 Ne4 Rd5 Rfe8 Bxe4 fxe4 Bf4 f5) {-0.18/25 4} 18.
Be3 (Be3 Rd8 Qd3 h5 Rbd1 Kh7 Bc1 Qd7 e3 Ng5 Bb2 Rfe8 Rd2 Ne4 Rdd1) {+0.45/2
3} Rd8 (Rd8 Rbd1 Kh8 Rfe1 Rf7 Qc1 Re7 Rd5 Red7 Red1 Ng5 h4 Nf7 h5 Ne5 hxg6
hxg6 Bd2 Kg8 Bc3 Qe6 Qc2 Re8) {-0.25/24 42} 19. Qd3 (Qd3 h5 Rbd1 Kh7 Rfe1
Qd7 Bc1 Rfe8 h4 Nd4 Bb2 Nc6 Bc3 Ne5) {+0.46/2 5} Kh8 (Kh8 Rbd1 Ng5 Bf4 Nf7
Bd2 Ne5 Qc2 Qd7 f4 Ng4 h3 Nh6 Qd3 Rde8 e3 Nf7 Bc3 Re7 Rfe1 Rfe8 Bd5 Nd8)
{-0.16/23 4} 20. Rbd1 (Rbd1 Ng5 Bc1 Rf7 Bd5 Re7 e3 Nf7 Bb2 Ne5 Qc2 Nf7 h4
Ne5 Kg2) {+0.50/2 9} Ng5 (Ng5 Bf4 Nf7 Bd2 Ne5 Qc2 Qd7 f4 Ng4 h3 Nh6 Bc3 a6
Rfe1 b5 a3 Rfe8 e3 bxc4 bxc4 Rb8 e4 fxe4) {-0.14/24 7} 21. Bc1 (Bc1 Qd7
Rfe1 Rfe8 Bd5 Nf7 Qc2 Ne5 Bg2 Nc6 Bb2 Ne5) {+0.50/2 10} Rf7 (Rf7 Bd5 Re7
Rfe1 a6 a4 Qd7 e3 Rde8 Rf1 Rd8 Bb2 Nf7 f4 Nh6 Rfe1 Rde8 h3 Rf8 Kg2 Rd8 Bc3
Rde8 Re2 Nf7 e4 fxe4 Bxe4) {-0.21/23 8} 22. Bd5 (Bd5 Re7 e3 h5 Rfe1 Nf7 f4
Nh6 Bb2 Kh7 h3 Ng8 e4 Nh6 Bc3) {+0.52/2 9} Re7 (Re7 Rfe1 Qd7 e3 Nf7 f4 a6
Bd2 Nh6 a4 Rb8 Bc3 Rbe8 h3 Nf7 Kg2 Nh6) {-0.24/24 4} 23. h4 (h4 Nf7 h5 Ne5
Qc2 Ng4 hxg6 hxg6 e3 Bh6 Kg2 Qd7 Rh1 Kg7 Rh3 Rh8 Rdh1 Ree8 Bb2 b5 cxb5 Qxb5
Rh4 Qd7 e4 fxe4) {+0.74/2 12} Nf7 (Nf7 h5 g5 Qxf5 Nh6 Qf3 g4 Qd3 Qxh5 Bf4
f5 Rfe1 Nf7 Bxf7 Rxf7) {-0.27/21 6} 24. h5 (h5 Ne5 Qc2 Ng4 hxg6 hxg6 e3 Bh6
Kg2 Qd7 Rh1 Kg7 Rh3 Rh8 Rdh1 Ree8 Qe2 Qe7 Bc6 Rc8 Bd5 Rce8 Bb2 Qd7 Rh4 g5
R4h3 Kg6 e4) {+0.72/2 5} g5 (g5 Qxf5 Rxe2 Bd2 Nh6 Qf3 g4 Qd3 Re5 Kg2 Qd7
Bf4 Rxh5 Rh1 Rh3 Rde1 Nf7 Be6 Qb7 Qd5 Qxd5 Bxd5 Rxh1 Rxh1 Ng5 Rh4 Nh3 Rxg4
f5 Rh4 Nxf4 Rxf4 Rf8 Be6 Bd4 Rxf5) {-0.29/25 15} 25. Qxf5 (Qxf5 Nh6 Qf3 g4
Qh1 Rxe2 Kg2 Qd7 Rfe1 Rde8 Rxe2 Rxe2 Re1 Qe8 Rxe2 Qxe2 Bf4 Bf8 Qb1 Qe8 Qh1)
{+0.90/2 8} Rxe2 (Rxe2 Bd2 Re5 Qf3 Re7 Rde1 Ne5 Qf5 Qd7 Qxd7 Rdxd7 Rd1 h6
Kg2 a6 f4 gxf4 Rxf4 b5 cxb5 axb5 a4 b4 Rff1) {-0.33/25 12} 26. Kg2 (Kg2 Re5
Qb1 Re2 Bb2 Qd7 Rde1 Rxe1 Rxe1 Ne5 Be4 h6 Rd1 Qe8 Bxe5 Qxe5) {+1.09/2 8}
Nh6 (Nh6 Qf3 Rxa2 Rfe1 Qd7 Re6 Rf8 Rd2 Rxd2 Bxd2 Ng8 Bc3 h6 Qe3 Rf7 Re8 Rf8
Rxf8 Bxf8 Qd3 Ne7 Bxf6 Bg7 Bxg7 Kxg7 Qc3 Kh7 Qf6 Nxd5 Qg6 Kh8 Qxh6 Kg8
cxd5) {-0.34/23 7} 27. Qf3 (Qf3 Re5 Bb2 g4 Qd3 f5 Rh1 Re2 Bc1 Bd4 Rhf1 Ng8
Bg5 Rb8 Qxf5 Qxh5 Rxd4 cxd4 Rh1 Rxf2 Kxf2 Qxh1) {+1.09/2 8} Rxa2 (Rxa2 Rfe1
Qd7 Re6 Re8 Rde1 Rf8 Kg1 Ra1 Kf1 Qd8 Qe2 f5 Re8 Rxe8 Qxe8 Qxe8 Rxe8 Bf8 Re1
Bg7 Bxg5 Rxe1 Kxe1 Ng4 Be6 Ne5 Ke2 Nc6 Be3 Ba1 Kf3 Nd4 Bxd4) {-0.31/25 6}
28. Rde1 (Rde1 Qd7 Re6 Rf8 Rfe1 Qc8 Kg1 Qd7 Kg2 Qc8 R1e2 Rxe2 Qxe2 Nf7 Re7
Ne5 f4 gxf4 Bxf4 Re8) {+1.95/2 13} Qd7 (Qd7 Re6 Re8 Rfe1 Rf8 R1e2 Rxe2 Qxe2
Ng8 Bb2 Qd8 g4 a6 Bc6 Qc7 Be4 b5 Bc2 bxc4 Qxc4 f5 Bxg7 Qxg7 Bxf5 Nh6 Rxd6
Nxf5 gxf5 Qb7 Qd5) {-0.42/24 12} 29. Re6 (Re6 Rf8 Rfe1 Qc8 Bb7 Qd7 Bc6 Qc8
Bd5 Qd7 Kg1 Qc8 Qd3 Ng4 Qf5 Ne5 h6 Bxh6 Be4 Qd7) {+1.94/2 4} a5 (a5 Qd3 a4
Qb1 axb3 Qxb3 Ra6 Rfe1 Rf8 Qb1 Ng8 R1e2 Nh6 Bb2 Ng8 Qd3 Ra7 Bc3 Ra3 Qd2 Ra7
Bf3 Rd8 Qd5 b5 cxb5) {-0.74/24 22} 30. Qe4 (Qe4 f5 Qb1 Ra1 Qc2 Rxc1 Rxc1
Rf8 Rce1 Ng8 Qe2 Be5 h6 Re8 Rxe8 Qxe8 Bxg8 Kxg8 Qf3 Qe6 Qa8 Kf7 Qb7 Kg6 f4
gxf4 gxf4 Kxh6 fxe5 Qg6 Kf2) {+2.46/2 10} f5 (f5 Qb1 Ra1 Qd3 Rxc1 Rxc1 Rf8
Rce1 Ng8 h6 Bxh6 Rh1 Bg7 Rg6 Ne7 Rxg5 Bd4 Bf3 Rg8 Rxg8 Kxg8 Qe2 Kh8 Qd2 Ng8
Rh5 Nf6 Qh6 Qg7 Qxg7 Kxg7 Rg5 Kh6 Rxf5) {-0.98/24 6} 31. Qb1 (Qb1 Ra1 Qc2
Rxc1 Rxc1 Rf8 Qe2 Ng4 Re7 Qc8 Qe6 Qxe6 Bxe6 Bd4 Rd1 Rf6 Rd2 Ne5 f4 gxf4
gxf4 Nc6 Re8 Kg7 Re2 Kh6 Bd7 Nb4 R2e7) {+2.51/2 5} Ra1 (Ra1 Qd3 Rxc1 Rxc1
Rf8 Rce1 f4 Qe4 Nf5 Bc6 Qc7 Re8 Qf7 Bd5 Qf6 Qe6 Qxe6 R1xe6 fxg3 fxg3 g4
Rxf8 Bxf8 Re8 Kg7 Rb8 Ne3 Kf2 Nxd5 cxd5) {-1.15/27 6} 32. Qc2 (Qc2 Rxc1
Rxc1 Rf8 Qe2 Ng4 Re7 Qc8 Bb7 Qd8 Qe6 Ne5 Bd5 h6 Rd1 f4 Be4 f3 Kg1 Rf6 Re8
Qxe8 Qxe8 Bf8) {+2.69/2 4} Rxc1 (Rxc1 Qxc1 f4 gxf4 gxf4 Qxf4 Rg8 Kh1 Be5
Qxh6 Qd8 Rf6 Bxf6 Bxg8 Kxg8 Rg1 Kh8 Rg2 Qe7 Qf4 Bd4 Qf5 Qe1 Rg1 Qe8)
{-1.33/25 6} 33. Rxc1 (Rxc1 Rf8 Qe2 Ng4 Re7 Qc8 Bb7 Qb8 Qe6 Bf6 Rf7 Rxf7
Qxf7 Bg7 Bf3 Nh6 Qd7 g4 Bd5 Qf8 Re1 Be5 Qa7 f4 gxf4 Qxf4) {+2.74/2 3} Rf8
(Rf8 Rce1 Ng8 Qd2 f4 g4 Be5 R1xe5 dxe5 Qc3 Qg7 Qxe5 Qxe5 Rxe5 h6 Bxg8 Rxg8
Re6 Kh7 Rxb6 Ra8 Rb5 a4 bxa4 Rxa4 Rxc5 Rb4) {-1.03/22 5} 34. Qe2 (Qe2 Ng8
h6 Be5 Qh5 Qd8 Re1 g4 Rd1 Bd4 Rde1 Be5 Kf1 Ne7 R1xe5 dxe5 Qg5 Ng6 Qxd8 Rxd8
Rxb6 Ne7 Be6) {+2.79/2 4} f4 (f4 Re1 Nf5 h6 Nxh6 Qh5 Ng8 Qxg5 Bc3 R1e4 fxg3
fxg3 Be5 R4xe5 dxe5 Qxe5 Qg7 Qxg7 Kxg7 Rxb6) {-1.07/23 7} 35. Re1 (Re1 Nf5
h6 Nxh6 Qh5 Ng8 Re8 fxg3 fxg3 Nf6 Rxf8 Bxf8 Qxg5 Qg7 Qf5 Qg6 Qxg6 hxg6 Bc6
Kg7 Kf3 Kf7 g4 Bh6 Bd5 Nxd5 cxd5 b5) {+2.91/2 8} Nf5 (Nf5 h6 Nxh6 Qh5 Ng8
Re8 fxg3 Rxf8 Bxf8 Qxg5 Qg7 Qxg3 Nf6 Qxg7 Kxg7 Be6 Ne8 Bf5 Nc7 Rh1 h6 Kf3
Kf6) {-0.85/25 3} 36. h6 (h6 Nxh6 Qh5 Ng8 Re8 fxg3 fxg3 Nf6 Rxf8 Bxf8 Qxg5
Qg7 Qf5 Qg6 Qxg6 hxg6 Bc6 Kg7 Kf3 Kf7 g4 Bh6 Bd5 Nxd5 cxd5 b5 Ra1) {+2.85/2
5} Nxh6 (Nxh6 Qh5 Ng8 Qxg5 Be5 R1xe5 dxe5 Qxe5 Qg7 Qxg7 Kxg7 Rxb6 fxg3 Kxg3
Ne7 Be4 Nf5 Bxf5 Rxf5 f4 Rf6 Rb5 Re6 Rxa5 Re3) {-1.11/25 7} 37. Qh5 (Qh5
Ng8 Re8 fxg3 fxg3 Nf6 Rxf8 Bxf8 Qxg5 Qg7 Qf5 Qg6 Be4 Kg7 Bd3 Qxf5 Bxf5 h6
g4 Kf7 Kf3 Ne8 Be6 Kg7 Bd5 Nf6) {+2.99/2 6} Ng8 (Ng8 Qxg5 Be5 R1xe5 dxe5
Qxe5 Qg7 Qxg7 Kxg7 Rxb6 fxg3 Kxg3 h5 Rb5 Ne7 Be4 h4 Kg2 h3 Kg3 Nf5 Bxf5
Rxf5 Kxh3 Rxf2 Kg4 Rb2 Kf5 Kf7 Ke5 a4 bxa4 Rb4 Rxc5 Rxa4) {-1.19/26 7} 38.
Re8 (Re8 fxg3 fxg3 Nf6 Rxf8 Bxf8 Qxg5 Qg7 Qf5 Qg6 Be4 Kg7 Bd3 Qxf5 Bxf5 h6
g4 Ng8 Re8 Ne7 Rb8 d5 Rxb6 dxc4 bxc4 Nxf5) {+3.04/2 3} fxg3 (fxg3 fxg3 Nf6
Rxf8 Bxf8 Qxg5 Qd8 Re6 Be7 Bf3 Qf8 Qe3 Bd8 g4 h6 g5 hxg5 Qxg5 Qg7 Qxg7 Kxg7
Rxd6 Bc7 Re6 Kg6 Be4 Kf7 Rc6 Nxe4 Rxc7 Ke6 Rb7 Ke5 Rxb6) {-1.51/24 5} 39.
fxg3 (fxg3 Nf6 Rxf8 Bxf8 Qxg5 Qg7 Qf5 Qg6 Be4 Kg7 Bd3 Qxf5 Bxf5 h5 Kh3 Kf7
Kh4 Be7 Kg5 Ne4 Kf4 Nd2 Be6 Kf6 Bd5 Nxb3 Re6) {+3.06/2 3} Nf6 (Nf6 Rxf8
Bxf8 Qxg5 Qg7 Qf5 Qg6 Qc8 Kg7 Qb7 Kh8 Rf1 Qg7 Qb8 Qe7 Rf2 Nd7 Qa8 Nf6 Bf3
Kg7 Qb8 Nd7 Qc8 h6) {-1.45/26 9} 40. Rxf8+ (Rxf8 Bxf8 Qxg5 Qg7 Qf5 Qg6 Be4
Kg7 Bd3 Qxf5 Bxf5 h5 Kh3 Kf7 Kh4 Be7 Kg5 Ne4 Kf4 Nd2 Be6 Kf6 Bd5 Nxb3 Re6
Kf7) {+3.07/2 2} Bxf8 (Bxf8 Qxg5 Qg7 Qf5 Qg6 Qc8 Kg7 Qb7 Kh8 Rf1 Qg7 Qc8
Qe7 Re1 Qg7 Bf3 h5 Rh1 Kg8 Qf5 Qe7 Rh4 Qe5 Qg6 Bg7 Rf4 Qb2 Kh3 Qe5 Rf5 Qe7
Bd5 Nxd5 cxd5 h4) {-1.67/27 5} 41. Qxg5 (Qxg5 Qg7 Qf5 Qg6 Be4 Kg7 Bd3 Qxf5
Bxf5 h5 Kh3 Kf7 Kh4 Be7 Kg5 Ne4 Kf4 Nd2 Be6 Kf6 Bd5 Nxb3 Re6 Kf7) {+3.12/2
1} Qg7 (Qg7 Qf5 Qg6 Qc8 Kg7 Qb7 Kh8 Rf1 Qg7 Qc8 h5 Qf5 Be7 Rf4 Bd8 Bf3 Qh7
Qc8 Qg8 Qb8 Qf8 Bxh5 Qe7 Bg6 Kg7 Bd3 d5 Qa8 dxc4 bxc4 Qd7 Qf3 Kg8 Rh4)
{-1.75/27 5} 42. Qf5 (Qf5 Qg6 Be4 Kg7 Bd3 Qxf5 Bxf5 h5 Kh3 Kf7 Kh4 Be7 Kg5
d5 Bg6 Kf8 Kf5 dxc4 bxc4 Bd8 Rd1 Be7 Ke6) {+3.11/2 2} Qg6 (Qg6 Qc8 Kg7 Qb7
Kh8 Rf1 Qg7 Qc8 h5 Qf5 Be7 Rf4 Bd8 Bf3 Qh7 Qc8 Qg8 Qb8 Qf8 Bxh5 Qe7 Bg6 Kg7
Bd3 d5 Qa8 dxc4 bxc4 Qd7 Qf3 Kg8 Rh4) {-1.75/27 3} 43. Be4 (Be4 Kg7 Bd3
Qxf5 Bxf5 h6 g4 Kf7 Kf3 Bg7 Kf4 Ne8 Bg6 Kxg6 Rxe8 Be5 Ke4 Kg5 Rg8 Kh4 Kf3
Bf6 Rg6) {+3.10/2 5} Qxf5 (Qxf5 Bxf5 Kg7 Kf3 Kg8 g4 h6 Kf4 Kf7 Re2 Kg7 Re6
Nd7 Be4 Ne5 Bd5 Ng6 Kf5 Ne7 Ke4 Ng6 Re8 Kf6 Rb8 Kg5 Rxb6 Be7 Ra6 Ne5)
{-1.20/23 4} 44. Bxf5 (Bxf5 Kg7 g4 h6 Kf3 Kf7 Kf4 Be7 Be6 Kg6 Bf5 Kf7 Re6
Ng8 Kf3 Nf6) {+3.29/2 8} Kg7 (Kg7 Kf3 Kh6 Rh1 Kg7 g4 h6 Re1 Kg8 Kf4 Kf7 Re2
Kg7 Re6 Kf7 Re1 Bg7 Be6 Kg6 Bc8 Bf8 Bb7 Kf7 Bc6 Kg7 Re6 Ng8 Be4 Nf6 Kf5 Nd7
Bf3 Ne5 Bd5 Kh7 Re8 Bg7) {-1.37/27 5} 45. Kf3 (Kf3 h6 g4 Kf7 Kf4 Bg7 Be6
Kg6 Bc8 Bf8 Bf5 Kf7 g5 hxg5 Kxg5 Be7 Bg6 Kf8 Kf5 d5 Ke6 dxc4) {+3.45/2 17}
Kf7 (Kf7 g4 h6 Kf4 Kg7 Re6 Kf7 Re2 Kg7 Re1 Kf7 Re2) {-1.37/28 3} 46. g4 (g4
h6 Kf4 Bg7 Be6 Kg6 Bc8 Kf7 Kf5 Ne8 Be6 Ke7 Bd5 Be5 Rh1 Bg7 Kg6 Be5 Rxh6 Nf6
Kf5 Nxd5 cxd5) {+3.70/2 6} h6 (h6 Kf4 Bg7 Be6 Kg6 Bc8 Bf8 Bb7 Kf7 Bc6 Kg7
Re6 Kf7 Kf5 Be7 Re3 Bf8 Re1 Kg7 Re6 Ng8 Be8 Kh7 Kf4 Be7 Bc6 Kg7 Bd5 Bg5 Ke4
Nf6 Kf5 Nxd5) {-1.43/27 5} 47. Kf4 (Kf4 Bg7 Re2 Bf8 g5 hxg5 Kxg5 Be7 Bg6
Kf8 Kf5 d5 Ke6 dxc4 bxc4 Ng8 Rf2 Nf6 Rg2 Bd8 Rd2 Be7) {+3.93/2 4} Kg7 (Kg7
g5 hxg5 Kxg5 d5 Re6 dxc4 bxc4 a4 Rxb6 Be7 Rb7 Kf7 Kf4 a3 Ra7 Ne8 Rxa3 Bd6
Kg5 Be7 Kg4 Bd6 Ra6 Ke7 Kf3 Nf6 Ke3 Nh5 Kd3 Nf6 Ra5 Nh5 Ra7 Kf6 Bg4 Ng3 Ra5
Ke5) {-1.71/29 17} 48. g5 (g5 Ng8 gxh6 Nxh6 Be6 Kf6 Bd5 Nf7 Re6 Kg7 Re8 Ne5
Kf5 Nd3 Rb8 Nb4 Rb7 Kh6 Bg8 Bg7 Rxb6 Be5) {+4.71/2 8} hxg5+ (hxg5 Kxg5 d5
Re6 dxc4 bxc4 a4 Rxb6 Be7 Rb7 Kf7 Kf4 a3 Ra7 Ne8 Rxa3 Bd6 Kg5 Be7 Kg4 Bd6
Ra6 Ke7 Kf3 Nf6 Ke3 Nh5 Rb6 Nf6 Rc6 Ne8 Ra6 Nf6 Rb6 Nh5 Kf3 Nf6) {-1.71/29
2} 49. Kxg5 (Kxg5 d5 Re6 a4 Rxb6 Be7 Rb7 Kf7 bxa4 Ne8 Kf4 Nd6 Rd7 Nxc4 Bg4
Nb6 Ra7 Kf6 Ra6 Bd6 Kf3 Nc4 a5 Ke5 Ra8 Kd4) {+4.67/2 6} d5 (d5 Re6 dxc4
bxc4 a4 Rxb6 Be7 Rb7 Kf7 Kf4 a3 Ra7 a2 Rxa2 Ne8 Ra6 Bd6 Ke3 Ke7 Ra7 Kf6 Bd7
Nc7 Ke4 Be5 Bg4 Bd6 Rb7 Kg5 Bd7 Kf6 Bg4) {-1.77/29 3} 50. Bd3 (Bd3 Kf7 cxd5
Be7 Bg6 Kf8 d6 Ne4 Kf5 Nxd6 Ke6 Ne8 Rf1 Nf6 Bd3 Bd8 Rxf6 Bxf6 Kxf6 Ke8 Ke6
Kd8 Kd6 c4 Bxc4 b5 Bxb5) {+5.20/2 9} dxc4 (dxc4 Bxc4 b5 Bxb5 c4 bxc4 Bb4
Re6 Ba3 Ra6 Ne4 Kf5 Ng3 Kf4 Ne2 Ke3 Nc3 Rxa5 Bb4 Ra6 Kf7 Bd7 Bc5 Kd3 Nd1
Be6 Ke7 Bd5 Nf2 Kc3 Nd1 Kd2 Nf2) {-2.12/22 4} 51. Bxc4 (Bxc4 b5 Bxb5 c4
bxc4 Bb4 Re6 Ng8 Ra6 Ne7 Kf4 Kf7 Ke5 Ng6 Kd4 Ne7 c5 Nf5 Kc4 Ne3) {+5.52/2
7} b5 (b5 Bxb5 c4 bxc4 Bb4 Re6 Ng8 Kf5 Ne7 Ke5 Ng6 Kd4 Nf4 Re4 Bd6 c5 Bc7
Re8 Kf6 Bd7 Ng6 Re6 Kg5 Be8 Nf4 Ra6 Ne2 Kd3 Ng3 Bd7 Be5 Kc4) {-2.34/25 3}
52. Bxb5 (Bxb5 c4 bxc4 Bb4 Re6 Ng8 Ra6 Ne7 Kf4 Kf7 Ke5 Ng6 Ke4 Ne7 Kd4 Nf5
Kd5 Ne7 Ke4 Nc8 Kd4) {+5.70/2 6} c4 (c4 bxc4 Bb4 Re6 Ng8 Kf5 Ne7 Ke5 Ng6
Kd4 Nf4 Re4 Bd6 c5 Bc7 Re8 Kf6 Bd7 Ng2 Re6 Kf7 Ra6 Ke7 Bh3 Nh4 Ra7 Kd8 Ra8
Ke7 Bg4 Ng2) {-2.34/26 3} 53. bxc4 (bxc4 Bb4 Re6 Ng8 Ra6 Ne7 Kf4 Kf7 Ke5
Ng6 Ke4 Ne7 Kd4 Nf5 Kd5 Ne7 Ke4 Ng6 Kd4 Ne7) {+5.77/2 5} Bb4 (Bb4 Re6 Ng8
Kf5 Ne7 Ke5 Ng6 Kd4 Nf4 Re4 Ng6 c5 Kf6 Be8 Ne7 Bd7 a4 Bxa4 Ba5 Bb3 Nc6 Kd5)
{-2.54/26 10} 54. Re6 (Re6 Ng8 Ra6 Ne7 Kf4 Kf7 Ke4 Ng6 Be8 Kxe8 Rxg6 Kd7
Kd5 Kc7 c5 a4 Rg7 Kb8 Rg4 a3) {+6.03/2 6} Ng8 (Ng8 Kf5 Ne7 Ke5 Ng6 Kd4 Nf4
Re4) {-2.56/26 6} 55. Ra6 (Ra6 Ne7 Kf4 Kf7 Ke4 Ng6 Be8 Kxe8 Rxg6 Kd7 Kd5
Kc7 c5 a4 Rg7 Kb8 Rg4 a3) {+6.14/2 4} Ne7 (Ne7 Kf4 Ng8 Kf5 Ne7 Ke5 Bc5 Rxa5
Bb6) {-2.62/23 3} 56. Kf4 (Kf4 Kf7 Ke4 Nc8 Kd4 Nd6 Kd5 Nf5 c5 Ne7 Kc4 Nf5
Bd7 Ne3 Kd4 Nc2) {+6.31/2 5} Kf7 (Kf7 Ke5 Ng6 Ke4 Ne7 Bd7 Kf8 Kd4 Be1 c5
Bf2 Kc4 Ng8 Rxa5 Nf6 Bf5 Bg3 Ra2 Ke7 Ra6 Bf4 Ra7 Ke8 c6 Kd8 Rf7 Ne8)
{-2.72/23 4} 57. Ke4 (Ke4 Kg7 Kd4 Nf5 Kd5 Ne7 Ke6 Ng6 Ra7 Kh6 Kf6 Bc3 Kf5
Bb4 Ra6 Kg7) {+6.57/2 7} Kf8 (Kf8 Ke5 Kg7 Bd7 Kf8 Kd4 Be1 c5 Bf2 Kc4 Ng8
Rxa5 Nf6 Ra8 Ke7 Bf5 Ne8 Ra7 Kf6 Bd7 Ng7) {-2.85/21 3} 58. Bd7 (Bd7 Ng8 Kd4
Ke7 Bh3 Nf6 Re6 Kf7 c5 Ne8 Re2 Nc7 Kc4 Kf6 Bg4 Na6 c6 Nc7) {+7.09/2 13} Ng8
(Ng8 Kd4 Be1 c5 Bg3 Bb5 Kg7 Ke4 Ne7 Rxa5 Kf7 Ra6 Kg7 Ra7 Kf6 Bd7 Bf2 Ra6
Kg5 c6 Bg3 Ra7) {-3.17/21 3} 59. Kd4 (Kd4 Ke7 Bh3 Nf6 c5 Ne8 Ra7 Kd8 Kd5
Nf6 Kc4 Ne4 c6 Nd6 Kd5 Nb5 Rd7 Ke8 Rb7 Nd6 Rb8 Ke7) {+7.31/2 5} Be1 (Be1 c5
Bg3 Bb5 Ne7 Ke4 Kf7 Bd7 Ng6 Rxa5 Ke7 Bf5 Nh8 Ra7 Kf6 Ra6 Ke7 Kf3 Bc7 Ra7
Kf6 Rxc7 Kxf5 c6 Ng6 Rf7 Ke6 c7 Ne5 Ke4) {-3.56/22 3} 60. c5 (c5 Bf2 Kc4
Ke7 Bh3 Nf6 Re6 Kf7 Re2 Bg3 Kb5 Nd5 Be6 Kf6 Bxd5 a4 Kxa4 Be5 c6) {+8.70/2
8} Bg3 (Bg3 Bb5 Kg7 Ke4 Bb8 Ra8 Bg3 Ra7 Kf6 c6 Ne7 c7 Ke6 c8=N Nxc8 Bd7 Kd6
Bxc8 Be1 Rd7 Kc5 Rd5 Kb6 Bd7 Bb4 Kd4 Kc7 Be6 Kc6) {-4.06/23 3} 61. Kc4 (Kc4
Ke7 Rg6 Bf2 Rxg8 Kxd7 Kb5 a4 c6 Kc7 Rg7 Kc8 Kxa4 Bd4) {+9.51/2 9} Ke7 (Ke7
Bf5 Bh2 Ra7 Kf6 Bd7 Bg1 Ra8 Kf7 c6 Bb6 Rb8 Bc7 Rb7 Bf4 Ra7 Kf6 Ra8 Nh6 Kd5
Nf7 Ra7 Nd6 c7 Ke7 Be6) {-4.44/24 4} 62. Rg6 (Rg6 Bf2 Rxg8 Kxd7 Kb5 a4 Rg2
Be3 c6 Kd6 Rg7 a3 Rd7 Ke6) {+10.95/2 7} Kxd7 (Kxd7 Rxg8 Be1 Kb5 Bc3 Ra8 Kc7
Ra7 Kb8 Rf7 Bd4 Kb6 Kc8 Ra7 Kb8) {-7.68/26 4} 63. Rxg3 (Rxg3 Ne7 Kb5 a4 Ra3
Nd5 Rd3 Ke6 Kxa4 Ke5 Kb5 Ke4 Rd2 Ke5 c6 Kd6) {+12.05/2 8} Nf6 (Nf6 Rg7 Kc8
Ra7 a4 Kb5) {-42.32/29 4} 64. Rg7+ (Rg7 Ke6 Ra7 a4 Rxa4 Nd5 Ra6 Ke5 Rh6 Ne3
Kb5 Nf5) {+14.00/2 10} Kd8 (Kd8 Ra7 Ne4 Kb5 Nc3 Kxa5 Nd5 Kb5 Nc3 Kc4 Ne4 c6
Ke8 Kb5) {-48.13/34 3 Arena Adjudication} 1-0[/pgn]
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Something goes wrong with lc0 since yesterday?

Post by yanquis1972 »

just started a game against the latest testserver net (10007); this is the output from the start position:

Analysis by The Lc0 chess engine. v0.14.0 256net:

1.a3 h6 2.h4 a6 3.h5
The position is equal: = (0.04) Depth: 2/6 00:00:00
1.g3 g6 2.c4 Nf6 3.a3 Ng4
The position is equal: = (0.03) Depth: 2/7 00:00:00
The position is equal: = (0.01) Depth: 3/8 00:00:01 3kN
1.a3 h6 2.h4 a6 3.h5 Nf6
The position is equal: = (0.02) Depth: 3/8 00:00:01 3kN
1.g3 g6 2.f4 Nf6 3.Nf3 Ng4 4.h3
The position is equal: = (0.02) Depth: 3/8 00:00:01 3kN
The position is equal: = (0.02) Depth: 3/9 00:00:01 4kN
1.a3 h6 2.h3 a6 3.g4 h5 4.gxh5
The position is equal: = (0.02) Depth: 3/9 00:00:04 21kN
1.g3 g6 2.c4 a5 3.a3 a4 4.Nc3 Nf6
The position is equal: = (0.02) Depth: 3/9 00:00:04 21kN
The position is equal: = (0.04) Depth: 3/11 00:00:19 114kN
1.f3 f6 2.d4 e5 3.dxe5 fxe5 4.e3 Nf6 5.h4 d5 6.Nc3
The position is equal: = (0.05) Depth: 3/11 00:00:21 123kN
The position is equal: = (0.05) Depth: 3/12 00:00:37 226kN
1.a4 a5 2.d4 g6 3.d5 h6 4.Nf3 Nf6 5.Nc3
The position is equal: = (0.05) Depth: 3/12 00:00:39 236kN
1.f3 f6 2.d4 e5 3.dxe5 fxe5 4.e3 Nf6 5.h4 d5 6.Nc3
The position is equal: = (0.05) Depth: 3/12 00:00:40 246kN
1.a4 a5 2.d4 c6 3.e4 d5 4.exd5 cxd5 5.Nf3
The position is equal: = (0.05) Depth: 3/12 00:00:41 249kN
The position is equal: = (0.05) Depth: 3/12 00:00:51 316kN
1.d4 f6 2.f3 a5 3.e4 e5 4.dxe5 fxe5 5.Nc3 Nf6 6.Nd5 c6 7.Nxf6+
The position is equal: = (0.09) Depth: 3/12 00:00:51 318kN
The position is equal: = (0.06) Depth: 3/15 00:01:34 572kN


still a ways to go.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Something goes wrong with lc0 since yesterday?

Post by Laskos »

yanquis1972 wrote: Sat Jun 30, 2018 4:18 am just started a game against the latest testserver net (10007); this is the output from the start position:

Analysis by The Lc0 chess engine. v0.14.0 256net:

1.a3 h6 2.h4 a6 3.h5
The position is equal: = (0.04) Depth: 2/6 00:00:00
1.g3 g6 2.c4 Nf6 3.a3 Ng4
The position is equal: = (0.03) Depth: 2/7 00:00:00
The position is equal: = (0.01) Depth: 3/8 00:00:01 3kN
1.a3 h6 2.h4 a6 3.h5 Nf6
The position is equal: = (0.02) Depth: 3/8 00:00:01 3kN
1.g3 g6 2.f4 Nf6 3.Nf3 Ng4 4.h3
The position is equal: = (0.02) Depth: 3/8 00:00:01 3kN
The position is equal: = (0.02) Depth: 3/9 00:00:01 4kN
1.a3 h6 2.h3 a6 3.g4 h5 4.gxh5
The position is equal: = (0.02) Depth: 3/9 00:00:04 21kN
1.g3 g6 2.c4 a5 3.a3 a4 4.Nc3 Nf6
The position is equal: = (0.02) Depth: 3/9 00:00:04 21kN
The position is equal: = (0.04) Depth: 3/11 00:00:19 114kN
1.f3 f6 2.d4 e5 3.dxe5 fxe5 4.e3 Nf6 5.h4 d5 6.Nc3
The position is equal: = (0.05) Depth: 3/11 00:00:21 123kN
The position is equal: = (0.05) Depth: 3/12 00:00:37 226kN
1.a4 a5 2.d4 g6 3.d5 h6 4.Nf3 Nf6 5.Nc3
The position is equal: = (0.05) Depth: 3/12 00:00:39 236kN
1.f3 f6 2.d4 e5 3.dxe5 fxe5 4.e3 Nf6 5.h4 d5 6.Nc3
The position is equal: = (0.05) Depth: 3/12 00:00:40 246kN
1.a4 a5 2.d4 c6 3.e4 d5 4.exd5 cxd5 5.Nf3
The position is equal: = (0.05) Depth: 3/12 00:00:41 249kN
The position is equal: = (0.05) Depth: 3/12 00:00:51 316kN
1.d4 f6 2.f3 a5 3.e4 e5 4.dxe5 fxe5 5.Nc3 Nf6 6.Nd5 c6 7.Nxf6+
The position is equal: = (0.09) Depth: 3/12 00:00:51 318kN
The position is equal: = (0.06) Depth: 3/15 00:01:34 572kN


still a ways to go.
Funny.
But somehow it plays pretty well (already mostly beating me):

Elo rating:
ID10008:
shown: 2280
CCRL: 1800-1850
Ron Langeveld
Posts: 140
Joined: Tue Jan 05, 2010 8:02 pm

Re: Something goes wrong with lc0 since yesterday?

Post by Ron Langeveld »

yanquis1972 wrote: Sat Jun 30, 2018 2:28 am how much time/position? i'm curious what happens (if feasible) if you increase x10.
To compare the test with others tests I increased 1 sec to 3,5 sec per position for the run of id10007 and it improved to 42%
Still well below other nets.
Alternatively I started a gauntlet 1m+1s with Noomen' 2 move suite against the 7th iteration of the previous 6x64 net (id9007)
Id9007 won all 52 first games before i aborted this 'unfair fight'.
Werewolf
Posts: 2064
Joined: Thu Sep 18, 2008 10:24 pm

Re: Something goes wrong with lc0 since yesterday?

Post by Werewolf »

Laskos wrote: Sat Jun 30, 2018 9:55 am
Funny.
But somehow it plays pretty well (already mostly beating me):

Elo rating:
ID10008:
shown: 2280
CCRL: 1800-1850
It seems to be progressing nicely to me. It is far more important how much head room it has at the end to avoid saturation than the speed of early improvement. Given its origins prior to the 256x20 setup...it's all about the finish line.
Werewolf
Posts: 2064
Joined: Thu Sep 18, 2008 10:24 pm

Re: Something goes wrong with lc0 since yesterday?

Post by Werewolf »

Laskos wrote: Sat Jun 30, 2018 9:55 am
Funny.
But somehow it plays pretty well (already mostly beating me):

Elo rating:
ID10008:
shown: 2280
CCRL: 1800-1850
It seems to be progressing nicely to me. It is far more important how much head room it has at the end to avoid saturation than the speed of early improvement. Given its network origins immediately prior to the 256x20 setup...it's all about the finish line.
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: Something goes wrong with lc0 since yesterday?

Post by CMCanavessi »

Ron Langeveld wrote: Sat Jun 30, 2018 10:52 am
yanquis1972 wrote: Sat Jun 30, 2018 2:28 am how much time/position? i'm curious what happens (if feasible) if you increase x10.
To compare the test with others tests I increased 1 sec to 3,5 sec per position for the run of id10007 and it improved to 42%
Still well below other nets.
Alternatively I started a gauntlet 1m+1s with Noomen' 2 move suite against the 7th iteration of the previous 6x64 net (id9007)
Id9007 won all 52 first games before i aborted this 'unfair fight'.
Can you repeat your tests with 10010 and 9010? What hardware are you running them on?
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls