Sergio NN 40x512

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: Sergio NN 40x512

Post by corres »

mwyoung wrote: Mon Jan 13, 2020 10:00 am ...
My first round of testing is giving the Sergio 512 network a jump of 17 elo over the sergio 1705 network in early testing.
What is about your system and where are the tests for those "optimized parameters" and the detailed test results?
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Sergio NN 40x512

Post by mwyoung »

shrapnel wrote: Mon Jan 13, 2020 5:16 am
corres wrote: Mon Jan 13, 2020 1:48 amThe speed of a net is such an important parameter than the knowledge stored in NN. A "clever" but too slow net is not better then a fast but "stupid" net. The task of net-makers is for making nets with optimal speed and knowledge.
I would say that it is rather YOUR Task, not NN maker's, to make sure you have the fastest possible GPU to fully UTILIZE the large NN.
Its rather silly to use a slow Graphic Card for Testing and then say that large NN is bad !
You neglect the importance of Hardware for testing NNs.
Corres has no idea what he is saying. After what he is saying here. I have doubts he even knows how a computer works. The speed of a net is irrelevant in terms of NPS. What matters is does it give you superior performance over any other networks.
Early testing is showing the 512 network is giving us better analysis over the smaller networks in early testing. Right now it is up +17 elo in early testing over the previous best net of 384x30-t40-1705
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Sergio NN 40x512

Post by mwyoung »

corres wrote: Mon Jan 13, 2020 10:15 am
mwyoung wrote: Mon Jan 13, 2020 10:00 am ...
My first round of testing is giving the Sergio 512 network a jump of 17 elo over the sergio 1705 network in early testing.
What is about your system and where are the tests for those "optimized parameters" and the detailed test results?
Just jump over to the Computer Chess Club: Tournaments and Matches. As I always do. I will be broadcasting the best nets and engines including the 40x512.

I am not sure what your problem is, but you act like you don't want better nets....
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Sergio NN 40x512

Post by mwyoung »

corres wrote: Mon Jan 13, 2020 10:15 am
mwyoung wrote: Mon Jan 13, 2020 10:00 am ...
My first round of testing is giving the Sergio 512 network a jump of 17 elo over the sergio 1705 network in early testing.
What is about your system and where are the tests for those "optimized parameters" and the detailed test results?
GPU RTX 2080 ti.

DESKTOP-CORSAIR, Blitz 0m+10s 0


1 Lc0 v0.23.2+git.c8d9095 512 n +17 +2/=18/-1 52.38% 11.0/21
2 Lc0 v0.23.2+git.c8d9095 Sergi -17 +1/=18/-2 47.62% 10.0/21
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: Sergio NN 40x512

Post by corres »

mwyoung wrote: Mon Jan 13, 2020 10:52 am
corres wrote: Mon Jan 13, 2020 10:15 am
mwyoung wrote: Mon Jan 13, 2020 10:00 am ...
My first round of testing is giving the Sergio 512 network a jump of 17 elo over the sergio 1705 network in early testing.
What is about your system and where are the tests for those "optimized parameters" and the detailed test results?
GPU RTX 2080 ti.
DESKTOP-CORSAIR, Blitz 0m+10s 0
1 Lc0 v0.23.2+git.c8d9095 512 n +17 +2/=18/-1 52.38% 11.0/21
2 Lc0 v0.23.2+git.c8d9095 Sergi -17 +1/=18/-2 47.62% 10.0/21
What are the "optimized parameters" of Leela and how you get them?
What about your CPU and RAM?
And you can state 17 Elo difference after 21 games...
Note
Nobody are obliged to see your "broadcast" about your matches.
But if somebody report test result that person is obliged to write down the used parameters for tests.
I am afraid technically and practically weak contemplation could not help the creation of nets.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Sergio NN 40x512

Post by mwyoung »

corres wrote: Mon Jan 13, 2020 11:32 am
mwyoung wrote: Mon Jan 13, 2020 10:52 am
corres wrote: Mon Jan 13, 2020 10:15 am
mwyoung wrote: Mon Jan 13, 2020 10:00 am ...
My first round of testing is giving the Sergio 512 network a jump of 17 elo over the sergio 1705 network in early testing.
What is about your system and where are the tests for those "optimized parameters" and the detailed test results?
GPU RTX 2080 ti.
DESKTOP-CORSAIR, Blitz 0m+10s 0
1 Lc0 v0.23.2+git.c8d9095 512 n +17 +2/=18/-1 52.38% 11.0/21
2 Lc0 v0.23.2+git.c8d9095 Sergi -17 +1/=18/-2 47.62% 10.0/21
What are the "optimized parameters" of Leela and how you get them?
What about your CPU and RAM?
And you can state 17 Elo difference after 21 games...
Note
in early testing
But if somebody report test result that person is obliged to write down the used parameters for tests.
Here is what I stated. "in early testing"

You are correct no is obliged to see anything. But I guess if you want to know go see for yourself. Because I am also not obliged to tell you settings. Go do your own homework.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: Sergio NN 40x512

Post by corres »

mwyoung wrote: Mon Jan 13, 2020 11:41 am
corres wrote: Mon Jan 13, 2020 11:32 am
mwyoung wrote: Mon Jan 13, 2020 10:52 am ...
GPU RTX 2080 ti.
DESKTOP-CORSAIR, Blitz 0m+10s 0
1 Lc0 v0.23.2+git.c8d9095 512 n +17 +2/=18/-1 52.38% 11.0/21
2 Lc0 v0.23.2+git.c8d9095 Sergi -17 +1/=18/-2 47.62% 10.0/21
...
What are the "optimized parameters" of Leela and how you get them?
What about your CPU and RAM?
And you can state 17 Elo difference after 21 games...
Note
Nobody are obliged to see your "broadcast" about your matches.
But if somebody report test result that person is obliged to write down the used parameters for tests.
Here is what I stated. "in early testing"
You are correct no is obliged to see anything. But I guess if you want to know go see for yourself. Because I am also not obliged to tell you settings. Go do you own homework.
Na ja, everybody have right to their own stupidity. These are all about "correct testing" and "optimized parameters"...
But if you really want to contribute to making better and stronger nets you should keep some basic rule of reporting the own results. The most basic rule is to make acquainted with the circumstances of your tests.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Sergio NN 40x512

Post by mwyoung »

corres wrote: Mon Jan 13, 2020 12:04 pm
mwyoung wrote: Mon Jan 13, 2020 11:41 am
corres wrote: Mon Jan 13, 2020 11:32 am
mwyoung wrote: Mon Jan 13, 2020 10:52 am ...
GPU RTX 2080 ti.
DESKTOP-CORSAIR, Blitz 0m+10s 0
1 Lc0 v0.23.2+git.c8d9095 512 n +17 +2/=18/-1 52.38% 11.0/21
2 Lc0 v0.23.2+git.c8d9095 Sergi -17 +1/=18/-2 47.62% 10.0/21
...
What are the "optimized parameters" of Leela and how you get them?
What about your CPU and RAM?
And you can state 17 Elo difference after 21 games...
Note
Nobody are obliged to see your "broadcast" about your matches.
But if somebody report test result that person is obliged to write down the used parameters for tests.
Here is what I stated. "in early testing"
You are correct no is obliged to see anything. But I guess if you want to know go see for yourself. Because I am also not obliged to tell you settings. Go do you own homework.
Na ja, everybody have right to their own stupidity. These are all about "correct testing" and "optimized parameters"...
But if you really want to contribute to making better and stronger nets you should keep some basic rule of reporting the own results. The most basic rule is to make acquainted with the circumstances of your tests.
When I am ready as the network is new and being tuned for best performance. Testing will be shown as usual and posted on tournament and matches. Because it is all about correct testing and optimized parameters. And I am not here to contribute to make better or stronger nets. I am here to test if they have made a better and stronger net or any other A/B engine.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Sergio NN 40x512

Post by mwyoung »

Nordlandia wrote: Sun Jan 12, 2020 11:54 pm In my case 2x 2080 Super is not strong enough to benefit it to the fullest. I think CCC can benefit from it.

TimeControl "3600+30"

[pgn][Event "i7-5930K 4.5GHz"]
[Site "i7-5930K 4.5GHz"]
[Date "2020.01.12"]
[Round "?"]
[White "lc0"]
[Black "Stockfish 10.01.20 Ultimaiq BM"]
[Result "0-1"]
[SetUp "1"]
[FEN "rnbqrbnk/pppp1ppp/4p3/8/8/3P4/PPP1PPPP/KNBRQBNR w - - 0 11"]
[PlyCount "81"]
[EventDate "2020.??.??"]
[TimeControl "3600+30"]

11. f4 {0.38/11 54} c5 {-0.28/35 137s} 12. g4 {0.41/12 124s} b5 {-0.34/37 278s}
13. Nf3 {0.45/13 64s} Nc6 {-0.30/32 33} 14. h4 {0.45/12 100s} a5 {-0.31/34 191s
} 15. h5 {0.43/13 237s} Bb7 {-0.42/34 292s} 16. e4 {0.64/12 73s} a4 {-0.17/33
96s} 17. h6 {0.69/13 64s} gxh6 {-0.40/33 80s} 18. g5 {0.67/14 49} a3 {-0.30/35
298s} 19. Nxa3 {0.61/16 199s} b4 {-0.80/34 95s} 20. Nc4 {0.65/20 33} Qc7 {
-0.75/37 171s} 21. b3 {1.11/18 199s} Bg7+ {0.00/33 31} 22. e5 {1.08/22 31} Nce7
{0.00/36 50} 23. gxh6 {0.85/13 243s} Nxh6 {0.00/36 53} 24. Bg2 {0.61/15 146s}
d5 {0.00/36 61s} 25. Ne3 {0.65/13 55} Nhf5 {0.00/40 186s} 26. Nxf5 {0.60/15 82s
} Nxf5 {0.45/36 49} 27. Bh3 {0.62/16 52} c4 {0.32/42 135s} 28. a4 {-0.05/20
130s} cxb3 {0.00/44 125s} 29. cxb3 {-0.21/21 0.66s} Bc6 {0.00/47 60s} 30. Kb1 {
-0.21/20 0.20s} Bxa4 {6.48/36 48} 31. bxa4 {-0.74/17 140s} Qc6 {7.38/37 56} 32.
Bxf5 {-0.89/19 208s} Rec8 {8.04/38 50} 33. Qf2 {-2.38/15 301s} Qxa4 {9.08/36 48
} 34. Qb2 {-2.45/15 114s} exf5 {9.79/36 62s} 35. Rd2 {-2.52/14 113s} Rc3 {
10.32/36 63s} 36. Rdh2 {-2.55/13 64s} Rb3 {22.50/34 53} 37. Nd4 {-2.59/14 87s}
Qa2+ {67.20/40 53} 38. Kc2 {-2.18/14 0.042s} Rxb2+ {148.78/43 111s} 39. Bxb2 {
-3.25/13 163s} b3+ {148.85/41 53} 40. Kd1 {-3.64/12 259s} Qb1+ {#51/40 49} 41.
Ke2 {-3.86/11 128s} Qxb2+ {#39/65 48} 42. Ke3 {-3.90/10 0.47s} Qc3 {#37/75 49}
43. Rxh7+ {-3.94/9 141s} Kg8 {#35/1 0} 44. Nxf5 {-3.82/8 122s} Bxe5 {#27/62 38}
45. Kf3 {-4.32/8 164s} Qxd3+ {#19/76 50} 46. Kg4 {-4.94/7 46} Qe2+ {#17/87 51}
47. Kg3 {-5.92/7 113s} Bxf4+ {#15/105 50} 48. Kh4 {-8.75/7 97s} Kxh7 {#11/193
45} 49. Nd4 {-12.73/6 90s} Qg2 {#9/245 13} 50. Rg1 {-14.26/4 60s} Qxg1 {
#7/245 0.017s} 51. Kh5 {adjudication -128.00/2 96s, Black wins by adjudication}
0-1[/pgn]
It is too early to tell if the new network is good or bad. Clearly not an impressive game. I just started my testing against Stockfish 130120. I will see if mine will do better.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Sergio NN 40x512

Post by mwyoung »

mwyoung wrote: Mon Jan 13, 2020 1:32 pm
Nordlandia wrote: Sun Jan 12, 2020 11:54 pm In my case 2x 2080 Super is not strong enough to benefit it to the fullest. I think CCC can benefit from it.

TimeControl "3600+30"

[pgn][Event "i7-5930K 4.5GHz"]
[Site "i7-5930K 4.5GHz"]
[Date "2020.01.12"]
[Round "?"]
[White "lc0"]
[Black "Stockfish 10.01.20 Ultimaiq BM"]
[Result "0-1"]
[SetUp "1"]
[FEN "rnbqrbnk/pppp1ppp/4p3/8/8/3P4/PPP1PPPP/KNBRQBNR w - - 0 11"]
[PlyCount "81"]
[EventDate "2020.??.??"]
[TimeControl "3600+30"]

11. f4 {0.38/11 54} c5 {-0.28/35 137s} 12. g4 {0.41/12 124s} b5 {-0.34/37 278s}
13. Nf3 {0.45/13 64s} Nc6 {-0.30/32 33} 14. h4 {0.45/12 100s} a5 {-0.31/34 191s
} 15. h5 {0.43/13 237s} Bb7 {-0.42/34 292s} 16. e4 {0.64/12 73s} a4 {-0.17/33
96s} 17. h6 {0.69/13 64s} gxh6 {-0.40/33 80s} 18. g5 {0.67/14 49} a3 {-0.30/35
298s} 19. Nxa3 {0.61/16 199s} b4 {-0.80/34 95s} 20. Nc4 {0.65/20 33} Qc7 {
-0.75/37 171s} 21. b3 {1.11/18 199s} Bg7+ {0.00/33 31} 22. e5 {1.08/22 31} Nce7
{0.00/36 50} 23. gxh6 {0.85/13 243s} Nxh6 {0.00/36 53} 24. Bg2 {0.61/15 146s}
d5 {0.00/36 61s} 25. Ne3 {0.65/13 55} Nhf5 {0.00/40 186s} 26. Nxf5 {0.60/15 82s
} Nxf5 {0.45/36 49} 27. Bh3 {0.62/16 52} c4 {0.32/42 135s} 28. a4 {-0.05/20
130s} cxb3 {0.00/44 125s} 29. cxb3 {-0.21/21 0.66s} Bc6 {0.00/47 60s} 30. Kb1 {
-0.21/20 0.20s} Bxa4 {6.48/36 48} 31. bxa4 {-0.74/17 140s} Qc6 {7.38/37 56} 32.
Bxf5 {-0.89/19 208s} Rec8 {8.04/38 50} 33. Qf2 {-2.38/15 301s} Qxa4 {9.08/36 48
} 34. Qb2 {-2.45/15 114s} exf5 {9.79/36 62s} 35. Rd2 {-2.52/14 113s} Rc3 {
10.32/36 63s} 36. Rdh2 {-2.55/13 64s} Rb3 {22.50/34 53} 37. Nd4 {-2.59/14 87s}
Qa2+ {67.20/40 53} 38. Kc2 {-2.18/14 0.042s} Rxb2+ {148.78/43 111s} 39. Bxb2 {
-3.25/13 163s} b3+ {148.85/41 53} 40. Kd1 {-3.64/12 259s} Qb1+ {#51/40 49} 41.
Ke2 {-3.86/11 128s} Qxb2+ {#39/65 48} 42. Ke3 {-3.90/10 0.47s} Qc3 {#37/75 49}
43. Rxh7+ {-3.94/9 141s} Kg8 {#35/1 0} 44. Nxf5 {-3.82/8 122s} Bxe5 {#27/62 38}
45. Kf3 {-4.32/8 164s} Qxd3+ {#19/76 50} 46. Kg4 {-4.94/7 46} Qe2+ {#17/87 51}
47. Kg3 {-5.92/7 113s} Bxf4+ {#15/105 50} 48. Kh4 {-8.75/7 97s} Kxh7 {#11/193
45} 49. Nd4 {-12.73/6 90s} Qg2 {#9/245 13} 50. Rg1 {-14.26/4 60s} Qxg1 {
#7/245 0.017s} 51. Kh5 {adjudication -128.00/2 96s, Black wins by adjudication}
0-1[/pgn]
It is too early to tell if the new network is good or bad. Clearly not an impressive game. I just started my testing against Stockfish 130120. I will see if mine will do better.
Mine did better and survived the first game against Stockfish with a draw as black.

"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.