rating adjustments of the NN testing

[Hugo]

Hi

does anyone know how it comes that one day the rating of tested 40 networks is arround 3200 +,
and a few hours later all versions are adjusted to 50 ELO less?
yesterday we had
41752 = 3172
41762 = 3183
41765 = 3192
41771 = 3200
41773 = 3206

now all of them have ~ 3140

C.K.

[Hugo]

Hi

Again a rating adjustment on the Lc0 network site.
Almost all 40 NN have been reduced by - 20 ELO.
For example NN 41812 started with 3165 after > 31.000 games.
Then over a week it was by 3159.
Now it has been reduced to 3140.

seems nobody knows here why this is. I already asked in other forums but also nothing concrete yet.

C.K.

[Guenther]

Hi

does anyone know how it comes that one day the rating of tested 40 networks is arround 3200 +,
and a few hours later all versions are adjusted to 50 ELO less?
yesterday we had
41752 = 3172
41762 = 3183
41765 = 3192
41771 = 3200
41773 = 3206

now all of them have ~ 3140

C.K.

Since a while (a few months meanwhile IIRC) they do regularily recalculations by adding match results from current nets vs. various
older nets (exact procedure for selecting the net number is surely written somewhere...) of the same NN. That's it.

Just check the matches site and you will see that not only N+1 vs. N nets are done since a certain time.
http://lczero.org/matches/

Edit:
Checked it precisely now. Since 2019-01-29 they added regularily cross matches between various older nets against the latest one.
(note that they did this also in the past, but just a very few times and randomly, probably just to check, if it is still progressing, or something went wrong)
N+1 vs. N matches have a different colour than N vs. N-x matches in the site quoted above.

[Hugo]

Thanks a lot for this explanation, Guenther !

kind regards, Clemens