SPCC: first results of net-testing with MEA

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Dann Corbit, Harvey Williamson

User avatar
pohl4711
Posts: 2391
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

SPCC: first results of net-testing with MEA

Post by pohl4711 »

First results of testing neural-nets with the great new MEA-tool of F.Mosca and Ed Schroeder are now online!

https://www.sp-cc.de/nn-mea-testing.htm

(Perhaps you have to clear your browsercache or reload the website)
User avatar
Werner
Posts: 2864
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: SPCC: first results of net-testing with MEA

Post by Werner »

Thanks for the help!

but: how to give the option Slowmover=0 to lc0 ?

I tried in the lc0.config
Slowmover=0
I used the dnnl version 0.24.1
but then the engine does not start;

...or can you please include network 58573 in your test?

edit
try with your help file now
Werner
User avatar
pohl4711
Posts: 2391
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: first results of net-testing with MEA

Post by pohl4711 »

Werner wrote: Thu Apr 23, 2020 12:17 pm Thanks for the help!

but: how to give the option Slowmover=0 to lc0 ?

I tried in the lc0.config
Slowmover=0
I used the dnnl version 0.24.1
but then the engine does not start;

...or can you please include network 58573 in your test?

edit
try with your help file now
Yes, I use the dnll-version of lc0 0.24.1,too. I dont use a lc0-config-file.
Just this in the run-temere.bat:

set MT=1
set THREADS=1
set PROTOCOL=uci
set EPD=epd\allsets_nodupes.epd
set OPTIONS=Slowmover=0
set MRL=temere

set EXE=engines\Lc0_cpu_1\lc0.exe
set NAME="lc0 0.24.1 LS 14.2 (20x256)"
mea.exe --engine %EXE% --name %NAME% --threads %THREADS% --protocol %PROTOCOL% --epd %EPD% --movetime %MT% --log --eoption %OPTIONS%
csv %MRL% %EPD% %OPTIONS% %NAME% %MT%
mrl %MRL% %MRL% %EPD% %MT%
User avatar
Werner
Posts: 2864
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: SPCC: first results of net-testing with MEA

Post by Werner »

Ok done.
results here (done with 0.25.1rc1) - I will repeat it with 0.24.1 to see if there is a difference
591226 Top1 16014 Top1Rate 0.460 Score 236240 ScoreRate 0.678
_58573 Top1 15427 Top1Rate 0.443 Score 231131 ScoreRate 0.663

with 0.24.1
591226 Top1 16012 Top1Rate 0.460 Score 236234 ScoreRate 0.678
_58573 Top1 15433 Top1Rate 0.443 Score 231153 ScoreRate 0.663
Werner
User avatar
pohl4711
Posts: 2391
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: first results of net-testing with MEA

Post by pohl4711 »

Hmmm. I got
lc0 0.24.1 58573 (10x128) : 15433 0.443 231162 0.663
which is little different. But the difference is very small. The rates are identical (0.443 (=44.3%) and 0.663 (=66.3%))