The real elo of lczero is in its name

[Daniel Shawul]

Not sure about the Arena file but i can tell you how to change the config to get the different options

Code: Select all

##################################################################
# montecarlo - Use montecarlo tree search (MCTS) if set to 1
# treeht - Maximum size of tree to store in memory given in MB.
#          Note that this memory is not allocated at start up; it only
#          specifies the maximum limit the tree could grow to.
#          Note: Don't think you are making scorpio weak by not setting
#          this memory to high value, infact treeht=0 is the strongest 
#          MCTS setting.
# frac_freeze_tree [0 - 100] - freeze tree after this percentage of time is spent
# frac_alphabeta   [0 - 100] - use alpha-beta search this percent of the time
# mcts_strategy_depth - Lookahead depth for MCTS
# alphabeta_depth  [0 - 64] - depth for the shallow standard alphabeta searches at the leaves
# evaluate_depth   [0 - 64] - search depth for evaluation of new children
# backup_type - minmax = 0, averaging = 1, mixed = 2, for mixing score with previous ID use 3,4,5 resp.
# reuse_tree - reuse tree between moves
##################################################################
montecarlo          1
treeht              12800
frac_freeze_tree    100
frac_alphabeta      100
mcts_strategy_depth 30
alphabeta_depth     16
evaluate_depth      0
backup_type         0
reuse_tree          1

To get #12 (i.e scorpio-mcts-min) change the following three options

Code: Select all

montecarlo 1
alphabeta_depth 0
backup_type 0

To get the rest of the engines (i.e. scorpio-mcts-abx where x is the alphabeta depth)

Code: Select all

montecarlo 1
alphabeta_depth x
backup_type 0

To get a version that has the most closely related search as leela (averaging current tree plus averaging with previous ID score) use

Code: Select all

montecarlo 1
alphabeta_depth 0
backup_type 4

This is the most horrible version and it was not even listed in my tournament.

[stavros]

the temptation to apply alpha beta elements (search,eval etc) in lczero is high and will
become higher and higher, then will be proper to delete the word "zero"
i think this temptation comes from the hidden impatience to see lczero to beat stockfish and this is bad. the lczero stuff and her fans cultivated expectations to ppl that
lczero soon will crush sf houdini komodo etc.
i predict sooner or later they will add aplha beta elements due to to impatience
but pls forget the word "zero"

[CMCanavessi]

Ok, scorpio.ini looks like this, does it look ok to you? Do you think it would provide a good challenge for leela?

Code: Select all

log                 off
resign              800
ht  	            4096
eht                 8
pht                 1
montecarlo          1
treeht              12800
frac_freeze_tree    100
frac_alphabeta      100
mcts_strategy_depth 30
alphabeta_depth     0
evaluate_depth      0
backup_type         0
reuse_tree          1 
mt                  1
smp_depth           8
cluster_depth       12
message_poll_nodes  20
smp_type            YBW
cluster_type        YBW 
egbb_path                /home/dabdi/egbb/
egbb_cache_size          32
egbb_load_type           0
egbb_depth_limit         6

Edit: what should I do with ponder? Currently it's on (and I don't mind), but in case we want to disable it I see no option to do that.

[duncan]

where does one go on the site to get the score ?

[CMCanavessi]

where does one go on the site to get the score ?

Click my signature, I'm streaming the original 100-game match vs full strenght scorpio.

[epanek]

You obviously did not read the paper. SF did win some games. Overall though, QED. DeepMind demonstrated that a NN could become a world class chess champ with only self play. Now its time to solve the real problems in the world with AI.

[Daniel Shawul]

Ponder has to be turned off from GUI. In xboard , it is Options->General.

[CMCanavessi]

Ponder has to be turned off from GUI. In xboard , it is Options->General.

Ok, do those options look good to you?

[Daniel Shawul]

That seems about right to get scorpio-mcts-min. If leela beats that convincingly switch to the alpha-beta rollouts with depth=3 (scorpio-mcts-ab3) and go up the ranks increasing the alphabeta depth...

[main line]

Seems Leela can't use more than 300 Mb hash.