Patrice Duhamel wrote: ↑Fri Jan 29, 2021 12:30 pm
Ferdy wrote: ↑Fri Jan 29, 2021 11:46 am
Right I see what you mean now.
Thanks for your help.
So if I let it end without interruption, it should print the best parameters ?
Yes.
Patrice Duhamel wrote: ↑Fri Jan 29, 2021 12:30 pm
(in my example the parameters from the first run ?)
Perhaps depending on the optimizer used, as there is optimizer that recommends best param by considering other conditions. Like when you use TBPSA
https://facebookresearch.github.io/neve ... rizedTBPSA
Sometimes, I might not notice that the library of nevergrad has changes to how they return the best param. Regardless we will get the best param after the scheduled budgets are completed.
In the update that I am working, the best param are now correctly printed after the first run.
First run ends:
Code: Select all
2021-01-29 20:11:40,223 | INFO | opt num_ask: 10
2021-01-29 20:11:40,225 | INFO | budget: 10
2021-01-29 20:11:40,225 | INFO | recommended param: {'FutilityMargin': 73, 'LmrFactor': 99, 'QsearchFutilityMargin': 97, 'WinEvalDepth': 7}
2021-01-29 20:11:40,229 | INFO | best param: {'FutilityMargin': 40, 'LmrFactor': 100, 'QsearchFutilityMargin': 86, 'WinEvalDepth': 8}
2021-01-29 20:11:40,229 | INFO | init param: {'FutilityMargin': 60, 'LmrFactor': 100, 'QsearchFutilityMargin': 100, 'WinEvalDepth': 7}
2021-01-29 20:11:40,230 | INFO | recommended vs init
2021-01-29 20:12:32,286 | INFO | actual result: 0.56250 @24 games, minimized result: 0.43750, point of view: recommended
2021-01-29 20:12:32,286 | INFO | best loss: 0.375
2021-01-29 20:12:32,293 | INFO | best_param: {'FutilityMargin': 40, 'LmrFactor': 100, 'QsearchFutilityMargin': 86, 'WinEvalDepth': 8}
2021-01-29 20:12:32,451 | INFO | option.FutilityMargin=40 option.LmrFactor=100 option.QsearchFutilityMargin=86 option.WinEvalDepth=8
Second run starts:
Code: Select all
2021-01-29 20:22:20,146 | INFO | total budget: 10
2021-01-29 20:22:20,148 | INFO | games_per_budget: 24
2021-01-29 20:22:20,151 | INFO | tuning match move control: base_time_sec: 2, inc_time_sec: 0.1, depth=1000
2021-01-29 20:22:20,153 | INFO | parameter dimension: 4
2021-01-29 20:22:20,176 | INFO | bayesopt previous num_ask: 10
2021-01-29 20:22:20,229 | INFO | opt num_ask: 11
2021-01-29 20:22:20,231 | INFO | budget: 1
2021-01-29 20:22:20,232 | INFO | recommended param: {'FutilityMargin': 76, 'LmrFactor': 97, 'QsearchFutilityMargin': 101, 'WinEvalDepth': 2}
2021-01-29 20:22:20,233 | INFO | best param: {'FutilityMargin': 40, 'LmrFactor': 100, 'QsearchFutilityMargin': 86, 'WinEvalDepth': 8}
2021-01-29 20:22:20,233 | INFO | init param: {'FutilityMargin': 60, 'LmrFactor': 100, 'QsearchFutilityMargin': 100, 'WinEvalDepth': 7}
2021-01-29 20:22:20,234 | INFO | recommended vs init
2021-01-29 20:23:16,772 | INFO | actual result: 0.47917 @24 games, minimized result: 0.52083, point of view: recommended
2021-01-29 20:23:16,824 | INFO | opt num_ask: 12
2021-01-29 20:23:16,826 | INFO | budget: 2
2021-01-29 20:23:16,827 | INFO | recommended param: {'FutilityMargin': 68, 'LmrFactor': 86, 'QsearchFutilityMargin': 84, 'WinEvalDepth': 7}
2021-01-29 20:23:16,828 | INFO | best param: {'FutilityMargin': 40, 'LmrFactor': 100, 'QsearchFutilityMargin': 86, 'WinEvalDepth': 8}
2021-01-29 20:23:16,828 | INFO | init param: {'FutilityMargin': 60, 'LmrFactor': 100, 'QsearchFutilityMargin': 100, 'WinEvalDepth': 7}
2021-01-29 20:23:16,830 | INFO | recommended vs init
2021-01-29 20:24:27,238 | INFO | actual result: 0.35417 @24 games, minimized result: 0.64583, point of view: recommended
2021-01-29 20:24:27,312 | INFO | opt num_ask: 13
2021-01-29 20:24:27,314 | INFO | budget: 3
2021-01-29 20:24:27,315 | INFO | recommended param: {'FutilityMargin': 61, 'LmrFactor': 100, 'QsearchFutilityMargin': 62, 'WinEvalDepth': 5}
2021-01-29 20:24:27,316 | INFO | best param: {'FutilityMargin': 40, 'LmrFactor': 100, 'QsearchFutilityMargin': 86, 'WinEvalDepth': 8}
2021-01-29 20:24:27,316 | INFO | init param: {'FutilityMargin': 60, 'LmrFactor': 100, 'QsearchFutilityMargin': 100, 'WinEvalDepth': 7}
2021-01-29 20:24:27,317 | INFO | recommended vs init
...
Will upload it after some tests.
Note that before restarting Lakas I don't forget to copy dataoptout.dat => dataoptin.dat
There is no need to copy (unless you want a backup of previous run) you can use the same filename like:
Code: Select all
--input-data-file dataopt.dat --output-data-file dataopt.dat