Scorpio 3.0.7 NN 42850

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Werner
Posts: 2871
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Scorpio 3.0.7 NN 42850

Post by Werner »

Scorpio 3.0.7 now runs fine with LCZero t40 network:

before:
1 LCZero 0.23.2 Cuda (t40-1541) +512 1111111½11111½111111 19.0/20
2 Scorpio 3.0.6 MCTS+NN 42850 -512 0000000½00000½000000 1.0/20

now:
1 Scorpio 3.0.7 MC+NN 42850 +17 ½½½1½101010½½½010101 10.5/20
2 LCZero 0.23.2 Cuda (t40-1541) -17 ½½½0½010101½½½101010 9.5/20
I will continue this match till 100 games.

https://github.com/dshawul/Scorpio/releases
Werner
Daniel Shawul
Posts: 4185
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Re: Scorpio 3.0.7 NN 42850

Post by Daniel Shawul »

Hi Werner,

What changes did you make? My guess is a fresh install was needed instead of editing scorpio.ini.
Anyway, I am glad that T40 nets work with INT8 now -- there was some major bug with INT8 calibration using EPD files.
My tests show that Scorpio with T40 net is slightly weaker than with Lc0 backend on my RTX 2070 super but
speed maybe more important on less powerful GPUs.

regards,
Daniel
User avatar
Werner
Posts: 2871
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: Scorpio 3.0.7 NN 42850

Post by Werner »

Daniel Shawul wrote: Sat Feb 22, 2020 1:22 am My guess is a fresh install was needed instead of editing scorpio.ini.
Hi Daniel,
I made a fresh install with install.bat and then I edited the scorpio.ini for the use with NN 42850. I started 1 times scorpio in command line window and then inside the gui. Here is my scorpio ini:

###################################################
# log on/off - turn logging on and off
# resign - resign value in centipawns
# contempt - +ve value discourages drawishness
###################################################
log off
resign 800
contempt 10
##################################################################
# montecarlo - Use montecarlo tree search (MCTS) if set to 1
# treeht - Maximum size of tree to store in memory given in MB.
# Note that this memory is not allocated at start up; it only
# specifies the maximum limit the tree could grow to.
# Note: Don't think you are making scorpio weak by not setting
# this memory to high value, infact treeht=0 is the strongest
# MCTS setting.
# frac_freeze_tree [0 - 100] - freeze tree after this percentage of time is spent
# frac_alphabeta [0 - 100] - use alpha-beta search this percent of the time
# frac_abrollouts [0 - 100] - use alpha-beta rollouts search this percent of the time
# mcts_strategy_depth [0 - 64] - Lookahead depth for MCTS rollouts
# alphabeta_depth [0 - 64] - Fixed search depth for standard alphabeta searches at the leaves
# evaluate_depth [-4 - 64] - Fixed search depth for evaluation of new children during expansion
# (-4=eval,-3=see,-2=recap qsearch,-1=no-checks qsearch 0=qsearch,x=search)
# backup_type [0 - 7] - minmax = 0, averaging = 1, mixed = 2, for mixing score with
# previous ID use 3,4,5 resp. 6 is classic MCTS, 7 is mixing by visit count
# reuse_tree - reuse MCTS tree between moves
# virtual_loss - virtual loss for parallel search
# visit_threshold - minimum number of visits for minimax backup
# policy_temp - Temperature for move policy
# cpuct_init - Starting cpuct value
# cpuct_base - Denominator of cpuct forumula
# fpu_is_loss - FPU is loss (1=true, 0=false)
# fpu_red - Reduction factor for FPU
##################################################################
montecarlo 1
treeht 12800
frac_freeze_tree 100
frac_alphabeta 0
frac_abrollouts 20
frac_abprior 0
mcts_strategy_depth 30
alphabeta_depth 16
evaluate_depth 0
backup_type 6
reuse_tree 1
virtual_loss 1
visit_threshold 3200
policy_temp 235
cpuct_init 125
cpuct_base 19652
fpu_is_loss 0
fpu_red 33
#############################################################################
# Parallel search setup
# mt - number of processors
# smp_depth - split depth for smp
# cluster_depth - split depth for cluster search
# message_poll_nodes - number nodes to search before checking for message
#############################################################################
mt 64
smp_depth 8
cluster_depth 12
message_poll_nodes 20
smp_type ABDADA
cluster_type YBW
##################################################################
# Hashtable sizes in mb.
# ht - main hash table shared by ALL threads
# eht - evalualtion hash table allocated PER thread
# pht - pawn hash table allocated PER thread
# Usually 1m or 2mb is enough for pawn hash table, but the others
# can be set as high as possible
##################################################################
ht 64
eht 4
pht 1
##########################################################################
# EGBB
# egbb_path - path to dll/so file for probing endgame egbbs
# egbb_files_path - path to endgame egbbs, if not specified it takes
# value of egbb_path
# egbb_cache_size - cache size for egbbs in MBs
# egbb_ply_limit_percent - percent of plies from the root to egbb probing
# egbb_depth_limit - depth from the leaves to egbb probing
# egbb_load_type - egbb load type with the following values
# 0 = none are loaded
# 1 = all 3/4 men are loaded
# 2 = Not implemented yet
# 3 = all 5 men are loaded
##########################################################################
egbb_path C:\Users\6600K\Arena\Engines\Scorpio307i\Scorpio-09-56\nnprobe-windows-gpu
egbb_files_path C:\Users\6600K\Arena\Engines\Scorpio307i\Scorpio-09-56\egbb
egbb_cache_size 32
egbb_load_type 3
egbb_depth_limit 6
#######################################
# NN
# use_nn - turn off/on neural network
# nn_cache_size - neural network cache size in MBs
# nn_path - path to neural network
# nn_type - type of neural network (0=scorpio, 1=lczero)
# device_type - CPU or GPU
# delay - Sleep threads for this amount. Set this to 1
# if you are using way too many threads than you
# have physical cores (maybe when >16x more).
# float_type - inference precison for tensorrt = FLOAT/HALF/INT8
# wdl_head - network has WDL head (e.g JH networks do)
# win/draw/loss_weight - weights for WDL resp in precent, range is [0...1000]
# alphabeta_man_c - switch to regular alpha-beta search with this many pieces on board
#######################################
use_nn 1
nn_cache_size 100
nn_type 1
wdl_head 0
nn_path c:\Users\6600K\Arena\Engines\Scorpio307i\Scorpio-09-56\nets-lczero\ID-42850.uff
device_type GPU
n_devices 1
delay 0
float_type INT8
win_weight 100
draw_weight 100
loss_weight 100
alphabeta_man_c 9
################################################################
# Multiple nets settings
#------------------------
# The opening is played by default network specified above
# nn_man_m/e -- threshold piece counts for middle/end game
# nn_type_m/e -- neural network type for middle/end game
# >=0 = as specified before
# -1/-2/-3 = used to refer to either opening/midgame/endgame network
# nn_path_m/e -- path to neural networks for middle/end game
# cpuct_init_m/e -- cpuct for middle/endgame
# policy_temp_m/e -- policy temperature for middle/endgame
# wdl_head_m/e -- wdl value head for middle/endgame
# ensemble -- percent of time to use ensembling [0-100]
# ensemble_type -- 0 = arthimetic mean, 1 = root mean cube
################################################################
nn_man_m 24
nn_man_e 14
nn_type_m -1
nn_type_e -1
nn_path_m c:\Users\6600K\Arena\Engines\Scorpio307i\Scorpio-09-56\nets-lczero\ID-42850.uff
nn_path_e C:\Users\6600K\Arena\Engines\Scorpio307i\Scorpio-09-56\nets-maddex\ME.uff
cpuct_init_m 125
cpuct_init_e 125
policy_temp_m 235
policy_temp_e 235
wdl_head_m 0
wdl_head_e 1
ensemble 0
ensemble_type 0
Werner
User avatar
Werner
Posts: 2871
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: Scorpio 3.0.7 NN 42850

Post by Werner »

Werner wrote: Fri Feb 21, 2020 8:51 am Scorpio 3.0.7 now runs fine with LCZero t40 network:
before:
1 LCZero 0.23.2 Cuda (t40-1541) +512 1111111½11111½111111 19.0/20
2 Scorpio 3.0.6 MCTS+NN 42850 -512 0000000½00000½000000 1.0/20
now:
1 Scorpio 3.0.7 MC+NN 42850 +17 ½½½1½101010½½½010101 10.5/20
2 LCZero 0.23.2 Cuda (t40-1541) -17 ½½½0½010101½½½101010 9.5/20
I will continue this match till 100 games.
https://github.com/dshawul/Scorpio/releases
Finished match
1 LCZero 0.23.2 Cuda (t40-1541) +49 +30/=54/-16 57.00% 57.0/100 (3487)
2 Scorpio 3.0.7 MC+42850 -49 +16/=54/-30 43.00% 43.0/100 (3438)
@Daniel: which networks do you use on CCC ?
Werner
Steppenwolf
Posts: 75
Joined: Thu Jan 31, 2019 4:54 pm
Full name: Sven Steppenwolf

Re: Scorpio 3.0.7 NN 42850

Post by Steppenwolf »

Can anybody post how to run Scorpio (or make a binary) on macOS Catalina?
Thanks in Advance...
Daniel Shawul
Posts: 4185
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Re: Scorpio 3.0.7 NN 42850

Post by Daniel Shawul »

Hi Werner,

Thanks for the test. I just wanted to be sure T40 nets work with INT8.
The default network with medium Ender is used for CCCC.

@Steppenwolf, the installation is pretty easy. All you have to do is download the install script for windows (install.bat) or for linux (install.sh).
Run that to install scorpio. The install scripts are available herehttps://github.com/dshawul/Scorpio/releases

regards,
Daniel
Steppenwolf
Posts: 75
Joined: Thu Jan 31, 2019 4:54 pm
Full name: Sven Steppenwolf

Re: Scorpio 3.0.7 NN 42850

Post by Steppenwolf »

Maybe I am to stupid.
I am using not Linux, I am using macOS Catalina...there is nothing be there.
Maybe the Community can provide a Compiled binary?
Thanks!
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Scorpio 3.0.7 NN 42850

Post by dkappe »

Steppenwolf wrote: Tue Feb 25, 2020 4:04 pm Maybe I am to stupid.
I am using not Linux, I am using macOS Catalina...there is nothing be there.
Maybe the Community can provide a Compiled binary?
Thanks!
Macs don’t have a) good gpu’s b) good support for gpu’s. You’ll need to use cpu backends.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".