Texel tuning: is tanh viable?

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

bctboi23
Posts: 21
Joined: Fri Feb 07, 2020 2:48 am
Location: United States
Full name: Tom R

Texel tuning: is tanh viable?

Post by bctboi23 »

I was getting back into chess programming and working through a tuning method like the Texel method to try and squeeze out some more elo on the vice clone I have before I go for a fully new engine, and was wondering if it would be a good idea to use the tanh function instead of the sigmoid function, anyone have any experience trying it? My first guess would be that it would perform better than the sigmoid function on tuning, since the gradient near 0 (where most of the tuning gains would likely be had) is larger, but I could be wildy off base.
User avatar
hgm
Posts: 28477
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Texel tuning: is tanh viable?

Post by hgm »

They are the same, not? Apart from shifting and scaling that makes one range from 0 to 1, instead of -1 to 1.
bctboi23
Posts: 21
Joined: Fri Feb 07, 2020 2:48 am
Location: United States
Full name: Tom R

Re: Texel tuning: is tanh viable?

Post by bctboi23 »

Yeah, essentially they are the same, except for the shifting means it is zero mean. The way texel tuning is described on the chessprogramming wiki has the scaling constant but no shift, and I guess I'm just asking if shifting to zero mean makes sense, the understanding I have being in other learning problems that the zero mean tends to help speed up convergence