Engine that allows tuning its evaluations?
Moderators: hgm, Rebel, chrisw
-
- Posts: 582
- Joined: Wed May 10, 2006 7:28 pm
- Location: Birmingham, England
Engine that allows tuning its evaluations?
I'm looking for a (strong) UCI engine that allows the tuning of its numerical evaluations. A good example would be a multiplier setting. While the default setting is "1", when the multiplier is set to "1.5" then a position normally evaluated at, say, "+0.76" centipawns would be evaluated and displayed and processed as "+1.14". In other words, advantages (and disadvantages) would be exaggerated when the multiplier is positive.
Marek Soszynski
Re: Engine that allows tuning its evaluations?
Glaurung has about a billion UCI options for tuning eval. But I don't think there is any engine that has a multiplier like that right now.
-
- Posts: 670
- Joined: Mon Dec 03, 2007 3:01 pm
- Location: Barcelona, Spain
Re: Engine that allows tuning its evaluations?
What is the purpose of this multiplier for the total evaluation?
If you want to tune an engine, you should try adjusting individual parts of the evaluation function, such as increasing the relevance of kingsafety.
Adjusting the total evaluation won't have much effect on the tree searched. The only places where I could imagine any differences would be, where absolute numbers are used for cutoffs. Eg Delta Cutoff in Quiescence search. There one uses the assumption, that making a certain move won't increase the value of the position by more than a static amount.
If you want to tune an engine, you should try adjusting individual parts of the evaluation function, such as increasing the relevance of kingsafety.
Adjusting the total evaluation won't have much effect on the tree searched. The only places where I could imagine any differences would be, where absolute numbers are used for cutoffs. Eg Delta Cutoff in Quiescence search. There one uses the assumption, that making a certain move won't increase the value of the position by more than a static amount.
-
- Posts: 12542
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: Engine that allows tuning its evaluations?
If everything is scaled by the same linear factor the net effect will be zero.
In other words if a pawn is worth 1000 then a knight will be 3200 or so.
In other words if a pawn is worth 1000 then a knight will be 3200 or so.
Re: Engine that allows tuning its evaluations?
Not sure if the OP intended this, but if you exclude material from the multiplier, you can roughly determine how speculative your program will play. And in my engine that's how my speculative option works. (Although a few evaluationparameters are excluded) A program that allows tuning of evaluation should ofcourse also adjust it's safety margins in search accordingly. (for example those delta pruning margins.)Codeman wrote:What is the purpose of this multiplier for the total evaluation?
For example internally my multiplier currently runs on 2, because in the beginning I was afraid to give big bonusses. My speculative option allows this to be set to resp. 4 and 6, and on 6 it will feed pawns and pieces at random for a little development, passed pawn or kingattack. Just how chess should be. (and about 400 Elo weaker. )
Stan
Ps. On a sidenote considering delta pruning, last weeks I have experimented with some sort of intelligent delta pruning in quiescent search, because I don't do SEE pruning. Fe. capturing a knight won't be able to cause a huge positional evaluation jump, while capturing a passed pawn or queen likely can. Along with also always giving recaptures on the previous square a high margin, (that really reduces risk of completely missing positional cases) this turned out to be quite safe and works well for me.
-
- Posts: 582
- Joined: Wed May 10, 2006 7:28 pm
- Location: Birmingham, England
Re: Engine that allows tuning its evaluations?
>If everything is scaled by the same linear factor the net effect will be zero.
>What is the purpose of this multiplier for the total evaluation?
It is strange that in many engines it is possible to alter all kinds of settings - except this one.
There are at least three situations where a multiplier setting could be useful.
1) It is always possible that an engine has a "wrong" relative evaluation. Older versions of Shredder are an example of an engine exaggerating advantages compared to the evaluations of other engines.
2) Altering the multiplier could affect the length of games. A high (positive) multiplier would cause the engine to resign earlier, and could cause a different attitude to draw offers and agreements.
3) There are some special circumstances where the absolute value of evaluations could be important. For instance, in Aquarium IDeA which converts an engine's evaluations from centipawns to percentages and back again.
>What is the purpose of this multiplier for the total evaluation?
It is strange that in many engines it is possible to alter all kinds of settings - except this one.
There are at least three situations where a multiplier setting could be useful.
1) It is always possible that an engine has a "wrong" relative evaluation. Older versions of Shredder are an example of an engine exaggerating advantages compared to the evaluations of other engines.
2) Altering the multiplier could affect the length of games. A high (positive) multiplier would cause the engine to resign earlier, and could cause a different attitude to draw offers and agreements.
3) There are some special circumstances where the absolute value of evaluations could be important. For instance, in Aquarium IDeA which converts an engine's evaluations from centipawns to percentages and back again.
Marek Soszynski
-
- Posts: 540
- Joined: Sat Nov 11, 2006 2:56 pm
Re: Engine that allows tuning its evaluations?
You may be able to do it only as a visual reference in Arena GUI:
Right Click on Permanent Statistics and then click "Scale the statistics".
Now, slide the slider to the left (to 1).
The engine evaluation scores would now form taller towers even for shorter values.
Don't know if this is what you were looking for.
Right Click on Permanent Statistics and then click "Scale the statistics".
Now, slide the slider to the left (to 1).
The engine evaluation scores would now form taller towers even for shorter values.
Don't know if this is what you were looking for.
-
- Posts: 9773
- Joined: Wed Mar 08, 2006 8:44 pm
- Location: Amman,Jordan
Re: Engine that allows tuning its evaluations?
No,he means real tunning of the engine's evaluation itself....Anil wrote:You may be able to do it only as a visual reference in Arena GUI:
Right Click on Permanent Statistics and then click "Scale the statistics".
Now, slide the slider to the left (to 1).
The engine evaluation scores would now form taller towers even for shorter values.
Don't know if this is what you were looking for.
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
-
- Posts: 3245
- Joined: Thu Mar 09, 2006 9:10 am
Re: Engine that allows tuning its evaluations?
Dr.Wael Deeb wrote:No,he means real tunning of the engine's evaluation itself....Anil wrote:You may be able to do it only as a visual reference in Arena GUI:
Right Click on Permanent Statistics and then click "Scale the statistics".
Now, slide the slider to the left (to 1).
The engine evaluation scores would now form taller towers even for shorter values.
Don't know if this is what you were looking for.
He wants to tune the final score _after_ search.
He is aware that this will not affect the engine's search: search depth, best move, search time, nodes, speed, etc, will not change and he knows it.
Matthias.
My engine was quite strong till I added knowledge to it.
http://www.chess.hylogic.de
http://www.chess.hylogic.de