Rating lists what I've always wanted to ask the specialists here

[chessica]

Rating lists what I've always wanted to ask the specialists here. What are the operators
of the lists actually testing? Are you testing skill level or just time management? When
I look at the engine-engine tournaments, I'm really desperate about how the results come
about. Wouldn't the test results be more accurate if you tested with a fixed thinking
time per move? has this already been done? What do these lists look like?

So far no one has been able to explain my questions to me.

[Ras]

Are you testing skill level or just time management?

Time management is part of the engine's playing strength, just like with human player.

[chessica]

Hello Rasmus, you are not wrong. But I use the engines as an analysis tool,
so I only do infinite calculations. I never use tournament thinking times.
So for me it's important.

[Uri Blass]

Rating lists what I've always wanted to ask the specialists here. What are the operators
of the lists actually testing? Are you testing skill level or just time management? When
I look at the engine-engine tournaments, I'm really desperate about how the results come
about. Wouldn't the test results be more accurate if you tested with a fixed thinking
time per move? has this already been done? What do these lists look like?

So far no one has been able to explain my questions to me.

Test results are not going to be more accurate with fixed thinking time.

Engines are not prepared for competition with fixed thinking time and I guess programmers can make adjustments to their engine in case they know testers are going to test them with a fixed tested time.