When you integrate new engines to a list, then you have to use few engines to measure comparative strength. Otherwise, you will end up with an independently hanging list that has no correlation to the previous one.
Agreed. We also play most of our quad engines against some good single CPU engines to make sure the list is joined-up. Of course the disparity isn't as great as the SSDF example where the hardware is very different. The only other alternative is two separate lists, which is possibly what Norm is suggesting
Tony Thomas wrote:When you integrate new engines to a list, then you have to use few engines to measure comparative strength. Otherwise, you will end up with an independently hanging list that has no correlation to the previous one.
Somehow I don't like games where one engine has an enormous advantage at the start. That is the case when one engine is playing on an A1200, and the other is playing on a Q6600. Why integrate the list? Just close the old list, and start a new list for the Q6600. Mixing them up is very questionable, imho.
Tony Thomas wrote:When you integrate new engines to a list, then you have to use few engines to measure comparative strength. Otherwise, you will end up with an independently hanging list that has no correlation to the previous one.
Somehow I don't like games where one engine has an enormous advantage at the start. That is the case when one engine is playing on an A1200, and the other is playing on a Q6600. Why integrate the list? Just close the old list, and start a new list for the Q6600. Mixing them up is very questionable, imho.
One engine has an enormous advantage at the start also when the same hardware is used if one engine is called rybka and another engine is called Deep Fritz8.
Why mix rybka and non rybka in the same list?
Tell the ssdf to have one list for rybka engines and another list for weaker engines.
Note that I have no problem with having different hardware in the same list but if you have problems with it then you can also have
problems with different softwares because better software can also give enormous advantage.