Hamsters CCRL rating

[Uri Blass]

changing the link make it 90%

http://computerchess.org.uk/ccrl/4040.l ... =by+rating

[Kirill Kryukov]

Look at the error bars. Statistically Hamsters 0.4 is extremely likely to be stronger at 40/40.

You don't need to just look at the error bars. Using the CCRL custom comparison utility the Likelihood of Superiority of Hamsters at 40/40 is only 78.5%.

I wonder how did you get the 78.5% number.
I do not know about CCRL utility that compare rating at different time control.

Indeed we don't have a tool to compare ratings at different time controls yet, but we are planning to add it soon.

I only know about liklihood of superiority between 2 programs from the same list and even in this case I know to do it only when they are from the same family and even for programs for the same family I cannot always do it and I cannot see lilkelihood of superiority between hamsters and kiwi.

You can see likelihood of superiority between any 2 programs of your choice (if they are tested in the same time control). You should use custom comparison feature, which allows you to select any arbitrary set of engines. Easiest way to do it:

Open the index page, scroll down to the "Custom comparison" section, select engines you want to compare in the "Engines" selection list, press "Compare them!" button.

You can as well select complete families.

This is the selection of all Kiwi and Hamsters versions in 40/40, took me 10 seconds to make: Link.

When you are watching any custom comparison, like selection of engines from one family, etc, you can easily modify the selection using "Alter engine selection" interface at the end of page. You can add or remove any engines there and see the list and tables again. For example, I just removed all Hamsters versions except 0.4: Link.

[Kirill Kryukov]

There are not enough games. Last time I tested, Hamsters performed slightly worse at longer time controls, but that was before a bunch of many bug fixes. I expect the rating to come close to that of blitz, hopefully not worse this time.

The good news of course is that whatever the rating, it made it into the CCRL list!

Wow I did not notice that new Hamsters is (are?) so strong... I will have to include it into my systematic Free Single-CPU 40/4 comparison.

[Uri Blass]

changing the link make it 90%

http://computerchess.org.uk/ccrl/4040.l ... =by+rating

Things change quickly

Now movei has 79% superiority.

http://www.computerchess.org.uk/ccrl/40 ... msters_0_4

[Graham Banks]

Things change quickly

Now movei has 79% superiority.

Indeed - never trust ratings or stats for engines with a small number of games!