Updated comparison of Amy, Crazy Bishop and Phalanx

[Kirill Kryukov]

I updated the comparison with ratings kindly shown to me by Tony Thomas, Swaminathan and Wael Deeb. It is attached here (I can't attach files in this forum). (Direct link to file). I also changed to a better method for computing the average ratings.

Unfortunately I could not find the number of games these engines played in WOCT, ChessWar and Le Systeme du Suisse.

Comments, corrections, additions or ideas are welcome.

[swami]

Thanks for the update, Kirill. It's interesting to know engines do sometimes perform entirely different at blitz than they do on longer time controls.

For example, In Blitz ratings, Tony's List, my list and Claude's list more or less confirm that TCB> Phalanx > Amy.

While longer Time controls ratings system confirm that: Amy> TCB> Phalanx.

So I'm happy to know that Blitz is sometimes indeed entirely different league. (albeit only amongst the engines of similar strength)

One thing that is common in blitz and Longer Time controls tournament is that: they both correctly confirm that Rybka > Toga > Frenzee

[swami]

Comments, corrections, additions or ideas are welcome.

There is one more ratings list you missed:

FACE Tournament by Gerhard

http://computer-chess.org/doku.php?id=c ... ments:face

Regards.

[Kirill Kryukov]

Comments, corrections, additions or ideas are welcome.

There is one more ratings list you missed:

FACE Tournament by Gerhard

http://computer-chess.org/doku.php?id=c ... ments:face

Regards.

Thanks, it will appear in the next version of comparison.

I actually looked at it before but did not notice the complete rating list, which is not online but is only available as download. I found it now.

[Kirill Kryukov]

Thanks for the update, Kirill. It's interesting to know engines do sometimes perform entirely different at blitz than they do on longer time controls.

For example, In Blitz ratings, Tony's List, my list and Claude's list more or less confirm that TCB> Phalanx > Amy.

While longer Time controls ratings system confirm that: Amy> TCB> Phalanx.

So I'm happy to know that Blitz is sometimes indeed entirely different league. (albeit only amongst the engines of similar strength)

Well the problem is that KCEC, CEGT 40/4 and FACE are very blitz, and they support Amy > TCB > Phalanx standing.

I agree that it's very interesting to see the differences between the lists.

One thing that is common in blitz and Longer Time controls tournament is that: they both correctly confirm that Rybka > Toga > Frenzee

Can't argue with that!

[Tony Thomas]

Kirill, I wish you hadnt used the values from my first prior 0.1 experiment. After doing that, I realized that I had to use a much lower offset value to get a realistic rating for those engines. Only problem is that now I have few engines with a negetive rating. I guess those engines have a good chance in losers chess. I guess it doesnt really matter since you are calculating the average, but it would have been better to use the ratings that I posted with the recently recaliberated ratings.

[Kirill Kryukov]

Kirill, I wish you hadnt used the values from my first prior 0.1 experiment. After doing that, I realized that I had to use a much lower offset value to get a realistic rating for those engines. Only problem is that now I have few engines with a negetive rating. I guess those engines have a good chance in losers chess. I guess it doesnt really matter since you are calculating the average, but it would have been better to use the ratings that I posted with the recently recaliberated ratings.

Offset does not matter because this time I calibrate the ratings in all lists to the same standard (KCEC). Though I'll appreciate if you point me to your latest list. Thanks. (Negative ratings don't scare me either).

[Tony Thomas]

Kirill, I wish you hadnt used the values from my first prior 0.1 experiment. After doing that, I realized that I had to use a much lower offset value to get a realistic rating for those engines. Only problem is that now I have few engines with a negetive rating. I guess those engines have a good chance in losers chess. I guess it doesnt really matter since you are calculating the average, but it would have been better to use the ratings that I posted with the recently recaliberated ratings.

Offset does not matter because this time I calibrate the ratings in all lists to the same standard (KCEC). Though I'll appreciate if you point me to your latest list. Thanks. (Negative ratings don't scare me either).

My latest rating isnt published yet, I am not planning to until I add some much needed games for those engines with a 0% score. There were also three or four new engines released after my computer started having problems. Please give me about a month.

[Kirill Kryukov]

My latest rating isnt published yet, I am not planning to until I add some much needed games for those engines with a 0% score. There were also three or four new engines released after my computer started having problems. Please give me about a month.

I'll look forward to it!

[pedrox]

I got 2 conclusions:

1. Phalanx plays better in blitz.
2. TCB has better ponder that Amy, this seems to indicate WBEC and ChessWar.