LS-rankinglist: Komodo 5

[lkaufman]

Before this version of the LS-rankinglist, I had the TEB-rankinglist and a LS-rankinglist, which were the same except the thinking time. TEB had 60''+750ms. The results were the same (all differences were inside errorbar), so I decided the TEB-speed is to slow, it is better to have more games than long games.
Only effect of more thinking time is, that all results are closer to 50%, which means the elo-distances in a rankinglistlist with more thinking time are smaller. But the order in the list stays the same.
By the way: Before the TEB-list, I had the two NEBB-lists (half of TEB-time and a list with 4'+2'' (a so called "regular time"). The order of the engines in that lists were the same, too (except Komodo 4). So it really doesnt matter, if you use 4'+2'' or 60''+750ms or 20''+250ms. Only the distances between the engines in a list are getting bigger. And thats not a big problem (in my opinion), because I am interested in the order of the engines, not in virtual "Elo"-numbers...

With longer thinking times in engine testing you get only 1 profit (better chess), but 2 problems: a) less number of games -> bigger errorbar and b) smaller distances between engines in a rankinglist, which is another source of uncertainty, if you have some engines wich are nearly at the same level of playing strength... For that problem see your own Sedat-rankinglist and the results of the Houdini T3 and z-Setting: So close to Houdini default and so big errorbar: pure random, that t3 and z are better than default-Houdini 2. That is a big waste of your valuable time! Robert Houdart played a much bigger number of (ultrafast) games with the z-setting and it was not stronger (slightly weaker) than the default-engine.

Best - Stefan

"Randomness is a monster and you beat it by volume." - Ed Schroeder

On your list, we are some 16 elo behind Critter 1.6. But if you look at all the normal (meaning slower than bullet) rating lists and combine the results there is little doubt that Komodo 5 is stronger than Critter. There is something about the search in Ippo that makes it and all other programs which use this search especially good at ultra-fast chess. I expect that when we pass Houdini 2 on those other lists we will still be behind on your list.

[JManion]

Sedat

I love your rating list and I do not see a problem with Stefan tests.

Many sites use repeating time controls which are not used "irl" They are not used in fide, uscf, playchess games, icc games, etc.

Good luck on this new list.