Dual Athlon XP2000+
Deep Shredder 11 GUI
128mb hash each
3-4-5 piece tablebases
Ponder off
Xmas2640b.bkt
40 moves in 68 minutes repeating (adapted for the CCRL)
4 cycles (44 rounds)
Dual Athlon XP2000+
Deep Shredder 11 GUI
128mb hash each
3-4-5 piece tablebases
Ponder off
Xmas2640b.bkt
40 moves in 68 minutes repeating (adapted for the CCRL)
4 cycles (44 rounds)
So Smash is a weak engine after all playing around 1800 Elo and even a little bit less....
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
Dual Athlon XP2000+
Deep Shredder 11 GUI
128mb hash each
3-4-5 piece tablebases
Ponder off
Xmas2640b.bkt
40 moves in 68 minutes repeating (adapted for the CCRL)
4 cycles (44 rounds)
Dr.Wael Deeb wrote:So Smash is a weak engine after all playing around 1800 Elo and even a little bit less....
If you think you can base a meaningful rating on just 3 won games, you just don't know how to determine a rating.
It does not matter if you have a score of 3 out of 60, 3 out of 1000, 3 out of 100,000. In all cases the rating will be crap, and the probability the engine would have scored 2 or 4 points in stead of 3 hardly any lower than that it has 3. In fact the standard error in the rating would be far greater with 3 out of 100,000 games than it would be for 3 out of 10 games, as the same statistical error in score would map to a much larger uncertainty in Elo becuase of the (apparently) increased strength difference between the tested engine and its opponents.
So remember: an Elo based on N points can at most be as accurate as any Elo based on ~2N games. So for 3 points that is only 6 effective games. Most of the tail of your rating list is just based on 6 games, and all the other games were a meaningless exercise. This is why your ratings are crap.
Dr.Wael Deeb wrote:So Smash is a weak engine after all playing around 1800 Elo and even a little bit less....
If you think you can base a meaningful rating on just 3 won games, you just don't know how to determine a rating.
It does not matter if you have a score of 3 out of 60, 3 out of 1000, 3 out of 100,000. In all cases the rating will be crap, and the probability the engine would have scored 2 or 4 points in stead of 3 hardly any lower than that it has 3. In fact the standard error in the rating would be far greater with 3 out of 100,000 games than it would be for 3 out of 10 games, as the same statistical error in score would map to a much larger uncertainty in Elo becuase of the (apparently) increased strength difference between the tested engine and its opponents.
So remember: an Elo based on N points can at most be as accurate as any Elo based on ~2N games. So for 3 points that is only 6 effective games. Most of the tail of your rating list is just based on 6 games, and all the other games were a meaningless exercise. This is why your ratings are crap.
All the results of the engines under the 2000 barrier are deleted and will be restarted....
And you are right,the tail of my rating list is not accurate,as I pay attention to the higher divisions,now there is another story running for more than 5 yeaars now....
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
Well, there is no reason to delete any results. Just supplement them with more results of the weak engines amongst each other, so that they get more wins and a score closer to 50%. The results you already have will remain helpful to position them, as a group, relative to the stronger engines in an accurate way.
hgm wrote:Well, there is no reason to delete any results. Just supplement them with more results of the weak engines amongst each other, so that they get more wins and a score closer to 50%. The results you already have will remain helpful to position them, as a group, relative to the stronger engines in an accurate way.
I see,but 6 effective games are way too small and I've started a new series of tournaments on a lower hardware as I won't use my new core 2 duo machine for engines like Cassandre,Soldat,etc....
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
