CCRL update (6th November 2009)

[Graham Banks]

In the CEGT rating list i can see all last version since 3.21a

Yes, but you can run twice as many games at a 40/20 time control. That's one explanation.

Cheers,
Graham.

[Engin]

ok, since version 3.0 they are was buggy then fixed and updated quickly, but version 3.21a are stable i think or?.

how much games need to be established in your list?

is 100 games are not enough or even 50 ?

[Graham Banks]

ok, since version 3.0 they are was buggy then fixed and updated quickly, but version 3.21a are stable i think or?.

how much games need to be established in your list?

is 100 games are not enough or even 50 ?

An engine must have at least 200 games in order to become established in our lists.

Cheers,
Graham.

[bigo]

Why is there no Stockfish 1.5.1 in either ccrl or cegt? The engine has been out quite some time.

[Werner]

I am just testing Tornado 3.21a x64 2CPU and now we have a new version already. I think on CEGT 40/20 we need at least 300 - 500 games to see which version is really better (dedpends on the differecne in elos)

[Graham Banks]

Why is there no Stockfish 1.5.1 in either ccrl or cegt? The engine has been out quite some time.

You need to look more carefully.

[gerold]

Thanks to all the testers that make a good rating list.
Rating list that show just one version of the strongest
engine seems to be the most accurate and a lot
easier to understand.
25 versions of the same engine seems to have a
high error rate.

Best.

Gerold.

[Kirill Kryukov]

Thanks to all the testers that make a good rating list.
Rating list that show just one version of the strongest
engine seems to be the most accurate and a lot
easier to understand.
25 versions of the same engine seems to have a
high error rate.

Best.

Gerold.

This is the idea behind constructing our "Pure" lists, please see here. Only one version of each engine is allowed to enter.

[gerold]

Thanks to all the testers that make a good rating list.
Rating list that show just one version of the strongest
engine seems to be the most accurate and a lot
easier to understand.
25 versions of the same engine seems to have a
high error rate.

Best.

Gerold.

This is the idea behind constructing our "Pure" lists, please see here. Only one version of each engine is allowed to enter.

Thanks Kirill.
I had forgotten about that list. Put a shortcut on my
desktop for easy access.
Best.

Gerold.

[Norm Pollock]

ok, since version 3.0 they are was buggy then fixed and updated quickly, but version 3.21a are stable i think or?.

how much games need to be established in your list?

is 100 games are not enough or even 50 ?

An engine must have at least 200 games in order to become established in our lists.

Cheers,
Graham.

I think 200 games is fine. But I also think there should be a minimum number of different opponents each with a minimum number of games.

200 games against 1 opponent just doesn't seem as meaningful as 200 games total where there are 20 opponents, each with a minimum of 4 games.