Page 1 of 3

CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Posted: Sun Nov 24, 2019 8:42 pm
by Graham Banks
The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/40)
http://ccrl.chessdom.com/ccrl/404 (40/4)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/4)

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).
However, our testers use different hardware ranging from the Q8200 through to the most recent i7's and octals. We benchmark our hardware for consistency of results.
These time controls are roughly equivalent to 40 moves in 15 minutes repeating or 40 moves in 1.5 minutes repeating on modern computers.

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.
Also, please note that the 40/40 and 40/4 lists are constructed from totally different databases and not comparable to each other.

Thanks to all of our currently active testers (Graham, Ray, Gabor, Sergio and Volodymyr). Thanks also to Chessdom.com for hosting our website.

40/40 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):

77th Amateur Series Division 2 Tournament (finishing Tuesday 16053)
77th Amateur Series Division 3 Tournament (continuing 16002)
77th Amateur Series Division 4 Tournament (starting Tuesday 16053)
The Mad Woman And The Octopus Tournament (finishing Thursday 16001)
New Tournament (starting Thursday 16001)
FabChess 1.12.8 64-bit Gauntlet (continuing 16063)
Axolotl 1.9 64-bit Gauntlet (continuing 16064)
Minic 1.09 64-bit Gauntlet (continuing 16065)
Ethereal 11.75 64-bit Gauntlet (continuing 16091)
Rubichess 1.6 64-bit Gauntlet (continuing 16092)
Fritz 17 64-bit Gauntlet (continuing 16093)
Xiphos 0.6 64-bit Gauntlet (continuing 16094)
Xiphos 0.6 64-bit 4CPU Gauntlet (continuing 16083)
Ethereal 11.75 64-bit 4CPU Gauntlet (continuing 16084)
Rubichess 1.6 64-bit 4CPU Gauntlet (being run by Volodymyr)
Various 1CPU Tournaments (being run by Sergio)

40/4 testing since the last update report has included (thanks to Gabor, Sergio, Volodymyr and Ray):

JaksaH 1.15 64-bit
Francesca MAD 0.26 64-bit
Xiphos 0.6 64-bit
Stoofvlees II a13 RTX2080
Fat Fritz RTX2080
Stockfish 2019-10-09 64-bit 4CPU
SlowChess Blitz Classic 1.6 64-bit
Swiss Tournaments (Sergio)

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Posted: Mon Nov 25, 2019 4:54 am
by schack
What is the Leela ratio of the Fat Fritz games?

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Posted: Mon Nov 25, 2019 12:59 pm
by Gian-Carlo Pascutto
https://www.sp-cc.de/lc0-testing.htm

This shows Fat Fritz being 40-50 Elo weaker? Rather incompatible results, unless 49921 is a very weak net or something.

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Posted: Mon Nov 25, 2019 6:15 pm
by Jouni

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Posted: Tue Nov 26, 2019 9:44 am
by Gian-Carlo Pascutto
Jouni wrote: Mon Nov 25, 2019 6:15 pm Chessbase don't waste time https://en.chessbase.com/post/optimizing-fat-fritz .
I am sure Albert Silver (who wrote the article) is very proud he wrote the strongest engine in the world.

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Posted: Tue Nov 26, 2019 12:50 pm
by Eduard
This rating list is not acceptable to me. And I think you know why.

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Posted: Tue Nov 26, 2019 1:23 pm
by pohl4711
schack wrote: Mon Nov 25, 2019 4:54 am What is the Leela ratio of the Fat Fritz games?
That it the question... I would guess around 1.85. Which is much too high.

I will do a testrun of Lc0 0.22.0 49921 for my ratinglist, now. Because it is the only lc0 net, which was tested in the CCRL. Lets see, how strong this one really is. Result not before next Tuesday...

https://www.sp-cc.de/lc0-testing.htm

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Posted: Tue Nov 26, 2019 3:02 pm
by Albert Silver
Gian-Carlo Pascutto wrote: Tue Nov 26, 2019 9:44 am
Jouni wrote: Mon Nov 25, 2019 6:15 pm Chessbase don't waste time https://en.chessbase.com/post/optimizing-fat-fritz .
I am sure Albert Silver (who wrote the article) is very proud he wrote the strongest engine in the world.
The article on optimization is what I wrote last week. The ratings part was added by CB in view of the result. As to being proud of my work: absolutely.

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Posted: Tue Nov 26, 2019 7:57 pm
by Graham Banks
Eduard wrote: Tue Nov 26, 2019 12:50 pm This rating list is not acceptable to me. And I think you know why.
No idea Eduard. Why?

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Posted: Tue Nov 26, 2019 8:22 pm
by Eduard
Anyone who conscientiously tests Lc0 against AB Engines knows, there is a Lc0 Ratio for reliable results. And CCRL knows that too. Nevertheless, CCRL does not release any information about it.