CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 41416
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/40)
http://ccrl.chessdom.com/ccrl/404 (40/4)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/4)

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).
However, our testers use different hardware ranging from the Q8200 through to the most recent i7's and octals. We benchmark our hardware for consistency of results.
These time controls are roughly equivalent to 40 moves in 15 minutes repeating or 40 moves in 1.5 minutes repeating on modern computers.

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.
Also, please note that the 40/40 and 40/4 lists are constructed from totally different databases and not comparable to each other.

Thanks to all of our currently active testers (Graham, Ray, Gabor, Sergio and Volodymyr). Thanks also to Chessdom.com for hosting our website.

40/40 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):

77th Amateur Series Division 2 Tournament (finishing Tuesday 16053)
77th Amateur Series Division 3 Tournament (continuing 16002)
77th Amateur Series Division 4 Tournament (starting Tuesday 16053)
The Mad Woman And The Octopus Tournament (finishing Thursday 16001)
New Tournament (starting Thursday 16001)
FabChess 1.12.8 64-bit Gauntlet (continuing 16063)
Axolotl 1.9 64-bit Gauntlet (continuing 16064)
Minic 1.09 64-bit Gauntlet (continuing 16065)
Ethereal 11.75 64-bit Gauntlet (continuing 16091)
Rubichess 1.6 64-bit Gauntlet (continuing 16092)
Fritz 17 64-bit Gauntlet (continuing 16093)
Xiphos 0.6 64-bit Gauntlet (continuing 16094)
Xiphos 0.6 64-bit 4CPU Gauntlet (continuing 16083)
Ethereal 11.75 64-bit 4CPU Gauntlet (continuing 16084)
Rubichess 1.6 64-bit 4CPU Gauntlet (being run by Volodymyr)
Various 1CPU Tournaments (being run by Sergio)

40/4 testing since the last update report has included (thanks to Gabor, Sergio, Volodymyr and Ray):

JaksaH 1.15 64-bit
Francesca MAD 0.26 64-bit
Xiphos 0.6 64-bit
Stoofvlees II a13 RTX2080
Fat Fritz RTX2080
Stockfish 2019-10-09 64-bit 4CPU
SlowChess Blitz Classic 1.6 64-bit
Swiss Tournaments (Sergio)
gbanksnz at gmail.com
schack
Posts: 172
Joined: Thu May 27, 2010 3:32 am

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by schack »

What is the Leela ratio of the Fat Fritz games?
Gian-Carlo Pascutto
Posts: 1243
Joined: Sat Dec 13, 2008 7:00 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Gian-Carlo Pascutto »

https://www.sp-cc.de/lc0-testing.htm

This shows Fat Fritz being 40-50 Elo weaker? Rather incompatible results, unless 49921 is a very weak net or something.
Jouni
Posts: 3281
Joined: Wed Mar 08, 2006 8:15 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Jouni »

Jouni
Gian-Carlo Pascutto
Posts: 1243
Joined: Sat Dec 13, 2008 7:00 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Gian-Carlo Pascutto »

Jouni wrote: Mon Nov 25, 2019 6:15 pm Chessbase don't waste time https://en.chessbase.com/post/optimizing-fat-fritz .
I am sure Albert Silver (who wrote the article) is very proud he wrote the strongest engine in the world.
Eduard
Posts: 1439
Joined: Sat Oct 27, 2018 12:58 am
Location: Germany
Full name: N.N.

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Eduard »

This rating list is not acceptable to me. And I think you know why.
User avatar
pohl4711
Posts: 2433
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by pohl4711 »

schack wrote: Mon Nov 25, 2019 4:54 am What is the Leela ratio of the Fat Fritz games?
That it the question... I would guess around 1.85. Which is much too high.

I will do a testrun of Lc0 0.22.0 49921 for my ratinglist, now. Because it is the only lc0 net, which was tested in the CCRL. Lets see, how strong this one really is. Result not before next Tuesday...

https://www.sp-cc.de/lc0-testing.htm
Albert Silver
Posts: 3019
Joined: Wed Mar 08, 2006 9:57 pm
Location: Rio de Janeiro, Brazil

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Albert Silver »

Gian-Carlo Pascutto wrote: Tue Nov 26, 2019 9:44 am
Jouni wrote: Mon Nov 25, 2019 6:15 pm Chessbase don't waste time https://en.chessbase.com/post/optimizing-fat-fritz .
I am sure Albert Silver (who wrote the article) is very proud he wrote the strongest engine in the world.
The article on optimization is what I wrote last week. The ratings part was added by CB in view of the result. As to being proud of my work: absolutely.
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."
User avatar
Graham Banks
Posts: 41416
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Graham Banks »

Eduard wrote: Tue Nov 26, 2019 12:50 pm This rating list is not acceptable to me. And I think you know why.
No idea Eduard. Why?
gbanksnz at gmail.com
Eduard
Posts: 1439
Joined: Sat Oct 27, 2018 12:58 am
Location: Germany
Full name: N.N.

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Eduard »

Anyone who conscientiously tests Lc0 against AB Engines knows, there is a Lc0 Ratio for reliable results. And CCRL knows that too. Nevertheless, CCRL does not release any information about it.