CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Discussion of computer chess matches and engine tournaments.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
Graham Banks
Posts: 33220
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Graham Banks » Sun Nov 24, 2019 7:42 pm

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/40)
http://ccrl.chessdom.com/ccrl/404 (40/4)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/4)

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).
However, our testers use different hardware ranging from the Q8200 through to the most recent i7's and octals. We benchmark our hardware for consistency of results.
These time controls are roughly equivalent to 40 moves in 15 minutes repeating or 40 moves in 1.5 minutes repeating on modern computers.

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.
Also, please note that the 40/40 and 40/4 lists are constructed from totally different databases and not comparable to each other.

Thanks to all of our currently active testers (Graham, Ray, Gabor, Sergio and Volodymyr). Thanks also to Chessdom.com for hosting our website.

40/40 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):

77th Amateur Series Division 2 Tournament (finishing Tuesday 16053)
77th Amateur Series Division 3 Tournament (continuing 16002)
77th Amateur Series Division 4 Tournament (starting Tuesday 16053)
The Mad Woman And The Octopus Tournament (finishing Thursday 16001)
New Tournament (starting Thursday 16001)
FabChess 1.12.8 64-bit Gauntlet (continuing 16063)
Axolotl 1.9 64-bit Gauntlet (continuing 16064)
Minic 1.09 64-bit Gauntlet (continuing 16065)
Ethereal 11.75 64-bit Gauntlet (continuing 16091)
Rubichess 1.6 64-bit Gauntlet (continuing 16092)
Fritz 17 64-bit Gauntlet (continuing 16093)
Xiphos 0.6 64-bit Gauntlet (continuing 16094)
Xiphos 0.6 64-bit 4CPU Gauntlet (continuing 16083)
Ethereal 11.75 64-bit 4CPU Gauntlet (continuing 16084)
Rubichess 1.6 64-bit 4CPU Gauntlet (being run by Volodymyr)
Various 1CPU Tournaments (being run by Sergio)

40/4 testing since the last update report has included (thanks to Gabor, Sergio, Volodymyr and Ray):

JaksaH 1.15 64-bit
Francesca MAD 0.26 64-bit
Xiphos 0.6 64-bit
Stoofvlees II a13 RTX2080
Fat Fritz RTX2080
Stockfish 2019-10-09 64-bit 4CPU
SlowChess Blitz Classic 1.6 64-bit
Swiss Tournaments (Sergio)
My email addresses:
gbanksnz at gmail.com
gbanksnz at yahoo.co.nz

schack
Posts: 140
Joined: Thu May 27, 2010 1:32 am
Contact:

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by schack » Mon Nov 25, 2019 3:54 am

What is the Leela ratio of the Fat Fritz games?

Gian-Carlo Pascutto
Posts: 1189
Joined: Sat Dec 13, 2008 6:00 pm
Contact:

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Gian-Carlo Pascutto » Mon Nov 25, 2019 11:59 am

https://www.sp-cc.de/lc0-testing.htm

This shows Fat Fritz being 40-50 Elo weaker? Rather incompatible results, unless 49921 is a very weak net or something.

Jouni
Posts: 2024
Joined: Wed Mar 08, 2006 7:15 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Jouni » Mon Nov 25, 2019 5:15 pm

Jouni

Gian-Carlo Pascutto
Posts: 1189
Joined: Sat Dec 13, 2008 6:00 pm
Contact:

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Gian-Carlo Pascutto » Tue Nov 26, 2019 8:44 am

Jouni wrote:
Mon Nov 25, 2019 5:15 pm
Chessbase don't waste time https://en.chessbase.com/post/optimizing-fat-fritz .
I am sure Albert Silver (who wrote the article) is very proud he wrote the strongest engine in the world.

User avatar
Eduard
Posts: 224
Joined: Fri Oct 26, 2018 10:58 pm
Location: Germany
Full name: Eduard Nemeth
Contact:

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Eduard » Tue Nov 26, 2019 11:50 am

This rating list is not acceptable to me. And I think you know why.

pohl4711
Posts: 1102
Joined: Sat Sep 03, 2011 5:25 am
Location: Berlin, Germany
Contact:

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by pohl4711 » Tue Nov 26, 2019 12:23 pm

schack wrote:
Mon Nov 25, 2019 3:54 am
What is the Leela ratio of the Fat Fritz games?
That it the question... I would guess around 1.85. Which is much too high.

I will do a testrun of Lc0 0.22.0 49921 for my ratinglist, now. Because it is the only lc0 net, which was tested in the CCRL. Lets see, how strong this one really is. Result not before next Tuesday...

https://www.sp-cc.de/lc0-testing.htm

Albert Silver
Posts: 2867
Joined: Wed Mar 08, 2006 8:57 pm
Location: Rio de Janeiro, Brazil

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Albert Silver » Tue Nov 26, 2019 2:02 pm

Gian-Carlo Pascutto wrote:
Tue Nov 26, 2019 8:44 am
Jouni wrote:
Mon Nov 25, 2019 5:15 pm
Chessbase don't waste time https://en.chessbase.com/post/optimizing-fat-fritz .
I am sure Albert Silver (who wrote the article) is very proud he wrote the strongest engine in the world.
The article on optimization is what I wrote last week. The ratings part was added by CB in view of the result. As to being proud of my work: absolutely.
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."

User avatar
Graham Banks
Posts: 33220
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Graham Banks » Tue Nov 26, 2019 6:57 pm

Eduard wrote:
Tue Nov 26, 2019 11:50 am
This rating list is not acceptable to me. And I think you know why.
No idea Eduard. Why?
My email addresses:
gbanksnz at gmail.com
gbanksnz at yahoo.co.nz

User avatar
Eduard
Posts: 224
Joined: Fri Oct 26, 2018 10:58 pm
Location: Germany
Full name: Eduard Nemeth
Contact:

Re: CCRL 40/40, 40/4 and FRC lists updated (23rd November 2019)

Post by Eduard » Tue Nov 26, 2019 7:22 pm

Anyone who conscientiously tests Lc0 against AB Engines knows, there is a Lc0 Ratio for reliable results. And CCRL knows that too. Nevertheless, CCRL does not release any information about it.

Post Reply