Page 1 of 1

CCRL 40/40, 40/4 and FRC lists updated (12th October 2019)

Posted: Sun Oct 13, 2019 12:10 am
by Graham Banks
The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/40)
http://ccrl.chessdom.com/ccrl/404 (40/4)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/4)

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).
However, our testers use different hardware ranging from the Q8200 through to the most recent i7's and octals. We benchmark our hardware for consistency of results.
These time controls are roughly equivalent to 40 moves in 15 minutes repeating or 40 moves in 1.5 minutes repeating on modern computers.

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.
Also, please note that the 40/40 and 40/4 lists are constructed from totally different databases and not comparable to each other.

Thanks to all of our currently active testers (Graham, Ray, Tirsa, Gabor, Sergio and Volodymyr). Thanks also to Chessdom.com for hosting our website.

40/40 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):

76th Amateur Series Division 6 Tournament (continuing 16001)
76th Amateur Series Division 7 Tournament (continuing 16002)
76th Amateur Series Division 8 Tournament (continuing 16053)
Nawito 1906 Gauntlet (continuing 16063)
chess22k 1.13 64-bit Gauntlet (continuing 16064)
Micah 1.0 64-bit Gauntlet (starting Wednesday 16065)
Asymptote 0.6.3 64-bit Gauntlet (finishing Wednesday 16066)
RofChade 2.202 64-bit Gauntlet (continuing 16091)
Wasp 3.75 64-bit Gauntlet (continuing 16092)
Komodo 13.1 64-bit Gauntlet (continuing 16093)
Googleplex StarThinker 1.6 64-bit Gauntlet (continuing 16094)
Komodo 13.1 64-bit 4CPU Gauntlet (starting today 16083)
Defenchess 2.2 64-bit 4CPU Gauntlet (finishing Thursday 16084)
RofChade 2.202 64-bit 4CPU Gauntlet (starting Thursday 16084)
Various 4CPU and 1CPU Gauntlets (being run by Volodymyr)
Various 4CPU and 1CPU Gauntlets (being run by Tirsa - on hold)
Various 1CPU Tournaments (being run by Sergio)

40/4 testing since the last update report has included (thanks to Gabor and Sergio):

Deuterium 2019.2.37.73 64-bit
Enxadrista 1.01
SlowChess Blitz Classic 1.5 64-bit
Stoofvlees II a12 RTX2080
RofChade 2.202 64-bit
Achillees 1.0 64-bit
FabChess 1.12 64-bit
Arasan 21.4 64-bit 4CPU
Raven 0.60 64-bit
Achillees 1.0 64-bit
Winter 0.7 64-bit 4CPU
Swiss Tournaments (Sergio)

Re: CCRL 40/40, 40/4 and FRC lists updated (12th October 2019)

Posted: Wed Oct 16, 2019 7:41 pm
by jorose
May I suggest that engines running with GPU be counted as multi-CPU? It feels very wrong to be comparing engines running on a RTX2080 with single core engines (normalized to a very old single core at that...) and then when you go to the "multi-CPU" list and those same engines don't show up at all.

Optimally there should be GPU/no-GPU lists, so we can immediately also see how Leela and co matchup without a GPU or see just GPU based engines, but I understand how that might be more work.

Re: CCRL 40/40, 40/4 and FRC lists updated (12th October 2019)

Posted: Wed Oct 16, 2019 9:15 pm
by Modern Times
jorose wrote: Wed Oct 16, 2019 7:41 pm May I suggest that engines running with GPU be counted as multi-CPU? It feels very wrong to be comparing engines running on a RTX2080 with single core engines (normalized to a very old single core at that...) and then when you go to the "multi-CPU" list and those same engines don't show up at all.
Yes I totally agree in the case of the RTX2080 on the blitz list. Unfortunately our developer who looks after the processing scripts and website is only able to do serious bug fixes and not changes or enhancements, so this is unlikely to happen. The RTX2080 is also grossly overpowered compared to the 4CPU engines - we'd need to test on at least 8CPU if not more for normal engines to compete with it. That won't happen any time soon either. Personally I'd have been more comfortable for the list to have an RTX2060 at the very most.

The 40/40 list works with the GTX1050 treated as a single CPU engine though :)

Optimally there should be GPU/no-GPU lists, so we can immediately also see how Leela and co matchup without a GPU or see just GPU based engines, but I understand how that might be more work.
Yes that is a good idea also. Again you'd have to treat the RTX2080 as multi-CPU.