CCRL 40/15, 40/2 and FRC lists updated (19th September 2020)

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 41423
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/15, 40/2 and FRC lists updated (19th September 2020)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/15)
http://ccrl.chessdom.com/ccrl/404 (40/2)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/2)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 15 minutes repeating and 40 moves in 2 minutes repeating are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to all of our currently active testers (Graham, Ray, Gabor, Sergio and Volodymyr). Thanks also to Chessdom.com for hosting our website.

40/15 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):

81st Amateur Series Division 7 Tournament (finishing Tuesday 16002)
81st Amateur Series Division 8 Tournament (continuing 16053)
Prime Cut Tournament (finishing Monday 16001)
New Tournament (starting Monday 16001)
New Tournament (starting Tuesday 16002)
Pedone 2.1 64-bit Gauntlet (continuing 16063)
Cheese 2.2 64-bit Gauntlet (starting Monday 16064)
Combusken 1.3.1 64-bit Gauntlet (continuing 16065)
FoxSEE 5.1.2 64-bit Gauntlet (finishing Monday 16066)
Ethereal 12.50 64-bit Gauntlet (continuing 16091)
Igel 2.7.0 NNUE 64-bit Gauntlet (continuing 16092)
Stockfish 12 64-bit Gauntlet (continuing 16093)
SlowChess Blitz Classic 2.3 64-bit Gauntlet (continuing 16094)
Komodo 14 MCTS 64-bit 4CPU Gauntlet (continuing 16083)
RubiChess 1.8 64-bit 4CPU Gauntlet (finishing Wednesday 16084)
Stockfish 12 64-bit 4CPU Gauntlet (starting Wednesday 16084)

40/2 testing since the last update report has included (thanks to Gabor and Sergio):

Neocortex 1.0 64-bit
Weiss 1.1 64-bit
Ethereal 12.50 64-bit
Koivisto 1.0 64-bit
RESP 0.19 64-bit
Mr Bob 0.8.0 64-bit
Shallow 2020-09-09 64-bit

FRC 40/2 testing since the last update report has included (thanks to Ray):

Ethereal 12.50 64-bit (completed)
Stockfish 12 64-bit (completed)
gbanksnz at gmail.com
Terje
Posts: 347
Joined: Tue Nov 19, 2019 4:34 am
Location: https://github.com/TerjeKir/weiss
Full name: Terje Kirstihagen

Re: CCRL 40/15, 40/2 and FRC lists updated (19th September 2020)

Post by Terje »

Thanks for the testing - fixing the time management issue did wonders! :D
AndrewGrant
Posts: 1752
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: CCRL 40/15, 40/2 and FRC lists updated (19th September 2020)

Post by AndrewGrant »

Thanks for the testing, especially the FRC, Ray.
Very large progress there. I hope to continue that with the next releases.
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
Alayan
Posts: 550
Joined: Tue Nov 19, 2019 8:48 pm
Full name: Alayan Feh

Re: CCRL 40/15, 40/2 and FRC lists updated (19th September 2020)

Post by Alayan »

Graham Banks wrote: Sun Sep 20, 2020 1:43 am The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.
This snippet is probably an old copy-pasted one from Rybka's time, and I can understand the desire to still rate engines that have played a lot of games with others in the list and serve as useful anchor points.

But the Houdini and Fire engine notes should take an update, and some notice in the main list through e.g. color-coding would be appropriate.
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (19th September 2020)

Post by Modern Times »

We will put notes against those two highlighting the controversy surrounding them, as we did with Rybka. There wasn't time this week.
User avatar
Graham Banks
Posts: 41423
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/15, 40/2 and FRC lists updated (19th September 2020)

Post by Graham Banks »

Alayan wrote: Sun Sep 20, 2020 8:53 pm
Graham Banks wrote: Sun Sep 20, 2020 1:43 am The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.
This snippet is probably an old copy-pasted one from Rybka's time, and I can understand the desire to still rate engines that have played a lot of games with others in the list and serve as useful anchor points.

But the Houdini and Fire engine notes should take an update, and some notice in the main list through e.g. color-coding would be appropriate.
It has been on our homepage since then. I just transferred it into the update notice as a reminder.
gbanksnz at gmail.com
Alayan
Posts: 550
Joined: Tue Nov 19, 2019 8:48 pm
Full name: Alayan Feh

Re: CCRL 40/15, 40/2 and FRC lists updated (19th September 2020)

Post by Alayan »

Ok, thank you.
chysiddh14
Posts: 38
Joined: Tue Jan 01, 2019 9:34 am
Full name: Siddhartha Chaudhary

Re: CCRL 40/15, 40/2 and FRC lists updated (19th September 2020)

Post by chysiddh14 »

this is a mistake or what ?
Ethereal 12.25 - 3365 elo
and new Ethereal 12.50 - 3303 elo

http://www.computerchess.org.uk/ccrl/40 ... +opponents
AndrewGrant
Posts: 1752
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: CCRL 40/15, 40/2 and FRC lists updated (19th September 2020)

Post by AndrewGrant »

chysiddh14 wrote: Mon Sep 21, 2020 7:33 am this is a mistake or what ?
Ethereal 12.25 - 3365 elo
and new Ethereal 12.50 - 3303 elo

http://www.computerchess.org.uk/ccrl/40 ... +opponents
You are comparing 4CPU to 1CPU.

Code: Select all

Ethereal 12.25 64-bit 4CPU   3365	
Ethereal 12.25 64-bit	     3291

Ethereal 12.50 64-bit 4CPU   ????
Ethereal 12.50 64-bit	     3303
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )