CCRL 40/15, 40/2 and FRC lists updated (23rd October 2021)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 45491
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/15, 40/2 and FRC lists updated (23rd October 2021)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/15)
http://ccrl.chessdom.com/ccrl/404 (40/2)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/2)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 15 minutes repeating and 40 moves in 2 minutes repeating are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to all of our currently active testers (Graham, Ray, Gabor, Sergio, and Basti). Thanks also to Chessdom.com for hosting our website.

40/15 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):
(Web based viewer courtesy of Jay Honnold - Berserk engine author)

88th Amateur Series Division 6 Tournament (finishing today 16093) Web based viewer http://tlcv.net/16093
88th Amateur Series Division 7 Tournament (finishing today 16091) Web based viewer http://tlcv.net/16091
88th Amateur Series Division 8 Tournament (continuing 16094) Web based viewer http://tlcv.net/16094
New Tournament (starting today 16093) Web based viewer http://tlcv.net/16093
New Tournament (starting today 16091) Web based viewer http://tlcv.net/16091
Bagatur 2.2e 64-bit Gauntlet (starting today 16092) Web based viewer http://tlcv.net/16092
Monolith 2.0 64-bit 4CPU Gauntlet (continuing 16083) Web based viewer http://tlcv.net/16083
Asymptote 0.8 64-bit 4CPU Gauntlet (continuing 16084) Web based viewer http://tlcv.net/16084
Berserk 6.0 64-bit 4CPU Gauntlet (continuing)
Lc0 0.28.0 w744204 64-bit 4CPU Gauntlet (continuing)
Marvin 5.1.0 64-bit 4CPU Gauntlet (continuing)
Dragon by Komodo 2.5 64-bit Gauntlet (continuing)
Lc0 0.28.0 w744204 64-bit Gauntlet (finishing Tuesday)
Berserk 6.0 64-bit Gauntlet (starting Tuesday)
Minic 3.16 64-bit Gauntlet (finishing Thursday)
Demolito 2021-07-09 64-bit Gauntlet (starting Thursday)
CCRL 40/15 Mini-TCEC Tournament: League 10 (being run by Basti)

40/2 testing since the last update report has included (thanks to Gabor, Basti and Sergio):

Odonata 0.4.0 64-bit
Zahak 7.1 64-bit
Prophet 4.0 64-bit
Benjamin 1.1
Blunder 6.1.0 64-bit
Devra 1.0 64-bit
RubiChess 2.2 64-bit 8CPU
Koivisto 6.0 64-bit 8CPU
Nu-chess 2021.10.15 64-bit
gbanksnz at gmail.com
User avatar
xr_a_y
Posts: 1872
Joined: Sat Nov 25, 2017 2:28 pm
Location: France

Re: CCRL 40/15, 40/2 and FRC lists updated (23rd October 2021)

Post by xr_a_y »

Hi, thanks for testing.

I am wondering though if the best executable is used for CCRL blitz list.

On the 40/15 list we see

Code: Select all

Minic 3.16 64-bit	3216	
Minic 3.07 64-bit	3121	
which looks ok

but on the blitz list

Code: Select all

Minic 3.08 64-bit	3254
Minic 3.14 64-bit	3236
this looks weird. But maybe that is an opponent pool thing as for now "165 wins, 308 losses, 275 draws" looks a bit unbalanced.

Anyway, can you please confirm the best possible executable is used ? Feel free to ask if in doubt.
User avatar
Graham Banks
Posts: 45491
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/15, 40/2 and FRC lists updated (23rd October 2021)

Post by Graham Banks »

The 40/15 and Blitz lists are compiled using their own separate database of games.
gbanksnz at gmail.com
User avatar
xr_a_y
Posts: 1872
Joined: Sat Nov 25, 2017 2:28 pm
Location: France

Re: CCRL 40/15, 40/2 and FRC lists updated (23rd October 2021)

Post by xr_a_y »

Graham Banks wrote: Sun Oct 24, 2021 10:39 am The 40/15 and Blitz lists are compiled using their own separate database of games.
Yes sure. I'm just wondering why newer version Minic doesn't perform well and one possible answer might be that a slow executable is used.