CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 45265
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/15)
http://ccrl.chessdom.com/ccrl/404 (40/2)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/2)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 15 minutes repeating and 40 moves in 2 minutes repeating are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to all of our currently active testers (Graham, Ray, Gabor, Sergio, and Basti). Thanks also to Chessdom.com for hosting our website.

40/15 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):
(Web based viewer courtesy of Jay Honnold - Berserk engine author)

90th Amateur Series Division 7 Tournament (continuing 16094) Web based viewer http://tlcv.net/16094
90th Amateur Series Division 8 Tournament (continuing 16091) Web based viewer http://tlcv.net/16091
Mr Bob And The Amoeba Tournament (continuing 16093) Web based viewer http://tlcv.net/16093
Marvin 5.2.0 64-bit Gauntlet (continuing 16092) Web based viewer http://tlcv.net/16092
Myrddin 0.88 64-bit 4CPU Gauntlet (continuing 16083) Web based viewer http://tlcv.net/16083
Invictus r382 64-bit 4CPU Gauntlet (continuing 16084) Web based viewer http://tlcv.net/16084
Revenge 2.0 64-bit 4CPU Gauntlet (continuing)
Dragon 2.6 by Komodo 64-bit 4CPU Gauntlet (continuing)
Berserk 8.0 4CPU Gauntlet (continuing)
Revenge 2.0 64-bit Gauntlet (continuing)
Stash 32.0 64-bit Gauntlet (continuing)
Fire 8.1 64-bit Gauntlet (continuing)
Berserk 8.0 64-bit Gauntlet (continuing)
Topple 0.8.1 64-bit Gauntlet (continuing)
Sugar AI 2.50 64-bit Gauntlet (continuing)
Drofa 3.2.0 64-bit Gauntlet (finishing Monday)
Zevra 2.5 64-bit Gauntlet (starting Monday)
Seer 2.4.0 64-bit Gauntlet (finishing Monday)
Supernova 2.4 64-bit Gauntlet (starting Monday)

40/2 testing since the last update report has included (thanks to Gabor, Basti and Sergio):

Blunder 7.4.0 64-bit
Black Marlin 2.0 64-bit
Amoeba 3.4 64-bit
Revenge 2.0 64-bit
Arasan 23.2 64-bit
Chai 2.6.6 64-bit
ChessKISS 1.8 64-bit
Roc 1.8 64-bit
Seer 2.4.0 64-bit
Dragon 2.6 by Komodo 64-bit
Cheese 3.0.0 64-bit
BLANK 1.3.0 64-bit
Stash 32.0 64-bit
Berserk 7.0 64-bit 8CPU
Anka 0.6.0 64-bit
Eubos 2.4 64-bit


40/2 FRC testing since the last update report has included (thanks to Ray):

Dragon 2.6 by Komodo 64-bit (completed)
Revenge 2.0 64-bit (in progress)
Berserk 8.0 64-bit (in progress)
gbanksnz at gmail.com
Jouni
Posts: 3797
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Post by Jouni »

FRC is very close!

1 Stockfish 14.1 3904
2 Dragon 2.6 by Komodo 3900

About 3000 games both.
Jouni
Modern Times
Posts: 3803
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Post by Modern Times »

Jouni wrote: Mon Dec 27, 2021 1:15 pm FRC is very close!

1 Stockfish 14.1 3904
2 Dragon 2.6 by Komodo 3900

About 3000 games both.
Yes, and both will be playing SlowChess 2.8 which is currently running, depending on how each performs against it that could alter the gap by a couple of Elo maybe, in either direction.
User avatar
xr_a_y
Posts: 1872
Joined: Sat Nov 25, 2017 2:28 pm
Location: France

Re: CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Post by xr_a_y »

If you have some time, I d love to see how Minic 3.17 is performing on the FRC list. Thanks a lot.
Modern Times
Posts: 3803
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Post by Modern Times »

xr_a_y wrote: Mon Dec 27, 2021 2:08 pm If you have some time, I d love to see how Minic 3.17 is performing on the FRC list. Thanks a lot.
Yes it is on the catch-up list. Should be done by next week.
Modern Times
Posts: 3803
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Post by Modern Times »

Graham Banks wrote: Mon Dec 27, 2021 5:05 am
40/2 FRC testing since the last update report has included (thanks to Ray):
Revenge 2.0 64-bit (in progress)
Berserk 8.0 64-bit (in progress)
These two have been completed now, as well as Ethereal 13.25

I had been in no rush to test Ethereal 13.25 with its built-in generic NNUE, thinking it may be weaker than 13.00 with the specific FRC-trained NNUE, but it did come out a handful of Elo stronger subject to error margins.

Mini 3.17 is now underway.
Modern Times
Posts: 3803
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Post by Modern Times »

xr_a_y wrote: Mon Dec 27, 2021 2:08 pm If you have some time, I d love to see how Minic 3.17 is performing on the FRC list. Thanks a lot.
This has now been completed. Big jump !
Chessqueen
Posts: 5685
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Post by Chessqueen »

Graham Banks wrote: Mon Dec 27, 2021 5:05 am The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/15)
http://ccrl.chessdom.com/ccrl/404 (40/2)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/2)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 15 minutes repeating and 40 moves in 2 minutes repeating are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to all of our currently active testers (Graham, Ray, Gabor, Sergio, and Basti). Thanks also to Chessdom.com for hosting our website.

40/15 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):
(Web based viewer courtesy of Jay Honnold - Berserk engine author)

90th Amateur Series Division 7 Tournament (continuing 16094) Web based viewer http://tlcv.net/16094
90th Amateur Series Division 8 Tournament (continuing 16091) Web based viewer http://tlcv.net/16091
Mr Bob And The Amoeba Tournament (continuing 16093) Web based viewer http://tlcv.net/16093
Marvin 5.2.0 64-bit Gauntlet (continuing 16092) Web based viewer http://tlcv.net/16092
Myrddin 0.88 64-bit 4CPU Gauntlet (continuing 16083) Web based viewer http://tlcv.net/16083
Invictus r382 64-bit 4CPU Gauntlet (continuing 16084) Web based viewer http://tlcv.net/16084
Revenge 2.0 64-bit 4CPU Gauntlet (continuing)
Dragon 2.6 by Komodo 64-bit 4CPU Gauntlet (continuing)
Berserk 8.0 4CPU Gauntlet (continuing)
Revenge 2.0 64-bit Gauntlet (continuing)
Stash 32.0 64-bit Gauntlet (continuing)
Fire 8.1 64-bit Gauntlet (continuing)
Berserk 8.0 64-bit Gauntlet (continuing)
Topple 0.8.1 64-bit Gauntlet (continuing)
Sugar AI 2.50 64-bit Gauntlet (continuing)
Drofa 3.2.0 64-bit Gauntlet (finishing Monday)
Zevra 2.5 64-bit Gauntlet (starting Monday)
Seer 2.4.0 64-bit Gauntlet (finishing Monday)
Supernova 2.4 64-bit Gauntlet (starting Monday)

40/2 testing since the last update report has included (thanks to Gabor, Basti and Sergio):

Blunder 7.4.0 64-bit
Black Marlin 2.0 64-bit
Amoeba 3.4 64-bit
Revenge 2.0 64-bit
Arasan 23.2 64-bit
Chai 2.6.6 64-bit
ChessKISS 1.8 64-bit
Roc 1.8 64-bit
Seer 2.4.0 64-bit
Dragon 2.6 by Komodo 64-bit
Cheese 3.0.0 64-bit
BLANK 1.3.0 64-bit
Stash 32.0 64-bit
Berserk 7.0 64-bit 8CPU
Anka 0.6.0 64-bit
Eubos 2.4 64-bit


40/2 FRC testing since the last update report has included (thanks to Ray):

Dragon 2.6 by Komodo 64-bit (completed)
Revenge 2.0 64-bit (in progress)
Berserk 8.0 64-bit (in progress)
You should also have all those engines ratings for a single CPU
User avatar
Graham Banks
Posts: 45265
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Post by Graham Banks »

Chessqueen wrote: Wed Dec 29, 2021 7:11 am
Graham Banks wrote: Mon Dec 27, 2021 5:05 am The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/15)
http://ccrl.chessdom.com/ccrl/404 (40/2)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/2)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 15 minutes repeating and 40 moves in 2 minutes repeating are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to all of our currently active testers (Graham, Ray, Gabor, Sergio, and Basti). Thanks also to Chessdom.com for hosting our website.

40/15 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):
(Web based viewer courtesy of Jay Honnold - Berserk engine author)

90th Amateur Series Division 7 Tournament (continuing 16094) Web based viewer http://tlcv.net/16094
90th Amateur Series Division 8 Tournament (continuing 16091) Web based viewer http://tlcv.net/16091
Mr Bob And The Amoeba Tournament (continuing 16093) Web based viewer http://tlcv.net/16093
Marvin 5.2.0 64-bit Gauntlet (continuing 16092) Web based viewer http://tlcv.net/16092
Myrddin 0.88 64-bit 4CPU Gauntlet (continuing 16083) Web based viewer http://tlcv.net/16083
Invictus r382 64-bit 4CPU Gauntlet (continuing 16084) Web based viewer http://tlcv.net/16084
Revenge 2.0 64-bit 4CPU Gauntlet (continuing)
Dragon 2.6 by Komodo 64-bit 4CPU Gauntlet (continuing)
Berserk 8.0 4CPU Gauntlet (continuing)
Revenge 2.0 64-bit Gauntlet (continuing)
Stash 32.0 64-bit Gauntlet (continuing)
Fire 8.1 64-bit Gauntlet (continuing)
Berserk 8.0 64-bit Gauntlet (continuing)
Topple 0.8.1 64-bit Gauntlet (continuing)
Sugar AI 2.50 64-bit Gauntlet (continuing)
Drofa 3.2.0 64-bit Gauntlet (finishing Monday)
Zevra 2.5 64-bit Gauntlet (starting Monday)
Seer 2.4.0 64-bit Gauntlet (finishing Monday)
Supernova 2.4 64-bit Gauntlet (starting Monday)

40/2 testing since the last update report has included (thanks to Gabor, Basti and Sergio):

Blunder 7.4.0 64-bit
Black Marlin 2.0 64-bit
Amoeba 3.4 64-bit
Revenge 2.0 64-bit
Arasan 23.2 64-bit
Chai 2.6.6 64-bit
ChessKISS 1.8 64-bit
Roc 1.8 64-bit
Seer 2.4.0 64-bit
Dragon 2.6 by Komodo 64-bit
Cheese 3.0.0 64-bit
BLANK 1.3.0 64-bit
Stash 32.0 64-bit
Berserk 7.0 64-bit 8CPU
Anka 0.6.0 64-bit
Eubos 2.4 64-bit


40/2 FRC testing since the last update report has included (thanks to Ray):

Dragon 2.6 by Komodo 64-bit (completed)
Revenge 2.0 64-bit (in progress)
Berserk 8.0 64-bit (in progress)
You should also have all those engines ratings for a single CPU
Not sure what you mean?

There are single-cpu lists for both 40/2 and 40/15:

http://www.computerchess.org.uk/ccrl/40 ... ons_only=1

http://www.computerchess.org.uk/ccrl/40 ... ons_only=1
gbanksnz at gmail.com
User avatar
xr_a_y
Posts: 1872
Joined: Sat Nov 25, 2017 2:28 pm
Location: France

Re: CCRL 40/15, 40/2 and FRC lists updated (26th December 2021)

Post by xr_a_y »

Modern Times wrote: Wed Dec 29, 2021 6:11 am
xr_a_y wrote: Mon Dec 27, 2021 2:08 pm If you have some time, I d love to see how Minic 3.17 is performing on the FRC list. Thanks a lot.
This has now been completed. Big jump !
Great, big thanks to you.