CCRL 40/15, 2m1s and FRC 40/2 lists updated (02-03-2024)

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 42325
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/15, 2m1s and FRC 40/2 lists updated (02-03-2024)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics (2nd March) are available for viewing from the following links:

https://computerchess.org.uk/ccrl/4040/ (40/15 and 15m+10s)
https://computerchess.org.uk/ccrl/404/ (BLITZ 2m+1s)
https://computerchess.org.uk/ccrl/402.archive/ (BLITZ 40/2 Archive)
https://computerchess.org.uk/ccrl/404FRC/ (FRC 40/2)

Our 40 moves in 15 minutes repeating (including 15 minutes with 10 second increments) and 2 minutes with 1 second increments are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.
All of our current testing uses AVX2 compiles where available.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.

It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to:
- all of our currently active testers (Graham, Gabor, Sergio, Basti, Shaun and another).
- Ray for the weekly updates.
- Jay Honnold for both the tournament viewer and for hosting Graham's live broadcasts.
- all engine authors.

40/15 and 15m+10s testing this week will include (with live broadcast given where applicable):

Live broadcasts of Gauntlets can be made available upon request.
(Web based viewer courtesy of Jay Honnold, with additions by Lana (Princhess), Jost Triller (Nalwald) and Finn Eggers (Koivisto).

The Dirty Dozen Tournament (finishing Friday) Web based viewer http://ccrl.live/16064
Recklessness Tournament (continuing) Web based viewer http://ccrl.live/16069
Midnight Cruiser Tournament (finishing Tuesday) Web based viewer http://ccrl.live/16073
Avalanche On A Frozen Night In Winter Tournament (finishing Wednesday) Web based viewer http://ccrl.live/16074
Cadie And The Princhess Tournament (starting Tuesday) Web based viewer http://ccrl.live/16073
Patricia And The Jet Tournament (starting Wednesday) Web based viewer http://ccrl.live/16074
107th Amateur Series Division 1 Tournament (starting Friday) Web based viewer http://ccrl.live/16064

Stockfish 16.1 64-bit 4CPU Gauntlet (continuing) Web based viewer http://ccrl.live/16061
Minic 3.41 64-bit 4CPU Gauntlet (continuing) Web based viewer http://ccrl.live/16062
Caissa 1.17 64-bit 4CPU Gauntlet (continuing) Web based viewer http://ccrl.live/16063
Superultra 2.0 64-bit 4CPU Gauntlet (another tester)
Stash 35.0 64-bit 4CPU Gauntlet (another tester)

Caissa 1.17 64-bit Gauntlet (continuing)
Velvet 7.0.0 64-bit Gauntlet (continuing)
Stockfish 16.1 64-bit Gauntlet (continuing)
JackyChess 23.12 64-bit Gauntlet (continuing)
Alexandria 6.0.0 64-bit Gauntlet (continuing)
ChessBrainVB 4.02 64-bit (continuing)
Oxidation 0.6.0 64-bit (another tester)
Patricia 1.0 64-bit (another tester)
Black Marlin 9 64-bit (another tester)

2m+1s testing since the last update report has included (thanks to Gabor, Basti, Sergio and Shaun):

CederChess 2 64-bit
Peripheral 1.0.0 64-bit
Lynx 1.3.0 64-bit
Clarity 5.1.0 64-bit
Oxidation 0.6.0 64-bit
HIARCS 15.3 64-bit
CeeChess 1.4 64-bit
Patricia 1.0 64-bit
Stockfish 16.1 64-bit
Maxwell 3.1-3 64-bit
Lizard 10.2 64-bit
February RR Tournament (Shaun)
Stockfish 16.1 64-bit 8CPU

FRC 40/2 testing since the last update report has included (thanks to Basti):

Altair 7.0.0 (completed)
Velvet 7.0.0 (completed)
Stockfish 16.1 (in progress)
Viridithas 12.0 (in progress)
Black Marlin 9.0 (in progress)
gbanksnz at gmail.com
Jouni
Posts: 3369
Joined: Wed Mar 08, 2006 8:15 pm

Re: CCRL 40/15, 2m1s and FRC 40/2 lists updated (02-03-2024)

Post by Jouni »

2m1s nothing spectacular :lol:

Stockfish 16 64-bit 8CPU 3804
Stockfish 15 64-bit 8CPU 3797
Stockfish 15.1 64-bit 8CPU 3795
Stockfish 16.1 64-bit 8CPU 3794
Stockfish 14.1 64-bit 8CPU 3782
Jouni
Modern Times
Posts: 3590
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 2m1s and FRC 40/2 lists updated (02-03-2024)

Post by Modern Times »

Indeed.

Same picture on 40/15, although a tiny number of games.
RubiChess
Posts: 618
Joined: Fri Mar 30, 2018 7:20 am
Full name: Andreas Matthies

Re: CCRL 40/15, 2m1s and FRC 40/2 lists updated (02-03-2024)

Post by RubiChess »

CCRL solved chess.
Modern Times
Posts: 3590
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 2m1s and FRC 40/2 lists updated (02-03-2024)

Post by Modern Times »

Chess960 is better, it takes the books out of the equation.

Without any hard evidence, choosing a particular balanced book can give different performance to another balanced book, I'd guess as much as 10 Elo. It is pointless now testing these top engines in the traditional way !
User avatar
Graham Banks
Posts: 42325
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/15, 2m1s and FRC 40/2 lists updated (02-03-2024)

Post by Graham Banks »

Modern Times wrote: Sun Mar 03, 2024 6:59 pm Chess960 is better, it takes the books out of the equation. It is pointless now testing these top engines in the traditional way !
Yet to do otherwise would skew and invalidate all of our testing.
There was a good reason why Stefan kept his UHO and main rating lists separate.
gbanksnz at gmail.com
Modern Times
Posts: 3590
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 2m1s and FRC 40/2 lists updated (02-03-2024)

Post by Modern Times »

Graham Banks wrote: Sun Mar 03, 2024 9:57 pm
Modern Times wrote: Sun Mar 03, 2024 6:59 pm Chess960 is better, it takes the books out of the equation. It is pointless now testing these top engines in the traditional way !
Yet to do otherwise would skew and invalidate all of our testing.
There was a good reason why Stefan kept his UHO and main rating lists separate.
You clearly completely misunderstood my comment.
bastiball
Posts: 5352
Joined: Tue Oct 20, 2020 4:18 am
Full name: Basti Dangca

Re: CCRL 40/15, 2m1s and FRC 40/2 lists updated (02-03-2024)

Post by bastiball »

Modern Times wrote: Sun Mar 03, 2024 6:59 pm Chess960 is better, it takes the books out of the equation.
:D :D
Basti Dangca
CCRL testing group