CCRL 40/15, 2m1s and FRC 40/2 lists updated (26-03-2023)

[Graham Banks]

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/15)
http://ccrl.chessdom.com/ccrl/404 (BLITZ 2m+1s)
http://ccrl.chessdom.com/ccrl/402.archive/ (BLITZ 40/2 Archive)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/2)

Please note that the lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). The default lists contain the 64-bit engines.



Our 40 moves in 15 minutes repeating and 2 minutes with 1 second increments are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.
All of our current testing uses AVX2 compiles where available.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to:
- all of our currently active testers (Graham, Gabor, Sergio, and Basti).
- Ray for the weekly updates.
- Chessdom.com for hosting our website.
- Jay Honnold for hosting Graham's live broadcasts.
- all engine authors.

40/15 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):
Live broadcasts of Gauntlets can be made available upon request.
(Web based viewer courtesy of Jay Honnold - Berserk engine author)

100th Amateur Series Division 1 Tournament (finishing Wednesday) Web based viewer http://tlcv.net/16094
100th Amateur Series Division 2 Tournament (finishing Thursday) Web based viewer http://tlcv.net/16092
100th Amateur Series Division 3 Tournament (starting Wednesday) Web based viewer http://tlcv.net/16094
100th Amateur Series Division 4 Tournament (starting Thursday) Web based viewer http://tlcv.net/16092
Mr Bob And The Carp Tournament (finishing Thursday) Web based viewer http://tlcv.net/16093
New Tournament (starting Thursday) Web based viewer http://tlcv.net/16093
March Madness Tournament (continuing) Web based viewer http://tlcv.net/16091

SmallBrain 7.0 64-bit 4CPU (continuing) Web based viewer http://tlcv.net/16061
Caissa 1.7 64-bit 4CPU Gauntlet (finishing Friday) Web based viewer http://tlcv.net/16062
Velvet 5.1.0 64-bit 4CPU (starting Friday) Web based viewer http://tlcv.net/16062
Booot 7.1 64-bit 4CPU Gauntlet (continuing) Web based viewer http://tlcv.net/16063

Cadie 1.4 64-bit Gauntlet (continuing)
Caissa 1.7 64-bit Gauntlet (continuing)
Roc 1.9.1 64-bit Gauntlet (continuing)
Svart 2.0.0 64-bit Gauntlet (continuing)
Cheers 0.2 64-bit Gauntlet (continuing)
Seawall 20230316 64-bit Gauntlet (continuing)
Willow 2.6 64-bit Gauntlet (continuing)
Akimbo 0.1.1 64-bit Gauntlet (finishing Wednesday)
Pawn 1.0 64-bit Gauntlet (finishing Wednesday)
Carp 2.0.0 64-bit Gauntlet (finishing Thursday)
Polaris 1.3.0 64-bit Gauntlet (starting Wednesday)
Leorik 2.4 64-bit Gauntlet (starting Wednesday)

2m+1s testing since the last update report has included (thanks to Gabor, Basti and Sergio):

Dragon 3.2 MCTS by Komodo 64-bit 8CPU
Uralochka 3.39d 64-bit 8CPU
Fatalii 0.4.0 64-bit
Clovis III 64-bit
Renegade 0.9.0 64-bit
Wasp 6.50 64-bit 8CPU
Svart 2.0.0 64-bit
Polaris 1.2.0 64-bit
Pawn 1.0 64-bit\
Khepri Chess 3.1.0 64-bit
Clover 3.3.1 64-bit
Avalanche 1.4.0 64-bit
Renegade 0.9.0 64-bit
Cheers 0.2 64-bit
Rebel 16.2 64-bit 8CPU
Captain 4.0 64-bit
Leorik 2.4 64-bit

FRC 40/2 testing since the last update report has included (thanks to Basti):

Nothing new this week.

[Jouni]

Can You describe "general book up to 12 moves" more?

[lithander]

It's great that you tested Leorik 2.4 so quickly. But the results are very confusing to me because in your tests my engine appears to be 150 Elo stronger than in my own tests!

http://ccrl.chessdom.com/ccrl/404/cgi/e ... 2_4_64-bit

I have since run matches against some of the engines you tested against at 2 minutes + 1s increment with 256MB hash and I still can't reproduce the 2950 Elo on my hardware. I only seem to be able to produce matches that hint at a strength around 2800 Elo.

Can you maybe help me reproduce these stellar results? Could it have to do with the opening book you are using? Did you make your own compile or use the pre-built binaries released on github? I'd really like to understand why Leorik seems to have superpowers on your computer but not on mine!

[Wolfgang]

https://cegt.forumieren.com/t1900-testing-leorik-2-4

You must add ~150 points, because CCRL ratings are higher. So our results would be around 2800 @ CCRL

[Graham Banks]

Can You describe "general book up to 12 moves" more?

Both engines use the same book, which must go no further than 12 moves for each side.

[Modern Times]

Leorik 2.4 is 2784 Elo on the 40/15 list after 338 games.

[lithander]

Leorik 2.4 is 2784 Elo on the 40/15 list after 338 games.

Thanks for testing! A little lower than what I hoped but well within the expected range, especially as the error margins are probably still quite big with "only" 338 games!