CCRL 40/15, 40/2 and FRC lists updated (27th November 2021)

[Graham Banks]

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/15)
http://ccrl.chessdom.com/ccrl/404 (40/2)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/2)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.



Our 40 moves in 15 minutes repeating and 40 moves in 2 minutes repeating are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to all of our currently active testers (Graham, Ray, Gabor, Sergio, and Basti). Thanks also to Chessdom.com for hosting our website.

40/15 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):
(Web based viewer courtesy of Jay Honnold - Berserk engine author)

89th Amateur Series Division 8 Tournament (finishing Tuesday 16093) Web based viewer http://tlcv.net/16093
90th Amateur Series Division 1 Tournament (starting Tuesday 16093) Web based viewer http://tlcv.net/16093
Super Tournament XXXIV 1CPU (continuing 16094) Web based viewer http://tlcv.net/16094
CM10th Champions 2021 Tournament (continuing 16091) Web based viewer http://tlcv.net/16091
Wasp 5.00 64-bit Gauntlet (continuing 16092) Web based viewer http://tlcv.net/16092
Gogobello 2.2 64-bit 4CPU Gauntlet (continuing 16083) Web based viewer http://tlcv.net/16083
Counter 4.0 64-bit 4CPU Gauntlet (continuing 16084) Web based viewer http://tlcv.net/16084
Wasp 5.00 64-bit 4CPU Gauntlet (continuing)
SlowChess Blitz 2.8 64-bit 4CPU Gauntlet (continuing)
Zahak 9.0 64-bit 4CPU Gauntlet (continuing)
Berserk 7.0 64-bit Gauntlet (finishing Tuesday)
SlowChess Blitz 2.8 64-bit Gauntlet (starting Tuesday)
Koivisto 7.0 64-bit Gauntlet (finishing Thursday)
Zahak 9.0 64-bit Gauntlet (starting Thursday)
ShashChess 19.3 64-bit Gauntlet (continuing)
Various Events (being run by Basti)

40/2 testing since the last update report has included (thanks to Gabor, Basti and Sergio):

Coiled 1.1 64-bit (no NNUE)
Wasp 5.00 64-bit
Princhess 0.5.1 64-bit
Hopper 1.8 64-bit
Slowchess Blitz 2.7 64-bit 8CPU
SlowChess Blitz 2.8 64-bit
Stash 31.0 64-bit
Marvin 5.2.0 64-bit
Velvet 3.1.0 64-bit

40/2 FRC testing since the last update report has included (thanks to Ray):

Berserk 7.0 64-bit (in progress)

[mehmet123]

Stockfish 14.1 64-bit 4CPU is 29 elo behind of Stockfish 14 64-bit 4CPU
Stockfish 14.1 64-bit 4CPU is 22 elo behind of Stockfish 13 64-bit 4CPU.
Stockfish 14.1 64-bit 4CPU is only 2 elo ahead of Dragon by Komodo 2.5 64-bit 4CPU.

Interesting results.

[Madeleine Birchfield]

When restricted to single CPU, Slowchess is now stronger than Stockfish 11 on the 40/2 rating list.

[jhonnold]

Thanks for testing Berserk

[dkappe]

Stockfish 14.1 64-bit 4CPU is 29 elo behind of Stockfish 14 64-bit 4CPU
Stockfish 14.1 64-bit 4CPU is 22 elo behind of Stockfish 13 64-bit 4CPU.
Stockfish 14.1 64-bit 4CPU is only 2 elo ahead of Dragon by Komodo 2.5 64-bit 4CPU.

Interesting results.

You haven’t gotten the memo. In order to see 14.1’s advantage, you have to use a special set of openings.

[jonkr]

Thanks for testing, nice to see Slow 2.8 at #4 above Stockfish 11 in a rating list, never thought I'd see that when I re-started chess programming years ago.
With more games it might change, though with the standard opening sets it did edge SF11 and other strong engines in my tests. (FRC vs SF11 still was a big difference.)

[Rubinus]

Caissa 0.4
Will this programme be tested? There are some bugs, but it doesn't crash anymore even with multiple cpu. My guess is that it might have 3230 on 4 cpu. A bit more at fast pace - it's slower to get to greater depths.

[Graham Banks]

Caissa 0.4
Will this programme be tested? There are some bugs, but it doesn't crash anymore even with multiple cpu. My guess is that it might have 3230 on 4 cpu. A bit more at fast pace - it's slower to get to greater depths.

If it's using a SF net, I won't be testing it, but Gabor might test it for the blitz list.

[Madeleine Birchfield]

Caissa 0.4
Will this programme be tested? There are some bugs, but it doesn't crash anymore even with multiple cpu. My guess is that it might have 3230 on 4 cpu. A bit more at fast pace - it's slower to get to greater depths.

As Graham Banks said, most likely not if you are using a net trained by the Stockfish team.

A good idea might be to try to train your own NNUE net. There are many engine authors who have done so for their engine, such as the authors of Koivisto, Zahek, Seer, Halogen, Ethereal, Berserk, Dark Toga, and Stockfish, and who could help you set everything up. The OpenBench and Stockfish discords are two additional resources to use for help.

[Rubinus]

Caissa 0.4
Will this programme be tested? There are some bugs, but it doesn't crash anymore even with multiple cpu. My guess is that it might have 3230 on 4 cpu. A bit more at fast pace - it's slower to get to greater depths.

As Graham Banks said, most likely not if you are using a net trained by the Stockfish team.

A good idea might be to try to train your own NNUE net. There are many engine authors who have done so for their engine, such as the authors of Koivisto, Zahek, Seer, Halogen, Ethereal, Berserk, Dark Toga, and Stockfish, and who could help you set everything up. The OpenBench and Stockfish discords are two additional resources to use for help.

I'm not the author, I was just testing it. Yes, it's using some older Stockfish network. I'm not going to train a new network, I don't think I have the resources of machine time for that. I have no idea how long it would take to be of any use.