CCRL 40/40, 40/4 and FRC lists updated (28th February 2015)

[Graham Banks]

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

40/40 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable)

51st Amateur Division 6 (continuing 16053)
51st Amateur Division 7 (continuing 16001)
March Mayhem Tournament (continuing 16002)
Hannibal 1.5 64-bit 64-bit Gauntlet (continuing 16063)
Nemeton 1.1 Gauntlet (continuing 16064)
Atlas 3.80 64-bit Gauntlet (continuing 16065)
K2 0.71 Gauntlet (continuing 16074)
Stockfish 6 64-bit Gauntlet (continuing 16075)
Sting SF 4.8.4 64-bit Gauntlet (continuing 16076)
Stockfish 6 64-bit 4CPU Gauntlet (continuing 16083)
Heat Wave 4CPU Tournament (continuing 16084)
Cheng4 0.38 64-bit 4CPU Gauntlet (being run by Nathan)
Assorted 4CPU Matches (being run by Charles)
Assorted 1CPU Tournaments (being run by Charles)

[lkaufman]

So Komodo 8 is 8 elo behind Stockfish 6 on 4 cores and 5 elo behind on 1 core, on the "40/40" list, which I think is really close to a 40/20 list on a modern I7, correct? Can Komodo 9 overcome this enormous deficit?

[JJJ]

So Komodo 8 is 8 elo behind Stockfish 6 on 4 cores and 5 elo behind on 1 core, on the "40/40" list, which I think is really close to a 40/20 list on a modern I7, correct? Can Komodo 9 overcome this enormous deficit?

Hehe. On this list at this time controle, sure you can. Will Komodo 9 win in direct encounter versus stockfish 6 also ?

[lkaufman]

So Komodo 8 is 8 elo behind Stockfish 6 on 4 cores and 5 elo behind on 1 core, on the "40/40" list, which I think is really close to a 40/20 list on a modern I7, correct? Can Komodo 9 overcome this enormous deficit?

Hehe. On this list at this time controle, sure you can. Will Komodo 9 win in direct encounter versus stockfish 6 also ?

At bullet speeds SF6 still beats us by about 20 elo in latest tests, I would estimate that we would cross over 50% vs. SF6 at somewhere around the CCRL 40/40 (really 40/20) level, but I haven't confirmed that yet.

[melajara]

Don't forget SF is a moving target, and moving FAST. Recent dev versions made progress on MP scaling and with the fine tuning of eval terms related to pawn formations, all in all SF current dev is maybe already +15 ELO on high end hardware relatively to SF 6.

Of course, this has to be proved

Btw, would be only for that, I'm eager to follow TCEC season 8.
In Season 7 superfinal, it was implicit that Season 8 would start somewhere at the end of February. We are now in March and no news, not even in Facebook and chatwing is not even resumed over the main site.
Do you have any update about Martin's schedule?

[JJJ]

Don't forget SF is a moving target, and moving FAST. Recent dev versions made progress on MP scaling and with the fine tuning of eval terms related to pawn formations, all in all SF current dev is maybe already +15 ELO on high end hardware relatively to SF 6.

Of course, this has to be proved

Btw, would be only for that, I'm eager to follow TCEC season 8.
In Season 7 superfinal, it was implicit that Season 8 would start somewhere at the end of February. We are now in March and no news, not even in Facebook and chatwing is not even resumed over the main site.
Do you have any update about Martin's schedule?

I totally agree.

[JJJ]

So Komodo 8 is 8 elo behind Stockfish 6 on 4 cores and 5 elo behind on 1 core, on the "40/40" list, which I think is really close to a 40/20 list on a modern I7, correct? Can Komodo 9 overcome this enormous deficit?

Hehe. On this list at this time controle, sure you can. Will Komodo 9 win in direct encounter versus stockfish 6 also ?

At bullet speeds SF6 still beats us by about 20 elo in latest tests, I would estimate that we would cross over 50% vs. SF6 at somewhere around the CCRL 40/40 (really 40/20) level, but I haven't confirmed that yet.

Really nice. I like a lot Komodo, so I m really hoping to see him crushing Stockfish 6.

[lkaufman]

I noticed that Stephen Pohl's list showed only regression for SF since SF6. Improved scaling on 16 cores will probably offset the lead Komodo already had on such hardware, so whichever engine is best on 1 or 4 cores will probably also be best on 16. I have no info regarding Martin and TCEC.

[Vinvin]

So Komodo 8 is 8 elo behind Stockfish 6 on 4 cores and 5 elo behind on 1 core, on the "40/40" list, which I think is really close to a 40/20 list on a modern I7, correct? Can Komodo 9 overcome this enormous deficit?

Hehe. On this list at this time controle, sure you can. Will Komodo 9 win in direct encounter versus stockfish 6 also ?

At bullet speeds SF6 still beats us by about 20 elo in latest tests, I would estimate that we would cross over 50% vs. SF6 at somewhere around the CCRL 40/40 (really 40/20) level, but I haven't confirmed that yet.

Really nice. I like a lot Komodo, so I m really hoping to see him crushing Stockfish 6.

They are both very close in strength and this will probably still like this for 6 months and may be more ...

[beram]

So Komodo 8 is 8 elo behind Stockfish 6 on 4 cores and 5 elo behind on 1 core, on the "40/40" list, which I think is really close to a 40/20 list on a modern I7, correct? Can Komodo 9 overcome this enormous deficit?

Hehe. On this list at this time controle, sure you can. Will Komodo 9 win in direct encounter versus stockfish 6 also ?

At bullet speeds SF6 still beats us by about 20 elo in latest tests, I would estimate that we would cross over 50% vs. SF6 at somewhere around the CCRL 40/40 (really 40/20) level, but I haven't confirmed that yet.

I doubt that Komodo9dev is allready able to beat SF6 at whatever TC
The performance of SF6 against K8 at LTC is average 57 % in 568 LTC games (lCCRL 40/40; CEGT; Tom Casanovas and Immortal chess)
57 % is about +50 ELO and since there has only been spoken of an improvement of +30 ELO for K9dev
Than that will not be enough to beat SF6

Code: Select all

SF6 vs K8 at LTC 	          games                    perc.  drawperc.  w/l ratio
TC 60m15s AMD FX8320 @8cpu	  188 games, +46 =120 -22	56,38%	63,83%	2,30
TC 40/40 CCRL @4cpu	            80 games +15 =60 −5	56,30%	75,00%	3,00
TC 30m5s Tom Casanovas @6cpu 	150 games  +40 =97 -13	59,00%	65,00%	3,08
TC 40/20 CEGT @4cpu	        100games +24 =67 -9	  57,50%	67,00%	2,67
TC 40/120 CEGT@1cpu	         50 games +12 =30 -8	  54,00%	60,00%	1,50
	                568 games +137 =374 -57 	avg 57,0%	avg 65,8%	avg 2,4