Leela Chess 0.10 64-bit w323 Gauntlet for CCRL 40/40

[tpoppins]

Games: PGN
Test setup: details

Code: Select all

CCRL 40/40 Rating List - Custom engine selection
839944 games played by 2174 programs, run by 21 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), 
about 15 minutes on a modern Intel CPU.
Computed on May 26, 2018 with Bayeselo based on 839'944 games
Tested by CCRL team, 2005-2018, http://computerchess.org.uk/ccrl/4040/

 Engine                              Elo   +    -   Score  AvOp  Games
 Leela Chess 0.10 64-bit w323       2651  +19  -19  51.6%  -13.3  1000

[Vinvin]

Hi !
2 questions this new engine:
1) How many NPS does Leela on your system ?
2) Is there plan to rate Leela on a fast GPU like a GTX 1080 Ti (or a slower GTX 1060) ?

[Kotlov]

Hi !
2 questions this new engine:
1) How many NPS does Leela on your system ?
2) Is there plan to rate Leela on a fast GPU like a GTX 1080 Ti (or a slower GTX 1060) ?

3) Is there plan to give Leela 1024TB RAM?
4) Is there plan to give Tablebases with 16-piece endings?
5) Is there plan to rate Leela on a fast Quantum Computer with 128-Qubit?

etc...

[Ozymandias]

Hi !
2 questions this new engine:
1) How many NPS does Leela on your system ?
2) Is there plan to rate Leela on a fast GPU like a GTX 1080 Ti (or a slower GTX 1060) ?

3) Is there plan to give Leela 1024TB RAM?
4) Is there plan to give Tablebases with 16-piece endings?
5) Is there plan to rate Leela on a fast Quantum Computer with 128-Qubit?

etc...

These questions, designed to ridicule the ones quoted before, are unwarranted.

For many years, the recurrent "is there an engine that can use my GPU?" popped in computer chess forums every now and then; now that we have the option to finally use that (previously untapped) HW resource, it'd be nice to see traditional rating lists reacting a little more promptly to the new situation, instead of just keeping testing it as a CPU bound engine.

[Rubinus]

Possible bad selection of opponents. LC0 makes gross errors, yes. Therefore he loses even with the weak. But he gets a lot more powerful, and sometimes Spike or The King.

[Nay Lin Tun]

2650 Official CCRL confirmed!! Not 2100!!

[tpoppins]

Hi !
2 questions this new engine:
1) How many NPS does Leela on your system ?
2) Is there plan to rate Leela on a fast GPU like a GTX 1080 Ti (or a slower GTX 1060) ?

Hey Vince!
1) I have three (listed in the setup details), and on the startpos it ranges from 18 to 26 NPS on them. The NPS observed during the games were in the 12-16 range, going up to 24 towards the end of the game
2) Not at the moment.

3) Is there plan to give Leela 1024TB RAM?
4) Is there plan to give Tablebases with 16-piece endings?
5) Is there plan to rate Leela on a fast Quantum Computer with 128-Qubit?

etc...

These questions, designed to ridicule the ones quoted before, are unwarranted.

I thought they were delightful and meant no offense. All work and no play, etc.

For many years, the recurrent "is there an engine that can use my GPU?" popped in computer chess forums every now and then; now that we have the option to finally use that (previously untapped) HW resource, it'd be nice to see traditional rating lists reacting a little more promptly to the new situation, instead of just keeping testing it as a CPU bound engine.

For many years the recurrent "is there a bicycle that could use an internal combustion engine?" question, no doubt, popped up in many cyclists' minds, yet we do not see motorcycles taking part in Tour de France.

[Modern Times]

now that we have the option to finally use that (previously untapped) HW resource, it'd be nice to see traditional rating lists reacting a little more promptly to the new situation, instead of just keeping testing it as a CPU bound engine.

The principle of the CCRL list is that every participant is on equal hardware. It is a list for engines that use the CPU, and that can be benchmarked and time control adjusted agaunst the benchmark CPU. Yes at some point in the future this sort of list could become obsolete, but not yet.

Someone like SSDF could test it on GPU. Their list does not have common hardware. They have old dedicated chess machines, and old A1200 right through to latest Ryzen all on the same ratings list. And actual time control, not adjusted ones.

[Robert Pope]

For many years the recurrent "is there a bicycle that could use an internal combustion engine?" question, no doubt, popped up in many cyclists' minds, yet we do not see motorcycles taking part in Tour de France.

True, but when pro-athlete swimsuit designers started coming up with designs with less and less water resistance, the governing bodies didn't just say "we'll only allow results from swimmers wearing 1980s spandex Speedos". No, they sat down, examined the issue and tried to set standards that allowed competitors to use state of the art materials, while not imparting an unnatural advantage to those that used them (e.g. suits that added buoyancy).

There's no reason the "common hardware" can't be defined to include some level of GPU as well as CPU.

[Ozymandias]

These questions, designed to ridicule the ones quoted before, are unwarranted.

I thought they were delightful and meant no offense. All work and no play, etc.

For many years, the recurrent "is there an engine that can use my GPU?" popped in computer chess forums every now and then; now that we have the option to finally use that (previously untapped) HW resource, it'd be nice to see traditional rating lists reacting a little more promptly to the new situation, instead of just keeping testing it as a CPU bound engine.

For many years the recurrent "is there a bicycle that could use an internal combustion engine?" question, no doubt, popped up in many cyclists' minds, yet we do not see motorcycles taking part in Tour de France.

Ridicule (verb): to make fun of. What sort of delight did it bring you? The offence is in trying to be funny, when there was no other desire in the original questions, other than to obtain information.

The analogy you propose isn't appropriate. The first Tour de France took place in 1903, almost a decade after the mass production of the motorcycles, had already started. It was decided from the get go, to leave motorcycles out of the race. Besides, that's not my complain, my point is that a "motorcycle" is participating, but it's being pedaled.