LC0 ver 0.16.0 ID 10520 vs Deep Shredder 13 x64 40/4

[AdminX]

Hardware:
i7-4790 CPU @ 3.60GHz
GTX 1060
32 GB Ram

Software:
Windows 10 Pro
Shredder 13 GUI

Book:
Tournament Setting: FCP-Live-Book_V4.49

Engines:
Deep Shredder 13 x64 (4 Cores) (2048 Hash) (Permanent Brain On) (Complete Syzygybases)
LC0 ver 0.16.0 (Default Settings)




Games: https://www59.zippyshare.com/v/AnZHZHGL/file.html

[oreopoulos]

GPU hardware is not enough for such a limited time.

[jhellis3]

(Permanent Brain On)

Well....

[Javier Ros]

The Permanent Brain in Shredder is lowering the performance of LC0 because LC0 uses at least one core of CPU.
It is easy to detect it with a CPU monitor. Depending on the CPU and GPU I have seen it uses until 60 % the CPU.

Fair conditions would involve turning Permanent Brain off.

On the other hand, I also think that an average of 15 or 30 seconds per movement helps a lot to improve the play of LC0.

Do you use CUDA libraries? They multiply by 6 the performance of LC0.

[AdminX]

GPU hardware is not enough for such a limited time.

Not so sure this statement is true. I am currently re-running the same test with these modified LC0 settings and LC0 is currently leading this time.

Code: Select all

-t 4 --minibatch-size=512 --nncache=2000000

PS: Using CUDNN

[AdminX]

GPU hardware is not enough for such a limited time.

Not so sure this statement is true. I am currently re-running the same test with these modified LC0 settings and LC0 is currently leading this time.

Code: Select all

-t 4 --minibatch-size=512 --nncache=2000000

PS: Using CUDNN

While match is still on going, here are the current standings.

[AdminX]

Here is the final score of the rematch using the modified settings.

[Ron Langeveld]

Here is the final score of the rematch using the modified settings.

With "Permanent brain" still active in Shredder the rerun is still irrelevant as pointed out earlier by Javier. Since you did not mention changing it I guess you decided to keep it enabled, or did you just forget it?

[AdminX]

Here is the final score of the rematch using the modified settings.

With "Permanent brain" still active in Shredder the rerun is still irrelevant as pointed out earlier by Javier. Since you did not mention changing it I guess you decided to keep it enabled, or did you just forget it?

Correct, I decided to keep it enabled.

[Ron Langeveld]

What is your reasoning for keeping it enabled?
Common test protocol and practice is with PONDER OFF for good reason. I am sure a man with your experience knows this all too well.
In this case only Shredder is allowed to ponder during the opponents time.
Furthermore, while pondering Shredder will compete with Leela for CPU thread utilization.
To me this is like a boxing match where Leela had one arm tied to his back.
So what do you think the outcome of your test is telling us?
There are plenty of pointless tests to be found on the internet and I couldn't care less.
It's the fact that you actually decided not to address the obvious issue with your test that triggered me to post.