Eduard wrote: ↑Tue Nov 26, 2019 8:22 pm
Anyone who conscientiously tests Lc0 against AB Engines knows, there is a Lc0 Ratio for reliable results. And CCRL knows that too. Nevertheless, CCRL does not release any information about it.
Agreed. Any testing of NN-engine vs AB-engines without information about the Leela-Ratio makes the results total useless. And I believe, the CCRL Leela-Ratio of the Fat Fritz testrun could be ridiculous high (2 - 2.5 or even worse) - only explanation for Fat Fritz being at the same Elo-level as a new Stockfish-Dev.
Somewhat around 1.0 (between 0.7 and 1.3) is an acceptable Leela-Ratio for testing.
Well its RTX2080 vs Athlon 64 X2 4600+ (2.4 GHz) on 4 cores. Does not require much analysis to see that the results are not as meaningful as others cast present them.
We use mainly modern Intel and AMD computers for testing. Nobody uses a Athlon 64 X2 4600+ (2.4 GHz). All of our computers are just benchmarked to that CPU.
Chessbase is making a BIG deal about two little points of Fat Fritz over Stockfish, once Fat Fritz reaches over 1000 games that little difference of 2 points will banish or go away in favor of Stockfish
Chessqueen wrote: ↑Wed Nov 27, 2019 5:39 pm
Chessbase is making a BIG deal about two little points of Fat Fritz over Stockfish, once Fat Fritz reaches over 1000 games that little difference of 2 points will banish or go away in favor of Stockfish
Yes, + 2 Elo is very precarious, it could lose that very easily with more games. Or it might improve.
I am sure Albert Silver (who wrote the article) is very proud he wrote the strongest engine in the world.
The article on optimization is what I wrote last week. The ratings part was added by CB in view of the result. As to being proud of my work: absolutely.
