Graham Banks wrote: ↑Mon Jul 01, 2019 1:12 am
mwyoung wrote: ↑Mon Jul 01, 2019 1:06 am.....CCRL to mislead people on the time control, and hardware used.
Well, we do state the following:
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
And:
CCRL 40/40 Testing Conditions
Time Control: Equivalent to 40 moves in 40 minutes on AMD X2 4600+ at 2.4GHz. We use Crafty 19.17 BH as a benchmark to determine the equivalent time control for particular machine.
I pointed that out also. It is called a bait and switch in advertising. People see 40m/40 and you hope they don't read the fine print on what they are really receiving. I also pointed out that the setting is less powerful then a modern smartphone.
You need to advertise the real testing standard in the Header. 1.5m/40 and 15m/40 on a testing speed of a AMD X2 4600+ at 2.4GHz.
SSDF does not have an issue calling the correct time control. And Hardware used to test the engines.
Why is CCRL not will to do the same?
What are you going to do in the next few years as your hardware improves. Test at 30 seconds in 40 moves. So CCRL can pump out more low quality games at an even faster rate.
2019-02-28
148673 games played by 377 computers
The Swedish Ratinglist may be quoted in other magazines, but we insist that this will be done in a correct way! We expect, that not only the rating figures, but also the number of games and the margin of error will be quoted.
Please read the comment by the chairman, Lars Sandin. You may also download the list in DOS text format. Please note that this is a longer list, with almost all tested computers since SSDF began its work more than 20 years ago!
All games have been played on the tournament level, 40 moves/2 hours followed by 20 moves/each following hour. In matches between PC-programs, two separate PCs have been used, connected with an auto232-cable.
If you have any questions about the list you are welcome to contact us.
Rating + - Games Won Av.opp
1 Stockfish 9 x64 1800X 3.6 GHz 3494 32 -30 642 74% 3308
2 Komodo 12.3 x64 1800X 3.6 GHz 3456 30 -28 640 68% 3321
3 Stockfish 9 x64 Q6600 2.4 GHz 3446 50 -48 200 57% 3396
4 Stockfish 8 x64 1800X 3.6 GHz 3432 26 -24 1059 77% 3217
5 Stockfish 8 x64 Q6600 2.4 GHz 3418 38 -35 440 72% 3251
6 Komodo 11.01 x64 1800X 3.6 GHz 3397 23 -22 1134 72% 3229
7 Deep Shredder 13 x64 1800X 3.6 GHz 3360 25 -24 830 66% 3246
8 Booot 6.3.1 x64 1800X 3.6 GHz 3352 29 -29 560 54% 3319
9 Komodo 9.1 x64 Q6600 2.4 GHz 3340 21 -20 1435 72% 3175