CCRL Blitz conditions

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Ferdy
Posts: 4852
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

CCRL Blitz conditions

Post by Ferdy »

CCRL Blitz Testing Conditions
Time Control: As from January 2020, the blitz list is transitioning from a 40 moves in 2 minutes repeating time control to game in 2 minutes plus 1 second increment, 2'+1", on an Intel i7-4770k. Over time the list will reach a point where new engines and engine versions will have played at the new time control, and old versions and engines at the old repeating time control, with some engines having played both. At that point we can make a decision whether to leave things as they are, or move the games at the new time control to a brand new list and archive the old one.

We use Stockfish 10 as a benchmark to determine the equivalent time control for a particular machine.

Endgame tablebases: 4, 5 or 6 piece tablebases.

Pondering: OFF.

Tournament format: Any format of tester's choice: Match, Round-robin, Gauntlet, Swiss, etc.

Hash size: Should be set to the same value of either 128 or 256 MB for all engines in a match or tourney. There are two exeptions: 1) Engines using 4 CPUs should have up to four times the hash size, compared to single-CPU engines in the same tourney. 2) Smaller hash size can be used if an engine has problems with particular hash size, or if it does not allow to configure hash size.

EGTB hash: 32 MB or 64MB.

Tournament Interface: Any. Examples: Winboard, Arena, Shredder, Chessbase, Chess Partner, Cutechess, ChessGUI.

Opening book: Any generic. Examples: remis.ctg, draw.ctg, 5moves.ctg, perfect.ctg etc. Book line length has to be limited to 12 moves per side maximum. The same book should be used for all engines in the same match or tournament.

Engines with their own books should have them disabled (deleted or switched off in parameters). Engines which can't disable their own book can't participate in CCRL testing.

Book learning: Off for all engines.

Position learning: Off for all engines.
Can somebody with processor i7-4770k post the bench of stockfish 10? I would like to calibrate my i7-2600k with the CCRL Blitz. Thanks.

Here are my figures:
i7-2600k

Code: Select all

Stockfish 10 64 by T. Romstad, M. Costalba, J. Kiiski, G. Linscott
uci
id name Stockfish 10 64
id author T. Romstad, M. Costalba, J. Kiiski, G. Linscott

option name Debug Log File type string default
option name Contempt type spin default 24 min -100 max 100
option name Analysis Contempt type combo default Both var Off var White var Black var Both
option name Threads type spin default 1 min 1 max 512
option name Hash type spin default 16 min 1 max 131072
option name Clear Hash type button
option name Ponder type check default false
option name MultiPV type spin default 1 min 1 max 500
option name Skill Level type spin default 20 min 0 max 20
option name Move Overhead type spin default 30 min 0 max 5000
option name Minimum Thinking Time type spin default 20 min 0 max 5000
option name Slow Mover type spin default 84 min 10 max 1000
option name nodestime type spin default 0 min 0 max 10000
option name UCI_Chess960 type check default false
option name UCI_AnalyseMode type check default false
option name SyzygyPath type string default <empty>
option name SyzygyProbeDepth type spin default 1 min 1 max 100
option name Syzygy50MoveRule type check default true
option name SyzygyProbeLimit type spin default 7 min 0 max 7
uciok
bench

Code: Select all

sf10 x64
Total time (ms) : 3010
Nodes searched  : 3939338
Nodes/second    : 1308750

Code: Select all

sf10 x64 popcnt
Total time (ms) : 2903
Nodes searched  : 3939338
Nodes/second    : 1356988
User avatar
Graham Banks
Posts: 45420
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL Blitz conditions

Post by Graham Banks »

Ferdy wrote: Wed Jan 19, 2022 2:51 amCan somebody with processor i7-4770k post the bench of stockfish 10? I would like to calibrate my i7-2600k with the CCRL Blitz. Thanks.
I use 40 moves in 16 minutes repeating (rounded up) for 40/15.

For the Blitz (40/2 repeating or the 2m+1), I'd use 40/2 or 2m+1.
Either time control can still be used for blitz.
gbanksnz at gmail.com
Ferdy
Posts: 4852
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: CCRL Blitz conditions

Post by Ferdy »

Graham Banks wrote: Wed Jan 19, 2022 3:09 am
Ferdy wrote: Wed Jan 19, 2022 2:51 amCan somebody with processor i7-4770k post the bench of stockfish 10? I would like to calibrate my i7-2600k with the CCRL Blitz. Thanks.
I use 40 moves in 16 minutes repeating (rounded up) for 40/15.

For the Blitz (40/2 repeating or the 2m+1), I'd use 40/2 or 2m+1.
Either time control can still be used for blitz.
Is the TC on 40/4 using crafty bench is just similar to stockfish 10 on i7-4770k with TC 2+1?
CCRL 40/4: T minutes / 40 moves repeated, where T = 40 * <your elapsed seconds> / 480 = <your elapsed seconds> / 12
With my i7-2600k using crafty bench, this is just 40moves/2minutes TC.
User avatar
Graham Banks
Posts: 45420
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL Blitz conditions

Post by Graham Banks »

Ferdy wrote: Wed Jan 19, 2022 8:38 am
Graham Banks wrote: Wed Jan 19, 2022 3:09 am
Ferdy wrote: Wed Jan 19, 2022 2:51 amCan somebody with processor i7-4770k post the bench of stockfish 10? I would like to calibrate my i7-2600k with the CCRL Blitz. Thanks.
I use 40 moves in 16 minutes repeating (rounded up) for 40/15.

For the Blitz (40/2 repeating or the 2m+1), I'd use 40/2 or 2m+1.
Either time control can still be used for blitz.
Is the TC on 40/4 using crafty bench is just similar to stockfish 10 on i7-4770k with TC 2+1?
CCRL 40/4: T minutes / 40 moves repeated, where T = 40 * <your elapsed seconds> / 480 = <your elapsed seconds> / 12
With my i7-2600k using crafty bench, this is just 40moves/2minutes TC.
We no longer use the Crafty bench, only the Stockfish 10 one.
gbanksnz at gmail.com
User avatar
Gabor Szots
Posts: 1520
Joined: Sat Jul 21, 2018 7:43 am
Location: Budapest, Hungary
Full name: Gabor Szots

Re: CCRL Blitz conditions

Post by Gabor Szots »

These are the values produced by an i7-4770k machine (not mine, I've looked up an old post).

Total time: 2054
Nodes searched: 3939338
Nodes/second: 1917886
Gabor Szots
CCRL testing group