Comparison wanted: mate in 7 test

[federico]

I'm testing my new engine which is based on mailbox ideas; however, it's not really a mailbox in a formal sense. It's 21x faster than my old inefficient engine, but, I don't have any idea how it compares with a well structured mailbox or bitboard program. So, I tested it on the FEN below with the following statistics:

FEN[201] = "5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1 "; // Unknown author 7-move mate [Qe4]

engine calls: 847,550,776
nodes visited: 34,141233,773
time: 11,327.6 seconds

methods: alpha/beta, history by ply, Zobirst hash, optimized evaluation function: history, capture, check, slider piece, enemy king moves[feedback[], and pawn promotion.

computer chip Intel I5, 2.5 GHz, 16GB ram

Need somebody to compare with.

Ceibo - latest dev.
5950X. 256mb hash. Single thread.
Finds mate in 8 in 0.9 secs, and mate in 7 in 5.6 secs.

Code: Select all

ucinewgame
position fen 5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1
go
info depth 1 seldepth 5 score cp 1485 time 1 nodes 119 fnodes 55 qnodes 64 nps 86732 hashfull 0 pv d1d8 f8e7
info depth 2 seldepth 3 score cp 1485 time 2 nodes 233 fnodes 80 qnodes 34 nps 96927 hashfull 0 pv d1d8 f8e7
info depth 3 seldepth 7 score cp 1466 time 3 nodes 1255 fnodes 726 qnodes 296 nps 342494 hashfull 0 pv c4b4 c6c5 b4b7
info depth 4 seldepth 6 score cp 1466 time 4 nodes 2093 fnodes 687 qnodes 151 nps 437481 hashfull 0 pv c4b4 c6c5 b4b7 e3h6
info depth 5 seldepth 10 score cp 1506 time 6 nodes 4094 fnodes 1437 qnodes 564 nps 645814 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 6 seldepth 9 score cp 1506 time 8 nodes 7338 fnodes 2939 qnodes 305 nps 893015 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 7 seldepth 11 score cp 1537 time 11 nodes 14911 fnodes 6325 qnodes 1248 nps 1307247 hashfull 0 pv c4b4 c6c5 b4b7 e3h6 b7a7 h6e3 a7a4
info depth 8 seldepth 11 score cp 1735 time 16 nodes 27434 fnodes 10051 qnodes 2472 nps 1684007 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 d8d7 e7f6 d7f7 f6f7
info depth 9 seldepth 13 score cp 1920 time 20 nodes 35877 fnodes 7136 qnodes 1307 nps 1782957 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 f3e5 e3h6 d3d7 e7f6 e5f7
info depth 10 seldepth 13 score cp 1911 time 25 nodes 48775 fnodes 10786 qnodes 2112 nps 1910785 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 f3e5 e3h6 d3d7 e7f6 e5f7 h6f4
info depth 11 seldepth 15 score cp 2058 time 46 nodes 105757 fnodes 45892 qnodes 11090 nps 2289229 hashfull 1 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 f4e5 f3e5
info depth 12 seldepth 17 score cp 2081 time 57 nodes 133888 fnodes 24352 qnodes 3779 nps 2344773 hashfull 1 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 f6f5 d8h8 c6c5
info depth 13 seldepth 18 score cp 2220 time 74 nodes 182436 fnodes 41718 qnodes 6830 nps 2451324 hashfull 1 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 g6g5 f7f6 h6h5 f6e6
info depth 14 seldepth 18 score cp 2242 time 99 nodes 256683 fnodes 64378 qnodes 9869 nps 2567735 hashfull 2 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 g6g5 f7f6 h6h5 d8h8 h7h6
info depth 15 seldepth 19 score cp 2249 time 142 nodes 386251 fnodes 112334 qnodes 17234 nps 2710534 hashfull 3 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6g5 e8g8 g7h6 g8f7 b7b5 d8h8 h6h5 f7h7 h5g4 h7g6
info depth 16 seldepth 21 score cp 2351 time 216 nodes 610944 fnodes 190176 qnodes 34517 nps 2816558 hashfull 5 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6e3 e8g8 g7h6 g8f7 b7b6 f7f6 e3c5 f6f4 h6g7 f4c7 g7h6
info depth 17 seldepth 23 score cp 2433 time 312 nodes 894716 fnodes 245497 qnodes 38275 nps 2865166 hashfull 7 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6g5 e8g8 g7h6 g8f7 h6h5 f7c7 c6c5 c7b7 h5h6 b7a7 g5e3 a7d7
info depth 18 seldepth 23 score cp 2597 time 472 nodes 1372365 fnodes 411977 qnodes 65672 nps 2906417 hashfull 12 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 f4e5 g2g4 f6f5 g4g5 h6h5 f7h7 h5g4 f3e5 g4g5
info depth 19 seldepth 25 score mate 8 time 895 nodes 2842609 fnodes 1360225 qnodes 110019 nps 3174062 hashfull 21 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 20 seldepth 23 score mate 8 time 1347 nodes 4585769 fnodes 1681472 qnodes 61688 nps 3402798 hashfull 27 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 21 seldepth 25 score mate 8 time 1796 nodes 6221462 fnodes 1583392 qnodes 52301 nps 3462138 hashfull 33 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 22 seldepth 25 score mate 8 time 2540 nodes 8956446 fnodes 2651845 qnodes 83139 nps 3524985 hashfull 41 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 23 seldepth 29 score mate 8 time 3781 nodes 13567730 fnodes 4466216 qnodes 145068 nps 3588094 hashfull 59 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 24 seldepth 28 score mate 7 time 5567 nodes 19956814 fnodes 6190166 qnodes 198918 nps 3584403 hashfull 84 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7 g8h8 f7h7
stop
info depth 25 seldepth 35 score mate 7 time 10044 nodes 35787587 fnodes 11763713 qnodes 4067060 nps 3562832 hashfull 229 pv c4e4
bestmove c4e4

4 threads. 256mb hash.
Finds mate in 8 in 0.5 secs, and mate in 7 in 2 secs.

Code: Select all

setoption name Threads value 4
Threads: 4
ucinewgame
position fen 5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1
go
info depth 1 seldepth 5 score cp 1485 time 1 nodes 119 fnodes 55 qnodes 64 nps 92265 hashfull 0 pv d1d8 f8e7
info depth 2 seldepth 3 score cp 1485 time 2 nodes 318 fnodes 80 qnodes 34 nps 132075 hashfull 0 pv d1d8 f8e7
info depth 3 seldepth 7 score cp 1466 time 3 nodes 4102 fnodes 707 qnodes 269 nps 1046097 hashfull 0 pv c4b4 c6c5 b4b7
info depth 4 seldepth 6 score cp 1466 time 5 nodes 5073 fnodes 306 qnodes 40 nps 991809 hashfull 0 pv c4b4 c6c5 b4b7
info depth 5 seldepth 9 score cp 1506 time 6 nodes 12285 fnodes 1326 qnodes 443 nps 1781650 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 6 seldepth 9 score cp 1506 time 8 nodes 19511 fnodes 1794 qnodes 166 nps 2257197 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 7 seldepth 11 score cp 1537 time 11 nodes 41082 fnodes 4851 qnodes 711 nps 3471898 hashfull 0 pv c4b4 c6c5 b4b7 e3h6 b7a7 h6e3 a7a4
info depth 8 seldepth 11 score cp 1735 time 15 nodes 66489 fnodes 5243 qnodes 786 nps 4306471 hashfull 0 pv d1d8 f8e7 c4d3 f6f5
info depth 9 seldepth 14 score cp 1920 time 19 nodes 97519 fnodes 6774 qnodes 1132 nps 4899210 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 f3e5 e3h6 d3d7 e7f6 e5f7
info depth 10 seldepth 10 score cp 1911 time 23 nodes 119842 fnodes 4693 qnodes 507 nps 5082925 hashfull 0 pv d1d8 f8e7 c4d3 f6f5
info depth 11 seldepth 15 score cp 2058 time 40 nodes 265197 fnodes 33595 qnodes 6846 nps 6551523 hashfull 1 pv c4e6 e3h6 d1d8 f8g7 e6e8 h6f4 e8g8 g7h6 g8f7 f4e5 f3e5
info depth 12 seldepth 17 score cp 2165 time 53 nodes 381822 fnodes 24194 qnodes 4048 nps 7149531 hashfull 2 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4
info depth 13 seldepth 16 score cp 2165 time 63 nodes 477610 fnodes 20889 qnodes 2422 nps 7473352 hashfull 3 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4
info depth 14 seldepth 15 score cp 2204 time 83 nodes 688327 fnodes 44887 qnodes 5764 nps 8204411 hashfull 4 pv c4e4 e3h6 d1d8 f8g7
info depth 15 seldepth 17 score cp 2249 time 115 nodes 1029523 fnodes 71280 qnodes 7175 nps 8902641 hashfull 6 pv c4e4 e3h6 d1d8
info depth 16 seldepth 18 score cp 2298 time 161 nodes 1519293 fnodes 110394 qnodes 10362 nps 9381474 hashfull 10 pv c4e4 e3h6 d1d8
info depth 17 seldepth 20 score cp 2420 time 231 nodes 2300339 fnodes 162958 qnodes 25533 nps 9923340 hashfull 17 pv c4e6 e3h6 d1d8 f8g7 e6e8 h6f4
info depth 18 seldepth 23 score mate 8 time 525 nodes 5969165 fnodes 857132 qnodes 76908 nps 11348330 hashfull 39 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 19 seldepth 15 score mate 8 time 678 nodes 8012389 fnodes 504474 qnodes 16334 nps 11805155 hashfull 44 pv c4e6 e3h6
info depth 20 seldepth 15 score mate 8 time 996 nodes 12283195 fnodes 1038985 qnodes 32464 nps 12323109 hashfull 54 pv c4e6 e3h6 d1d8
info depth 21 seldepth 15 score mate 8 time 1154 nodes 14223846 fnodes 471685 qnodes 11155 nps 12318190 hashfull 59 pv c4e6 e3h6
info depth 22 seldepth 15 score mate 7 time 1981 nodes 24676025 fnodes 2509147 qnodes 75513 nps 12455387 hashfull 96 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7
info depth 23 seldepth 13 score mate 7 time 2217 nodes 27407492 fnodes 691687 qnodes 13469 nps 12360084 hashfull 111 pv c4e4 e3h6
info depth 24 seldepth 33 score mate 7 time 7635 nodes 95364532 fnodes 13843907 qnodes 2864355 nps 12489974 hashfull 652 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7
stop
info depth 25 seldepth 33 score mate 7 time 8219 nodes 102240236 fnodes 1458177 qnodes 429443 nps 12439081 hashfull 688 pv c4e4
bestmove c4e4

in your website you say you don't use magic/rotated bitboards, what do you use?

It's just the classical approach.

[dangi12012]

What are you comparing?
Hardware or engines?
Single Thread?
The parameters are not fixed so this thread is noise IMO.

"Time until Mate is found" is not a metric thats well defined

[Chessnut1071]

What are you comparing?
Hardware or engines?
Single Thread?
The parameters are not fixed so this thread is noise IMO.

"Time until Mate is found" is not a metric thats well defined

Time and nodes per second tell me whether it's raw speed of the engine, or, the evaluation algorithm that's most efficient. Noise to you maybe. but, info to me. I'd be interested in seeing the evaluation algorithm, but, nobody is reporting that.

[hgm]

Nodes per sec only tells you the combination of raw engine speed, hardware speed and number of threads. In addition, not everyone counts nodes the same way, so different engines with higher nps single threaded on the same hardware can actualle be slower.

[JohnWoe]

[fen]5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1[/fen]

Mayhem 6.3. 443M nodes for Ng5

Code: Select all

exclude: none best +tail                                          
dep	score	nodes	time	(not shown:  tbhits	knps	seldep)
 18	+104,85 	443,8M	5:37.57	Ng5 
 17	+104,85 	443,8M	5:37.57	Ng5 
 16	+8,49 	307,7M	3:53.24	Rd8+ 
 15	+8,25 	233,3M	2:58.66	Rd8+ 
 14	+8,30 	80,7M  	1:00.16	Rd8+ 
 13	+8,34 	49,4M  	0:37.77	Rd8+ 
 12	+8,22 	29,2M  	0:22.38	Qg4 
 11	+8,19 	9,97M  	0:07.58	Qg4 
 10	+8,39 	2,05M  	0:01.57	Qe6 
  9	+8,17 	837630	0:00.64	Qe6 
  8	+8,38 	555553	0:00.46	Qe6 
  7	+8,28 	319043	0:00.28	Qe6 
  6	+8,39 	127776	0:00.12	Kc2 
  5	+6,97 	60868  	0:00.06	Qxf7+ 
  4	+8,60 	19719  	0:00.02	Kc2 
  3	+6,04 	6264    	0:00.01	Qh4 
  2	+8,62 	1272    	0:00.00	Kc2 
  1	+4,90 	92        	0:00.00	Qxf7+ 
  0	#