Comparison wanted: mate in 7 test

Discussion of chess software programming and technical issues.

Moderator: Ras

federico
Posts: 32
Joined: Sun Oct 22, 2017 4:36 am
Location: Canada
Full name: Federico Rojo

Re: Comparison wanted: mate in 7 test

Post by federico »

Chessnut1071 wrote: Fri Nov 26, 2021 5:07 am I'm testing my new engine which is based on mailbox ideas; however, it's not really a mailbox in a formal sense. It's 21x faster than my old inefficient engine, but, I don't have any idea how it compares with a well structured mailbox or bitboard program. So, I tested it on the FEN below with the following statistics:

FEN[201] = "5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1 "; // Unknown author 7-move mate [Qe4]

engine calls: 847,550,776
nodes visited: 34,141233,773
time: 11,327.6 seconds

methods: alpha/beta, history by ply, Zobirst hash, optimized evaluation function: history, capture, check, slider piece, enemy king moves[feedback[], and pawn promotion.

computer chip Intel I5, 2.5 GHz, 16GB ram

Need somebody to compare with.
Ceibo - latest dev.
5950X. 256mb hash. Single thread.
Finds mate in 8 in 0.9 secs, and mate in 7 in 5.6 secs.

Code: Select all

ucinewgame
position fen 5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1
go
info depth 1 seldepth 5 score cp 1485 time 1 nodes 119 fnodes 55 qnodes 64 nps 86732 hashfull 0 pv d1d8 f8e7
info depth 2 seldepth 3 score cp 1485 time 2 nodes 233 fnodes 80 qnodes 34 nps 96927 hashfull 0 pv d1d8 f8e7
info depth 3 seldepth 7 score cp 1466 time 3 nodes 1255 fnodes 726 qnodes 296 nps 342494 hashfull 0 pv c4b4 c6c5 b4b7
info depth 4 seldepth 6 score cp 1466 time 4 nodes 2093 fnodes 687 qnodes 151 nps 437481 hashfull 0 pv c4b4 c6c5 b4b7 e3h6
info depth 5 seldepth 10 score cp 1506 time 6 nodes 4094 fnodes 1437 qnodes 564 nps 645814 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 6 seldepth 9 score cp 1506 time 8 nodes 7338 fnodes 2939 qnodes 305 nps 893015 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 7 seldepth 11 score cp 1537 time 11 nodes 14911 fnodes 6325 qnodes 1248 nps 1307247 hashfull 0 pv c4b4 c6c5 b4b7 e3h6 b7a7 h6e3 a7a4
info depth 8 seldepth 11 score cp 1735 time 16 nodes 27434 fnodes 10051 qnodes 2472 nps 1684007 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 d8d7 e7f6 d7f7 f6f7
info depth 9 seldepth 13 score cp 1920 time 20 nodes 35877 fnodes 7136 qnodes 1307 nps 1782957 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 f3e5 e3h6 d3d7 e7f6 e5f7
info depth 10 seldepth 13 score cp 1911 time 25 nodes 48775 fnodes 10786 qnodes 2112 nps 1910785 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 f3e5 e3h6 d3d7 e7f6 e5f7 h6f4
info depth 11 seldepth 15 score cp 2058 time 46 nodes 105757 fnodes 45892 qnodes 11090 nps 2289229 hashfull 1 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 f4e5 f3e5
info depth 12 seldepth 17 score cp 2081 time 57 nodes 133888 fnodes 24352 qnodes 3779 nps 2344773 hashfull 1 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 f6f5 d8h8 c6c5
info depth 13 seldepth 18 score cp 2220 time 74 nodes 182436 fnodes 41718 qnodes 6830 nps 2451324 hashfull 1 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 g6g5 f7f6 h6h5 f6e6
info depth 14 seldepth 18 score cp 2242 time 99 nodes 256683 fnodes 64378 qnodes 9869 nps 2567735 hashfull 2 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 g6g5 f7f6 h6h5 d8h8 h7h6
info depth 15 seldepth 19 score cp 2249 time 142 nodes 386251 fnodes 112334 qnodes 17234 nps 2710534 hashfull 3 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6g5 e8g8 g7h6 g8f7 b7b5 d8h8 h6h5 f7h7 h5g4 h7g6
info depth 16 seldepth 21 score cp 2351 time 216 nodes 610944 fnodes 190176 qnodes 34517 nps 2816558 hashfull 5 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6e3 e8g8 g7h6 g8f7 b7b6 f7f6 e3c5 f6f4 h6g7 f4c7 g7h6
info depth 17 seldepth 23 score cp 2433 time 312 nodes 894716 fnodes 245497 qnodes 38275 nps 2865166 hashfull 7 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6g5 e8g8 g7h6 g8f7 h6h5 f7c7 c6c5 c7b7 h5h6 b7a7 g5e3 a7d7
info depth 18 seldepth 23 score cp 2597 time 472 nodes 1372365 fnodes 411977 qnodes 65672 nps 2906417 hashfull 12 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 f4e5 g2g4 f6f5 g4g5 h6h5 f7h7 h5g4 f3e5 g4g5
info depth 19 seldepth 25 score mate 8 time 895 nodes 2842609 fnodes 1360225 qnodes 110019 nps 3174062 hashfull 21 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 20 seldepth 23 score mate 8 time 1347 nodes 4585769 fnodes 1681472 qnodes 61688 nps 3402798 hashfull 27 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 21 seldepth 25 score mate 8 time 1796 nodes 6221462 fnodes 1583392 qnodes 52301 nps 3462138 hashfull 33 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 22 seldepth 25 score mate 8 time 2540 nodes 8956446 fnodes 2651845 qnodes 83139 nps 3524985 hashfull 41 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 23 seldepth 29 score mate 8 time 3781 nodes 13567730 fnodes 4466216 qnodes 145068 nps 3588094 hashfull 59 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 24 seldepth 28 score mate 7 time 5567 nodes 19956814 fnodes 6190166 qnodes 198918 nps 3584403 hashfull 84 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7 g8h8 f7h7
stop
info depth 25 seldepth 35 score mate 7 time 10044 nodes 35787587 fnodes 11763713 qnodes 4067060 nps 3562832 hashfull 229 pv c4e4
bestmove c4e4

4 threads. 256mb hash.
Finds mate in 8 in 0.5 secs, and mate in 7 in 2 secs.

Code: Select all

setoption name Threads value 4
Threads: 4
ucinewgame
position fen 5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1
go
info depth 1 seldepth 5 score cp 1485 time 1 nodes 119 fnodes 55 qnodes 64 nps 92265 hashfull 0 pv d1d8 f8e7
info depth 2 seldepth 3 score cp 1485 time 2 nodes 318 fnodes 80 qnodes 34 nps 132075 hashfull 0 pv d1d8 f8e7
info depth 3 seldepth 7 score cp 1466 time 3 nodes 4102 fnodes 707 qnodes 269 nps 1046097 hashfull 0 pv c4b4 c6c5 b4b7
info depth 4 seldepth 6 score cp 1466 time 5 nodes 5073 fnodes 306 qnodes 40 nps 991809 hashfull 0 pv c4b4 c6c5 b4b7
info depth 5 seldepth 9 score cp 1506 time 6 nodes 12285 fnodes 1326 qnodes 443 nps 1781650 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 6 seldepth 9 score cp 1506 time 8 nodes 19511 fnodes 1794 qnodes 166 nps 2257197 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 7 seldepth 11 score cp 1537 time 11 nodes 41082 fnodes 4851 qnodes 711 nps 3471898 hashfull 0 pv c4b4 c6c5 b4b7 e3h6 b7a7 h6e3 a7a4
info depth 8 seldepth 11 score cp 1735 time 15 nodes 66489 fnodes 5243 qnodes 786 nps 4306471 hashfull 0 pv d1d8 f8e7 c4d3 f6f5
info depth 9 seldepth 14 score cp 1920 time 19 nodes 97519 fnodes 6774 qnodes 1132 nps 4899210 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 f3e5 e3h6 d3d7 e7f6 e5f7
info depth 10 seldepth 10 score cp 1911 time 23 nodes 119842 fnodes 4693 qnodes 507 nps 5082925 hashfull 0 pv d1d8 f8e7 c4d3 f6f5
info depth 11 seldepth 15 score cp 2058 time 40 nodes 265197 fnodes 33595 qnodes 6846 nps 6551523 hashfull 1 pv c4e6 e3h6 d1d8 f8g7 e6e8 h6f4 e8g8 g7h6 g8f7 f4e5 f3e5
info depth 12 seldepth 17 score cp 2165 time 53 nodes 381822 fnodes 24194 qnodes 4048 nps 7149531 hashfull 2 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4
info depth 13 seldepth 16 score cp 2165 time 63 nodes 477610 fnodes 20889 qnodes 2422 nps 7473352 hashfull 3 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4
info depth 14 seldepth 15 score cp 2204 time 83 nodes 688327 fnodes 44887 qnodes 5764 nps 8204411 hashfull 4 pv c4e4 e3h6 d1d8 f8g7
info depth 15 seldepth 17 score cp 2249 time 115 nodes 1029523 fnodes 71280 qnodes 7175 nps 8902641 hashfull 6 pv c4e4 e3h6 d1d8
info depth 16 seldepth 18 score cp 2298 time 161 nodes 1519293 fnodes 110394 qnodes 10362 nps 9381474 hashfull 10 pv c4e4 e3h6 d1d8
info depth 17 seldepth 20 score cp 2420 time 231 nodes 2300339 fnodes 162958 qnodes 25533 nps 9923340 hashfull 17 pv c4e6 e3h6 d1d8 f8g7 e6e8 h6f4
info depth 18 seldepth 23 score mate 8 time 525 nodes 5969165 fnodes 857132 qnodes 76908 nps 11348330 hashfull 39 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 19 seldepth 15 score mate 8 time 678 nodes 8012389 fnodes 504474 qnodes 16334 nps 11805155 hashfull 44 pv c4e6 e3h6
info depth 20 seldepth 15 score mate 8 time 996 nodes 12283195 fnodes 1038985 qnodes 32464 nps 12323109 hashfull 54 pv c4e6 e3h6 d1d8
info depth 21 seldepth 15 score mate 8 time 1154 nodes 14223846 fnodes 471685 qnodes 11155 nps 12318190 hashfull 59 pv c4e6 e3h6
info depth 22 seldepth 15 score mate 7 time 1981 nodes 24676025 fnodes 2509147 qnodes 75513 nps 12455387 hashfull 96 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7
info depth 23 seldepth 13 score mate 7 time 2217 nodes 27407492 fnodes 691687 qnodes 13469 nps 12360084 hashfull 111 pv c4e4 e3h6
info depth 24 seldepth 33 score mate 7 time 7635 nodes 95364532 fnodes 13843907 qnodes 2864355 nps 12489974 hashfull 652 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7
stop
info depth 25 seldepth 33 score mate 7 time 8219 nodes 102240236 fnodes 1458177 qnodes 429443 nps 12439081 hashfull 688 pv c4e4
bestmove c4e4

JVMerlino
Posts: 1404
Joined: Wed Mar 08, 2006 10:15 pm
Location: San Francisco, California

Re: Comparison wanted: mate in 7 test

Post by JVMerlino »

I have to disagree with the statement "any information is better than none", because it implies that all information is relevant to the problem you are trying to solve, or the conclusion you are trying to reach.

As I've shown with many of your tests, the The King engine from CM9000, which is nearly 20 years old, is lightning fast in these positions, solving it in less than one second at depth 8:

Code: Select all

Time	Depth	Score	Positions	Moves
0:00	1/3	13.99	4781		1.Rd8+ Ke7 2.Rd7+ Kxd7 3.Qxf7+
					Kd6 4.Qxf6+ Kc5 5.Qe5+ Kb6 6.Qxe3+
					c5
0:00	1/4	17.01	28884		1.Rd8+ Ke7 2.Qd3 f5 3.Rg8 Bc5 4.Qd8+
					Ke6 5.Ng5+ Ke5 6.Nxf7+ Ke6 7.Ng5+
					Ke5 8.Qxc7+ Kd5 9.Nxh7
0:00	1/5	18.32	95220		1.Rd8+ Ke7 2.Qd3 f5 3.Rg8 Bc5 4.Qd8+
					Ke6 5.Ng5+ Ke5 6.Nxf7+ Ke6 7.Ng5+
					Ke5 8.Re8+ Kf4 9.Ne6+ Kg3 10.Qg5+
					Kh2 11.Nxc5
0:00	1/5	Mate08	112202		1.Qe6 Bxh6 2.Rd8+ Kg7 3.Ne5 fxe5
					4.Qxe5+ Rf6 5.Rd7+ Kg8 6.Qxf6 c5
					7.Qf7+ Kh8 8.Qxh7#
0:00	1/6	Mate08	148296		1.Qe6 Bxh6 2.Rd8+ Kg7 3.Ne5 fxe5
					4.Qxe5+ Rf6 5.Rd7+ Kg8 6.Qxf6 c5
					7.Qf7+ Kh8 8.Qxh7#
0:00	1/7	Mate08	304400		1.Qe6 Bxh6 2.Rd8+ Kg7 3.Ne5 fxe5
					4.Qxe5+ Rf6 5.Rd7+ Kg8 6.Qxf6 c5
					7.Qf7+ Kh8 8.Qxh7#
0:00	1/8	Mate08	692755		1.Qe6 Bxh6 2.Rd8+ Kg7 3.Ne5 fxe5
					4.Qxe5+ Rf6 5.Rd7+ Kg8 6.Qxf6 c5
					7.Qf7+ Kh8 8.Qxh7#
0:00	1/8	Mate07	1278179		1.Qe4 Bd2 2.Rxd2 Re7 3.Rd8+ Kf7
					4.Qc4+ Re6 5.Rd7+ Kf8 6.Qxe6 f5
					7.Qf7#
So you would be inclined to conclude that The King was one of the strongest engines in existence. Stockfish takes 1.3 seconds on my machine and doesn't find it until depth 31! So The King must be "more efficient'. And yet, SF is rated 900 points higher.

Being good at matefinding is a nice feature, but it means nothing for elo.

FYI, Myrddin (bitboards, rated about 2550) needs 210 seconds to find it with 8 threads. But I don't know what you can do with that information.
dangi12012
Posts: 1062
Joined: Tue Apr 28, 2020 10:03 pm
Full name: Daniel Infuehr

Re: Comparison wanted: mate in 7 test

Post by dangi12012 »

JVMerlino wrote: Fri Nov 26, 2021 7:03 pm I have to disagree with the statement "any information is better than none", because it implies that all information is relevant to the problem you are trying to solve, or the conclusion you are trying to reach.

As I've shown with many of your tests, the The King engine from CM9000, which is nearly 20 years old, is lightning fast in these positions, solving it in less than one second at depth 8:

Code: Select all

Time	Depth	Score	Positions	Moves
0:00	1/3	13.99	4781		1.Rd8+ Ke7 2.Rd7+ Kxd7 3.Qxf7+
					Kd6 4.Qxf6+ Kc5 5.Qe5+ Kb6 6.Qxe3+
					c5
0:00	1/4	17.01	28884		1.Rd8+ Ke7 2.Qd3 f5 3.Rg8 Bc5 4.Qd8+
					Ke6 5.Ng5+ Ke5 6.Nxf7+ Ke6 7.Ng5+
					Ke5 8.Qxc7+ Kd5 9.Nxh7
0:00	1/5	18.32	95220		1.Rd8+ Ke7 2.Qd3 f5 3.Rg8 Bc5 4.Qd8+
					Ke6 5.Ng5+ Ke5 6.Nxf7+ Ke6 7.Ng5+
					Ke5 8.Re8+ Kf4 9.Ne6+ Kg3 10.Qg5+
					Kh2 11.Nxc5
0:00	1/5	Mate08	112202		1.Qe6 Bxh6 2.Rd8+ Kg7 3.Ne5 fxe5
					4.Qxe5+ Rf6 5.Rd7+ Kg8 6.Qxf6 c5
					7.Qf7+ Kh8 8.Qxh7#
0:00	1/6	Mate08	148296		1.Qe6 Bxh6 2.Rd8+ Kg7 3.Ne5 fxe5
					4.Qxe5+ Rf6 5.Rd7+ Kg8 6.Qxf6 c5
					7.Qf7+ Kh8 8.Qxh7#
0:00	1/7	Mate08	304400		1.Qe6 Bxh6 2.Rd8+ Kg7 3.Ne5 fxe5
					4.Qxe5+ Rf6 5.Rd7+ Kg8 6.Qxf6 c5
					7.Qf7+ Kh8 8.Qxh7#
0:00	1/8	Mate08	692755		1.Qe6 Bxh6 2.Rd8+ Kg7 3.Ne5 fxe5
					4.Qxe5+ Rf6 5.Rd7+ Kg8 6.Qxf6 c5
					7.Qf7+ Kh8 8.Qxh7#
0:00	1/8	Mate07	1278179		1.Qe4 Bd2 2.Rxd2 Re7 3.Rd8+ Kf7
					4.Qc4+ Re6 5.Rd7+ Kf8 6.Qxe6 f5
					7.Qf7#
So you would be inclined to conclude that The King was one of the strongest engines in existence. Stockfish takes 1.3 seconds on my machine and doesn't find it until depth 31! So The King must be "more efficient'. And yet, SF is rated 900 points higher.

Being good at matefinding is a nice feature, but it means nothing for elo.

FYI, Myrddin (bitboards, rated about 2550) needs 210 seconds to find it with 8 threads. But I don't know what you can do with that information.
Its useless to do a single position and compare mating times in seconds...
For a good cross table you would need 1000s of positions with different "mate in" and compare the cpu cycles used.
That would give a true strenght in terms of "CPU CYCLES per Ply Mate" - also doesnt say anything about ELO.
Worlds-fastest-Bitboard-Chess-Movegenerator
Daniel Inführ - Software Developer
Chessnut1071
Posts: 313
Joined: Tue Aug 03, 2021 2:41 pm
Full name: Bill Beame

Re: Comparison wanted: mate in 7 test

Post by Chessnut1071 »

dangi12012 wrote: Fri Nov 26, 2021 4:34 pm
Chessnut1071 wrote: Fri Nov 26, 2021 3:55 pm
dangi12012 wrote: Fri Nov 26, 2021 3:45 pm
Chessnut1071 wrote: Fri Nov 26, 2021 5:07 am I'm testing my new engine which is based on mailbox ideas; however, it's not really a mailbox in a formal sense. It's 21x faster than my old inefficient engine, but, I don't have any idea how it compares with a well structured mailbox or bitboard program. So, I tested it on the FEN below with the following statistics:

FEN[201] = "5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1 "; // Unknown author 7-move mate [Qe4]

engine calls: 847,550,776
nodes visited: 34,141233,773
time: 11,327.6 seconds

methods: alpha/beta, history by ply, Zobirst hash, optimized evaluation function: history, capture, check, slider piece, enemy king moves[feedback[], and pawn promotion.

computer chip Intel I5, 2.5 GHz, 16GB ram

Need somebody to compare with.
You know that this is totally useless?
One engine can perform better than others - but this is just random noise.

You would need thousands of "mate in X" positions to actually get engine performance test.
I strongly disagree, it's not as useless as you think. When you have no information, any information is better than none. Also, deep mate in x puzzles tests trillions of nodes and deep ply searches. Any efficient engine will act proportionally to 10s of 1,000s of game iterations without the time overhead. I agree it's not ELO, but, the most efficient engines with respect to ELO will also tend to be the most efficient at mate in x puzzles. If somebody has access to the major engines with reported ELO scores we can make a direct correlation and see who's right.
Engine A finds this by pure chance after a few million nodes. Engine B finds this with its algo a lot later but has a much higher elo.
Thats why you need a lot of positions to get rid of NOISE.

Anyways for SF14.1 on a Ryzen 5950X the output is this:
Same machine after reboot (to clear the TB cache)

Code: Select all

Run A)
62/16	00:04	 165.515k	39.474k	+M7	Qc4-e4 Be3xh6 Rd1-d8+ Kf8-g7 Nf3-d4 Bh6-f4 Nd4-e6+ Kg7-h6 Rd8-d3 Kh6-h5 Rd3-h3+ Kh5-g4 Qe4xf4+
Run B)
33/16	00:00	 9.163k	57.271k	+M7	Qc4-e4 Be3xh6 Rd1-d8+ Kf8-g7 Nf3-d4 Rf7-f8 Qe4-e7+ Kg7-g8 Rd8-d7 Rf8-d8 Rd7xd8+ Bh6-f8 Qe7xf8+
Soooo. I just proved my point. Same engine same hardware - looks as if Run B is a much better engine. But in reallity its the same.
So this test run as a single test is not only saying nothing - its heavily misleading.

Better have 1000 Mate in X tests to get proper results.
I think you're not looking at some of the statistics being reported above. I agree that it's hard to tell the difference between strong engines when they're just seconds apart; however, it discriminates between the weaker engines taking minutes instead of seconds. Most of the engines you're running are not optimized to find mate, they're optimized on ELO. Therefore, you need at least 2 classes. As far as 1000 puzzle mates, I have 400 which I test with. I'd like to group by bitboard, mailbox and other, then by mate optimizers and pruners or ELO optimizers.

You are right that more puzzles are needed to statistically compare performance. Also, the game database will also have biases similar to puzzle mates. In fact, everything has some bias which is why you need to increase the sample size. I think puzzle mate would be less biased because there is a known solution and games could have blunders and missed lines. An overly pruned engine will sometimes beat a superior engine by chance too. My objective is to develop a 30-ply, or higher, mate finder which can run reasonably fast on a personal computer.
jdart
Posts: 4410
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Comparison wanted: mate in 7 test

Post by jdart »

Arasan (current dev version) terminates after finding the move Rd8+ which it scores as mate in 13. It doesn't find the quicker mate. This is due to pruning. It takes 14.6 seconds to get a mate score on a Xeon 2690v3 (1 core, 1G hash), but Rd8+ is found almost immediately, it just doesn't see for a while that there is a mate.
Joost Buijs
Posts: 1646
Joined: Thu Jul 16, 2009 10:47 am
Location: Almere, The Netherlands

Re: Comparison wanted: mate in 7 test

Post by Joost Buijs »

It takes Nightmare on a I9-10980XE (1 core, 1G hash) 19 seconds to find a mate in 8, after 114 seconds it switches to mate in 7.

Code: Select all

info depth 14 score cp 1648 time 480 nodes 807315 nps 1681906 tbhits 0 pv d1d8 f8e7 c4d3 f6f5 d8g8 e3c5 d3d8 e7e6 f3d4 e6e5 g8e8 f7e7
info depth 15 score cp 1741 time 542 nodes 911385 nps 1681522 tbhits 0 pv d1d8 f8e7 c4d3 f6f5 d8g8 e3c5 d3d8 e7e6 f3g5 e6e5 g5f7 e5f4
info depth 16 score mate 8 time 19070 nodes 37450122 nps 1963823 tbhits 0 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8
info depth 17 score mate 8 time 23596 nodes 46583922 nps 1974229 tbhits 0 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8
info depth 18 score mate 8 time 32168 nodes 63959731 nps 1988303 tbhits 0 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8
info depth 19 score mate 8 time 49505 nodes 98738793 nps 1994521 tbhits 0 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8
info depth 20 score mate 8 time 75250 nodes 150695057 nps 2002592 tbhits 0 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8
info depth 21 score mate 7 time 114872 nodes 230737902 nps 2008652 tbhits 0 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7 g8h8
info depth 22 score mate 7 time 144935 nodes 292116640 nps 2015501 tbhits 0 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7 g8h8
abulmo2
Posts: 479
Joined: Fri Dec 16, 2016 11:04 am
Location: France
Full name: Richard Delorme

Re: Comparison wanted: mate in 7 test

Post by abulmo2 »

On a ryzen 1700x, Amoeba 3.4 (in dev) takes 56 s to find the mate in 7 on a single thread (4Gb of Hash)

Code: Select all

position fen 5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1
go mate 7
info depth 1 seldepth 6 score cp 1299 time 4 nodes 98 nps 20038 pv c4b4 f7e7 
info depth 2 seldepth 3 score cp 1299 time 4 nodes 165 nps 33121 pv c4b4 f7e7 b4b7 
info depth 3 seldepth 7 score cp 1304 time 5 nodes 323 nps 63156 pv c4b4 c6c5 b4b7 e3h6 
info depth 4 seldepth 5 score cp 1340 time 5 nodes 589 nps 110171 pv c4b4 c6c5 b4b7 e3h6 b7e4 
info depth 5 seldepth 12 score cp 1486 time 5 nodes 1523 nps 261414 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6d7 f6f7 d7c8 
info depth 6 seldepth 11 score cp 1488 time 6 nodes 1973 nps 327991 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6d7 f6f7 d7d6 f7h7 
info depth 7 seldepth 14 score cp 1565 time 6 nodes 2903 nps 448720 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6d7 f6f7 d7d6 f7h7 g6g5 
info depth 8 seldepth 19 score cp 1691 time 8 nodes 6187 nps 750439 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6d7 f6g7 d7c8 g7h8 c8d7 h8h7 d7d8 h7g6 
info depth 9 seldepth 18 score cp 1776 time 9 nodes 9140 nps 947228 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6d7 f6g7 d7c8 g7h8 c8d7 h8h7 d7d6 h7g6 d6c5 h6h7 
info depth 10 seldepth 22 score cp 1926 time 14 nodes 16846 nps 1192544 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 c6c5 e3e4 c7c6 f3e5 b6c7 
info depth 11 seldepth 21 score cp 1944 time 26 nodes 36027 nps 1344281 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 c6c5 e3e4 c7c6 f3e5 b6a6 e5d7 
info depth 12 seldepth 23 score cp 1961 time 34 nodes 51488 nps 1485032 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 c6c5 f3e5 c7c6 e3e4 a7a6 e5d7 b6c7 d7c5 
info depth 13 seldepth 29 score cp 2048 time 53 nodes 89346 nps 1675021 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5c4 e5e3 a7a5 e3e5 a5a4 e5d4 c4b5 d4b4 b5a6 b4a4 a6b6 f3e5 
info depth 14 seldepth 25 score cp 2119 time 76 nodes 154713 nps 2016006 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5c4 e5e3 a7a5 e3e5 c4d3 e5e1 d3c4 e1e5 c4d3 e5e1 
info depth 15 seldepth 27 score cp 2159 time 113 nodes 266515 nps 2346690 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 b6a6 e3e5 a6b6 e5h8 g6g5 f3g5 c6c5 h8f6 b6a5 f6f7 a5b6 f7f6 b6a5 
info depth 16 seldepth 27 score cp 2210 time 165 nodes 426631 nps 2581880 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 c6c5 e3e6 c7c6 e6f7 g6g5 f3g5 a7a6 f7h7 c5c4 g5e6 b6a7 h7e4 
info depth 17 seldepth 35 score cp 2455 time 302 nodes 869105 nps 2868786 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 b6b5 e3a7 b5c4 a7b7 c4d3 b7c6 d3e3 c6c7 e3f2 c7h7 f2g2 f3e5 
info depth 18 seldepth 32 score cp 2662 time 391 nodes 1142827 nps 2916396 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 b6b5 e3a7 b5c4 a7b7 c4d5 b7c7 d5e6 c7c6 e6e7 c6b7 e7e6 b7a7 e6f5 a7h7 f5f6 
info depth 19 seldepth 34 score cp 2979 time 729 nodes 2338814 nps 3205621 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5c4 e5e3 a7a5 e3e2 c4c5 e2e7 c5b6 e7h7 g6g5 f3g5 a5a4 h7f7 a4a3 h6h7 a3b2 h7h8Q c6c5 
info depth 20 seldepth 36 score mate 8 time 43695 nodes 172846098 nps 3955737 hashfull 431 pv d1d8 f8e7 d8c8 f7f8 c4e4 e7d6 c8f8 d6c5 e4b4 c5d5 f8d8 d5e6 d8e8 e6d5 c3c4 
info depth 21 seldepth 38 score mate 7 time 56392 nodes 226289623 nps 4012729 hashfull 498 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8e8 e7f7 g8h8 f7h7 
bestmove c4e4
With 8 threads it takes between 10 and 15 seconds depending on the run:

Code: Select all

moeba-3.4.3 -H 4096 -c 8
position fen 5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1
go mate 7
info depth 1 seldepth 6 score cp 1299 time 39 nodes 158 nps 4000 pv c4b4 f7e7 
info depth 2 seldepth 3 score cp 1304 time 39 nodes 455 nps 11490 pv c4b4 c6c5 b4b7 
info depth 3 seldepth 4 score cp 1304 time 39 nodes 1066 nps 26863 pv c4b4 c6c5 b4b7 e3h6 
info depth 4 seldepth 7 score cp 1365 time 39 nodes 3309 nps 82932 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7h7 
info depth 5 seldepth 9 score cp 1511 time 40 nodes 6455 nps 160820 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7h7 g6g5 
info depth 6 seldepth 15 score cp 1520 time 40 nodes 10222 nps 253123 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6d7 f6f7 d7d6 f7f6 d6d7 
info depth 7 seldepth 14 score cp 1565 time 40 nodes 13526 nps 333181 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6d7 f6f7 d7d6 f7h7 g6g5 
info depth 8 seldepth 14 score cp 1641 time 41 nodes 23900 nps 578756 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6d7 f6f7 d7d6 f7h7 d6d5 h7g6 
info depth 9 seldepth 17 score cp 1817 time 42 nodes 42776 nps 1001399 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d8 f7f6 d8e8 f6e6 e8f8 e6e3 a7a6 f3e5 f8e7 
info depth 10 seldepth 24 score cp 1932 time 46 nodes 93444 nps 2000625 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d8 f7f8 d8d7 f8f7 d7d8 f7f6 d8e8 f6e6 e8d8 e6e3 b7b6 f3e5 d8c8 
info depth 11 seldepth 23 score cp 1979 time 50 nodes 137079 nps 2741563 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 b6a6 f3e5 b7b6 e5c6 a6b7 c6e5 
info depth 12 seldepth 21 score cp 2007 time 51 nodes 164446 nps 3169633 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d8 f7f6 d8c8 f6f8 c8d7 f8f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 b6a6 f3e5 b7b6 e5c6 
info depth 13 seldepth 22 score cp 2119 time 68 nodes 401842 nps 5849560 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 b6a6 e3d3 a6a5 d3d7 a5b6 d7h7 g6g5 f3g5 a7a5 
info depth 14 seldepth 21 score cp 2139 time 76 nodes 523587 nps 6836463 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 c6c5 e3e6 c7c6 e6g8 c5c4 g8c4 c6c5 c4f7 c5c4 f7c4 
info depth 15 seldepth 26 score cp 2200 time 102 nodes 1008166 nps 9818800 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 c6c5 e3e6 c7c6 e6g8 g6g5 f3g5 a7a6 g8h7 a6a5 h7g8 b6b5 
info depth 16 seldepth 28 score cp 2219 time 130 nodes 1641817 nps 12614505 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5b6 e5e3 c6c5 e3e6 c7c6 e6g8 g6g5 f3g5 b6a6 g8c4 a6b6 c4f7 a7a5 f7h7 a5a4 
info depth 17 seldepth 34 score cp 2380 time 165 nodes 2364049 nps 14288022 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5c4 e5e3 a7a5 e3f4 c4c5 f4c7 g6g5 c7a5 b7b5 f3g5 c5d5 g5h7 d5d6 h7f6 d6e5 
info depth 18 seldepth 35 score cp 2546 time 259 nodes 4515589 nps 17405137 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6 f7f6 d6c5 f6e5 c5c4 e5e3 a7a5 e3f4 c4c5 f4c7 g6g5 c7a5 c5d6 f3g5 c6c5 a5b6 d6e5 g5h7 e5f5 b6b7 f5g6 b7g7 g6f5 g7f7 f5e5 
info depth 19 seldepth 32 score mate 7 time 10695 nodes 257109596 nps 24038226 hashfull 519 pv c4e4 e3h6 d1d8 f8g7 f3d4 h6f4 d4e6 g7h6 d8d1 g6g5 d1h1 f4h2 h1h2 
bestmove c4e4
Richard Delorme
Chessnut1071
Posts: 313
Joined: Tue Aug 03, 2021 2:41 pm
Full name: Bill Beame

Re: Comparison wanted: mate in 7 test

Post by Chessnut1071 »

jdart wrote: Sun Nov 28, 2021 4:49 am Arasan (current dev version) terminates after finding the move Rd8+ which it scores as mate in 13. It doesn't find the quicker mate. This is due to pruning. It takes 14.6 seconds to get a mate score on a Xeon 2690v3 (1 core, 1G hash), but Rd8+ is found almost immediately, it just doesn't see for a while that there is a mate.
I think the metric that would be useful is nodes/second and time. For example, there are an average of 42.26 moves per ply in that puzzle:

total all possible moves: 29,393,246.941,314,447,711,165.7

Obviously, you need a fast engine and a good evaluation function. If your engine is slow but you have a fast time it points to a very efficient evaluation function. If your engine is fast but you have a long solution time it indicates a weak evaluation function. The evaluation function is most critical in solving that puzzle quickly. It would be nice to know the solution method, mailboxes, bitboards or other. I'm trying to get some comparison between these methods and it's confounded with evaluation, so, I have to rely on nodes/second. thx for the example
tcusr
Posts: 325
Joined: Tue Aug 31, 2021 10:32 pm
Full name: tcusr

Re: Comparison wanted: mate in 7 test

Post by tcusr »

federico wrote: Fri Nov 26, 2021 4:39 pm
Chessnut1071 wrote: Fri Nov 26, 2021 5:07 am I'm testing my new engine which is based on mailbox ideas; however, it's not really a mailbox in a formal sense. It's 21x faster than my old inefficient engine, but, I don't have any idea how it compares with a well structured mailbox or bitboard program. So, I tested it on the FEN below with the following statistics:

FEN[201] = "5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1 "; // Unknown author 7-move mate [Qe4]

engine calls: 847,550,776
nodes visited: 34,141233,773
time: 11,327.6 seconds

methods: alpha/beta, history by ply, Zobirst hash, optimized evaluation function: history, capture, check, slider piece, enemy king moves[feedback[], and pawn promotion.

computer chip Intel I5, 2.5 GHz, 16GB ram

Need somebody to compare with.
Ceibo - latest dev.
5950X. 256mb hash. Single thread.
Finds mate in 8 in 0.9 secs, and mate in 7 in 5.6 secs.

Code: Select all

ucinewgame
position fen 5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1
go
info depth 1 seldepth 5 score cp 1485 time 1 nodes 119 fnodes 55 qnodes 64 nps 86732 hashfull 0 pv d1d8 f8e7
info depth 2 seldepth 3 score cp 1485 time 2 nodes 233 fnodes 80 qnodes 34 nps 96927 hashfull 0 pv d1d8 f8e7
info depth 3 seldepth 7 score cp 1466 time 3 nodes 1255 fnodes 726 qnodes 296 nps 342494 hashfull 0 pv c4b4 c6c5 b4b7
info depth 4 seldepth 6 score cp 1466 time 4 nodes 2093 fnodes 687 qnodes 151 nps 437481 hashfull 0 pv c4b4 c6c5 b4b7 e3h6
info depth 5 seldepth 10 score cp 1506 time 6 nodes 4094 fnodes 1437 qnodes 564 nps 645814 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 6 seldepth 9 score cp 1506 time 8 nodes 7338 fnodes 2939 qnodes 305 nps 893015 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 7 seldepth 11 score cp 1537 time 11 nodes 14911 fnodes 6325 qnodes 1248 nps 1307247 hashfull 0 pv c4b4 c6c5 b4b7 e3h6 b7a7 h6e3 a7a4
info depth 8 seldepth 11 score cp 1735 time 16 nodes 27434 fnodes 10051 qnodes 2472 nps 1684007 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 d8d7 e7f6 d7f7 f6f7
info depth 9 seldepth 13 score cp 1920 time 20 nodes 35877 fnodes 7136 qnodes 1307 nps 1782957 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 f3e5 e3h6 d3d7 e7f6 e5f7
info depth 10 seldepth 13 score cp 1911 time 25 nodes 48775 fnodes 10786 qnodes 2112 nps 1910785 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 f3e5 e3h6 d3d7 e7f6 e5f7 h6f4
info depth 11 seldepth 15 score cp 2058 time 46 nodes 105757 fnodes 45892 qnodes 11090 nps 2289229 hashfull 1 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 f4e5 f3e5
info depth 12 seldepth 17 score cp 2081 time 57 nodes 133888 fnodes 24352 qnodes 3779 nps 2344773 hashfull 1 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 f6f5 d8h8 c6c5
info depth 13 seldepth 18 score cp 2220 time 74 nodes 182436 fnodes 41718 qnodes 6830 nps 2451324 hashfull 1 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 g6g5 f7f6 h6h5 f6e6
info depth 14 seldepth 18 score cp 2242 time 99 nodes 256683 fnodes 64378 qnodes 9869 nps 2567735 hashfull 2 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 g6g5 f7f6 h6h5 d8h8 h7h6
info depth 15 seldepth 19 score cp 2249 time 142 nodes 386251 fnodes 112334 qnodes 17234 nps 2710534 hashfull 3 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6g5 e8g8 g7h6 g8f7 b7b5 d8h8 h6h5 f7h7 h5g4 h7g6
info depth 16 seldepth 21 score cp 2351 time 216 nodes 610944 fnodes 190176 qnodes 34517 nps 2816558 hashfull 5 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6e3 e8g8 g7h6 g8f7 b7b6 f7f6 e3c5 f6f4 h6g7 f4c7 g7h6
info depth 17 seldepth 23 score cp 2433 time 312 nodes 894716 fnodes 245497 qnodes 38275 nps 2865166 hashfull 7 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6g5 e8g8 g7h6 g8f7 h6h5 f7c7 c6c5 c7b7 h5h6 b7a7 g5e3 a7d7
info depth 18 seldepth 23 score cp 2597 time 472 nodes 1372365 fnodes 411977 qnodes 65672 nps 2906417 hashfull 12 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7 f4e5 g2g4 f6f5 g4g5 h6h5 f7h7 h5g4 f3e5 g4g5
info depth 19 seldepth 25 score mate 8 time 895 nodes 2842609 fnodes 1360225 qnodes 110019 nps 3174062 hashfull 21 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 20 seldepth 23 score mate 8 time 1347 nodes 4585769 fnodes 1681472 qnodes 61688 nps 3402798 hashfull 27 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 21 seldepth 25 score mate 8 time 1796 nodes 6221462 fnodes 1583392 qnodes 52301 nps 3462138 hashfull 33 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 22 seldepth 25 score mate 8 time 2540 nodes 8956446 fnodes 2651845 qnodes 83139 nps 3524985 hashfull 41 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 23 seldepth 29 score mate 8 time 3781 nodes 13567730 fnodes 4466216 qnodes 145068 nps 3588094 hashfull 59 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 24 seldepth 28 score mate 7 time 5567 nodes 19956814 fnodes 6190166 qnodes 198918 nps 3584403 hashfull 84 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7 g8h8 f7h7
stop
info depth 25 seldepth 35 score mate 7 time 10044 nodes 35787587 fnodes 11763713 qnodes 4067060 nps 3562832 hashfull 229 pv c4e4
bestmove c4e4

4 threads. 256mb hash.
Finds mate in 8 in 0.5 secs, and mate in 7 in 2 secs.

Code: Select all

setoption name Threads value 4
Threads: 4
ucinewgame
position fen 5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1
go
info depth 1 seldepth 5 score cp 1485 time 1 nodes 119 fnodes 55 qnodes 64 nps 92265 hashfull 0 pv d1d8 f8e7
info depth 2 seldepth 3 score cp 1485 time 2 nodes 318 fnodes 80 qnodes 34 nps 132075 hashfull 0 pv d1d8 f8e7
info depth 3 seldepth 7 score cp 1466 time 3 nodes 4102 fnodes 707 qnodes 269 nps 1046097 hashfull 0 pv c4b4 c6c5 b4b7
info depth 4 seldepth 6 score cp 1466 time 5 nodes 5073 fnodes 306 qnodes 40 nps 991809 hashfull 0 pv c4b4 c6c5 b4b7
info depth 5 seldepth 9 score cp 1506 time 6 nodes 12285 fnodes 1326 qnodes 443 nps 1781650 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 6 seldepth 9 score cp 1506 time 8 nodes 19511 fnodes 1794 qnodes 166 nps 2257197 hashfull 0 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7d6
info depth 7 seldepth 11 score cp 1537 time 11 nodes 41082 fnodes 4851 qnodes 711 nps 3471898 hashfull 0 pv c4b4 c6c5 b4b7 e3h6 b7a7 h6e3 a7a4
info depth 8 seldepth 11 score cp 1735 time 15 nodes 66489 fnodes 5243 qnodes 786 nps 4306471 hashfull 0 pv d1d8 f8e7 c4d3 f6f5
info depth 9 seldepth 14 score cp 1920 time 19 nodes 97519 fnodes 6774 qnodes 1132 nps 4899210 hashfull 0 pv d1d8 f8e7 c4d3 f6f5 f3e5 e3h6 d3d7 e7f6 e5f7
info depth 10 seldepth 10 score cp 1911 time 23 nodes 119842 fnodes 4693 qnodes 507 nps 5082925 hashfull 0 pv d1d8 f8e7 c4d3 f6f5
info depth 11 seldepth 15 score cp 2058 time 40 nodes 265197 fnodes 33595 qnodes 6846 nps 6551523 hashfull 1 pv c4e6 e3h6 d1d8 f8g7 e6e8 h6f4 e8g8 g7h6 g8f7 f4e5 f3e5
info depth 12 seldepth 17 score cp 2165 time 53 nodes 381822 fnodes 24194 qnodes 4048 nps 7149531 hashfull 2 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4
info depth 13 seldepth 16 score cp 2165 time 63 nodes 477610 fnodes 20889 qnodes 2422 nps 7473352 hashfull 3 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4
info depth 14 seldepth 15 score cp 2204 time 83 nodes 688327 fnodes 44887 qnodes 5764 nps 8204411 hashfull 4 pv c4e4 e3h6 d1d8 f8g7
info depth 15 seldepth 17 score cp 2249 time 115 nodes 1029523 fnodes 71280 qnodes 7175 nps 8902641 hashfull 6 pv c4e4 e3h6 d1d8
info depth 16 seldepth 18 score cp 2298 time 161 nodes 1519293 fnodes 110394 qnodes 10362 nps 9381474 hashfull 10 pv c4e4 e3h6 d1d8
info depth 17 seldepth 20 score cp 2420 time 231 nodes 2300339 fnodes 162958 qnodes 25533 nps 9923340 hashfull 17 pv c4e6 e3h6 d1d8 f8g7 e6e8 h6f4
info depth 18 seldepth 23 score mate 8 time 525 nodes 5969165 fnodes 857132 qnodes 76908 nps 11348330 hashfull 39 pv c4e6 e3h6 d1d8 f8g7 f3e5 f6e5 e6e5 f7f6 d8d7 g7f8 e5f6 f8g8 d7d8 h6f8 d8f8
info depth 19 seldepth 15 score mate 8 time 678 nodes 8012389 fnodes 504474 qnodes 16334 nps 11805155 hashfull 44 pv c4e6 e3h6
info depth 20 seldepth 15 score mate 8 time 996 nodes 12283195 fnodes 1038985 qnodes 32464 nps 12323109 hashfull 54 pv c4e6 e3h6 d1d8
info depth 21 seldepth 15 score mate 8 time 1154 nodes 14223846 fnodes 471685 qnodes 11155 nps 12318190 hashfull 59 pv c4e6 e3h6
info depth 22 seldepth 15 score mate 7 time 1981 nodes 24676025 fnodes 2509147 qnodes 75513 nps 12455387 hashfull 96 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7
info depth 23 seldepth 13 score mate 7 time 2217 nodes 27407492 fnodes 691687 qnodes 13469 nps 12360084 hashfull 111 pv c4e4 e3h6
info depth 24 seldepth 33 score mate 7 time 7635 nodes 95364532 fnodes 13843907 qnodes 2864355 nps 12489974 hashfull 652 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7
stop
info depth 25 seldepth 33 score mate 7 time 8219 nodes 102240236 fnodes 1458177 qnodes 429443 nps 12439081 hashfull 688 pv c4e4
bestmove c4e4

in your website you say you don't use magic/rotated bitboards, what do you use?
User avatar
mvanthoor
Posts: 1784
Joined: Wed Jul 03, 2019 4:42 pm
Location: Netherlands
Full name: Marcel Vanthoor

Re: Comparison wanted: mate in 7 test

Post by mvanthoor »

Chessnut1071 wrote: Fri Nov 26, 2021 5:07 am I'm testing my new engine which is based on mailbox ideas; however, it's not really a mailbox in a formal sense. It's 21x faster than my old inefficient engine, but, I don't have any idea how it compares with a well structured mailbox or bitboard program. So, I tested it on the FEN below with the following statistics:

FEN[201] = "5k2/ppp2r1p/2p2ppP/8/2Q5/2P1bN2/PP4P1/1K1R4 w - - 0 1 "; // Unknown author 7-move mate [Qe4]

engine calls: 847,550,776
nodes visited: 34,141233,773
time: 11,327.6 seconds

methods: alpha/beta, history by ply, Zobirst hash, optimized evaluation function: history, capture, check, slider piece, enemy king moves[feedback[], and pawn promotion.

computer chip Intel I5, 2.5 GHz, 16GB ram

Need somebody to compare with.
My engine doesn't have history heuristics yet, nor any prunings except alpha/beta itself. It finds mate in 7 at depth 10:

Code: Select all

go
info score cp 822 depth 1 seldepth 6 time 0 nodes 274 nps 0 pv c4b4 c6c5 b4b7 e3h6 b7a7
info score cp 822 depth 2 seldepth 7 time 0 nodes 886 nps 0 pv c4b4 c6c5 b4b7 e3h6 b7a7
info score cp 872 depth 3 seldepth 10 time 3 nodes 4935 nps 1645000 pv d1d8 f8e7 d8d7 e7d7 c4f7 d7c8 f7h7
info score cp 1098 depth 4 seldepth 11 time 7 nodes 23304 nps 3329143 pv d1d8 f8e7 c4d3 f6f5 d8d7 e7f6 d7f7 f6f7 d3e3
info score cp 1098 depth 5 seldepth 13 time 20 nodes 119780 nps 5989000 pv d1d8 f8e7 c4d3 f6f5 d8d7 e7f6 d7f7 f6f7 d3e3
info score cp 1170 depth 6 seldepth 15 time 93 nodes 650253 nps 6991968 hashfull 1 pv c4e4 e3h6 d1d8 f8g7 e4e8 h6f4 e8g8 g7h6 g8f7
info score cp 1264 depth 7 seldepth 17 time 403 nodes 2871969 nps 7126474 hashfull 5 pv d1d8 f8e7 d8c8 f7f8 c4e4 e7f7 c8c7 f7g8 e4e3 f8f7 c7f7 g8f7 e3a7
info score cp 1312 depth 8 seldepth 21 time 1696 nodes 12136697 nps 7156071 hashfull 22 pv d1d8 f8e7 d8c8 f7f8 c8c7 e7d6 c7b7 c6c5 c4d3 e3d4 c3d4
info score cp 1549 depth 9 seldepth 21 time 7216 nodes 50730558 nps 7030288 hashfull 95 pv d1d8 f8e7 d8c8 f6f5 c8c7 e7d6 c7f7 f5f4 f7b7 a7a5 b7h7
info score mate 7 depth 10 seldepth 23 time 38200 nodes 270719243 nps 7086891 hashfull 399 pv c4e4 e3h6 d1d8 f8g7 f3d4 f7f8 e4e7 g7g8 d8d7 f8f7 e7f7 g8h8 f7h7
38 seconds on a Core i7-6700K.
Author of Rustic, an engine written in Rust.
Releases | Code | Docs | Progress | CCRL