Arasan 24.0 release

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

peter
Posts: 3187
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Arasan 24.0 release

Post by peter »

jdart wrote: Mon Aug 14, 2023 4:12 pm
peter wrote: Mon Aug 14, 2023 8:39 am How about position learning?
Does not work in UCI mode - this is a known issue.
In which mode does it and where are the learning- entries stored? In book.bin? Is it about book- learning only or is it a feature for all played or analysed moves?
Peter.
peter
Posts: 3187
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Arasan 24.0 release

Post by peter »

ImNotStockfish wrote: Mon Aug 14, 2023 4:21 pm
jdart wrote: Sat Aug 12, 2023 9:53 pm I have also made some updates to the Arasan test suite, replacing some positions that were known to have multiple solutions, or appeared to have incorrect solutions, or multiple moves somewhat close in score. Latest version here: https://arasanchess.org/arasan2023.epd.
Can you explain the solution of these test positions?

Code: Select all

8/7p/5kp1/4p3/p3rPRP/3K2P1/8/8 b - - bm Kg7; id "Arasan2023.17"; c0 "Flohr-Geller, URS-ch Final Moscow 1949";
1r2r1k1/2R2p2/1N1Rp2p/p2b3P/4pPP1/8/P4K2/8 w - - bm g5; id "arasan2023.99"; c0 "ENGINEMASTER-Arasan, ICC 2015";
First one isn't a game changer, and if e.g. next best 1...Rd4+ is much weaker, won't be easy to prove. Crystal after some Forward- Backward and 1...Kg7:
[d]8/6kp/6p1/4p3/p3rPRP/3K2P1/8/8 w - - 0 1 Analysis by Crystal 6 PMT:

2.h5 a3 3.Kxe4 a2 4.hxg6 a1Q 5.gxh7+ Kxh7 6.fxe5
Black is clearly winning: -+ (-96.91) Depth: 22/55 00:00:03 148MN, tb=1233673

and after 1...Rd4+:
[d]8/7p/5kp1/4p3/p2r1PRP/3K2P1/8/8 w - - 0 1 Analysis by Crystal 6 PMT:

2.Kc3 Kg7 3.Rg5 Re4 4.Kd3 Re1 5.Kd2 h6 6.Rg4 a3 7.f5 a2 8.Rxg6+ Kf7 9.Kxe1 a1Q+ 10.Kd2 Qb2+ 11.Kd3 Qd4+ 12.Kc2 e4 13.Kb3 e3 14.Rxh6 Qd3+ 15.Kb4 Qxf5 16.Ra6 Qd7 17.Ka5 e2 18.Kb6 Qb5+ 19.Kxb5
Black is clearly winning: -+ (-96.65) Depth: 28/55 00:02:52 7918MN, tb=77384156

Time to best eval for second one is a little higher maybe but you're right, not enough discrimination for a single best move position.

Second one in MultiPV=3 again after some Forward- Backward in depth 50:
[d]1r2r1k1/2R2p2/1N1Rp2p/p2b3P/4pPP1/8/P4K2/8 w - - 0 1 Analysis by Crystal 6 PMT:

1. = (0.00): 1.a4 Red8 2.Rxd8+ Rxd8 3.Nxd5 exd5 4.Ke3 Rb8 5.Rd7 Rb3+ 6.Ke2 Rd3 7.g5 hxg5 8.fxg5 d4 9.g6 Re3+ 10.Kd2 Rd3+
2. = (0.00): 1.g5 Red8 2.Rxd8+ Rxd8 3.Nd7 e5 4.Nxe5 Bxa2 5.Ke3 Rb8 6.Nd7 Rb3+ 7.Kxe4 Bb1+ 8.Kd5 hxg5 9.fxg5 Rb5+ 10.Nc5 Rb4 11.g6 fxg6 12.hxg6 Bxg6 13.Ke5 a4 14.Ra7 Rg4 15.Rxa4
3. = (0.00): 1.Ra7 Bxa2 2.Nd7 Rb2+ 3.Kg3 Rc8 4.Nf6+ Kg7 5.g5 Rc3+ 6.Kg4 Rg2+ 7.Kh4 hxg5+ 8.fxg5 Rh2+ 9.Kg4 Rg2+

So not a good single best move test position neither, regards
Peter.
jdart
Posts: 4367
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Arasan 24.0 release

Post by jdart »

Stockfish multi-PV analysis, 5 minutes/positions, 20 cores on a dual Xeon 2690v3 system:


8/7p/5kp1/4p3/p3rPRP/3K2P1/8/8 b - - bm Kg7; id "Arasan2023.17"; c0 "Flohr-Geller, URS-ch Final Moscow 1949";

depth 38 seldepth 49 multipv 1 score PovScore(Cp(+19955), BLACK) nodes 4710099621 nps 15700279 hashfull 837 tbhits 62105628 time 300.001 pv Kg7 h5 a3 Rh4 Ra4 Rh1 exf4 gxf4 a2 Ra1 Kf6 Ke3 Kf5 Kd3 Ra3+ Kd2 Kxf4 Kc2 Kg5 Kb2 Ra5 Kc2 Rb5 Rg1+ Kxh5 Rh1+ Kg5 Rg1+ Kf6 Rf1+ Kg7 Re1 a1=Q Re7+ Kh6 Re4 Rb2+ Kd3 Qd1+ Kc3 Rb3+ Kc4 Qd3+ Kc5
depth 37 seldepth 47 multipv 2 score PovScore(Cp(+3247), BLACK) nodes 4710099621 nps 15700279 hashfull 837 tbhits 62105628 time 300.001 pv Rd4+ Kc3 Kf7 Rg5 Re4 fxe5 a3 Kb3 Re3+ Ka2 Ke6 Kb1 Rxe5 Rg4 Re1+ Ka2 Re3 Ka1 Ke5 Kb1 Rb3+ Ka2 Rf3 Ka1 Kf6 Rg5 h6 Rb5 Rxg3 Rb6+ Kf5 Rb5+ Kg4 Rb4+ Kh5 Rb7 Kxh4 Rb4+ Kh5
depth 37 seldepth 32 multipv 3 score PovScore(Cp(0), BLACK) nodes 4710099621 nps 15700279 hashfull 837 tbhits 62105628 time 300.001 pv Re1 fxe5+ Rxe5 Rxa4 Re7 g4 Rc7 Ke4 Kg7 Kd3 Rd7+ Ke4
++ solved in 17.194 seconds (210610580 nodes) (1 out of 1 solved, 100.0%)

1r2r1k1/2R2p2/1N1Rp2p/p2b3P/4pPP1/8/P4K2/8 w - - bm g5; id "arasan2023.99"; c0 "ENGINEMASTER-Arasan, ICC 2015";

depth 56 seldepth 69 multipv 1 score PovScore(Cp(+9), WHITE) nodes 1795092366 nps 5982524 hashfull 488 tbhits 5249790 time 300.056 pv g5 Red8 Nd7 Kg7 g6 Rb7 Rxb7 Bxb7 gxf7 Kxf7 Ne5+ Ke7 Rxd8 Kxd8 Nf7+ Ke7 Nxh6 Bd5 a3 Bb3 Ng4 Bd1 h6 Kf7 Ne5+ Kg8 Ke3 Kh7 Nc6 a4 Kxe4 Kxh6 Ke5 Bb3 Nd4 Kg6 Nxe6 Bc2 Ng5 Bd3 Nf3 Kf7 Ne1 Bb1 Ng2 Ba2 Ne3 Bb1 Ng4 Bc2 Nf6 Bd1 Ne4 Ke7 Nc3 Bc2 Nb5 Kf7 Nd4 Bb1 Kd5 Ba2+ Ke4 Kf6 Kd3 Bf7
depth 56 seldepth 41 multipv 2 score PovScore(Cp(0), WHITE) nodes 1795092366 nps 5982524 hashfull 488 tbhits 5249790 time 300.056 pv a3 Red8 Rxd8+ Rxd8 Nd7 Bb3 Ne5 Bd1 Nxf7 Rd3 Ke1 Bf3 Nxh6+ Kf8 Kf2 Bd1 f5 e3+ Kg2 exf5 Rc8+ Ke7 Nxf5+ Kd7 Rc4 e2 Re4 e1=Q Rxe1 Bxg4 Re5 Bxh5 Rxa5 Bd1 Ra7+ Kd8 Ra8+ Kc7 Ne3 Rxe3
depth 56 seldepth 30 multipv 3 score PovScore(Cp(0), WHITE) nodes 1795092366 nps 5982524 hashfull 488 tbhits 5249790 time 300.056 pv a4 Red8 Rxd8+ Rxd8 Nd7 Bb3 g5 Bxa4 Nf6+ Kg7 g6 Be8 Nxe8+ Rxe8 Rxf7+ Kg8 Ra7 e5 f5 Rf8 Rxa5 Rxf5+ Ke3 Rxh5 Kxe4 Rh4+ Kf5 Rf4+ Kxe5
++ solved in 4.129 seconds (53436727 nodes) (2 out of 2 solved, 100.0%)

Stockfish doesn't show a clear advantage for the 2nd position, but it does select g5.
peter
Posts: 3187
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Arasan 24.0 release

Post by peter »

peter wrote: Mon Aug 14, 2023 7:15 pm

Code: Select all

8/7p/5kp1/4p3/p3rPRP/3K2P1/8/8 b - - bm Kg7; id "Arasan2023.17"; c0 "Flohr-Geller, URS-ch Final Moscow 1949";
1r2r1k1/2R2p2/1N1Rp2p/p2b3P/4pPP1/8/P4K2/8 w - - bm g5; id "arasan2023.99"; c0 "ENGINEMASTER-Arasan, ICC 2015";
Took out these two and nr.189, [d]4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - - 0 1 because this one Salai- study is too difficult for STC and has a dual with 1.f4 and 1.Bd1.
I then added Eret (Eigenmann Rapid Engine Test) minus 8 of it, 594 single best move positions from STS (Strategic Test Suite from Swaminathan and Corbit revised by Schröder and Mosca), 60 UHO- positions from Stefan Pohl's sets and 157 easy endgame studies out of HHdbVI (Harold van der Heijden database).
So I have 1111 positions of a rather homogenous level of difficulty for modern engines on modern hardware at 1"/position or less, preferably single thread for an even wider spreading of results.

https://www.dropbox.com/scl/fi/p9hjdzlf ... jdedf&dl=0

Single thread (3.5GHz), 1 second/position, 16Mb hash, 6men Syzygys, 2 extra plies Shredder 13 GUI:

Code: Select all

SF 230807:

Bisher gelöst: 990 von 1111  ;  3:15m

         1   2   3   4   5   6   7   8   9  10  11  12  13  14  15  16  17  18  19  20
 -------------------------------------------------------------------------------------
   0 |   -   0   0   0   0   0   -   0   0   0   0   0   0   0   -   0   -   0   -   0
  20 |   0   0   0   -   0   0   0   -   0   0   0   -   -   0   0   -   -   0   0   0
  40 |   0   0   -   -   0   0   0   -   0   0   0   -   0   0   0   0   -   0   0   0
  60 |   0   -   0   0   0   0   0   0   0   -   0   -   0   0   0   0   0   0   0   0
  80 |   0   0   0   0   0   0   -   0   -   0   -   0   0   0   0   0   0   0   0   0
 100 |   0   0   0   0   0   -   0   0   0   -   0   0   0   0   0   0   0   0   0   0
 120 |   0   -   0   0   -   0   0   0   -   0   0   0   0   -   -   -   0   0   0   -
 140 |   0   0   -   -   0   -   -   0   0   0   -   0   0   0   -   0   0   0   -   0
 160 |   -   0   0   0   0   0   0   -   0   0   -   0   0   0   -   -   0   0   0   0
 180 |   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   -   0   0
 200 |   0   0   0   0   0   -   -   0   0   -   0   0   0   0   -   0   -   -   0   0
 220 |   0   -   -   0   -   0   0   0   0   0   0   0   -   -   0   -   0   0   0   0
 240 |   0   -   0   0   0   0   -   -   0   0   0   0   0   -   -   -   -   0   0   0
 260 |   0   0   0   0   -   0   -   0   0   -   0   -   0   -   -   0   -   0   -   -
 280 |   0   0   0   0   -   0   0   0   -   0   0   -   0   0   0   0   0   -   0   0
 300 |   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   0
 320 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 340 |   0   0   0   -   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   0
 360 |   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   0   0
 380 |   0   0   -   0   -   0   0   0   0   0   -   0   0   0   0   0   0   0   0   -
 400 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 420 |   -   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0   -   0   0   0
 440 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 460 |   0   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0
 480 |   0   0   0   -   0   0   0   0   0   -   0   0   0   -   0   0   -   0   0   0
 500 |   0   0   0   0   0   -   0   -   0   0   0   0   0   0   0   0   -   0   0   0
 520 |   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 540 |   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0
 560 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   -
 580 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0
 600 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 620 |   0   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0
 640 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 660 |   0   0   0   0   0   0   -   0   0   0   0   0   0   0   -   0   0   0   0   0
 680 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -
 700 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0
 720 |   0   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0
 740 |   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 760 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 780 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 800 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 820 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 840 |   0   0   0   0   0   0   -   0   0   -   0   -   0   0   -   0   0   0   0   0
 860 |   0   0   0   0   0   0   0   -   0   -   0   0   0   0   0   0   0   0   0   0
 880 |   0   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 900 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 920 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 940 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 960 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 980 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
1000 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0
1020 |   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0   0
1040 |   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0
1060 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
1080 |   0   0   0   0   0   0   0   -   0   0   0   0   0   -   0   0   0   0   0   0
1100 |   0   0   0   0   0   0   -   0   0   0   0

   1 sec -> 990/1111
  K/s: 1.261.800  
  TotTime: 19:39m    SolTime: 3:15m
990/1111, 89.1%, TotTime: 19:39m SolTime: 3:15m

Code: Select all

Arasan 24.0:

Bisher gelöst: 859 von 1111  ;  5:17m


         1   2   3   4   5   6   7   8   9  10  11  12  13  14  15  16  17  18  19  20
 -------------------------------------------------------------------------------------
   0 |   -   -   0   -   0   -   0   0   -   -   -   -   0   -   -   0   -   -   -   0
  20 |   0   0   -   -   0   -   0   -   0   0   0   -   -   -   0   -   -   0   0   0
  40 |   0   0   0   -   -   0   0   0   0   0   0   -   0   0   -   0   -   0   0   0
  60 |   -   -   -   -   0   0   0   0   0   0   0   -   -   0   0   -   -   0   0   0
  80 |   -   0   0   -   0   -   -   0   -   -   -   0   0   0   0   0   -   0   0   -
 100 |   0   -   0   0   0   -   0   0   0   -   0   0   0   0   0   -   0   0   -   0
 120 |   0   -   0   -   -   0   0   -   -   0   0   0   0   -   -   -   -   -   -   -
 140 |   0   -   -   0   -   -   -   0   0   0   0   -   0   -   -   -   0   0   0   0
 160 |   -   -   0   -   0   -   0   -   0   -   0   -   -   0   -   0   -   0   0   0
 180 |   0   0   -   -   -   0   0   0   -   -   0   0   -   -   -   -   -   -   0   0
 200 |   0   -   0   0   0   0   -   0   0   -   -   0   -   -   -   0   -   -   -   0
 220 |   -   -   -   0   -   0   -   0   0   -   0   -   -   -   -   -   0   0   -   -
 240 |   -   -   -   0   -   -   -   -   0   0   0   0   -   -   -   -   -   0   -   0
 260 |   -   0   0   0   -   0   -   -   -   -   -   -   0   -   0   0   -   0   -   -
 280 |   0   0   0   -   -   0   -   -   -   -   0   -   0   -   0   -   -   -   0   0
 300 |   0   0   0   0   0   0   0   0   0   -   0   0   -   0   0   0   0   0   0   0
 320 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 340 |   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   -   0   0   0   0
 360 |   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   -   0   0   0   0
 380 |   0   0   -   -   -   -   0   0   0   0   0   0   0   0   -   0   0   0   -   -
 400 |   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -   0
 420 |   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   0   0
 440 |   -   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   0   0
 460 |   0   0   0   0   0   -   -   0   0   0   0   0   0   0   0   0   0   0   0   0
 480 |   0   0   -   -   0   0   0   0   0   -   0   0   0   -   0   0   -   0   0   0
 500 |   0   0   0   0   0   0   0   -   0   0   0   0   0   0   0   0   -   0   0   0
 520 |   -   -   0   -   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0
 540 |   0   0   -   0   -   0   -   0   -   0   -   -   0   0   0   -   0   0   0   -
 560 |   0   0   -   0   0   0   -   0   0   0   -   0   0   -   0   0   0   0   0   -
 580 |   -   0   -   0   -   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0
 600 |   -   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0
 620 |   0   0   0   0   0   0   0   0   0   0   0   0   -   -   0   0   0   0   0   0
 640 |   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0
 660 |   0   0   0   0   0   0   -   0   0   0   0   0   0   0   -   0   0   -   0   0
 680 |   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   -
 700 |   0   0   0   0   0   0   -   0   0   0   0   0   0   0   -   0   0   0   0   0
 720 |   0   0   0   0   0   -   0   0   0   0   0   0   0   0   0   0   -   -   0   0
 740 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 760 |   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   0
 780 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 800 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 820 |   0   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 840 |   0   0   -   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   -
 860 |   0   0   -   -   0   0   0   -   0   -   0   0   0   0   0   0   0   0   0   0
 880 |   -   0   0   0   0   0   0   0   0   0   -   0   -   0   0   0   0   0   0   0
 900 |   0   0   0   -   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 920 |   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   0
 940 |   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
 960 |   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   -   0
 980 |   0   0   0   0   0   0   0   0   0   0   0   0   -   0   0   0   0   -   0   -
1000 |   0   0   0   0   0   0   0   0   -   -   0   0   0   -   0   0   0   0   0   0
1020 |   0   0   0   0   -   -   0   0   0   0   0   0   0   0   0   -   0   0   0   0
1040 |   0   0   0   0   0   0   0   0   0   -   -   0   0   -   0   0   0   0   0   0
1060 |   0   0   0   0   0   0   0   0   -   0   0   0   0   0   0   -   0   0   -   0
1080 |   0   0   0   0   0   0   0   0   -   0   0   0   0   0   -   0   0   0   0   0
1100 |   0   0   0   0   -   -   -   0   -   -   0

   1 sec -> 859/1111
  K/s: 907.661  
  TotTime: 18:23m    SolTime: 5:17m
859/1111, 77.3%, TotTime: 18:23m SolTime: 5:17m
Peter.
ImNotStockfish
Posts: 51
Joined: Tue Sep 14, 2021 12:29 am
Full name: .

Re: Arasan 24.0 release

Post by ImNotStockfish »

peter wrote: Tue Aug 15, 2023 8:35 am So I have 1111 positions of a rather homogenous level of difficulty for modern engines on modern hardware at 1"/position or less, preferably single thread for an even wider spreading of results.

https://www.dropbox.com/scl/fi/p9hjdzlf ... jdedf&dl=0
A lot of the positions in that epd have the wrong best move. A simple google search gives different results.
peter
Posts: 3187
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Arasan 24.0 release

Post by peter »

ImNotStockfish wrote: Wed Aug 16, 2023 9:33 am
peter wrote: Tue Aug 15, 2023 8:35 am So I have 1111 positions of a rather homogenous level of difficulty for modern engines on modern hardware at 1"/position or less, preferably single thread for an even wider spreading of results.

https://www.dropbox.com/scl/fi/p9hjdzlf ... jdedf&dl=0
A lot of the positions in that epd have the wrong best move. A simple google search gives different results.
E.g.?
Peter.
ImNotStockfish
Posts: 51
Joined: Tue Sep 14, 2021 12:29 am
Full name: .

Re: Arasan 24.0 release

Post by ImNotStockfish »

peter wrote: Wed Aug 16, 2023 9:47 am
ImNotStockfish wrote: Wed Aug 16, 2023 9:33 am
peter wrote: Tue Aug 15, 2023 8:35 am So I have 1111 positions of a rather homogenous level of difficulty for modern engines on modern hardware at 1"/position or less, preferably single thread for an even wider spreading of results.

https://www.dropbox.com/scl/fi/p9hjdzlf ... jdedf&dl=0
A lot of the positions in that epd have the wrong best move. A simple google search gives different results.
E.g.?
These are just some of them. I don't know if you are manually changing the best move or if they are unintentional mistakes.

Code: Select all

r3r1k1/1p2bppp/nqp2n2/p5B1/2bPP3/P1N3P1/1P2N1BP/R1Q2RK1 w - - bm Kh1; hmvc 0; id "1_390, 190_?_1001, 496";
r3r1k1/1p2bppp/nqp2n2/p5B1/2bPP3/P1N3P1/1P2N1BP/R1Q2RK1 w - - bm e5; id "STS(v13.0) Pawn Play in the Center.090"; c0 "e5=10, Bf3=7, Kh1=7, Rf5=7";

Code: Select all

n1rr2k1/3qppbp/p1nP2p1/6P1/5P1Q/1P2B3/P4PBP/2RR2K1 w - - bm Qh3; hmvc 0; id "1_1369, 568_?_1001, 874";
n1rr2k1/3qppbp/p1nP2p1/6P1/5P1Q/1P2B3/P4PBP/2RR2K1 w - - bm f5; id "STS(v8.0) AKPC.069"; c0 "f5=10, Bc5=4, Qh3=6, Rc4=2"; c7 "f5 Bc5 Qh3 Rc4"; c8 "10 4 6 2"; c9 "f4f5 e3c5 h4h3 c1c4";

Code: Select all

1r2k2r/pp2ppb1/2n2np1/7p/4P3/P3BB1P/1P1N1PP1/R2R2K1 b k - bm O-O; hmvc 0; id "1_807, 367_?_1001, 673";
1r2k2r/pp2ppb1/2n2np1/7p/4P3/P3BB1P/1P1N1PP1/R2R2K1 b k - bm Nd7; c0 "Nd7=10, Bh6=6, a6=6"; id "STS(v3.0) Knight Outposts/Repositioning/Centralization.007"; c7 "Nd7 Bh6 a6"; c8 "10 6 6"; c9 "f6d7 g7h6 a7a6";
peter
Posts: 3187
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Arasan 24.0 release

Post by peter »

ImNotStockfish wrote: Wed Aug 16, 2023 12:34 pm These are just some of them. I don't know if you are manually changing the best move or if they are unintentional mistakes.
The first of your two choices is true (I intentionally changed bm from sources, especially from old STS, sometimes even from Ed's revised version of it):

Engine: Stockfish dev-20230807-5c2111cc0, 30 threads of 16x3.5GHz, 8192 MB hash, 6men Syzygys, Shredder 13 GUI, MultiPV=2:
[d]r3r1k1/1p2bppp/nqp2n2/p5B1/2bPP3/P1N3P1/1P2N1BP/R1Q2RK1 w - - 51 2:01 -0.01 1.Kh1 Rad8 2.Rf5 Nd7 3.Be3 Nc7 4.b3 Qxb3
5.Rb1 Qxa3 6.Qxa3 Bxa3 7.Rxa5 Nb5
8.Nxb5 cxb5 9.Rxa3 Bxe2 10.e5 Nb6
11.Bxb7 h6 12.Bc6 Re6 13.Bxb5 Bxb5
14.Rxb5 (2.083.651.872) 17143
TB:8.728

51 2:01 -0.08 1.e5 Nd7 2.Be3 Nc7 3.Re1 c5 4.Bf2 Bf8
5.Na4 Qa6 6.Nf4 cxd4 7.b3 Bxb3
8.Qxc7 Bxa4 9.Bxb7 Ra7 10.Bxa6 Rxc7
11.e6 fxe6 12.Nxe6 Rc6 13.Nxf8 Ne5
14.Rxe5 (2.083.651.872) 17143
TB:8.728


[d]n1rr2k1/3qppbp/p1nP2p1/6P1/5P1Q/1P2B3/P4PBP/2RR2K1 w - - 42 1:07 +0.64 1.Qh3 e6 2.Rc4 Na7 3.Qf3 Rb8 4.Qe2 Bf8
5.Bxa8 Rxa8 6.Rc7 Qb5 7.Qf3 Qa5
8.Rxa7 Rxa7 9.Bxa7 Rxd6 10.Rxd6 Bxd6
11.Bd4 Qd2 12.Bf6 Qd5 13.Qxd5 exd5
14.Be5 (1.442.641.072) 21482
TB:33.118

42 1:07 +0.10 1.f5 Ne5 2.Rxc8 Qxc8 3.Rc1 Qxf5
4.dxe7 Re8 5.Qe4 Qe6 6.Bc5 Nc7 7.Bb4 Qd7
8.Qb7 Qg4 9.h3 Nf3+ 10.Qxf3 Qxb4
11.Rxc7 Rxe7 12.Rxe7 Qxe7 13.Qa8+ Bf8
14.Qxa6 (1.442.641.072) 21482
TB:33.118


[d]1r2k2r/pp2ppb1/2n2np1/7p/4P3/P3BB1P/1P1N1PP1/R2R2K1 b k -
42 0:49 0.00 1...Nd7 2.Nc4 b5 3.e5 Ndxe5 4.Nxe5 Nxe5
5.Be4 O-O 6.b3 a5 7.Rac1 e6 8.f4 f5
9.Bb1 Nf7 10.Rc6 Rfd8 11.Rd3 Re8
12.Kf2 Rbc8 13.Ra6 Ra8 14.Rb6 Rab8 (885.780.226) 18035
TB:12.113

41 0:49 +0.16 1...Bh6 2.Bxh6 Rxh6 3.Rac1 g5 4.Be2 Nd4
5.Bf1 Nh7 6.e5 Rc6 7.Ne4 Rxc1 8.Rxc1 g4
9.Rc3 Rd8 10.hxg4 hxg4 11.Rg3 Rd5
12.Rxg4 Rxe5 13.Nd6+ exd6 14.Rxd4 Kd7 (885.780.226) 18035
TB:12.113

As for the third one, you're right, mixed up there two of my many versions of STS with and without MEA- syntax. Won't have extra upload of the corrected suite, thanks for pointing out, just change that manually in your own one, and if you find further wrong ones, just show them too, please, so I don't have to check all of the positions on my own alone again, regards
Peter.
ImNotStockfish
Posts: 51
Joined: Tue Sep 14, 2021 12:29 am
Full name: .

Re: Arasan 24.0 release

Post by ImNotStockfish »

peter wrote: Wed Aug 16, 2023 1:14 pm if you find further wrong ones, just show them too, please, so I don't have to check all of the positions on my own alone again, regards
It should be avoid move, not best move.

Code: Select all

8/1pp5/p3k1pp/8/P1p2PPP/2P2K2/1P3R2/5r2 b - - bm Rxf2+; hmvc 0; id "ERET 064 - Endspiel_?_1001, 63";
8/1pp5/p3k1pp/8/P1p2PPP/2P2K2/1P3R2/5r2 b - - am Rxf2; id "ERET 064 - Endgame";

4rrk1/Rpp3pp/6q1/2PPn3/4p3/2N5/1P2QPPP/5RK1 w - - bm Rxb7; hmvc 0; id "ERET 028 - Vergifteter Bauer_?_1001, 28";
4rrk1/Rpp3pp/6q1/2PPn3/4p3/2N5/1P2QPPP/5RK1 w - - am Rxb7; id "ERET 028 - Poisoned Pawn";

r2q1r1k/3bppbp/pp1p4/2pPn1Bp/P1P1P2P/2N2P2/1P1Q2P1/R3KB1R w KQ - bm b3; hmvc 0; id "ERET 024 - Entwicklung_?_1001, 24";
r2q1r1k/3bppbp/pp1p4/2pPn1Bp/P1P1P2P/2N2P2/1P1Q2P1/R3KB1R w KQ - am b3; id "ERET 024 - Development";
ImNotStockfish
Posts: 51
Joined: Tue Sep 14, 2021 12:29 am
Full name: .

Re: Arasan 24.0 release

Post by ImNotStockfish »

ImNotStockfish wrote: Wed Aug 16, 2023 2:53 pm It should be avoid move, not best move.

Code: Select all

r1b2rk1/ppp3p1/4p2p/4Qpq1/3P4/2PB4/PPK2PPP/R6R b - - bm Qxg2; hmvc 0; id "ERET 092 - Vergifteter Bauer_?_1001, 89";
r1b2rk1/ppp3p1/4p2p/4Qpq1/3P4/2PB4/PPK2PPP/R6R b - - am Qxg2; id "ERET 092 - Poisoned Pawn";

8/6pp/5k2/1p1r4/4R3/7P/5PP1/5K2 w - - bm Ke2; hmvc 0; id "ERET 098 - Endspiel_?_1001, 95";
8/6pp/5k2/1p1r4/4R3/7P/5PP1/5K2 w - - am Ke2; id "ERET 098 - Endgame";