weaker winboard engines that support setboard?

[MattieShoes]

If I get to the point where I'm trying to detect small changes in rating like Mr. Hyatt does, I'll certainly have to change to some more complex system, probably with longer time controls. For now though, I'm making large changes to the code, each version seems to be at least 50 points different than the last.

In 1.7, I implemented futility pruning and extended futility pruning. (7.5-12.5 vs Gaviota)

Code: Select all

Rank Name                  Elo    +    - games score oppo. draws
   1 OliThink 5.1.8alpha   328   73   65    80   80%    66    8%
   2 Gaviota 0.33          198   69   68    60   56%   150    8%
   3 Moneypenny 1.7         89   65   67    60   38%   186   22%
   4 Moneypenny 1.6         34   58   60    80   39%   139   18%
   5 Moneypenny 1.5        -58   82   86    60   48%   -76   13%
   6 Beaches 2.26         -590  172  387    20    0%   -58    0%

I do have an external check too -- it plays on FICS. This gives it access to humans, other engines on a variety of hardware, uses a bunch of time controls, and leaves me free to turn pondering on. In this case, it's pretty easy to tell where it switched to 1.7...

[JVMerlino]

Myrddin scored poorly at 2m per position, as expected.

I don't have the summary information available any more, but I do know the following:

28 positions correct
total engine score = 385

jm

[WinPooh]

So now that I've got a relatively stable engine, I'd like to do some quick and dirty testing against other engines, perhaps using the nunn positions.

There's a bushel of strong engines that support setboard, but I'm having a bit of trouble locating weak ones. (well, weak ones other than my own, anyway...)

Do all y'all have any suggestions? I appreciate it!

Edit: Also, I have gradualtest.exe. Is there anything significantly better for running an EPD suite?

You can try GreKo 2.817.
It is stable, supporting "setboard" and very weak.

[flok]

So now that I've got a relatively stable engine, I'd like to do some quick and dirty testing against other engines, perhaps using the nunn positions.

A really weak engine supporting setboard is Pos: http://www.vanheusden.com/pos/

[swami]

New Test Suite: Open Files and Diagonals is now released... over to you, guys. I'd be curious to know how Tinker and MoneyPenny fare in this one so I could make comparison of their scores against their scores in Undermining...

As promised, I will post the complete results tonight. I have yet to run this new suite on engines <2300. These are the results so far under 10 seconds/ per move in the new suite:

Code: Select all

Fruit - 85
TwistedLogic - 80
Bright - 79
Glaurung - 78
Hamsters - 76
The King TrailBlazer - 75
Movei - 74
Delfi - 72
Alaric - 72
Crafty - 67 
Chiron - 67
Tao - 67
Kiwi - 67
The Baron - 66
NOW - 66
Aristarch - 65
Slowchess - 65
BugChess - 65
Jonny - 64
Deep Patzer - 64
Natwarlal - 63
LearningLemming - 61
Green Light Chess - 61
Comet - 61
Yace - 61
Gaia - 61
Lambchop - 61
Ufim - 60
Arasan - 59
Romichess - 57
King of Kings - 56
Knight Dreamer - 53
Horizon - 51
Booot - 50
Little Thought - 49
ZcT - 40
Beowulf - 39

[MattieShoes]

Trying to make my life diffuclt, huh? On some of the moves, the id is in the middle, and on others, the id is at the end. That'll teach me to write crappy scripts! Also, it jumps from .069 to .071, then you have a .000 between .093 and .094. I moved it to where .070 should be and renamed it to .070.

I also noticed some are in long format, some are in SAN, and some are in SAN but disambiguated for no apparent reason. For instance, .042 has h4h5 instead of h5, and Bf3e4 instead of Be4. I think Gradualtest copes with this just fine though.

If anybody else is interested, here's the epd in gradualtest format for best moves and scores

Code: Select all

1Q6/1b4pk/2q2b1p/1p1ppP2/1Pp5/2P2P1P/2BB2P1/6K1 b - - bm Qa6 Bc8 Qd7; id "Open Files & Diagnonals.1"; c1 "10 5 7";
1bq3rk/R6p/5n1P/1N1p4/1PnP2p1/6P1/5B2/2Q2BK1 w - - bm Re7 Ra2 Rg7; id "Open Files & Diagnonals.2"; c1 "10 5 2";
1k1r3r/1p1b1Q1p/p7/q3p3/4p3/2P1N3/P4PPP/R4RK1 w - - bm Rad1 Qf6 Rfd1 a4; id "Open Files & Diagnonals.3"; c1 "10 7 7 2";
1qrr3k/1p2bp1p/1n2p1pP/p2pP3/P4B2/1PPB2P1/2R1QP2/3R2K1 w - - bm Bb5 Qe1 Qe3; id "Open Files & Diagnonals.4"; c1 "10 2 2";
1r1n1rk1/3qp2p/P2p2p1/1p6/5pP1/1p3P1P/5PB1/R1QR2K1 w - - bm Bf1 Qb2 Qc3 Qd2; id "Open Files & Diagnonals.5"; c1 "10 7 7 6";
1r1n2k1/5r1p/P2qp1p1/3p4/1p3pP1/1Q3P1P/R4P2/2R2BK1 w - - bm Rac2 Kg2 Qa4; id "Open Files & Diagnonals.6"; c1 "10 5 4";
1r1q1nk1/p3bpp1/b1p1p2p/4P3/1P2NB2/P4N2/5PPP/2Q1R1K1 w - - bm Be3 Nd6 Rd1 h3; id "Open Files & Diagnonals.7"; c1 "10 5 7 6";
1r1q4/5p2/2p4k/1n2p1pP/4P3/P4BR1/3Q1PKP/8 w - - bm Qc1 Qa2 Qe3; id "Open Files & Diagnonals.8"; c1 "10 5 6";
1r1qbr1k/4bp1p/p3p2Q/3pP3/2pP4/P1N1PN2/1PR2RP1/6K1 b - - bm Rg8 Bc6 Bd7; id "Open Files & Diagnonals.9"; c1 "10 1 4";
1r3k2/8/R7/4pPP1/P1p5/1nP5/R5P1/3rB1K1 w - - bm Rh6 Kf1 Rf6+; id "Open Files & Diagnonals.10"; c1 "10 6 6";
1r3rk1/2b3pp/p4p2/2p5/P1Np4/1P1R2P1/1P3P1P/2R3K1 b - - bm Rfe8 Rfc8 Rfd8; id "Open Files & Diagnonals.11"; c1 "10 7 8";
1r5k/p7/3pQ1p1/1Np5/2P3P1/7P/1PK5/7q b - - bm Qf1 Qg2+ Qh2+; id "Open Files & Diagnonals.12"; c1 "10 2 2";
1r6/4q3/2p2p1k/4p1pP/P2nP2P/5BR1/5PK1/2Q5 w - - bm Bg4 Bd1 a5; id "Open Files & Diagnonals.13"; c1 "10 6 8";
1r6/7k/1p4r1/1P2p3/2P1p2P/2RbB3/6P1/2R4K w - - bm Ra1 Kg1 Kh2; id "Open Files & Diagnonals.14"; c1 "10 7 8";
1r6/8/1r5p/p2pk3/4p3/2P4P/RP2B1n1/1RK5 b - - bm Rf6 Rf8 Rg6; id "Open Files & Diagnonals.15"; c1 "10 8 6";
1rbr2k1/pp3pp1/q6p/4P3/3p1P2/6P1/P2QP1BP/R1R3K1 w - - bm Be4 Bf3 Qd3; id "Open Files & Diagnonals.16"; c1 "10 4 5";
2b2n2/2q2p1k/1r6/2pPP1QB/2p1P3/2P4P/1P4P1/2B3K1 b - - bm Rb6g6 Kh7h8 Qc7b7 Rb6a6; id "Open Files & Diagnonals.17"; c1 "10 3 5 4";
2r1k3/p5pp/1p2p3/7P/P2B2Q1/1bP5/R4PPK/4q3 w - - bm Re2 Qxg7 Rb2; id "Open Files & Diagnonals.18"; c1 "10 4 4";
2r1q1k1/2p2rbp/p2p2p1/Q2P4/b3P3/3p2P1/3B1PBP/2R1R1K1 w - - bm Bh3 Bf1 e5; id "Open Files & Diagnonals.19"; c1 "10 7 8";
2r1q2k/7p/p1np1P1P/8/1pP2R2/8/PP1Q4/R1KN2r1 b - - bm Qg6 Ne5 Qe5; id "Open Files & Diagnonals.20"; c1 "10 4 2";
2r1q3/p1p1nk1p/4p2p/2R1Pp2/1P1Q4/P3N1P1/5P2/6K1 w - - bm Qh4 Rc1 Rc2 Rc4; id "Open Files & Diagnonals.21"; c1 "10 6 9 6";
2r2k2/R4bpp/2p2p2/1pN5/1n3PP1/1P2P2P/8/5BK1 w - - bm Bg2 e4; id "Open Files & Diagnonals.22"; c1 "10 6";
2r2rk1/1p1nbppp/p2p4/B2Pp1PP/5P2/1P6/P1P5/1K1R1B1R w - - bm Bh3 Bd2 Re1; id "Open Files & Diagnonals.23"; c1 "10 5 6";
2r2rk1/4q1pp/p7/1pb1Pp2/5P2/1P1QB3/b3N1PP/2R1K2R b K - bm Rfd8 Bxe3 Kh8; id "Open Files & Diagnonals.24"; c1 "10 5 3";
2r3k1/1b1n1npp/1pq2p2/8/1P1QP3/6P1/1B1NBP1P/3R2K1 w - - bm Rc1 Bg4 f3 f4; id "Open Files & Diagnonals.25"; c1 "10 7 7 5";
2r3k1/p1pb2pp/3p1p1r/1p6/4P2q/1PQB2R1/PBP1N1P1/6K1 w - - bm Qa5 Bc1; id "Open Files & Diagnonals.26"; c1 "10 10";
2r3n1/p1p3kp/1q2p2p/4Pp2/1P4N1/P5P1/1Q3P2/2R3K1 w - - bm Qd2 Ne3 Nf6; id "Open Files & Diagnonals.27"; c1 "10 9 5";
2r5/1r4bk/4qn1p/3p1pp1/3P4/QP2P1P1/1B1NR2P/5RK1 b - - bm Rc2 Bf8 Kg8 Rbc7; id "Open Files & Diagnonals.28"; c1 "10 8 3 9";
2rq2k1/1p3pb1/1n4pp/pP2p3/P1b1P3/2N4P/2B1NPP1/R1Q3K1 b - - bm Bg7f8 Bg7f6 Qd8d6; id "Open Files & Diagnonals.29"; c1 "10 8 7";
2rq2k1/4rpp1/p3p3/P2n2pP/2pPR3/2P3B1/2Q2PP1/R5K1 b - - bm Rb7 Ra7 Rd7; id "Open Files & Diagnonals.30"; c1 "10 4 3";
2rr1b2/3q3k/p4n1p/1p1p2p1/2nNp3/P1N2PQ1/1PP3PP/R1BR2K1 b - - bm Bd6 Bc5 Bg7; id "Open Files & Diagnonals.31"; c1 "10 7 5";
3Q4/5pk1/4p1p1/3pb2p/P3q2P/1r4P1/2R2P1K/2R5 b - - bm Bf4 Ra3 Rd3; id "Open Files & Diagnonals.32"; c1 "10 3 4";
3b2k1/1p1b4/4p2B/1n1p1p2/pN6/P2P4/1PR3PP/7K w - - bm Be3 Bf4 Re2; id "Open Files & Diagnonals.33"; c1 "10 7 7";
3q2k1/5rpp/r1pPp3/1bQn4/p2B4/4P1P1/1P1R2BP/R5K1 w - - bm Bh3 Rc1 Rc2; id "Open Files & Diagnonals.34"; c1 "10 8 7";
3q4/7k/3ppp2/p3n2B/P1r1P2P/8/1PPQ4/1K3R2 w - - bm Rg1 Qe3 Qg2; id "Open Files & Diagnonals.35"; c1 "10 7 5";
3r1k2/R4bpp/2p2p2/1pN5/1n3PP1/1P2P2P/6B1/6K1 w - - bm Be4 Bf3 g5; id "Open Files & Diagnonals.36"; c1 "10 2 3";
3r1r2/p5k1/1pnpP2p/6p1/2P3P1/4P3/P1B1K1P1/3R3R w - - bm Ba4 Rdf1 Rhf1; id "Open Files & Diagnonals.37"; c1 "10 6 7";
3r2k1/4q1pp/p7/1p2Pp2/5P2/1P2Q3/b5PP/2N1K2R b K - bm Bb1; id "Open Files & Diagnonals.38"; c1 "10";
3r2k1/R7/1p3np1/1P1b4/1p6/5PqP/2Q3P1/3R2K1 b - - bm Re8 Rf8; id "Open Files & Diagnonals.39"; c1 "10 4";
3r2k1/pp1q1ppp/4rnn1/3p4/P1pP4/2P1P2P/1BQN1PP1/RR4K1 w - - bm Ba3 Qd1 Qf5; id "Open Files & Diagnonals.40"; c1 "10 4 4";
3r3k/1p2R2p/pP4p1/8/2rp1p2/5P2/2P3PP/4R1K1 w - - bm Re7c7; id "Open Files & Diagnonals.41"; c1 "10";
3r3k/p1q2ppp/5b2/3Pp3/2p4P/P4BQ1/1PP3P1/1K5R w - - bm Rh1f1 Bf3e4 Rh1e1 h4h5; id "Open Files & Diagnonals.42"; c1 "10 10 4 1";
3r4/3pkpp1/4p3/2p3q1/6r1/1P6/P5B1/2R1RQK1 b - - bm Rh8 Ra8 f5; id "Open Files & Diagnonals.43"; c1 "10 1 1";
3r4/3q2bk/3rp1p1/1p5p/4QP2/R1Pp2P1/P2B1R1P/6K1 b - - bm Rc8 Rc6 Re8; id "Open Files & Diagnonals.44"; c1 "10 6 6";
3r4/p2rppk1/2R3p1/4q3/3b4/PP4P1/2QRNP2/5K2 b - - bm Qh5 Bb6 Qd5; id "Open Files & Diagnonals.45"; c1 "10 2 2";
3rr1k1/1p2bppp/p1p5/P2P3q/2B1PPb1/1P1R4/3B1QP1/4R1K1 w - - bm Bc3 b4 f5; id "Open Files & Diagnonals.46"; c1 "10 8 4";
3rr1k1/pp2q1bp/n1p1P1p1/5p2/P2N1Pb1/1BP5/6PP/R1B1QRK1 w - - bm Ba3 Ra2 h3; id "Open Files & Diagnonals.47"; c1 "10 5 5";
4b2k/1q2bprp/pr6/3pP3/2pP4/P4N2/1P3RPQ/3N1RK1 b - - bm Bd7 Bd8 Rg8; id "Open Files & Diagnonals.48"; c1 "10 8 1";
4k2r/p2n3p/4q1pQ/1p2b2P/8/P1P2R2/1P4P1/K4R2 w - - bm Rd1 Re1 Re3; id "Open Files & Diagnonals.49"; c1 "10 9 5";
4qrk1/pb4p1/2p1p2p/PpP1Pr2/1P2QP1R/2B3P1/6R1/6K1 w - - bm Rd2 Be1 Ra2; id "Open Files & Diagnonals.50"; c1 "10 9 9";
4r1k1/3q1ppb/2p5/2Pp1P1p/p2P3P/P3P1PB/5Q1K/4R3 w - - bm Rb1 Qf4 Re2 Re2; id "Open Files & Diagnonals.51"; c1 "10 5 2 5";
4r1k1/R5p1/4b2p/1p2P3/7P/P1nP4/6PK/4R3 w - - bm Rc1 Ra6 d4; id "Open Files & Diagnonals.52"; c1 "10 7 6";
4r1k1/pbq2rpp/1p2p3/4P2P/P1p4Q/1nP1B3/R1B2PP1/1R4K1 w - - bm Bg6 Qg5 Rd1 a5; id "Open Files & Diagnonals.53"; c1 "10 1 3 4";
4r2k/1pp1n1pp/pb3r2/6Nq/P2P4/2PQ2P1/1R3RKP/2B5 w - - bm Rbe2 Rf3 Rxf6 a5 h3 h4; id "Open Files & Diagnonals.54"; c1 "10 4 3 3 4 3";
4rrk1/1b3pp1/1q3b1p/p2p1P2/3N4/2P3N1/1P3QPP/1R3R1K b - - bm Bb7a6; id "Open Files & Diagnonals.55"; c1 "10";
5b2/1p1q3n/pB1p2k1/P4N1p/6pP/4R3/6P1/5RK1 w - - bm Bd4; id "Open Files & Diagnonals.56"; c1 "10";
5k2/ppQbbp1p/8/5p2/P7/1P6/4KPPP/q4B1R b - - bm Bb4 Qa2+ Qb2+; id "Open Files & Diagnonals.57"; c1 "10 2 2";
5r1k/6p1/p1n1pr1p/2P1p2q/P5RN/4Q2P/5PP1/2R4K w - - bm Rb1 Qd3 Rd1; id "Open Files & Diagnonals.58"; c1 "10 6 7";
5rk1/p3qpb1/1p5p/5Q2/P7/1B2P3/1p3PPP/5RK1 b - - bm Rd8 Qb4 Qe5; id "Open Files & Diagnonals.59"; c1 "10 6 5";
5rk1/p7/1n1q1p2/1Prp1pNp/8/5NPP/P2Q1PB1/5RK1 w - - bm Re1 Qe3 a4; id "Open Files & Diagnonals.60"; c1 "10 4 3";
5rk1/pp4p1/5rnp/3p1b2/2p2P2/P1P3P1/2P1B2P/R1B1R1K1 w - - bm Bf3 Bd1 Be3; id "Open Files & Diagnonals.61"; c1 "10 2 7";
6k1/1b3p2/p2q2p1/P2Pp2p/1p2Pb1P/1Br5/Q4PP1/3RN1K1 b - - bm Bb7c8; id "Open Files & Diagnonals.62"; c1 "10";
6k1/1q3rpp/5n2/Rp2r3/4p3/1B5P/3BQPP1/6K1 w - - bm Be3 Bc3 g3; id "Open Files & Diagnonals.63"; c1 "10 5 5";
6k1/1q5p/5np1/pb1pNp2/3P1B1P/1Q6/1P2PP2/6K1 w - - bm Qa3 Qa2 Qc3; id "Open Files & Diagnonals.64"; c1 "10 6 7";
6k1/2q4p/r3b1p1/2P1p3/r7/4QP2/p1RN2PP/R5K1 b - - bm Rb4 R6a5 Ra8; id "Open Files & Diagnonals.65"; c1 "10 8 8";
6k1/pb4p1/1p1b2q1/1P1p3p/3Pn3/P1r2N1P/4QPB1/2B1R1K1 b - - bm Bc8 Bb8 Rc4; id "Open Files & Diagnonals.66"; c1 "10 5 7";
6k1/q4p2/2b1p2p/4Pp2/pP3N2/Q4PP1/6KP/8 b - - bm Qd4 Bb5 Qb8; id "Open Files & Diagnonals.67"; c1 "10 9 6";
6r1/1R6/1bp1knp1/pp1n3p/4pP1P/1PN3B1/1P3PB1/5K2 w - - bm Bh3+ Nxd5 Nxe4; id "Open Files & Diagnonals.68"; c1 "10 6 6";
6r1/4bbk1/p3p1p1/Pp1pPp2/3P1P2/2P2B2/3B2K1/1R6 b - - bm Rh8 Bd8 Be8 g5; id "Open Files & Diagnonals.69"; c1 "10 7 7 7";
r4rk1/5pb1/2p3pp/pp2n3/1n3B2/1PN1PP1P/1P2BPK1/2R3R1 w - - bm Rgd1; id "Open Files & Diagnonals.70"; c1 "10";
6rk/1n4bp/p3R2r/1p1P1Pp1/1P6/P1pB2P1/5P2/2R3K1 b - - bm Rc8; id "Open Files & Diagnonals.71"; c1 "10";
8/2b1rk2/2b1p1p1/5n2/p1pP2Q1/2p3P1/P4P2/2B1RK2 w - - bm Bg5 Ba3 Bf4; id "Open Files & Diagnonals.72"; c1 "10 5 4";
8/3q1pk1/3p4/2pB2p1/P2n4/1P4BP/6P1/4R1K1 b - - bm Qf5 Kh6 g4; id "Open Files & Diagnonals.73"; c1 "10 3 5";
8/3r1k2/2p3p1/1pPb1p2/p7/P1B2P2/4BK2/3R4 w - - bm Rh1 Bd3 Rd4; id "Open Files & Diagnonals.74"; c1 "10 5 6";
8/5r1k/p3b1pp/4p1q1/P3Pn2/2B1N2P/3R1PPK/3Q4 w - - bm Qb1 Ba1 Bb2; id "Open Files & Diagnonals.75"; c1 "10 5 5";
8/5r2/1pp2p1R/p3n3/4Pp1p/2P2P1k/4K2P/R7 b - - bm Rg7 b5; id "Open Files & Diagnonals.76"; c1 "10 3";
8/p1r3kp/r3p1p1/PRp1n1P1/7R/8/4K2P/7B b - - bm Rd6 Nd7 Nf7; id "Open Files & Diagnonals.77"; c1 "10 5 7";
8/p1rb3k/1p1b1p1p/3q1p2/1P1P4/P1n1PPP1/3N3P/R1R2Q1K b - - bm Bb5 Kg6 Kh8 h5; id "Open Files & Diagnonals.78"; c1 "10 5 3 3";
b1r3k1/3n1pb1/p2q2p1/P2Pp2p/1p2P2P/1Rr1NN2/Q1B2PP1/3R2K1 b - - bm Bg7h6; id "Open Files & Diagnonals.79"; c1 "10";
q1b2k2/5ppp/2n5/P1N1n3/8/2PpB1P1/3N1P1P/R4RK1 w - - bm Rfb1 Rfe1 a6; id "Open Files & Diagnonals.80"; c1 "10 7 7";
q4rk1/5ppp/p1r4b/2p1p3/Q3P2P/1R4P1/5PK1/3R1B2 w - - bm Rd7 Bc4 Rf3; id "Open Files & Diagnonals.81"; c1 "10 7 3";
r1b2r1k/1p2qpb1/1np3pp/p7/3P4/PBN2N2/1PQ2PPP/3R1RK1 w - - bm Rfe1 Qc1 Qd2 h3; id "Open Files & Diagnonals.82"; c1 "10 7 6 7";
r1b2rk1/4bpp1/7p/1B1pP3/3B4/8/1PP3PP/2KR3R b - - bm Bg4 Bf5 Ra5; id "Open Files & Diagnonals.83"; c1 "10 9 8";
r1b2rk1/pp3pb1/1npN1qpp/2P5/1PBp4/P4NPP/5P2/2RQ1RK1 w - - bm Re1 Nxc8 Qd3; id "Open Files & Diagnonals.84"; c1 "10 7 7";
r1b3k1/4brp1/p6p/1p1p4/3B4/8/PPP3PP/2KR1B1R w - - bm Bd3 Be3 Kb1; id "Open Files & Diagnonals.85"; c1 "10 4 2";
r1b3k1/pp2qrpp/1n6/1Bb1Pp2/3p1P2/7Q/PP1BN1PP/R3K2R b KQ - bm Be6 a6; id "Open Files & Diagnonals.86"; c1 "10 2";
r1b3kr/p3qpp1/1pn1p2p/3pP2P/7n/3B3Q/2P2PPN/1RB1R1K1 w - - bm Ba3 Qg3; id "Open Files & Diagnonals.87"; c1 "10 4";
r1br2k1/p4p2/1qp4p/1p2P1p1/6n1/5NP1/PP2QN1P/R1B2BK1 b - - bm Be6 Bf5 b4; id "Open Files & Diagnonals.88"; c1 "10 3 4";
r3r1k1/2q2pp1/1pp2np1/4p3/nP2P1P1/P3Q2P/3R1PB1/B1R3K1 w - - bm Bf1 Bf3 Rdc2; id "Open Files & Diagnonals.89"; c1 "10 5 6";
r3r1k1/ppn2ppp/2p5/5P2/P7/2N4P/1PP5/R1B2RK1 w - - bm Bf4 Kg2 Rd1 f6; id "Open Files & Diagnonals.90"; c1 "10 7 7 6";
r3r2k/2R4p/3B2b1/p7/1p2p3/6PP/PPP4K/4R3 w - - bm Bc5 c3 c4; id "Open Files & Diagnonals.91"; c1 "10 7 7";
r4rk1/1p2pp1p/3p1np1/q2P1P2/2P3BQ/pP5R/P1R3PP/7K w - - bm Re2 Be2 fxg6; id "Open Files & Diagnonals.92"; c1 "10 2 4";
r4rk1/1p2ppbp/1q1p2p1/p1nP1P2/2P3B1/5R2/PPRB2PP/1Q5K w - - bm Qe1 Bg5 Rh3; id "Open Files & Diagnonals.93"; c1 "10 4 5";
r4rk1/6b1/2p1N1p1/8/p2p3R/8/R4P1P/5K2 b - - bm Rfb8 Rf6 c5; id "Open Files & Diagnonals.94"; c1 "10 6 8";
r4rk1/ppp1qp1p/1n4p1/4P3/6Q1/1N6/PP3PPP/2R1R1K1 b - - bm Rad8 Nd5 Rfd8; id "Open Files & Diagnonals.95"; c1 "10 5 6";
r5k1/p1q2pbp/Ppp1bnp1/4p1B1/Q1P1P3/2N4P/1P2BPP1/5RK1 w - - bm Rd1 Be3 Rc1 b4; id "Open Files & Diagnonals.96"; c1 "10 1 8 1";
r5k1/p4nbp/2qN2p1/2P2p2/3p1B2/6P1/P2Q1P1P/3R2K1 w - - bm Qe2 Nxf7 Qd3; id "Open Files & Diagnonals.97"; c1 "10 8 7";
r6k/p3Npb1/q5pp/1p2p3/1B6/PPP3P1/3R1P1P/3R2K1 b - - bm Qf6 Qb7 Qe6; id "Open Files & Diagnonals.98"; c1 "10 8 10";
r7/3b1pk1/6p1/3Pp2p/2P4P/p4B2/5PP1/2R3K1 b - - bm Bf5 Kf6 Kf8; id "Open Files & Diagnonals.99"; c1 "10 6 5";
rbbrqnk1/pp3pp1/2p2n1p/5N2/3P1P2/1BN4P/PPQB2P1/R4RK1 w - - bm Rae1 Rfe1; id "Open Files & Diagnonals.100"; c1 "10 5"; 

Moneypenny does terrible with these! It has no knowledge of open diagonals, and a small bonus for rooks on semi-open/open files.

10 seconds/position:

Code: Select all

Number of tests:                       100
Max score:                             1000
Engines score:                         543
Number with full score:                38
Found in: 5 sec = 10, 10 sec = 28,
Time used for tests (wrong answer=10s): 866s

I'll run 2 minutes/position later.

[MattieShoes]

Moneypenny has played Pos on FICS! But 2100 vs 450 makes for short games and not terribly useful information

[brianr]

Tinker Files and Diagonals at 10 seconds

Code: Select all

Number of tests:                       100
Max score:                             1000
Engines score:                         648
Number with full score:                52
Found in: 1 sec = 30, 2 sec = 7, 5 sec = 11, 10 sec = 4,
Time used for tests (wrong answer=10s): 568s

[pedrox]

DanaSah 3.97b

Code: Select all

Number of tests:                       100
Max score:                             1000
Engines score:                         703
Number with full score:                59
Found in: 2 sec = 1, 5 sec = 11, 10 sec = 47,
Time used for tests (wrong answer=10s): 803s

[swami]

Thanks Matt for corrected version. I'll later replace the version with yours in download section and I'll make sure I credit you for this help.

Code: Select all

MoneyPenny 

Undermining 52
Open Files and Diagonals: 38

Tinker:

Undermining 51
Open Files and Diagonals: 52

Danasah: 

Undermining: 80
Open Files and Diagonals: 59

Conclusion:

Danasah has exceptionally high understanding of Undermining, however, it needs improvement in activating its pieces to seize control of open and semi open files. I'd expect more elo gain if this concept is implemented.

Tinker is consistent. Averagen value in both the suites.

MoneyPenny has an average understanding in undermining, but doesn't utilize the files and diagonals. I'd expect to see huge ELO gain if this concept is improved in future version.

Eelco De Groot reported the resulst from his engine, It does better in Open files and diagonals, but far poorer in undermining. Interesting that some engines do better at one suite while they lack in other one and vice versa.