Short testsets

Rubinus · Post by **Rubinus** » Mon Dec 20, 2021 5:05 pm

Here's an idea. Try matches with almost no theory. So for the first turn, there are 20 possibilities and they are all included in the database that the match will be based on. They're ranked according to the Stockfish clip analysis at depth 36. From worst to best. For example, e3 in 4th position was quite a surprise to me. Perhaps this could also be used to compare how similar some engines are.
only_first.pgn

I want to create a variant with two half-draws, that would be 400 games, so 800 with rematches. I'd probably rank it by absolute rating values, from most balanced to most asymmetrical. The best engines don't often lose equal positions with the library anymore, the difference is just the asymmetric ones, it was seen in the last TCEC final, so make it the hardest in the end.

Depth 36
rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1

Analysis by Stockfish 261121:

1. +/= (0.62): 1.e4 e5 2.Nf3 Nc6 3.Bb5 Nf6 4.0-0 Nxe4 5.Re1 Nd6 6.Nxe5 Be7 7.Bf1 Nxe5 8.Rxe5 0-0 9.d4 Bf6 10.Re1 Re8 11.c3 Rxe1 12.Qxe1 Ne8 13.Bf4 d5 14.Nd2 Bf5 15.a4 c6 16.a5 Nc7 17.Be5 h5 18.b4 h4 19.Nb3 Ne6
2. +/= (0.50): 1.Nf3 e6 2.d4 Nf6 3.c4 Be7 4.Nc3 d5 5.Bf4 0-0 6.e3 b6 7.Be2 dxc4 8.Bxc4 Ba6 9.Bxa6 Nxa6 10.Rc1 Nb4 11.0-0 c5 12.dxc5 Bxc5 13.Qb3 Nbd5 14.Rfd1 Qe8 15.a3 Nxc3 16.Qxc3 Rc8 17.Qc2 Nd5
3. +/= (0.41): 1.d4 Nf6 2.Nf3 e6 3.c4 d5 4.Nc3 dxc4 5.e3 a6 6.a4 c5 7.Bxc4 Nc6 8.0-0 Be7 9.Qe2 Qc7 10.dxc5 Bxc5 11.Bd2 b6 12.Rfc1 0-0 13.Bd3 Bb7 14.a5 bxa5 15.Ne4 Be7 16.Bxa5 Qb8 17.Nxf6+ Bxf6 18.Bc3 Bxc3 19.bxc3 Ne5 20.Nxe5 Qxe5 21.Rab1 Bc6
4. = (0.29): 1.e3 Nf6 2.d4 d5 3.Nf3 e6 4.Bd3 Be7 5.0-0 0-0 6.c4 dxc4 7.Bxc4 c5 8.dxc5 Bxc5 9.a3 Qxd1 10.Rxd1 Bd7 11.b3 Be7 12.Bb2 Rc8 13.Nbd2 Be8 14.Rac1 Nbd7 15.g3 Nc5 16.Be2 a6 17.Nd4 b5 18.Bf3 Nd5 19.Bxd5
5. = (0.26): 1.g3 e5 2.c4 Nf6 3.Bg2 c6 4.Nf3 e4 5.Nd4 Qb6 6.Nc2 d5 7.cxd5 cxd5 8.Nc3 Nc6 9.d3 Be6 10.0-0 Be7 11.b4 0-0 12.b5 Nb4 13.dxe4 dxe4 14.Nxb4 Bxb4 15.Nxe4 Nxe4 16.Bxe4 Qxb5 17.Be3 Rfd8 18.Qc2 Rac8 19.Bxh7+ Kh8 20.Bd3 Rxc2 21.Bxb5
6. = (0.24): 1.c4 e5 2.g3 Nf6 3.Bg2 c6 4.Nf3 e4 5.Nd4 Qb6 6.Nc2 d5 7.cxd5 cxd5 8.Nc3 Nc6 9.d3 Be6 10.0-0 Be7 11.b4 0-0 12.b5 Nb4 13.dxe4 dxe4 14.Nxb4 Bxb4 15.Nxe4 Nxe4 16.Bxe4 Qxb5 17.Be3 Qa5 18.Bxb7 Rab8 19.Bc6 Bc3 20.Rc1 Rb2 21.Bxa7 Qxa7 22.Rxc3 Rxa2 23.Qc1 Rc8
7. = (0.14): 1.c3 Nf6 2.d4 d5 3.Nf3 e6 4.Bf4 Bd6 5.e3 0-0 6.Nbd2 c5 7.Bg3 Qc7 8.dxc5 Qxc5 9.b4 Qc7 10.c4 Qe7 11.Bxd6 Qxd6 12.Qb1 a5 13.b5 Nbd7 14.cxd5 exd5 15.Bd3 Nc5 16.0-0 Bg4 17.Nd4 Bh5 18.Bf5 Ne6
8. = (0.00): 1.Nc3 d5 2.d4 Nf6 3.Bf4 e6 4.Nb5 Na6 5.e3 Be7 6.h4 0-0 7.Nf3 c6 8.Nc3 Qa5 9.Nd2 Qb6 10.Na4 Qa5
9. = (0.00): 1.a3 c5 2.e3 Nc6 3.d4 cxd4 4.exd4 d5 5.h3 Bf5 6.Nf3 e6 7.c4 Be4 8.Ng5 Bg6 9.Nf3
10. = (0.00): 1.d3 d5 2.Nf3 Nf6 3.g3 c5 4.Bg2 Nc6 5.Bf4 Nh5 6.Bd2 Nf6
11. = (0.00): 1.b3 e5 2.Bb2 Nc6 3.e3 d5 4.Bb5 Nge7 5.Bxe5 a6 6.Bxc6+ Nxc6 7.Bg3 h5 8.h4 d4 9.Ne2 Bd6 10.Bxd6 Qxd6 11.exd4 Nxd4 12.Nxd4 Qxd4 13.Nc3 Bg4 14.Ne2 Qf6 15.f3 0-0-0 16.fxg4 Rhe8 17.gxh5 Rxe2+ 18.Kxe2 Re8+ 19.Kd3 Rd8+
12. = (0.00): 1.h3 e5 2.e4 Nf6 3.Nc3 Bb4 4.a3 Ba5 5.Nf3 0-0 6.b4 Bb6 7.Bb2 d6 8.Bd3 a5 9.0-0 axb4 10.axb4 Rxa1 11.Qxa1 Nc6 12.Na4 Ba7 13.Nc3
13. = (-0.08): 1.a4 Nf6 2.Nf3 c5 3.e3 e6 4.d4 Nc6 5.Bd3 b6 6.0-0 Bb7 7.c3 d5 8.Nbd2 Bd6 9.Qe2 Qc7 10.Re1 Be7 11.b3 0-0 12.Bb2 Rfd8 13.Rac1 Bf8 14.c4 Nb4 15.Bb1 Qe7 16.h3 Rac8 17.cxd5 exd5
14. = (-0.20): 1.f4 d5 2.Nf3 c5 3.g3 g6 4.Bg2 Nf6 5.0-0 Bg7 6.d3 Nc6 7.Nc3 d4 8.Na4 Nd7 9.Ng5 Qc7 10.c3 0-0 11.cxd4 Bxd4+ 12.e3 Bg7 13.Nc3 Nf6 14.Nge4 Nxe4 15.Nd5 Qd7 16.dxe4 e6 17.Nc3 Rd8 18.Qxd7 Rxd7
15. =/+ (-0.34): 1.b4 e5 2.Bb2 Bxb4 3.Bxe5 Nf6 4.e3 d5 5.c3 Bd6 6.Bxd6 Qxd6 7.d4 c5 8.a4 0-0 9.Bd3 Bg4 10.Ne2 Nc6 11.0-0 Bh5 12.Re1 b6 13.Nd2 Rac8 14.Nf3 Bg4 15.h3 Bxf3 16.gxf3 Ne7 17.Ng3 Rfe8 18.dxc5 bxc5
16. =/+ (-0.45): 1.h4 d5 2.d4 c5 3.e3 Nf6 4.c4 cxd4 5.exd4 Bg4 6.Be2 Bxe2 7.Qxe2 e6 8.Nf3 dxc4 9.Qxc4 Nbd7 10.0-0 Bd6 11.Qb5 Rb8 12.Nc3 0-0 13.g3 h6 14.Rd1 a6 15.Qe2 Nb6 16.Bd2 Rc8 17.Rac1 Qe7 18.Ne5 Rfd8 19.Qf3 Bb4
17. =/+ (-0.56): 1.Na3 e5 2.Nc4 Nc6 3.e4 Nf6 4.d3 Bc5 5.Nf3 d5 6.exd5 Qxd5 7.Be2 e4 8.dxe4 Qxd1+ 9.Bxd1 Nxe4 10.0-0 Be6 11.Ncd2 Nxd2 12.Bxd2 0-0-0 13.Re1 Rhe8 14.c3 Bd5 15.Rxe8 Rxe8 16.b4 Bb6 17.a3 Bc4 18.Rc1 a6 19.a4 a5 20.g3 Ne5 21.Nxe5 Rxe5 22.Bg4+ f5
18. =/+ (-0.68): 1.Nh3 d5 2.g3 e5 3.d4 exd4 4.Qxd4 Nc6 5.Qa4 Bd7 6.Bg2 Bc5 7.c4 Nd4 8.Qd1 dxc4 9.Be3 Bf5 10.0-0 Qd7 11.Nf4 0-0-0 12.Nc3 Nf6 13.Nfd5 Nxd5 14.Bxd5 Nb5 15.Bxc4 Bxe3 16.Qxd7+ Bxd7 17.Nxb5 Bb6 18.a4 a6 19.Nc3 Rhf8 20.Rfd1 Bf5 21.Rxd8+ Rxd8
19. -/+ (-1.02): 1.f3 e5 2.Nc3 Nc6 3.e4 Bc5 4.Bc4 d6 5.d3 a5 6.a3 h6 7.Bb5 f5 8.exf5 Bxf5 9.Qe2 Bd7 10.Ne4 Nd4 11.Bxd7+ Qxd7 12.Nxc5 Qb5 13.Qd1 Qxc5 14.c3 Nf5 15.Ne2 Nge7 16.d4 exd4 17.cxd4 Qb6 18.Qd3 0-0 19.0-0 Nc6 20.Kh1 Ncxd4
20. -+ (-1.66): 1.g4 d5 2.e3 e5 3.d4 Nc6 4.Nc3 Be6 5.dxe5 Nxe5 6.Be2 a6 7.h3 h5 8.Nf3 Bd6 9.gxh5 Nf6 10.Nxe5 Bxe5 11.Bd2 b5 12.Bg4 Qd7 13.Bxe6 Qxe6 14.Qf3 Rxh5 15.0-0-0 0-0-0 16.Be1 g6 17.Qg2 Bxc3 18.Bxc3 Ne4 19.h4 Kb7 20.Bd4 c5 21.f3 cxd4 22.fxe4 dxe3 23.exd5 Rhxd5

White is slightly better