Test set from TCEC15 superfinal between Lc0-Sf

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Test set from TCEC15 superfinal between Lc0-Sf

Post by Ferdy »

Save the pos and its actual move as bm in epd from the games if:
1. The side to move in the position wins the game.
2. The score_cp <= 300 in the move comment from actual game.
3. bestmove of Stockfish 10 at 1 sec of analysis and actual move in the game are not the same. (Same move would most likely mean easy bestmove).
4. Not a book move

Download the file at:
https://github.com/fsmosca/chess-tests/ ... est%20sets

Some results at short search time.
https://fsmosca.github.io/chess-tests/
Type general in the search box.
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Test set from TCEC15 superfinal between Lc0-Sf

Post by Dann Corbit »

I wonder about the following, if the alternative moves are not as good or better:
1q1b4/4kp1p/1r1pb1pP/4n1P1/1pPQP3/6R1/2P1B3/RKN5 w - - acd 41; bm Nb3; ce 224; pv Nb3 Rc6;
1q1bk3/1r3p1p/3pb1pP/1p2n1P1/3QP3/2P3R1/2PN4/R1K2B2 w - - acd 40; bm Qe3; ce 146; pv Qe3;
1rbn1nr1/pk4q1/1p1p1pp1/2pPp2p/Q1P1P2P/2PBBPN1/PR1K2P1/1R6 w - - acd 39; bm Kc1; ce 30; pv Kc1 Nd7 Rb3 a6 Ra3 Ka7 Kb2 Nf8 Ka1 Qd7 Qb3 Qc7 Qb5 Qb7 Qb2 Qc7 Rb3 Nd7 Qe2 Nb7 R3b2 Na5 Nf1 Nf8 Nd2 f5 g3 Nh7 f4 Nf6 fxe5 dxe5 Bg5 fxe4 Bc2 Bg4 Qf1 Nh7 Nxe4 Nxg5 hxg5;
2rqk3/3bbp1p/p2p2pP/1p2n1P1/4P3/1NP1Q1R1/P1P1B3/K4R2 w - - acd 53; bm Rh1; ce 37; pv Rh1 Kf8 Rb1 Kg8 Qf4 Rc7 Rh1 Rc8 Nd4 Qa5 Rb1 Be8 Nb3 Qd8 Rf1 Bd7 Qd2 Qc7 Qe3 Be6 Qd4 Qd8 Qd2 Bd7 Nd4 Qc7 Rd1 Qa5 Nb3 Qb6 Bf1 Be8 Nd4 Qd8 Be2 Rc5 Rb1 Bd7 Qf4 Qc7 Kb2 Qd8 Nb3 Rc8 Rd1 Qc7 Ka1 Be6 Nd4 Bd7 Kb1 Qa5 Kb2 Qc7 Ka1 Qa5 Nb3 Qc7 Rb1 Qd8 Nd4 Qa5 Rb3 Be8 Bf1 Rc5 Rb1 Qd8 Nb3 Rc7 Kb2 f6 gxf6 Bxf6;
3qk3/3bbp1p/p1rp2pP/1p2n1P1/3QP3/1NP3R1/P1P1B3/K4R2 w - - acd 49; bm Rfg1; ce 32; pv Rfg1 Qc7 Rb1 Qd8 Qe3 Qc8 Na5 Rc7 Rf1 Kf8 Kb1 Rc5 Nb3 Rc7 Qd2 Kg8 Ka1 Qd8 Nd4 Rc5 Kb1 Qc7 a3 Qd8 Ka2 Qa8 Nb3 Rc6 Rb1 Rc8 Qf4 Qb8 Nd4 Rc5 Ka1 Qc8 Qd2 Qc7 Nb3 Rc6 Qe3 Qd8 Nd4 Rc5 Kb2 Kf8 Qf4 Kg8 Rf1 Kf8 Rd1 Rc8 Bf1 Qc7 Ka2 Kg8 Rb1 Qd8 Be2 Rc5 Rbg1 Qc7 Kb2 Qb6 Rf1 Qb8 Qe3 Qc7 Ka2 Qc8 Nb3 Rc7 Rd1 Rc6 Kb1 Qc7 Nd4 Rc5 Ka2 Qd8 Qd2 Qa8 Nb3 Rc7 Qf4 Qd8 Rf1 Rc8 Ka1 Kf8 Rb1 Qc7 Nd4 Qa5 Rb3 Rc5 Kb2 Qd8 Rb4 Qc8 Nb3 Rc7 Rd4 Be6 Rd1 Kg8 Nd4 Bd7 Rf1 Rc5 Nf3 Be6 Nxe5 dxe5 Qd2;
5b2/7k/2B3p1/P3p2p/5p2/3pP1PP/5P2/6K1 w - - acd 58; bm exf4; ce 561; pv exf4;
kn4rr/pb2qn2/1p1p1p2/2pPpBpp/2P1P2P/NKP1BPP1/R6R/Q7 w - - acd 43; bm Nb5; ce 160; pv Nb5;
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
MikeGL
Posts: 1010
Joined: Thu Sep 01, 2011 2:49 pm

Re: Test set from TCEC15 superfinal between Lc0-Sf

Post by MikeGL »

Ferdy wrote: Thu May 30, 2019 8:53 pm Save the pos and its actual move as bm in epd from the games if:
1. The side to move in the position wins the game.
2. The score_cp <= 300 in the move comment from actual game.
3. bestmove of Stockfish 10 at 1 sec of analysis and actual move in the game are not the same. (Same move would most likely mean easy bestmove).
4. Not a book move

Download the file at:
https://github.com/fsmosca/chess-tests/ ... est%20sets

Some results at short search time.
https://fsmosca.github.io/chess-tests/
Type general in the search box.
Thanks for this collection ferd. Will check and study this positions now.
I told my wife that a husband is like a fine wine; he gets better with age. The next day, she locked me in the cellar.
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Test set from TCEC15 superfinal between Lc0-Sf

Post by Ferdy »

Dann Corbit wrote: Mon Jun 03, 2019 9:15 pm I wonder about the following, if the alternative moves are not as good or better:
I am sure there are good alternative to some of those epd's. The test is mainly to see which engines at short movetime would get more hits from some positions in tcec 15 superfinal match. The epd's are from long TC with good hardware which most users could not duplicate, and the engine under test is only at 5s/pos. The talented NN is at number 2 so far :!:
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Test set from TCEC15 superfinal between Lc0-Sf

Post by Ferdy »

MikeGL wrote: Tue Jun 04, 2019 7:58 am Thanks for this collection ferd. Will check and study this positions now.
The positions from these games are indeed very interesting. A good time to review one's opening repertoire and also see the ideas of each move.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Test set from TCEC15 superfinal between Lc0-Sf

Post by zullil »

Dann Corbit wrote: Mon Jun 03, 2019 9:15 pm I wonder about the following, if the alternative moves are not as good or better:
1q1b4/4kp1p/1r1pb1pP/4n1P1/1pPQP3/6R1/2P1B3/RKN5 w - - acd 41; bm Nb3; ce 224; pv Nb3 Rc6;
...
[d]1q1b4/4kp1p/1r1pb1pP/4n1P1/1pPQP3/6R1/2P1B3/RKN5 w - -
Cfish-dev thinks Nb3 is second best:
+4.24 1. Nd3 Nc6 2. Qf6+ Kd7 3. Qg7 b3 4. Bg4 bxc2+ 5. Kxc2 Be7 6. Bxe6+ fxe6 7. c5 Rb4 8. Nxb4 Qxb4 9. Re3 Nd4+ 10. Kd1 Qc4 11. c6+ Nxc6 12. Qc3 Qf1+ 13. Re1 Qb5 14. Re2 Bxg5 15. Rf2 e5 16. Rf3 Bxh6 17. Qb3 Qxb3+ 18. Rxb3 Bf4 19. Rb7+ Ke6 20. Rxh7 Be3 21. Ra6 Nd4 22. Rh3 Bf4 23. Rb6 Ke7 24. Ra3 Kf6 25. Rxd6+ Kg5 26. Rh3 Kg4 27. Rd3 g5 28. Ke1 Bc1 29. Rf6 Bf4 30. Kf2 Bh2 31. Rd6 Bf4 32. Ra6 Kh5 33. Rb6 Nc2 34. Rbd6 Nb4 35. Rh3+ Kg4 36. Rb3 Nc2 37. Rd1 Nd4 38. Rg1+ Kh5 39. Rh3+ Kg6 40. Rb1 g4 41. Rh8 Kg7 (depth 53, 3:25:44)

+3.12 1. Nb3 Rb7 2. c5 dxc5 3. Qxc5+ Ke8 4. Qd4 Bb6 5. Bb5+ Ke7 6. Qxb4+ Qd6 7. Qe1 Rb8 8. Ra6 Bc8 9. Ra4 Kf8 10. Qc3 Be6 11. Ra6 Qd1+ 12. Kb2 Qd6 13. Kc1 Ke7 14. Rg2 Bxb3 15. Rd2 Qc5 16. Qxb3 Qe3 17. Ra3 Ng4 18. Be2 Qg1+ 19. Bd1 Ne5 20. Qb4+ Qc5 21. Qxc5+ Bxc5 22. Ra5 Rc8 23. Be2 f6 24. Kb1 Be3 25. Rdd5 Nf7 26. gxf6+ Kxf6 27. e5+ Ke7 28. Ra3 Rb8+ 29. Ka2 Bg1 30. Bg4 Rb7 31. Rad3 Ra7+ 32. Kb2 Bh2 33. Rd7+ Rxd7 34. Rxd7+ Ke8 35. e6 Ne5 36. Rd4 Ke7 37. Kc3 Nxg4 38. Rxg4 Kxe6 39. Re4+ Be5+ 40. Kd3 g5 41. Ra4 Kf5 42. Ra7 Kg6 43. c4 Kxh6 44. c5 (depth 53, 3:25:44)
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Test set from TCEC15 superfinal between Lc0-Sf

Post by Dann Corbit »

Thanks. It seems pretty clear than Nd3 is better.
That one is counter-intuitive for me. (IOW, Nb3 looks really obvious)
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Test set from TCEC15 superfinal between Lc0-Sf

Post by zullil »

Dann Corbit wrote: Mon Jun 03, 2019 9:15 pm I wonder about the following, if the alternative moves are not as good or better:
...
1q1bk3/1r3p1p/3pb1pP/1p2n1P1/3QP3/2P3R1/2PN4/R1K2B2 w - - acd 40; bm Qe3; ce 146; pv Qe3;
...
[d]1q1bk3/1r3p1p/3pb1pP/1p2n1P1/3QP3/2P3R1/2PN4/R1K2B2 w - -
Cfish-dev agrees that Qe3 is best:
+1.58 1. Qe3 Qc7 2. Ra6 Rb6 3. Qxb6 Qxb6 4. Rxb6 Bxb6 5. Bh3 Bc4 6. Nxc4 Nxc4 7. Bf1 Be3+ 8. Kd1 Bf4 9. Rg1 Na3 10. Ke2 Bh2 11. Rg2 Be5 12. Kd3 Nc4 13. Rg1 Ke7 14. Bh3 Bf4 15. Bc8 Be3 16. Rg2 f6 17. gxf6+ Kxf6 18. Rh2 Bf4 19. Rh3 Ne5+ 20. Ke2 Nf7 21. Bd7 Ng5 22. Rh1 Nxe4 23. Kf3 Ke5 24. Bxb5 Bd2 25. Rh2 Nxc3 26. Rxd2 Nxb5 27. Re2+ Kf6 28. Ke3 d5 29. Rf2+ Ke6 30. Rf8 Nd6 31. Rh8 Nf5+ 32. Kd3 Nxh6 33. Rxh7 Nf5 34. Kc3 d4+ 35. Kc4 Kf6 36. Kc5 (depth 58, 7:50:27)

+1.43 1. Ra6 Rb6 2. Ra1 b4 3. cxb4 Rxb4 4. Qa7 Qc8 5. Ba6 Qc6 6. Be2 Nd7 7. Ra6 Qc8 8. Qe3 Rb8 9. Qd4 Qc5 10. Qxc5 Nxc5 11. Ra7 Kf8 12. Kd1 Bb6 13. Raa3 Bd8 14. Bf3 Ke8 15. Ra7 Kf8 16. Bg2 Bb6 17. Raa3 Bd8 18. Ke1 Nd7 19. Ra6 Ne5 20. Bf1 Nd7 21. Be2 Nc5 22. Ra7 Be7 23. Kd1 Rd8 24. Bb5 d5 25. e5 Bc8 26. Bc6 Ne6 27. Nf3 Nc5 28. Ra8 Ne4 29. Rg2 Bh3 30. Rg1 Rxa8 31. Bxa8 Bc5 (depth 58, 7:50:27)
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Test set from TCEC15 superfinal between Lc0-Sf

Post by zullil »

Dann Corbit wrote: Mon Jun 03, 2019 9:15 pm I wonder about the following, if the alternative moves are not as good or better:
...
1rbn1nr1/pk4q1/1p1p1pp1/2pPp2p/Q1P1P2P/2PBBPN1/PR1K2P1/1R6 w - - acd 39; bm Kc1; ce 30; pv Kc1 Nd7 Rb3 a6 Ra3 Ka7 Kb2 Nf8 Ka1 Qd7 Qb3 ...
[d]1rbn1nr1/pk4q1/1p1p1pp1/2pPp2p/Q1P1P2P/2PBBPN1/PR1K2P1/1R6 w - -
Cfish-dev prefers Qb5, but with an evaluation of 0.00:
0.00 1. Qb5 Ka8 2. a4 f5 3. Bg5 Nh7 4. Bxd8 Rxd8 5. a5 Bd7 6. Qb3 f4 7. Nf1 Be8 8. Bc2 Qc7 9. axb6 Rxb6 10. Qa3 Rdb8 11. Rxb6 Rxb6 12. Ra1 a6 13. Ba4 Bxa4 14. Qxa4 Nf6 15. Kd3 Qg7 16. Nd2 Ka7 17. Kc2 g5 18. hxg5 Qxg5 19. Rb1 Rxb1 20. Kxb1 Qxg2 21. Qc6 Qxd2 22. Qc7+ Ka8 23. Qd8+ Kb7 24. Qxf6 Qxc3 25. Qe7+ Kc8 26. Qe8+ Kb7 27. Qd7+ Kb6 28. Qxd6+ Ka5 29. Qxc5+ Ka4 30. Qc6+ Kb4 31. Qb6+ Ka3 32. Qxa6+ Kb3 33. Qb7+ Ka3 34. Qa7+ Kb3 35. Qb8+ Ka3 (depth 58, 8:36:13)

-0.23 1. Rg1 Ka8 2. Kc1 Qc7 3. Qc2 Qf7 4. Kb1 Nb7 5. Ka1 Na5 6. Rbb1 Qe8 7. Nf1 g5 8. hxg5 fxg5 9. Nd2 Ba6 10. Rbe1 Nd7 11. Rh1 Nf6 12. g3 Rb7 13. Reg1 Rh7 14. Qd1 Qd7 15. Rg2 Kb8 16. Rgh2 Qe8 17. Rg1 Rhg7 18. Rgh1 Ka8 19. Rg2 Rf8 20. Rgh2 Rgg8 21. Rg1 Kb8 22. Kb1 Qd7 23. Kb2 Ka8 24. Ka1 Qe8 25. Rhh1 Kb8 26. Qc2 Rf7 27. Qd1 Rb7 28. Rh2 b5 29. cxb5 Bxb5 30. c4 Ba4 (depth 58, 8:36:13)
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Test set from TCEC15 superfinal between Lc0-Sf

Post by Dann Corbit »

Thanks for your efforts on these.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.