Komodo 14.1 levels vs random move generator

[Marcus91]

I wanted to share an interesting experiment I am currently conducting: a series of games between Komodo and a random move generator.

The setup is quite simple: Komodo will always play as White, while the random move generator will always play as Black. I will start with Komodo at level 0 and gradually increase the difficulty level until at least one victory for the random move generator is achieved.

Level: 0
WDL: [9456 1411 8]
elo performance: 461.43 ± 9.06

[pgn][Event "?"] [Site "?"] [Date "????.??.??"] [Round "?"] [White "?"] [Black "?"] [Result "0-1"] 1. h3 a6 2. f4 c5 3. a3 g6 4. Rh2 b6 5. e3 g5 6. Kf2 b5 7. Qh5 e6 8. Qxf7+ Kxf7 9. a4 e5 10. Be2 a5 11. fxe5 bxa4 12. Rxa4 Qe7 13. c4 Ke8 14. Kg3 Nh6 15. Nc3 Ng4 16. e6 Nxe3 17. h4 Nc6 18. Bd3 Rg8 19. Bc2 Nxc2 20. Na2 N6d4 21. Nc3 Ra7 22. Rh1 d6 23. Nb1 Rg6 24. Ra3 Qxe6 25. Kh2 Rf7 26. Rh3 d5 27. Rc3 Ra7 28. Rd3 Qd6+ 29. Rg3 h6 30. Na3 Kf7 31. Nxc2 h5 32. Nf3 Rg8 33. Ncxd4 Qf6 34. Nf5 Rg7 35. Ne5+ Ke8 36. Rg4 Qe7 37. Re1 Ba6 38. Rxg5 Rh7 39. Re2 Qf7 40. d4 Be7 41. Nxe7 Bb7 42. Rc2 Qg8 43. Rxg8+ Kxe7 44. Rd2 Ra8 45. Ng4 Ke6 46. Rg5 Ba6 47. b3 dxc4 48. Nh6 Ke7 49. Rc2 Rc8 50. bxc4 Ke8 51. Rxc5 Ra8 52. Rf5 Ke7 53. d5 Bc8 54. Rff2 Kd6 55. Ra2 Rd7 56. Rf1 Rc7 57. Rf3 Rxc4 58. Bb2 Bb7 59. Rf1 Rc1 60. Bd4 Kxd5 61. Rf4 Ke6 62. Nf5 Rh8 63. Ba1 Rh6 64. Rxa5 Bc6 65. Ra2 Rc5 66. Ra7 Rg6 67. Ng3 Kd6 68. Rf2 Rc2 69. Ra6 Kd7 70. Re2 Kd6 71. Re1 Rc3 72. Nh1 Rxg2# 0-1[/pgn]

[Marcus91]

Level: 01
WDL: [8689 1302 9]
elo performance: 460.32 ± 9.43

[pgn] [Event "?"] [Site "?"] [Date "????.??.??"] [Round "?"] [White "?"] [Black "?"] [Result "0-1"] 1. h4 a6 2. Na3 d6 3. b3 g5 4. Rh2 Bh3 5. d3 Bd7 6. Rb1 Be6 7. hxg5 b6 8. Rh1 Bh3 9. d4 a5 10. Bd2 e6 11. Nc4 Be7 12. f4 c6 13. gxh3 a4 14. c3 Bxg5 15. bxa4 h5 16. Rb4 d5 17. Nb2 Bh4# 0-1 [/pgn]

[Marcus91]

Level: 02
WDL: [9864 1002 9]
elo performance: 523.20 ± 10.76
[pgn] [Site "?"] [Date "????.??.??"] [Round "?"] [White "?"] [Black "?"] [Result "0-1"] 1. c4 h6 2. f4 e5 3. g3 a6 4. a4 Qh4 5. b3 b6 6. Bb2 e4 7. gxh4 Be7 8. h5 Bh4# 0-1 [/pgn]

[Marcus91]

Level: 03
WDL: [10133 738 4]
elo performance: 579.83 ± 12.55
[pgn] [Site "?"] [Date "????.??.??"] [Round "?"] [White "?"] [Black "?"] [Result "0-1"] 1. d3 h6 2. f4 a5 3. Kf2 Nc6 4. Bd2 a4 5. Bc3 b6 6. Nf3 g5 7. Ke3 Rh7 8. Ne1 b5 9. h3 b4 10. Bxb4 h5 11. Bc5 gxf4+ 12. Ke4 d6 13. Be3 e5 14. Bd2 Nge7 15. Nf3 f5# 0-1 [/pgn]

[Marcus91]

Level: 04
WDL: [9643 355 2]
elo performance: 695.23 ± 18.13
[pgn] [Site "?"] [Date "????.??.??"] [Round "?"] [White "?"] [Black "?"] [Result "0-1"] 1. Nc3 e5 2. Nf3 h6 3. a3 c6 4. g4 Qf6 5. b4 Be7 6. Nb5 Qg6 7. Nxe5 a6 8. f4 Qg5 9. Nc7+ Kd8 10. fxg5 Bxg5 11. Nxa6 d5 12. Nc7 Bh4# 0-1 [/pgn]

[Marcus91]

Level: 05
WDL: [10735 136 4]
elo performance: 870.48 ± 29.43
[pgn] [Site "?"] [Date "????.??.??"] [Round "?"] [White "?"] [Black "?"] [Result "0-1"] 1. d3 h6 2. Qd2 e6 3. Nc3 d6 4. b4 Qh4 5. Nb1 Ne7 6. g4 Rh7 7. Ba3 a6 8. h3 Rh8 9. Qe3 Qxh3 10. Bxh3 Nf5 11. gxf5 c6 12. Bg2 Ra7 13. Qxa7 Be7 14. Kd2 e5 15. Qxb8 Kd7 16. Ke3 Bf8 17. Rh3 f6 18. f3 a5 19. bxa5 b6 20. Bc1 Rh7 21. a6 Rh8 22. Ke4 Kd8 23. Ke3 b5 24. Bb2 Be7 25. a3 Rf8 26. Ke4 g5 27. Bf1 Rg8 28. Ra2 Ke8 29. Qxc8+ Bd8 30. e3 d5# 0-1 [/pgn]

[Marcus91]

Level: 06
WDL: [9941 58 1]
elo performance: 1008.63 ± 45.70
[pgn] [Site "?"] [Date "????.??.??"] [Round "?"] [White "?"] [Black "?"] [Result "0-1"] 1. f4 Nh6 2. h3 Rg8 3. Na3 f5 4. b4 e5 5. fxe5 Kf7 6. Nb5 Bc5 7. bxc5 Qh4+ 8. g3 Qxg3# 0-1 [/pgn]

[Marcus91]

Getting hard.

Games: 50875
Level: 07
WDL: [50718 156 1]
elo performance: 1123.28 ± 27.49
[pgn] [Site "?"] [Date "????.??.??"] [Round "?"] [White "?"] [Black "?"] [Result "0-1"] 1. e3 Nf6 2. d3 h6 3. Nh3 d5 4. Nf4 Nh7 5. f3 Nf6 6. Be2 Bf5 7. Nd2 Bh3 8. d4 g6 9. a4 b6 10. O-O b5 11. Nxh3 Ng8 12. Kf2 Nc6 13. Nb1 Rb8 14. axb5 Bg7 15. bxc6 f5 16. Ra4 Be5 17. dxe5 d4 18. exd4 a6 19. Re1 Kf8 20. d5 Qe8 21. Kg3 Qxc6 22. dxc6 Kg7 23. Qd7 f4+ 24. Kg4 Rb3 25. cxb3 g5 26. Na3 Kf7 27. Qxc7 Kg6 28. Qb8 h5# 0-1 [/pgn]

[Marcus91]

Komodo is blind to draws; I will repeat the test with 'claim_draw = False' in the Python library.

vs level 8 1M games and no black wins..

[Marcus91]

No claim draw
Games: 10000
Level: 00
WDL: [9604 386 10]
elo performance: 673.44 ± 17.38
[pgn] [Site "?"] [Date "????.??.??"] [Round "?"] [White "?"] [Black "?"] [Result "0-1"] 1. e4 f5 2. exf5 c6 3. c3 h5 4. Qb3 b5 5. d4 Qc7 6. Be3 a6 7. Bg5 Qa7 8. f4 Bb7 9. Kd1 e6 10. f6 gxf6 11. h3 Qxd4+ 12. cxd4 Bb4 13. d5 e5 14. Qf3 Ra7 15. Kc2 Ba5 16. Qxh5+ Rxh5 17. Kd3 b4 18. Ke2 Rh7 19. Rh2 Rg7 20. Nd2 cxd5 21. b3 Kd8 22. Kf3 Rf7 23. f5 e4+ 24. Ke3 Ra8 25. Rh1 Kc8 26. Kd4 Bc7 27. Re1 Bb6# 0-1 [/pgn]