Clover Tests

[mehmet123]

Clover vs Caissa:

Program Elo + - Games Score Av.Op. Draws

1 Clover 6.1.2.4 avx bmi2 : 3074 17 16 800 60.4 % 2363 52.5 %
2 Caissa 1.18 avx2 bmi2 : 3000 16 17 800 39.6 % 2437 52.5 %


Individual statistics:

1 Clover 6.1.2.4 avx bmi2 : 3074 800 (+273,=420,-107), 60.4 %

Caissa 1.18 avx2 bmi2 : 800 (+273,=420,-107), 60.4 %

2 Caissa 1.18 avx2 bmi2 : 3000 800 (+107,=420,-273), 39.6 %

Clover 6124 avx bmi2 : 800 (+107,=420,-273), 39.6 %


Game Conditions: Cutechess Gui, 1 Core, Core-i7 12700h ( 14 cores/ 20 threads), Concurrency:14, 1 min + 0.5 sec TC, UHO 2022 6mvs 120-129 Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/uy5ynjmb ... 2.pgn/file

Clover 6.1.2.4 is a development version of Clover compiled by Jim Abblett. It is clear that the new official version of Clover, which will be released in the near future, will be very powerful according to previous version.

[mehmet123]

Clover vs Seer:

Program Elo + - Games Score Av.Op. Draws

1 Clover 6124 avx bmi2 : 3080 13 13 1360 61.3 % 3000 52.6 %
2 Seer 2.8 avx2 popcnt : 3000 13 13 1360 38.7 % 3080 52.6 %


Individual statistics:

1 Clover 6124 avx bmi2 : 3080 1360 (+476,=716,-168), 61.3 %

Seer 2.8 avx2 popcnt : 1360 (+476,=716,-168), 61.3 %

2 Seer 2.8 avx2 popcnt : 3000 1360 (+168,=716,-476), 38.7 %

Clover 6124 avx bmi2 : 1360 (+168,=716,-476), 38.7 %


Game Conditions: Cutechess Gui, 1 Core, Core-i7 12700h ( 14 cores/ 20 threads), Concurrency:14, 1 min + 0.5 sec TC, UHO 2022 6mvs 120-129 Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/n0yi2arc ... 1.pgn/file

[mehmet123]

Clover vs Obsidian:

Program Elo + - Games Score Av.Op. Draws

1 Clover 6124 avx bmi2 : 3024 19 19 600 53.3 % 3000 54.3 %
2 Obsidian 12.0 avx2-pext : 3000 19 19 600 46.7 % 3024 54.3 %


Individual statistics:

1 Clover 6124 avx bmi2 : 3024 600 (+157,=326,-117), 53.3 %

Obsidian 12.0 avx2-pext : 600 (+157,=326,-117), 53.3 %

2 Obsidian 12.0 avx2-pext : 3000 600 (+117,=326,-157), 46.7 %

Clover 6124 avx bmi2 : 600 (+117,=326,-157), 46.7 %


Game Conditions: Cutechess Gui, 1 Core, Core-i7 12700h ( 14 cores/ 20 threads), Concurrency:14, 1 min +1 sec TC, UHO 2022 6mvs 120-129 Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/7htfremo ... 2.pgn/file

[mehmet123]

Clover vs Berserk:

Program Elo + - Games Score Av.Op. Draws

1 Berserk 13 avx2 pext : 3002 10 10 840 50.4 % 3000 82.7 %
2 Clover 6124 avx bmi2 : 3000 10 10 840 49.6 % 3002 82.7 %

Individual statistics:

1 Berserk 13 avx2 pext : 3002 840 (+ 76,=695,- 69), 50.4 %

Clover 6124 avx bmi2 : 840 (+ 76,=695,- 69), 50.4 %

2 Clover 6124 avx bmi2 : 3000 840 (+ 69,=695,- 76), 49.6 %

Berserk 13 avx2 pext : 840 (+ 69,=695,- 76), 49.6 %


Game Conditions: Cutechess Gui, 1 Core, Core-i7 12700h ( 14 cores/ 20 threads), Concurrency:14, 1 min + 1 sec TC, Balsa500 5 moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/c1xdehr0 ... 6.pgn/file

Berserk have some problems at Cutechess . It losses 27 games on time. But some of these games are a clear win for Clover. The real elo difference between these two engines is less than 10 elo at my tests.
Clover is now very close to being the most powerful alpha-beta chess engine after Stockfish and Torch.

[Guenther]

Berserk have some problems at Cutechess . It losses 27 games on time. But some of these games are a clear win for Clover. The real elo difference between these two engines is less than 10 elo at my tests.
Clover is now very close to being the most powerful alpha-beta chess engine after Stockfish and Torch.

No, the problems are with your setup. Check the Berserk depths in those 'lost on time' games - ridiculousy low... (sometimes as low as between depth 8-12 and generally missing several plies, if not nearly a dozen! of plies for Berserk), expected though knowing some of your 'test games' from the past.
viewtopic.php?p=923237#p923237
viewtopic.php?p=923364#p923364
That's CQ (cheesequack) level.

Just one example:
[Event "My Tournament"]
[Site "?"]
[Date "2024.05.13"]
[Round "20"]
[White "Berserk 13 avx2 pext"]
[Black "Clover 6124 avx bmi2"]
[Result "0-1"]
[ECO "A13"]
[GameDuration "00:02:53"]
[GameEndTime "2024-05-13T20:16:49.893 T³rkiye Standart Saati"]
[GameStartTime "2024-05-13T20:13:56.643 T³rkiye Standart Saati"]
[Opening "English Opening"]
[PlyCount "74"]
[Termination "time forfeit"]
[TimeControl "60+1"]
[Variation "Agincourt variation"]

1. c4 {book} e6 {book}
2. Nf3 {book} d5 {book}
3. e3 {book} Nf6 {book}
4. d4 {book} b6 {book}
5. Nc3 {book} Bd6 {book}
6. Bd3 {+0.01/22 11} O-O {0.00/22 2.9}
7. O-O {0.00/23 4.4} Bb7 {0.00/23 2.9}
8. cxd5 {+0.04/21 5.1} exd5 {+0.01/22 3.9}
9. Nb5 {+0.01/20 1.5} Be7 {-0.06/23 2.3}
10. b3 {-0.05/22 7.2} a6 {+0.06/23 1.9}
11. Nc3 {-0.06/17 1.3} Re8 {0.00/24 2.7}
12. Bb2 {+0.03/19 2.5} Nbd7 {0.00/25 2.2}
13. Ne5 {+0.04/17 1.4} Bd6 {0.00/20 2.6}
14. f4 {-0.11/18 4.6} c5 {+0.10/21 2.3}
15. Qf3 {0.00/20 3.9} b5 {+0.10/22 3.1}
16. a4 {+0.03/20 6.2} b4 {+0.03/21 3.4}
17. Nd1 {-0.05/17 1.5} c4 {0.00/23 8.1}
18. bxc4 {+0.23/18 1.6} dxc4 {0.00/23 1.6}
--------------------------------------------------------
19. Qxb7 {+0.35/14 1.6} cxd3 {0.00/26 1.8}
20. Qf3 {+0.32/16 1.6} Rc8 {0.00/27 2.5}
21. e4 {+0.17/18 1.8} d2 {0.00/26 1.8}
22. Qb3 {+0.36/20 6.2} Nxe5 {0.00/27 2.4}
23. fxe5 {+0.52/18 0.94} Nxe4 {0.00/28 3.7}
24. Rxf7 {+0.49/16 1.7} Kh8 {+0.38/19 1.6}
25. Rf4 {0.00/23 5.1} Nc5 {+0.88/19 1.9}
26. Qe3 {+0.15/17 1.7} Nb7 {+0.86/20 1.6}
27. Qg3 {+0.32/15 0.80} Be7 {+0.86/17 1.7}
28. h4 {-0.88/20 9.3} Qd5 {+0.94/23 5.4}
29. Qd3 {-0.88/10 0.33} Nc5 {+0.76/25 1.7}
30. Qf3 {-0.99/11 0.71} Qxf3 {+0.65/24 2.7}
31. Rxf3 {-1.18/14 0.48} Ne6 {+0.93/22 3.5}
32. d5 {-1.11/10 0.55} Nc5 {+0.71/25 1.4}
33. g3 {-0.88/17 1.5} Rcd8 {+1.01/19 1.2}
34. d6 {-0.84/11 0.55} Bxd6 {+0.79/17 1.0}
35. exd6 {-0.86/12 0.61} Rxd6 {+0.86/18 1.3}
36. Re3 {-0.53/11 0.69} Rxe3 {+0.56/23 1.7}
37. Nxe3 {-0.53/8 0.67} Nd3 {+0.73/20 1.3}
{White loses on time}
0-1

depth 14 in 1.6s in move 19 ;)

[d]r2qr1k1/1b1n1ppp/p2b1n2/4N3/PppP1P2/3BPQ2/1B4PP/R2N1RK1 w - - 0 19

I get at least depth 23 on a supposed slower Ryzen 7 5700G vs. your Core-I7 12700.
Those games are just trash...

Code: Select all

uci
id name Berserk 13
id author Jay Honnold
option name Hash type spin default 16 min 2 max 131072
option name Threads type spin default 1 min 1 max 256
option name SyzygyPath type string default <empty>
option name MultiPV type spin default 1 min 1 max 256
option name Ponder type check default false
option name UCI_ShowWDL type check default true
option name UCI_Chess960 type check default false
option name MoveOverhead type spin default 50 min 0 max 10000
option name Contempt type spin default 0 min -100 max 100
option name EvalFile type string default <empty>
uciok
isready
readyok
setoption name Hash value 64
info string set Hash to value 64 (67108864 bytes) (6291456 entries)
position fen r2qr1k1/1b1n1ppp/p2b1n2/4N3/PppP1P2/3BPQ2/1B4PP/R2N1RK1 w - - 0 19
go infinite
info string time -1 start 143900375 alloc 0 max 2147483647 depth 200 timeset 0 searchmoves 0
info depth 1 seldepth 1 multipv 1 score cp -70 wdl 2 760 238 nodes 73 nps 73000 hashfull 0 tbhits 0 time 1 pv f3b7
info depth 2 seldepth 2 multipv 1 score cp -70 wdl 2 760 238 nodes 113 nps 113000 hashfull 0 tbhits 0 time 1 pv f3b7 c4d3
info depth 3 seldepth 3 multipv 1 score cp -74 wdl 1 736 263 nodes 157 nps 157000 hashfull 0 tbhits 0 time 1 pv f3b7 c4d3 e5d3
info depth 4 seldepth 4 multipv 1 score cp -72 wdl 1 744 255 nodes 214 nps 214000 hashfull 0 tbhits 0 time 1 pv f3b7 c4d3 e5d3 a6a5
info depth 5 seldepth 5 multipv 1 score cp -31 wdl 7 927 66 nodes 409 nps 27266 hashfull 0 tbhits 0 time 15 pv d3h7
info depth 6 seldepth 6 multipv 1 score cp 11 wdl 33 953 14 nodes 616 nps 41066 hashfull 0 tbhits 0 time 15 pv f3b7
info depth 7 seldepth 6 multipv 1 score cp 49 wdl 123 874 3 nodes 813 nps 54200 hashfull 0 tbhits 0 time 15 pv f3b7 c4d3
info depth 8 seldepth 8 multipv 1 score cp 69 wdl 230 768 2 nodes 1463 nps 97533 hashfull 0 tbhits 0 time 15 pv f3b7 c4d3 d1f2 d3d2
info depth 9 seldepth 8 multipv 1 score cp 92 wdl 416 583 1 nodes 2558 nps 170533 hashfull 0 tbhits 0 time 15 pv f3b7 c4d3 d1f2 d3d2 b7f3
info depth 10 seldepth 10 multipv 1 score cp 88 wdl 384 615 1 nodes 5190 nps 346000 hashfull 0 tbhits 0 time 15 pv f3b7 c4d3 d1f2 h7h6 f2d3 a6a5 b7f3 a8c8 a1c1
info depth 11 seldepth 12 multipv 1 score cp 94 wdl 432 567 1 nodes 7338 nps 489200 hashfull 0 tbhits 0 time 15 pv f3b7 c4d3 d1f2 d6f8 f2d3 d7e5 f4e5 d8d5 b7d5 f6d5 e3e4
info depth 12 seldepth 16 multipv 1 score cp 45 wdl 107 889 4 nodes 41825 nps 909239 hashfull 3 tbhits 0 time 46 pv f3b7 c4d3 b7f3 d3d2 e3e4 a8c8 f1f2 c8c2 e5f7 g8f7 f3b3
info depth 13 seldepth 18 multipv 1 score cp 20 wdl 45 945 10 nodes 71463 nps 1152629 hashfull 6 tbhits 0 time 62 pv f3b7 c4d3 b7f3 d3d2 e3e4 a8c8 f1f2 d7c5 d4c5 d6c5 g1f1 c5f2 d1f2
info depth 14 seldepth 19 multipv 1 score cp 32 wdl 69 925 6 nodes 104642 nps 1341564 hashfull 10 tbhits 0 time 78 pv f3b7 c4d3 b7f3 d3d2 e3e4 a8c8 a4a5 d8c7 e5d7 f6d7 e4e5 d6f8 f3e2 c7c2 e2a6 c2e4 a6b5
info depth 15 seldepth 22 multipv 1 score cp 29 wdl 62 931 7 nodes 172308 nps 1580807 hashfull 16 tbhits 0 time 109 pv f3b7 c4d3 b7f3 a8c8 e3e4 d3d2 a4a5 d8c7 d1f2 d6f8 f1d1 c7c2 a1b1 c2c7 d1d2 c7a5 g1h1
info depth 16 seldepth 24 multipv 1 score cp 36 wdl 79 916 5 nodes 255336 nps 1823828 hashfull 24 tbhits 0 time 140 pv f3b7 c4d3 b7f3 a8c8 e3e4 d3d2 a4a5 d8c7 d1f2 d6f8 f1d1 c7c2 e5d3 c2c6 e4e5 c6f3 g2f3 f6d5 d1d2 d5c3 f2e4
info depth 17 seldepth 27 multipv 1 score cp 17 wdl 40 949 11 nodes 388424 nps 1913418 hashfull 35 tbhits 0 time 203 pv f3b7 c4d3 b7f3 a8c8 e3e4 d3d2 a4a5 d8c7 d1f2 d6f8 f1d1 c7c2 e5d3 c2c6 e4e5 c6f3 g2f3 f6d5 d1d2 e8d8 f2e4 d7b8 g1h1 b8c6 
info depth 18 seldepth 26 multipv 1 score cp 39 wdl 88 907 5 nodes 465928 nps 1991145 hashfull 42 tbhits 0 time 234 pv f3b7 c4d3 b7f3 d3d2 e3e4 a8c8 a4a5 d8c7 d1f2 d6f8 f1d1 c7c2 e5d3 c2c6 e4e5 c6f3 g2f3
info depth 19 seldepth 26 multipv 1 score cp 27 wdl 57 935 8 nodes 623083 nps 1997060 hashfull 58 tbhits 0 time 312 pv f3b7 c4d3 b7f3 d3d2 f1f2 a8c8 f2d2 d6e5 d4e5 d7e5 f3e2 e5d7 e2a6 f6e4 d2d4 e4c5 a6b5 c8b8 b5c4 d8a5 d4d5 b4b3 c4c3 a5c3 b2c3
info depth 20 seldepth 32 multipv 1 score cp 16 wdl 39 950 11 nodes 1318338 nps 2109340 hashfull 122 tbhits 0 time 625 pv f3b7 c4d3 b7f3 a8c8 e3e4 d3d2 a4a5 d8c7 e5d7 c7d7 e4e5 c8c2 f3b3 d7c6 d1e3 c2c3 b2c3 b4c3 e3c4 f6e4 e5d6 c6d5
info depth 21 seldepth 28 multipv 1 score cp 27 wdl 57 935 8 nodes 1408493 nps 2147092 hashfull 133 tbhits 0 time 656 pv f3b7 c4d3 b7f3 a8c8 e3e4 d3d2 a4a5 d8c7 d1f2 d6f8 f1d1 c7c2 e5d3 c2c6 e4e5 c6f3 g2f3 f6d5 d1d2 f8e7 f2e4 f7f5 e4g3 g7g6 g1f2 d7f8
info depth 22 seldepth 32 multipv 1 score cp 17 wdl 41 948 11 nodes 2030621 nps 2167151 hashfull 192 tbhits 0 time 937 pv f3b7 c4d3 b7f3 a8c8 e3e4 d3d2 a4a5 d8c7 d1f2 h7h5 e5d3 c7b7 e4e5 b7f3 g2f3 f6d5 e5d6 e8e2 f1d1 d5e3 d3b4 e3d1 a1d1 e2e1 g1g2 e1d1 f2d1 c8e8 g2f2 e8e1
info depth 23 seldepth 34 multipv 1 score cp 22 wdl 49 942 9 nodes 2808763 nps 2167255 hashfull 263 tbhits 0 time 1296 pv f3b7 c4d3 b7f3 a8c8 e3e4 d3d2 a4a5 d8c7 d1f2 d6f8 f1d1 c7c2 e5d3 c2c6 e4e5 c6f3 g2f3 c8c2 e5f6 d7f6 f2e4 f6e4 f3e4 e8e4 g1f2 f8d6 f2f3 f7f5 a1b1 d6c7 b2a1 c7a5 d3b4
info depth 24 seldepth 36 multipv 1 score cp 4 wdl 25 957 18 nodes 4032508 nps 2188013 hashfull 367 tbhits 0 time 1843 pv f3b7 c4d3 b7f3 a8c8 e3e4 d3d2 f3b3 d6e5 f4e5 f6e4 b3f7 g8h8 f7f3 e4c3 d1c3 d7e5 d4e5 d8d4 f3f2 d4f2 f1f2 b4c3 b2c3 c8c3 f2d2 c3e3 a4a5 e3e5 d2d6 e8e6 d6e6 e5e6 a1b1

What happened to your SF clone BTW? And what was the illegal link in your signature now banned by moderation?

[lucametehau]

Clover is now very close to being the most powerful alpha-beta chess engine after Stockfish and Torch.

Haha nice words, tho it's very far from close. Clover is by no means better than Caissa and Obsidian (idk about Seer, did not test) and very close strength to Berserk. So I also think there is a huge problem with your setup, i don't know what tho.

[mehmet123]

What happened to your SF clone BTW? And what was the illegal link in your signature now banned by moderation?

Kayra 1.5 was released nearly 2 years ago (2022 July) but it's 4 elo ahead of Stockfish 16.1 at woblis rating list (4 cores / 4 min + 2 sec tests). I dont know this engine tester and I don' t claim that Kayra 1.5 is more powerful than Stockfish 16.1 because it has been a long time since I stopped doing Kayra tests.
https://www.mediafire.com/folder/6b585g ... /Documents

I dont know anything about illegal links. Kayra wasn' t an illegal chess engine because I always published src codes with these Kayra chess engines