And the king of tactics is .....

[Leto]

I've run two tough tactical test suites with the top engines and one amateur engine, and it turns out that the king of tactics is undeniably Rybka WinFinder 2.2 mp, in fact it wasn't even close, Rybka WinFinder 2.2 mp was the only engine to score higher than 90% on both tests, and it was clearly the fastest solver. The only top engine I was unable to include in these tests was ListMP, I tried and tried but the thing kept crashing during the tests, which is weird because I've never seen it crash during my CEGT Blitz testing.

There were some surprising results, particularly the excellent results Hiarcs achieved, I had no idea Hiarcs was this good at tactics. We all know that Fritz 10 has more positional knowledge than Fritz 9, but did you know that it is just as strong if not stronger with tactics? Not surprisingly, Rybka which is known for being weak in tactics, finished in 9th place, but what is surprising to me is that Deep Shredder 10 finished 10th! This seems to suggest that like Rybka, Shredder 10 is more of a positional player than tactical.

Overall:
1. Rybka WinFinder 2.2 mp scored 355 out of 374, 94.9%, 1.14s/6.16
2. Hiarcs 11.1 mp scored 329 out of 374, 87.9%, 1.72s/10.22
3. Deep Fritz 10 scored 320 out of 374, 85.5%, 1.57s/10.48
4. Zap!Chess Zanzibar x64 mp scored 312 out of 374, 83.4%, 1.78s/3.5
5. Fritz 10 scored 312 out of 374, 83.4%, 1.78s/10.22
6. Fritz 9 scored 310 out of 374, 82.8%, 1.77s/9.02
7. Deep Junior 10 scored 299 out of 374, 79.9%, 1.53s/10.76
9. Rybka 2.2 mp scored 293 out of 374, 78.3%, 2.16s/8.63
10. Deep Shredder 10 x64 mp scored 289 out of 374, 77.2%, 3.35s/9.22
11. Arion 1.7 scored 218 out of 374, 58.2%, 2.74s/9.34

ecmgcp 10 sec max
1. Rybka WinFinder 2.2 mp scored 179 out of 183, 97.8%, 0.83s/5.34
2. Hiarcs 11.1 mp scored 165 out of 183, 90.1%, 1.32s/10.15
3. Deep Junior 10 scored 160 out of 183, 87.4%, 1.19s/10.65
4. Deep Fritz 10 scored 160 out of 183, 87.4%, 1.31s/10.21
5. Zap!Chess Zanzibar x64 mp scored 159 out of 183, 86.8%, 1.56s/2.77
6. Fritz 10 scored 156 out of 183, 85.2%, 1.56/10.05
7. Fritz 9 scored 155 out of 183, 84.6%, 1.49s/8.84
8. Deep Shredder 10 x64 mp scored 151 out of 183, 82.5%, 3.16s/9.11
9. Rybka 2.2 mp scored 144 out of 183, 78.6%, 1.97s/8.61
10. Arion 1.7 scored 129 out of 183, 70.4%, 2.13s/8.99

arasan6 10 sec max
1. Rybka WinFinder 2.2 mp scored 176 out of 191, 92.1%, 1.46s/6.98
2. Hiarcs 11.1 mp scored 164 out of 191, 85.8%, 2.13s/10.29
3. Deep Fritz 10 scored 160 out of 191, 83.7%, 1.83s/10.76
4. Fritz 10 scored 156 out of 191, 81.6%, 2.01s/10.39
5. Fritz 9 scored 155 out of 191, 81.8% 2.05s/9.21
6. Zap!Chess Zanzibar x64 mp scored 153 out of 191, 80.1%, 2.01s/4.26
7. Rybka 2.2 mp scored 149 out of 191, 78%, 2.35s/8.65
8. Deep Junior 10 scored 139 out of 191, 72.7%, 1.88s/10.87
9. Deep Shredder 10 x64 mp scored 138 out of 191, 72.2%, 3.54s/9.33
10. Arion 1.7 scored 89 out of 191, 46.5%, 3.72s/9.70

[PauloSoare]

Leto, Hiarcs 11.1 have the option "combinations", and Shredder 10 the
option " kamikaze", I think it´s correct to test this versions.
I don´t know if others engines have a similar option.
Paulo Soares

[PauloSoare]

Leto, what hardware and HT do you use in the tests?
And the Gui?

I am asking because Hiarcs 11.1 mp(combinations), in Shredder Gui, and
with my Athlon 2 cores 3800+, HT=64Mb, scores 158 in Arasan test
suite 6, less than in your test(164).

Thanks,

Paulo Soares

[PauloSoare]

I've run two tough tactical test suites with the top engines and one amateur engine, and it turns out that the king of tactics is undeniably Rybka WinFinder 2.2 mp, in fact it wasn't even close, Rybka WinFinder 2.2 mp was the only engine to score higher than 90% on both tests, and it was clearly the fastest solver. The only top engine I was unable to include in these tests was ListMP, I tried and tried but the thing kept crashing during the tests, which is weird because I've never seen it crash during my CEGT Blitz testing.

There were some surprising results, particularly the excellent results Hiarcs achieved, I had no idea Hiarcs was this good at tactics. We all know that Fritz 10 has more positional knowledge than Fritz 9, but did you know that it is just as strong if not stronger with tactics? Not surprisingly, Rybka which is known for being weak in tactics, finished in 9th place, but what is surprising to me is that Deep Shredder 10 finished 10th! This seems to suggest that like Rybka, Shredder 10 is more of a positional player than tactical.

Overall:
1. Rybka WinFinder 2.2 mp scored 355 out of 374, 94.9%, 1.14s/6.16
2. Hiarcs 11.1 mp scored 329 out of 374, 87.9%, 1.72s/10.22
3. Deep Fritz 10 scored 320 out of 374, 85.5%, 1.57s/10.48
4. Zap!Chess Zanzibar x64 mp scored 312 out of 374, 83.4%, 1.78s/3.5
5. Fritz 10 scored 312 out of 374, 83.4%, 1.78s/10.22
6. Fritz 9 scored 310 out of 374, 82.8%, 1.77s/9.02
7. Deep Junior 10 scored 299 out of 374, 79.9%, 1.53s/10.76
9. Rybka 2.2 mp scored 293 out of 374, 78.3%, 2.16s/8.63
10. Deep Shredder 10 x64 mp scored 289 out of 374, 77.2%, 3.35s/9.22
11. Arion 1.7 scored 218 out of 374, 58.2%, 2.74s/9.34

ecmgcp 10 sec max
1. Rybka WinFinder 2.2 mp scored 179 out of 183, 97.8%, 0.83s/5.34
2. Hiarcs 11.1 mp scored 165 out of 183, 90.1%, 1.32s/10.15
3. Deep Junior 10 scored 160 out of 183, 87.4%, 1.19s/10.65
4. Deep Fritz 10 scored 160 out of 183, 87.4%, 1.31s/10.21
5. Zap!Chess Zanzibar x64 mp scored 159 out of 183, 86.8%, 1.56s/2.77
6. Fritz 10 scored 156 out of 183, 85.2%, 1.56/10.05
7. Fritz 9 scored 155 out of 183, 84.6%, 1.49s/8.84
8. Deep Shredder 10 x64 mp scored 151 out of 183, 82.5%, 3.16s/9.11
9. Rybka 2.2 mp scored 144 out of 183, 78.6%, 1.97s/8.61
10. Arion 1.7 scored 129 out of 183, 70.4%, 2.13s/8.99

arasan6 10 sec max
1. Rybka WinFinder 2.2 mp scored 176 out of 191, 92.1%, 1.46s/6.98
2. Hiarcs 11.1 mp scored 164 out of 191, 85.8%, 2.13s/10.29
3. Deep Fritz 10 scored 160 out of 191, 83.7%, 1.83s/10.76
4. Fritz 10 scored 156 out of 191, 81.6%, 2.01s/10.39
5. Fritz 9 scored 155 out of 191, 81.8% 2.05s/9.21
6. Zap!Chess Zanzibar x64 mp scored 153 out of 191, 80.1%, 2.01s/4.26
7. Rybka 2.2 mp scored 149 out of 191, 78%, 2.35s/8.65
8. Deep Junior 10 scored 139 out of 191, 72.7%, 1.88s/10.87
9. Deep Shredder 10 x64 mp scored 138 out of 191, 72.2%, 3.54s/9.33
10. Arion 1.7 scored 89 out of 191, 46.5%, 3.72s/9.70

Leto, I found the following results for Arasan6 testsuite:
Athon 64 2 cores, 3800+, HT= 64Mb, Deep Shredder 10 Gui

Deep Shredder 10 with 3/4/5 shredderbases,
Hiarcs and Rybka WinFinder without tablebases.


Hiarcs 11.1 mp(combinations)- 158

Rybka WinFinder 2.2 mp - 157

DShredder 10 Kamikaze with 3/4/5 shredderbases- 144

[Leto]

Leto, what hardware and HT do you use in the tests?
And the Gui?

I am asking because Hiarcs 11.1 mp(combinations), in Shredder Gui, and
with my Athlon 2 cores 3800+, HT=64Mb, scores 158 in Arasan test
suite 6, less than in your test(164).

Thanks,

Paulo Soares

Athlon X2 3800+ at 2500mhz, Fritz 10 GUI and Zap!Chess GUI, HT=200mb.

[S.Taylor]

Rybka winfinder 2.2 should be an engine.

[Leto]

Rybka winfinder 2.2 should be an engine.

It can be used as one. I started testing it at CEGT Blitz, it beat Fritz 9 and lost a close match to Fritz 10, so it's probably a 2800-caliber engine.

[Erik Roggenburg]

Good stuff!

[PauloSoare]

I've run two tough tactical test suites with the top engines and one amateur engine, and it turns out that the king of tactics is undeniably Rybka WinFinder 2.2 mp, in fact it wasn't even close, Rybka WinFinder 2.2 mp was the only engine to score higher than 90% on both tests, and it was clearly the fastest solver. The only top engine I was unable to include in these tests was ListMP, I tried and tried but the thing kept crashing during the tests, which is weird because I've never seen it crash during my CEGT Blitz testing.

There were some surprising results, particularly the excellent results Hiarcs achieved, I had no idea Hiarcs was this good at tactics. We all know that Fritz 10 has more positional knowledge than Fritz 9, but did you know that it is just as strong if not stronger with tactics? Not surprisingly, Rybka which is known for being weak in tactics, finished in 9th place, but what is surprising to me is that Deep Shredder 10 finished 10th! This seems to suggest that like Rybka, Shredder 10 is more of a positional player than tactical.

Overall:
1. Rybka WinFinder 2.2 mp scored 355 out of 374, 94.9%, 1.14s/6.16
2. Hiarcs 11.1 mp scored 329 out of 374, 87.9%, 1.72s/10.22
3. Deep Fritz 10 scored 320 out of 374, 85.5%, 1.57s/10.48
4. Zap!Chess Zanzibar x64 mp scored 312 out of 374, 83.4%, 1.78s/3.5
5. Fritz 10 scored 312 out of 374, 83.4%, 1.78s/10.22
6. Fritz 9 scored 310 out of 374, 82.8%, 1.77s/9.02
7. Deep Junior 10 scored 299 out of 374, 79.9%, 1.53s/10.76
9. Rybka 2.2 mp scored 293 out of 374, 78.3%, 2.16s/8.63
10. Deep Shredder 10 x64 mp scored 289 out of 374, 77.2%, 3.35s/9.22
11. Arion 1.7 scored 218 out of 374, 58.2%, 2.74s/9.34

ecmgcp 10 sec max
1. Rybka WinFinder 2.2 mp scored 179 out of 183, 97.8%, 0.83s/5.34
2. Hiarcs 11.1 mp scored 165 out of 183, 90.1%, 1.32s/10.15
3. Deep Junior 10 scored 160 out of 183, 87.4%, 1.19s/10.65
4. Deep Fritz 10 scored 160 out of 183, 87.4%, 1.31s/10.21
5. Zap!Chess Zanzibar x64 mp scored 159 out of 183, 86.8%, 1.56s/2.77
6. Fritz 10 scored 156 out of 183, 85.2%, 1.56/10.05
7. Fritz 9 scored 155 out of 183, 84.6%, 1.49s/8.84
8. Deep Shredder 10 x64 mp scored 151 out of 183, 82.5%, 3.16s/9.11
9. Rybka 2.2 mp scored 144 out of 183, 78.6%, 1.97s/8.61
10. Arion 1.7 scored 129 out of 183, 70.4%, 2.13s/8.99

arasan6 10 sec max
1. Rybka WinFinder 2.2 mp scored 176 out of 191, 92.1%, 1.46s/6.98
2. Hiarcs 11.1 mp scored 164 out of 191, 85.8%, 2.13s/10.29
3. Deep Fritz 10 scored 160 out of 191, 83.7%, 1.83s/10.76
4. Fritz 10 scored 156 out of 191, 81.6%, 2.01s/10.39
5. Fritz 9 scored 155 out of 191, 81.8% 2.05s/9.21
6. Zap!Chess Zanzibar x64 mp scored 153 out of 191, 80.1%, 2.01s/4.26
7. Rybka 2.2 mp scored 149 out of 191, 78%, 2.35s/8.65
8. Deep Junior 10 scored 139 out of 191, 72.7%, 1.88s/10.87
9. Deep Shredder 10 x64 mp scored 138 out of 191, 72.2%, 3.54s/9.33
10. Arion 1.7 scored 89 out of 191, 46.5%, 3.72s/9.70

Leto, I found the following results for Arasan6 testsuite:
Athon 64 2 cores, 3800+, HT= 64Mb, Deep Shredder 10 Gui

Deep Shredder 10 with 3/4/5 shredderbases,
Hiarcs and Rybka WinFinder without tablebases.


Hiarcs 11.1 mp(combinations)- 158

Rybka WinFinder 2.2 mp - 157

DShredder 10 Kamikaze with 3/4/5 shredderbases- 144

On the ecmgcp, Rybka Windfinder show that maybe you are rigth, Leto. I was curious to see what chessmaster 9000 can do:

Rybka WindFinder 2.2 Result: 175 out of 183 = 95.6%. Average time = 0.98s / 5.44
Hiarcs 11.1 mp (Combinations) Result: 163 out of 183 = 89.0%. Average time = 1.17s / 9.82

I tryed Q3, from Ed, and it made 144 points on Arasan6. Very good,
the engine is probaly from the last century.

Paulo Soares

[MikeB]

I ran Crafty on my machine and updated the table.

Crafty 21.6 (8 cpus)
search time = 10 seconds , dual Xeon 5310, o/c 1.9 Ghz , 8 cores.
hash 768M

Overall:
1. Rybka WinFinder 2.2 mp scored 355 out of 374, 94.9%, 1.14s/6.16
2. Hiarcs 11.1 mp scored 329 out of 374, 87.9%, 1.72s/10.22
3. Deep Fritz 10 scored 320 out of 374, 85.5%, 1.57s/10.48
4. Zap!Chess Zanzibar x64 mp scored 312 out of 374, 83.4%, 1.78s/3.5
5. Fritz 10 scored 312 out of 374, 83.4%, 1.78s/10.22
6. Fritz 9 scored 310 out of 374, 82.8%, 1.77s/9.02
7. Crafty 21.6 scored 305 out of 374, 81.6%
8. Deep Junior 10 scored 299 out of 374, 79.9%, 1.53s/10.76
9. Rybka 2.2 mp scored 293 out of 374, 78.3%, 2.16s/8.63
10. Deep Shredder 10 x64 mp scored 289 out of 374, 77.2%, 3.35s/9.22
11. Arion 1.7 scored 218 out of 374, 58.2%, 2.74s/9.34

ecmgcp 10 sec max
1. Rybka WinFinder 2.2 mp scored 179 out of 183, 97.8%, 0.83s/5.34
2. Hiarcs 11.1 mp scored 165 out of 183, 90.1%, 1.32s/10.15
3. Crafty 21.6 scored 161 out of 183, 88.0%
4. Deep Junior 10 scored 160 out of 183, 87.4%, 1.19s/10.65
5. Deep Fritz 10 scored 160 out of 183, 87.4%, 1.31s/10.21
6. Zap!Chess Zanzibar x64 mp scored 159 out of 183, 86.8%, 1.56s/2.77
7. Fritz 10 scored 156 out of 183, 85.2%, 1.56/10.05
8. Fritz 9 scored 155 out of 183, 84.6%, 1.49s/8.84
9. Deep Shredder 10 x64 mp scored 151 out of 183, 82.5%, 3.16s/9.11
10. Rybka 2.2 mp scored 144 out of 183, 78.6%, 1.97s/8.61
11. Arion 1.7 scored 129 out of 183, 70.4%, 2.13s/8.99

arasan6 10 sec max
1. Rybka WinFinder 2.2 mp scored 176 out of 191, 92.1%, 1.46s/6.98
2. Hiarcs 11.1 mp scored 164 out of 191, 85.8%, 2.13s/10.29
3. Deep Fritz 10 scored 160 out of 191, 83.7%, 1.83s/10.76
4. Fritz 10 scored 156 out of 191, 81.6%, 2.01s/10.39
5. Fritz 9 scored 155 out of 191, 81.8% 2.05s/9.21
6. Zap!Chess Zanzibar x64 mp scored 153 out of 191, 80.1%, 2.01s/4.26
7. Rybka 2.2 mp scored 149 out of 191, 78%, 2.35s/8.65
8. Crafty 21.6 scored 144 out of 191, 75.4%
9. Deep Junior 10 scored 139 out of 191, 72.7%, 1.88s/10.87
10. Deep Shredder 10 x64 mp scored 138 out of 191, 72.2%, 3.54s/9.33
11. Arion 1.7 scored 89 out of 191, 46.5%, 3.72s/9.70
===============================

Code: Select all

total positions searched..........         191
number right......................         144
number wrong......................          47
percentage right..................          75
percentage wrong..................          24
total nodes searched.............. 11475122842
average search depth..............        11.1
nodes per second..................    12144272
total time........................       15:44

test results summary:

total positions searched..........         183
number right......................         161
number wrong......................          22
percentage right..................          87
percentage wrong..................          12
total nodes searched..............  6185912831
average search depth..............        10.4
nodes per second..................    11873381
total time........................        8:40