Shredder 11 UCI personalities compared in a spreadsheet

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Dann Corbit, Harvey Williamson

ZeroOne

Shredder 11 UCI personalities compared in a spreadsheet

Post by ZeroOne »

I couldn't find any comparisons about the different Shredder 11 personalities, so I made one myself. I used the following settings: the Nolot test suite, that focuses on deep sacrifices, 256 MB hash table and exactly 3 minutes/position. My equipment consists of an AMD Athlon XP 3000+ / 1,5 GB / WinXP box.

The results are published in Google Docs and the address is http://spreadsheets.google.com/pub?key= ... fsQHqFhJOQ

There are six different personalities included in the default Shredder 11 UCI distribution. Out of the eleven test positions, the best personalities solved four in the given time. These were Shredder 11 Kamikaze and Really Shredder 11?. Shredder 11 Solid solved three, Shredder 11 Gambit solved two and the default engine Shredder 11 UCI, along with Shredder 11 Beancounter, only solved one.

Comments are more than welcome.
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Re: Shredder 11 UCI personalities compared in a spreadsheet

Post by IWB »

Hi there,
ZeroOne wrote:I couldn't find any comparisons about the different Shredder 11 personalities, so I made one myself. I used the following settings: the Nolot test suite, that focuses on deep sacrifices, 256 MB hash table and exactly 3 minutes/position. My equipment consists of an AMD Athlon XP 3000+ / 1,5 GB / WinXP box.

The results are published in Google Docs and the address is http://spreadsheets.google.com/pub?key= ... fsQHqFhJOQ

There are six different personalities included in the default Shredder 11 UCI distribution. Out of the eleven test positions, the best personalities solved four in the given time. These were Shredder 11 Kamikaze and Really Shredder 11?. Shredder 11 Solid solved three, Shredder 11 Gambit solved two and the default engine Shredder 11 UCI, along with Shredder 11 Beancounter, only solved one.

Comments are more than welcome.
Very interesting to see that the best engine in play is not the best in THIS test set. It show that testsets are very suboptimal to see the playing strength of an engine.

Btw: The personalities are thought to enjoy humans. The Kamikaze style for example is a very nice opponent to play with.

If anyone finds a setting witch is better than S11 I am eager to see that proven!

Bye
Ingo
ozziejoe
Posts: 811
Joined: Wed Mar 08, 2006 10:07 pm

Re: Shredder 11 UCI personalities compared in a spreadsheet

Post by ozziejoe »

do you know what this "really shredder 11" engine is. I think i have a similar engine with shredder 10.

best
J
Tony Thomas

Re: Shredder 11 UCI personalities compared in a spreadsheet

Post by Tony Thomas »

Just a personality Joseph, nothing more.
ZeroOne

Re: Shredder 11 UCI personalities compared in a spreadsheet

Post by ZeroOne »

Here is another spreadsheet, with a breakdown of the various personalities: http://spreadsheets.google.com/pub?key= ... vNV72Ic1Ng

The parameters can be viewed and changed by selecting Extras -> Engines -> Engine Options... (Ctrl-T). They are described in the Shredder manual, available at http://download.shredderchess.com/pc/sc ... Manual.pdf
User avatar
Marek Soszynski
Posts: 580
Joined: Wed May 10, 2006 7:28 pm
Location: Birmingham, England

Re: Shredder 11 UCI personalities compared in a spreadsheet

Post by Marek Soszynski »

Please could someone who has seen the various default Shredder 11 personalities in action - DShredder 11 Beancnt, Gambit, Kamikaze and Solid - comment on their playing styles and analytical strengths and weaknesses? Thanks.
Marek Soszynski
ZeroOne

Re: Shredder 11 UCI personalities compared in a spreadsheet

Post by ZeroOne »

Yet another spreadsheet, this time with the tactical BT2450 test suite. All the personalities solved all the problems except for Kamikaze, which failed to solve problem number 25. On the other hand, it solved problem number 4 a lot faster than any other personality. Really Shredder 11? had the lowest average solving time.

The spreadsheet can be found at http://spreadsheets.google.com/pub?key= ... whDw&gid=0
ZeroOne

Arasan 8

Post by ZeroOne »

Here's yet another spreadsheet, this time using the Arasan 8 test suite: http://spreadsheets.google.com/pub?key= ... 3gJa7oJ5SQ

The hardware still consists of an AMD Athlon XP 3000+ CPU (2.16 GHz) with Windows XP and 1,5 GB of main memory. Hash table size was 256 MB and time per position set to 60 seconds.

The Kamikaze personality was the best one in this test, solving 235 positions out of 300.