Testing Critter 1.6 and Critter 1.6a

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Testing Critter 1.6 and Critter 1.6a

Post by Tomcass »

i7 975 3.33 Ghz.

4 real cores each engine

GUI: Fritz 12
Book: Masterbook 3.1 (With Critter own book on)
Ponder: Off.
No tablebases
300 GAMES: http://www.mediafire.com/?5da2hcb797gi0c4

Time control 2 min + 2 sec.

201206Critter1.6a_ownbook__2+2 2012

Critter 1.6a 64-bit_ownb - Deep Rybka 4.1 SSE42 x64(x4) 29.5 - 20.5 +16/=27/-7 59.00%
Critter 1.6a 64-bit_ownb - Houdini 2.0c Pro x64(x4) 24.5 - 25.5 +8/=33/-9 49.00%
Time control 5 min + 1 sec
201206Critter1.6a_ownbook__5+1 2012
Critter 1.6a 64-bit_ownb - Deep Rybka 4.1 SSE42 x64(x4) 22.5 - 27.5 +9/=27/-14 45.00%
Critter 1.6a 64-bit_ownb - Houdini 2.0c Pro x64(x4) 24.0 - 26.0 +7/=34/-9 48.00%

Time control 10 min + 0 sec.

201206Critter1.6a_ownbook__10+0 2012

Critter 1.6a 64-bit_ownb - Deep Rybka 4.1 SSE42 x64(x4) 30.0 - 20.0 +16/=28/-6 60.00%
Critter 1.6a 64-bit_ownb - Houdini 2.0c Pro x64(x4) 21.5 - 28.5 +5/=33/-12 43.00%

GLOBAL RESULT FOR CRITTER 1.6a - 4 CORES:

Critter 1.6a 64-bit_ownb - Deep Rybka 4.1 SSE42 x64(x4) 82.0 - 68.0 54.67%
Critter 1.6a 64-bit_ownb - Houdini 2.0c Pro x64(x4) 70.0 - 79.0 46.67%

... and comparing these results with Critter 1.6 under the same testing conditions:

Critter 1.6 64-bit_ownb - Deep Rybka 4.1 SSE42 x64(x4) 73.5 - 76.5 49.00%
Critter 1.6 64-bit_ownb - Houdini 2.0c Pro x64(x4) 63.5 - 86.5 42.33%

I7 980 3.33 Ghz.

6 real cores each engine

GUI: Fritz 12
Book: Perfect 2012 - Critter 1.6 own book.
Ponder: Off
No tablebases
GAMES: http://www.mediafire.com/?d2cal306k44s5s8

Time control: 2 min + 2 sec.

201206Critter1.6a_ownbook_2+2 2012

Critter 1.6a 64-bit_x6 - Deep Rybka 4.1 SSE42 x64(x4) 31.0 - 19.0 +16/=30/-4 62.00%
Critter 1.6a 64-bit_x6 - Houdini 2.0c Pro x64(x6) 22.5 - 27.5 +10/=25/-15 45.00%

Time control: 5 min. + 1 sec.

201206Critter1.6a_ownbook_5+1 2012

Critter 1.6a 64-bit_x6 - Deep Rybka 4.1 SSE42 x64 (x6) 20.5 - 29.5 +9/=23/-18 41.00%
Critter 1.6a 64-bit_x6 - Houdini 2.0c Pro x64(x6) 23.5 - 26.5 +7/=33/-10 47.00%

Time control 10 min. + 0 sec.

201206Critter1.6a_ownbook_10+0 2012

Critter 1.6a 64-bit_x6 - Deep Rybka 4.1 SSE42 x64 (x6) 25.0 - 25.0 +11/=28/-11 50.00%
Critter 1.6a 64-bit_x6 - Houdini 2.0c Pro x64(x6) 22.5 - 27.5 +4/=37/-9 45.00%

GLOBAL RESULT FOR CRITTER 1.6a – 6 CORES:

Critter 1.6a 64-bit_x6 - Deep Rybka 4.1 SSE42 x64(x4) 76.5 – 73.5 51%
Critter 1.6a 64-bit_x6 - Houdini 2.0c Pro x64(x6) 68.5 – 81.5 45.67%

... and comparing these results with Critter 1.6 under the same testing conditions:

Critter 1.6 64-bit_x6 - Deep Rybka 4.1 SSE42 x64 (x6) 88.0 – 62.0 58.67%
Critter 1.6 64-bit_x6 - Houdini 2.0c Pro x64(x6) 72.5 – 77.5 48.33%

SUMMARY:

After 600 games for Critter 1.6 and 600 games (in fact 599 games) for Critter 1.6a under the same testing conditions against Houdini 2.0c Pro and Deep Rybka 4.1 SSE42, the final result for comparison purposes is:

Critter 1.6 297.5 – 302.5 49.58%
Critter 1.6a 297.0 – 302.0 49.50%

Being aware that 1.200 games is a small sample, according to this test at three different time controls, the difference between Critter 1.6 and Critter 1.6a is near to zero.


Regards from Barcelona.

Tom.