CM11th settings testing - Ray's results so far

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 44611
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CM11th settings testing - Ray's results so far

Post by Graham Banks »

CM11 testing is on track after some initial hiccups....
Results so far - one better than default, and two worse...:

Code: Select all

Summary of CM11 Ratings so far

2778 CM11 Sauron
2767 CM11 Default
2763 CM11 Default Sel 21
2761 CM11 Silver Fern


Performances


CM 11 Sauron              2778  600 (+183,=193,-224), 46.6 %

Chess Tiger 2007.1            :  50 (+ 10,= 16,- 24), 36.0 %
Delfi 5.2                     :  50 (+ 26,= 15,-  9), 67.0 %
Glaurung 2.0.1 64-bit         :  50 (+  9,= 18,- 23), 36.0 %
Hiarcs 11.1                   :  50 (+  5,= 14,- 31), 24.0 %
Loop 13.6 32-bit              :  50 (+  8,= 18,- 24), 34.0 %
Movei 00.8.438                :  50 (+ 25,= 15,- 10), 65.0 %
Scorpio 1.91                  :  50 (+ 23,= 16,- 11), 62.0 %
Slow Chess Blitz WV2.1        :  50 (+ 19,= 20,- 11), 58.0 %
Spike 1.2 Turin               :  50 (+ 12,= 11,- 27), 35.0 %
WildCat 7                     :  50 (+ 21,= 18,- 11), 60.0 %
Ktulu 8.0                     :  50 (+ 15,= 15,- 20), 45.0 %
Naum 2.2 32-bit               :  50 (+ 10,= 17,- 23), 37.0 %



CM 11 Default             2767  600 (+170,=198,-232), 44.8 %

Chess Tiger 2007.1  	      :  50 (+  7,= 21,- 22), 35.0 %
Delfi 5.2   		      :  50 (+ 22,= 12,- 16), 56.0 %
Glaurung 2.0.1 64-bit         :  50 (+ 10,= 13,- 27), 33.0 %
Hiarcs 11.1                   :  50 (+  9,= 12,- 29), 30.0 %
Loop 13.6 32-bit              :  50 (+ 12,= 11,- 27), 35.0 %
Movei 00.8.438                :  50 (+ 22,= 14,- 14), 58.0 %
Scorpio 1.91                  :  50 (+ 19,= 20,- 11), 58.0 %
Slow Chess Blitz WV2.1        :  50 (+ 21,= 21,-  8), 63.0 %
Spike 1.2 Turin               :  50 (+  7,= 20,- 23), 34.0 %
WildCat 7                     :  50 (+ 18,= 20,- 12), 56.0 %
Ktulu 8.0                     :  50 (+ 12,= 17,- 21), 41.0 %
Naum 2.2 32-bit               :  50 (+ 11,= 17,- 22), 39.0 %



CM11 Default Sel 21       2763  600 (+152,=228,-220), 44.3 %

Chess Tiger 2007.1            :  50 (+ 14,= 16,- 20), 44.0 %
Delfi 5.2                     :  50 (+ 19,= 18,- 13), 56.0 %
Glaurung 2.0.1 64-bit         :  50 (+ 13,= 16,- 21), 42.0 %
Hiarcs 11.1                   :  50 (+  3,= 18,- 29), 24.0 %
Loop 13.6 32-bit              :  50 (+  5,= 17,- 28), 27.0 %
Movei 00.8.438                :  50 (+ 18,= 19,- 13), 55.0 %
Scorpio 1.91                  :  50 (+ 14,= 24,- 12), 52.0 %
Slow Chess Blitz WV2.1        :  50 (+ 18,= 24,-  8), 60.0 %
Spike 1.2 Turin               :  50 (+ 13,= 19,- 18), 45.0 %
WildCat 7                     :  50 (+ 22,= 15,- 13), 59.0 %
Ktulu 8.0                     :  50 (+  8,= 18,- 24), 34.0 %
Naum 2.2 32-bit               :  50 (+  5,= 24,- 21), 34.0 %


CM 11 Silver Fern         2761  600 (+169,=189,-242), 43.9 %

Chess Tiger 2007.1            :  50 (+ 12,= 15,- 23), 39.0 %
Delfi 5.2                     :  50 (+ 18,= 24,-  8), 60.0 %
Glaurung 2.0.1 64-bit         :  50 (+ 10,= 16,- 24), 36.0 %
Hiarcs 11.1                   :  50 (+  6,= 17,- 27), 29.0 %
Loop 13.6 32-bit              :  50 (+  8,= 16,- 26), 32.0 %
Movei 00.8.438                :  50 (+ 16,= 14,- 20), 46.0 %
Scorpio 1.91                  :  50 (+ 22,= 12,- 16), 56.0 %
Slow Chess Blitz WV2.1        :  50 (+ 27,= 13,- 10), 67.0 %
Spike 1.2 Turin               :  50 (+ 11,= 15,- 24), 37.0 %
WildCat 7                     :  50 (+ 15,= 20,- 15), 50.0 %
Ktulu 8.0                     :  50 (+ 12,= 11,- 27), 35.0 %
Naum 2.2 32-bit               :  50 (+ 12,= 16,- 22), 40.0 %
gbanksnz at gmail.com
Top
perejaslav
Posts: 240
Joined: Sat Mar 18, 2006 4:01 am
Location: Cold

Re: CM11th settings testing - Ray's results so far

Post by perejaslav »

And what about Glorfindel? I think it's strongest!
opp=115 opn=119 opb=120 opr=119 opq=123 myp=115 myn=119 myb=120 myr=119 myq=123 cc=125 mob=125 ks=160 pp=117 pw=117 cfd=0 sop=100 avd=0 rnd=0 sel=21 md=99
Top
User avatar
Graham Banks
Posts: 44611
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CM11th settings testing - Ray's results so far

Post by Graham Banks »

perejaslav wrote:And what about Glorfindel? I think it's strongest!
opp=115 opn=119 opb=120 opr=119 opq=123 myp=115 myn=119 myb=120 myr=119 myq=123 cc=125 mob=125 ks=160 pp=117 pw=117 cfd=0 sop=100 avd=0 rnd=0 sel=21 md=99
Currently being tested along with Tomahawk. 8-)
Galadriel II, Gil-Galad and Nightfire to follow.
gbanksnz at gmail.com
Top
ozziejoe
Posts: 811
Joined: Wed Mar 08, 2006 10:07 pm

Re: CM11th settings testing - Ray's results so far

Post by ozziejoe »

wow selectivity 21 was much stronger in my tests, but I did blitz and used a dual processor? I wonder of these two factors is responsible for the discrepency?

best
J
Top
User avatar
Graham Banks
Posts: 44611
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CM11th settings testing - Ray's results so far

Post by Graham Banks »

ozziejoe wrote:wow selectivity 21 was much stronger in my tests, but I did blitz and used a dual processor? I wonder of these two factors is responsible for the discrepency?

best
J
Actually I forgot to point out that this is at the CCRL 40/4 time control, so it is blitz also.
gbanksnz at gmail.com
Top
User avatar
Graham Banks
Posts: 44611
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CM11 Tomahawk completed

Post by Graham Banks »

Code: Select all

Summary of CM11 Ratings so far
------------------------------

2778 CM11 Sauron
2767 CM11 Default
2767 CM11 Tomahawk
2763 CM11 Default Sel 21
2761 CM11 Silver Fern


Chessmaster 11 Tomahawk   2767  600 (+177,=184,-239), 44.8 %

Chess Tiger 2007.1            :  50 (+ 10,= 23,- 17), 43.0 %
Delfi 5.2                     :  50 (+ 20,= 15,- 15), 55.0 %
Glaurung 2.0.1 64-bit         :  50 (+ 11,= 17,- 22), 39.0 %
Hiarcs 11.1                   :  50 (+  7,= 13,- 30), 27.0 %
Loop 13.6 32-bit              :  50 (+  8,= 11,- 31), 27.0 %
Movei 00.8.438                :  50 (+ 21,= 14,- 15), 56.0 %
Scorpio 1.91                  :  50 (+ 20,= 11,- 19), 51.0 %
Slow Chess Blitz WV2.1        :  50 (+ 24,= 16,- 10), 64.0 %
Spike 1.2 Turin               :  50 (+ 15,= 16,- 19), 46.0 %
WildCat 7                     :  50 (+ 21,= 16,- 13), 58.0 %
Ktulu 8.0                     :  50 (+ 14,= 16,- 20), 44.0 %
Naum 2.2 32-bit               :  50 (+  6,= 16,- 28), 28.0 %
gbanksnz at gmail.com
Top
User avatar
Werner
Posts: 2993
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: CM11 Tomahawk completed

Post by Werner »

It seems, its not so easy to find a stronger setting this time?

CEGT 40/20
100 The King 3.50 x64 2CPU 2768
103 The King 3.5 Sauron x64 2CPU 2767
Werner
Top
User avatar
Graham Banks
Posts: 44611
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CM11 Tomahawk completed

Post by Graham Banks »

Werner wrote:It seems, its not so easy to find a stronger setting this time?

CEGT 40/20
100 The King 3.50 x64 2CPU 2768
103 The King 3.5 Sauron x64 2CPU 2767
Hi Werner,

I'm not sure about you, but I was quite impressed with the play of Chessmaster 11 Default compared to the default settings of previous versions, so we might be struggling to get similar performance increases this time.

Regards, Graham.
gbanksnz at gmail.com
Top
Spock

Re: CM11th settings testing - Ray's results so far

Post by Spock »

Glorfindel is close to half way through, and indeed it is looking quite strong :wink:
Top
Chris Tatham
Posts: 142
Joined: Wed Mar 08, 2006 8:15 pm

Re: CM11th settings testing - Ray's results so far

Post by Chris Tatham »

Thanks for running these tests Ray, good to see you testing CM again! :)
Top

Return to “Computer Chess Club: Tournaments and Matches”