The HGM Invitational

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Dan Honeycutt
Posts: 5258
Joined: Mon Feb 27, 2006 4:31 pm
Location: Atlanta, Georgia

Re: The HGM Invitational

Post by Dan Honeycutt »

Adam Hair wrote:I have not seen any misbehavior. If I do, I will document it and send you the information.
Ok, thanks. Sorry about hijacking your HGM Invitational thread. I'll shut up now.

Best
Dan H.
User avatar
Graham Banks
Posts: 44599
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: The HGM Invitational

Post by Graham Banks »

Adam Hair wrote:
Dan Honeycutt wrote:
Adam Hair wrote:I missed on my initial guess of Cupcake's strength and have adjusted accordingly. I will fill in additional appropriate opponents to get the number of games played to around 800+.
Thanks ever so much, Adam. From what you have so far it looks like Cupcake would be around 2000 - 2100 on your Also-Rans Rating List. That's where I think a program with a very basic search and eval should be if it doesn't have bugs so, hopefully, Cupcake doesn't have too many bugs.

One bug I know of - it can lose input if it arrives during search and it's not move now (?). That shouldn't affect tournament play but let me ask you, did you observe any misbehavior in your tests?

Thanks again,
Dan H.
I have not seen any misbehavior. If I do, I will document it and send you the information.
Looks like I can include Cupcake in my next Amateur Series Division 7. :)
gbanksnz at gmail.com
Vinvin
Posts: 5298
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: The HGM Invitational

Post by Vinvin »

Adam Hair wrote:I forgot to list EasyPeasy 1.0.0.0 (author unknown) as one of the participants.

After 174 of 4352 (maybe less) games:

Code: Select all

    Engine                     Score   Xa Sa Cm Us St Ch SU De Io Cr Te Py Ea Ne Ra PO Br    S-B
01: Xadreco 5.7                18.5/21 ·· 1  =  1  1  11 0  11 1  0  1  1  11 11 1  11 1   165.25
02: Safrad 2.1.35.210          16.0/21 0  ·· 01 =1 1  11 1  1  0  1  11 =  10 1  1  1  1   153.50
03: CmcChess 2.27              15.5/20 =  10 ·· =  =  1  11 1  1  1= =  =  1  =  11 1  1   141.50
04: Usurpator II               15.5/21 0  =0 =  ·· 10 1  =  0  11 11 1  1  1  1  11 1  1   129.00
05: Strategic Deep 1.25        14.0/20 0  0  =  01 ·· =  0  1  11 11 10 1  1  1  1  1  1   119.75
06: Chad's Chess 0.15          13.0/21 00 00 0  0  =  ·· 11 =  =  =  1  11 1  1  1  1  11   94.50
07: SUPRA 11.5.1 64-bit        12.5/20 1  0  00 =  1  00 ·· 1  1  1  0? 1  01 11 1  1  1   105.25
08: Delfi 5.4 1000 Elo         12.0/20 00 0  0  1  0  =  0  ·· 0  1  =  11 1  1  1  11 11   73.75
09: Iota 1.0 32-bit JA(tcc)    11.5/20 0  1  0  00 00 =  0  1  ·· 1= =  1  1  1  11 1  1    82.00
10: Crafty 23.4 64-bit skill 1 9.5/21  1  0  0= 00 00 =  0  0  0= ·· 1= =  1  1  1  1  1    74.50
11: Testina 2.2                9.5/20  0  00 =  0  01 0  1? =  =  0= ·· 0  1  1  =1 1  1    68.75
12: Pyotr 0.6 AM               9.5/20  0  =  =  0  0  00 0  00 0  =  1  ·· 1  11 1  11 1    53.50
13: EasyPeasy 1.0.0.0          8.0/21  00 01 0  0  0  0  10 0  0  0  0  0  ·· 1  11 1  11   40.00
14: Neg 0.3d                   5.5/21  00 0  =  0  0  0  00 0  0  0  0  00 0  ·· 1  11 11   12.75
15: Ram 2.0                    2.0/21  0  0  00 00 0  0  0  0  00 0  =0 0  00 0  ·· =  1     5.75
16: POS 1.20                   1.0/20  00 0  0  0  0  0  0  00 0  0  0  00 0  00 =  ·· =     1.25
17: Brutus RND                 0.5/20  0  0  0  0  0  00 0  00 0  0  0  0  00 00 0  =  ··    0.50
What's the timecontrol ?

Your games seems very interesting to rise the accuracy in the bottom of the big rating list http://home.scarlet.be/vincentlejeune/r ... 120614.txt
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: The HGM Invitational

Post by Adam Hair »

Vinvin wrote:
Adam Hair wrote:I forgot to list EasyPeasy 1.0.0.0 (author unknown) as one of the participants.

After 174 of 4352 (maybe less) games:

Code: Select all

    Engine                     Score   Xa Sa Cm Us St Ch SU De Io Cr Te Py Ea Ne Ra PO Br    S-B
01: Xadreco 5.7                18.5/21 ·· 1  =  1  1  11 0  11 1  0  1  1  11 11 1  11 1   165.25
02: Safrad 2.1.35.210          16.0/21 0  ·· 01 =1 1  11 1  1  0  1  11 =  10 1  1  1  1   153.50
03: CmcChess 2.27              15.5/20 =  10 ·· =  =  1  11 1  1  1= =  =  1  =  11 1  1   141.50
04: Usurpator II               15.5/21 0  =0 =  ·· 10 1  =  0  11 11 1  1  1  1  11 1  1   129.00
05: Strategic Deep 1.25        14.0/20 0  0  =  01 ·· =  0  1  11 11 10 1  1  1  1  1  1   119.75
06: Chad's Chess 0.15          13.0/21 00 00 0  0  =  ·· 11 =  =  =  1  11 1  1  1  1  11   94.50
07: SUPRA 11.5.1 64-bit        12.5/20 1  0  00 =  1  00 ·· 1  1  1  0? 1  01 11 1  1  1   105.25
08: Delfi 5.4 1000 Elo         12.0/20 00 0  0  1  0  =  0  ·· 0  1  =  11 1  1  1  11 11   73.75
09: Iota 1.0 32-bit JA(tcc)    11.5/20 0  1  0  00 00 =  0  1  ·· 1= =  1  1  1  11 1  1    82.00
10: Crafty 23.4 64-bit skill 1 9.5/21  1  0  0= 00 00 =  0  0  0= ·· 1= =  1  1  1  1  1    74.50
11: Testina 2.2                9.5/20  0  00 =  0  01 0  1? =  =  0= ·· 0  1  1  =1 1  1    68.75
12: Pyotr 0.6 AM               9.5/20  0  =  =  0  0  00 0  00 0  =  1  ·· 1  11 1  11 1    53.50
13: EasyPeasy 1.0.0.0          8.0/21  00 01 0  0  0  0  10 0  0  0  0  0  ·· 1  11 1  11   40.00
14: Neg 0.3d                   5.5/21  00 0  =  0  0  0  00 0  0  0  0  00 0  ·· 1  11 11   12.75
15: Ram 2.0                    2.0/21  0  0  00 00 0  0  0  0  00 0  =0 0  00 0  ·· =  1     5.75
16: POS 1.20                   1.0/20  00 0  0  0  0  0  0  00 0  0  0  00 0  00 =  ·· =     1.25
17: Brutus RND                 0.5/20  0  0  0  0  0  00 0  00 0  0  0  0  00 00 0  =  ··    0.50
What's the timecontrol ?

Your games seems very interesting to rise the accuracy in the bottom of the big rating list http://home.scarlet.be/vincentlejeune/r ... 120614.txt
Sorry about that omission. The time control is equivalent to CCRL 40/4. These engines are or will be on my Also-Rans list. Eventually, the majority of those engines will be on the CCRL 40/4 lists. Many of the games used to compute the Also-Rans list are in the CCRL 40/4 database.
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: The HGM Invitational

Post by Adam Hair »

Dan Honeycutt wrote:
Adam Hair wrote:I have not seen any misbehavior. If I do, I will document it and send you the information.
Ok, thanks. Sorry about hijacking your HGM Invitational thread. I'll shut up now.

Best
Dan H.
No, I did not feel that you were hijacking the thread.
If I can do anything for you, let me know.

Adam
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: The HGM Invitational

Post by Adam Hair »

After 1007 games:

Code: Select all

    Engine                     Score 
01: Usurpator II               104.0/119 
02: Xadreco 5.7                90.0/118  
03: CmcChess 2.27              88.0/119  
04: Strategic Deep 1.25        87.5/118  
05: SUPRA 11.5.1 64-bit        82.0/119  
06: Safrad 2.1.35.210          79.0/119  
07: Chad's Chess 0.15          73.5/119  
08: Iota 1.0 32-bit JA(tcc)    71.0/118  
09: Crafty 23.4 64-bit skill 1 64.0/118  
10: Testina 2.2                60.5/118  
11: Delfi 5.4 1000 Elo         60.5/118  
12: Pyotr 0.6 AM               55.0/118  
13: EasyPeasy 1.0.0.0          39.0/119  
14: Neg 0.3d                   23.5/118  
15: Ram 2.0                    18.0/119  
16: POS 1.20                   7.5/118   
17: Brutus RND                 4.0/119  
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: The HGM Invitational

Post by Adam Hair »

Graham Banks wrote:
Adam Hair wrote:
Dan Honeycutt wrote:
Adam Hair wrote:I missed on my initial guess of Cupcake's strength and have adjusted accordingly. I will fill in additional appropriate opponents to get the number of games played to around 800+.
Thanks ever so much, Adam. From what you have so far it looks like Cupcake would be around 2000 - 2100 on your Also-Rans Rating List. That's where I think a program with a very basic search and eval should be if it doesn't have bugs so, hopefully, Cupcake doesn't have too many bugs.

One bug I know of - it can lose input if it arrives during search and it's not move now (?). That shouldn't affect tournament play but let me ask you, did you observe any misbehavior in your tests?

Thanks again,
Dan H.
I have not seen any misbehavior. If I do, I will document it and send you the information.
Looks like I can include Cupcake in my next Amateur Series Division 7. :)
Yeah. It looks like Cupcake will be a great addition for the Amateur Series.
User avatar
Graham Banks
Posts: 44599
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: The HGM Invitational

Post by Graham Banks »

Adam Hair wrote:Yeah. It looks like Cupcake will be a great addition for the Amateur Series.
Of course, I'd prefer a new Bruja, but.......... :P :lol:
gbanksnz at gmail.com