2013 Tournament between Android Engines

abik · Post by **abik** » Sat Feb 09, 2013 10:43 pm

My 2013 tournament between UCI and XBoard engines for Android (ARMv5TE-based) is about to start with the test and qualifying rounds. I have setup a tournament website with past tournaments (one old, one new so far). The new tournament results will be posted in this thread and at the 2013 tournament site.

Games will be played on a Nexus 7 (1.3 GHz quad-core Cortex-A9). If supported, engines will be allowed to use 2 threads with "pondering" enabled.

Let the games begin! If you don't see your favorite engine in the test tournaments, feel free to drop me a request.

abik · Post by **abik** » Mon Feb 11, 2013 1:38 am

First test results using one second-per-move test tournaments played from both sides of the first position in the Nunn opening suite. Also, I changed the conditions into 4 threads and "pondering" disabled (the tournament got stuck a few times using 2 threads and pondering, I still have to investigate if that is an issue with the GUI or some engines only).

As usual, games available on request.

Code: Select all

                                    1  2  3  4  5  6  
1   Rodent 0.18.0                   ** 11 ½1 ½½ 11 11   8.5/10
2   crafty-235-android-ja           00 ** 1½ 11 11 11   7.5/10
3   typhoon-android-ja              ½0 0½ ** 10 1½ 11   5.5/10
4   Jazz 6.40 JA                    ½½ 00 01 ** 10 11   5.0/10
5   betsabe-II-130-android-ja       00 00 0½ 01 ** 11   3.5/10
6   Ifrit_m1_8_Beta_12_June_2012_J  00 00 00 00 00 **   0.0/10

Disqualified&#58; ifrit-m18-ja &#40;illegal moves&#41;.

                            1  2  3  4  5  
1   Arasan 14.0.1           ** ½1 11 11 11   7.5/8
2   cheng3 1.07 JA          ½0 ** 01 11 11   5.5/8
3   BikJump v2.1P &#40;32-bit&#41;  00 10 ** 10 11   4.0/8
4   AdroitChess 0.3         00 00 01 ** 11   3.0/8
5   Cassandre               00 00 00 00 **   0.0/8

Disqualified&#58; apilchess-106-ja &#40;hangs&#41;, cassandre-026-ja &#40;sends wrong format&#41;, cyrano-061-b17-ja &#40;hangs&#41;.

                           1  2  3  4  5  6  
1   DiscoCheck 4.0.1       ** ½1 11 11 11 11   9.5/10
2   Critter 1.2 32-bit     ½0 ** 11 11 ½½ 11   7.5/10
3   Daydreamer 1.75 JA     00 00 ** ½1 11 11   5.5/10
4   GarboChess 3 &#40;32-bit&#41;  00 00 ½0 ** ½1 11   4.0/10
5   gaviota v0.83.0.3      00 ½½ 00 ½0 ** 11   3.5/10
6   Diablo 0.5.1           00 00 00 00 00 **   0.0/10

Adam Hair · Post by **Adam Hair** » Mon Feb 11, 2013 2:53 am

Hi Aart,

Gaviota 0.86 for Android can be found at the Gaviota website:
https://sites.google.com/site/gaviotach ... e/download

Very interested in your tournament,
Adam

abik · Post by **abik** » Mon Feb 11, 2013 2:58 am

Adam Hair wrote:Gaviota 0.86 for Android can be found at the Gaviota website

Of course! I even pre-tested that version

Not sure how this old version slipped into the test tournament. Updated to latest.

Thanks for noticing!

abik · Post by **abik** » Mon Feb 11, 2013 3:17 am

I am also updating Critter to version 1.6a. If anyone spots other outdated versions, please let me know. A bit interest from the engine authors is always nice....

lucasart · Post by **lucasart** » Mon Feb 11, 2013 3:26 am

abik wrote:

Code: Select all

                           1  2  3  4  5  6  
1   DiscoCheck 4.0.1       ** ½1 11 11 11 11   9.5/10
2   Critter 1.2 32-bit     ½0 ** 11 11 ½½ 11   7.5/10
3   Daydreamer 1.75 JA     00 00 ** ½1 11 11   5.5/10
4   GarboChess 3 &#40;32-bit&#41;  00 00 ½0 ** ½1 11   4.0/10
5   gaviota v0.83.0.3      00 ½½ 00 ½0 ** 11   3.5/10
6   Diablo 0.5.1           00 00 00 00 00 **   0.0/10

That was surely a very lucky draw from DiscoCheck. Of course there's a lot of variability in a 10 game experiment, but here we must be in the 1% quantile.

How did Critter 1.2 loose a game to DiscoCheck ? Did something go wrong (lost on time for example) ?

abik · Post by **abik** » Mon Feb 11, 2013 3:34 am

lucasart wrote:How did Critter 1.2 loose a game to DiscoCheck ? Did something go wrong (lost on time for example) ?

Here is the game, Lucas.

[pgn]
[Event "Chess for Android Tournament"]
[Site "United States"]
[Date "2013.02.09"]
[Round "2"]
[White "DiscoCheck 4.0.1"]
[Black "Critter 1.2 32-bit"]
[Result "1-0"]
[PlyCount "97"]
[TimeControl "1/1"]
[Device "Nexus 7"]

1. e4 c5
2. Nf3 e6
3. d4 cxd4
4. Nxd4 Nc6
5. Nb5 Nf6
6. N1c3 d6
7. Bf4 e5
8. Bg5 a6
9. Na3 b5
10. Bxf6 gxf6
11. Nd5 f5
12. c3 Bg7
13. exf5 Bxf5 {from PGN 0.008}
14. Bd3 {[12]17/ 1.76} e4 {[9/14]24/d3c2 1.081}
15. Be2 {[11]-17/ 1.918} O-O {[9/11]45/e1g1 1.366}
16. O-O {[11]-17/d8h4 1.633} Ne7 {[8/10]34/a3c2 1.434}
17. Nc2 {[11]7/f5d7 d1d2 g7e5 d 1.573} Be6 {[8/12]12/d5e7 1.463}
18. Nxe7+ {[11]29/d8e7 a2a4 b5a4 1.526} Qxe7 {[9/16]-4/a2a4 0.997}
19. a4 {[11]35/e7d7 c2d4 e6c4 e 1.007} Qc7 {[9/14]-12/c2d4 0.994}
20. Nd4 {[11]54/b5b4 c3b4 d6d5 a 2.009} b4 {[8/13]-19/c3b4 1.276}
21. cxb4 {[11]53/d6d5 a1c1 c7f4 0.72} Be5 {[9/16]-13/g2g3 1.004}
22. Rc1 {[13]98/ 1.996} Qb7 {[9/16]-51/d4e6 1.092}
23. Qd2 {[11]117/e6d7 1.91} Bd7 {[9/12]-46/b4b5 1.303}
24. b5 {[11]99/a6b5 d4b5 b7b6 b 1.696} axb5 {[8/13]-46/d4b5 1.022}
25. Nxb5 {[10]103/b7b6 b2b3 g8h8 d 0.973} Qb6 {[9/16]-53/c1c4 1.425}
26. b3 {[11]119/g8h8 1.58} Be6 {[8/10]-76/e2c4 1.785}
27. Bc4 {[10]139/f8c8 c4e6 f7e6 d 1.211} Qd8 {[8/14]-113/c4d5 1.777}
28. Bd5 {[10]181/a8a6 d5b7 a6a5 b 1.225} Ra6 {[9/13]-133/d5e6 1.751}
29. Bxe4 {[9]148/ 0.254} Bxh2+ {[8/14]-164/g1h2 1.235}
30. Kxh2 {[11]233/d8h4 0.76} Qh4+ {[10/21]-245/h2g1 1.614}
31. Kg1 {[]/ 0.002} Qxe4 {[10/17]-246/c1c3 1.048}
32. Rc3 {[11]289/e4e5 c3g3 g8h8 f 1.335} Bf5 {[9/15]-238/b5c7 1.476}
33. Nc7 {[11]310/a6a7 d2d6 a7a5 c 1.528} Ra7 {[9/15]-291/f1e1 2.112}
34. Qxd6 {[10]322/ 0.888} Bg6 {[8/10]-239/c7d5 1.432}
35. Rfc1 {[10]321/a7a5 c3e3 e4h4 c 1.565} Ra5 {[9/14]-235/c7b5 1.411}
36. Re3 {[11]330/e4h4 c7d5 h4d8 d 1.592} Qb7 {[9/19]-272/c7b5 1.221}
37. Ne8 {[11]354/b7a6 e8f6 g8g7 d 1.78} Ra6 {[9/16]-305/d6d4 1.469}
38. Qd4 {[12]362/ 1.527} f6 {[9/21]-375/c1c7 1.064}
39. Rc7 {[12]711/b7a8 c7g7 1.933} Qa8 {[8/15]-393/d4d7 1.399}
40. Rg7+ {[12]721/g8h8 g7g6 a8a7 g 1.606} Kh8 {[10/20]-547/d4d7 1.025}
41. Rxg6 {[14]744/a8a7 g6f6 f8f6 d 1.972} Rf7 {[7/15]-913/e8f6 1.007}
42. Rxf6 {[10]1227/a6f6 e8f6 h7h6 e 0.996} Raxf6 {[9/19]-1296/e8f6 1.028}
43. Nxf6 {[10]2129/h7h6 d4f4 f7h7 e 1.725} h6 {[9/21]-1323/b3b4 1.024}
44. Qf4 {[11]18848/f7h7 e3e7 a8g8 e 1.225} Qxg2+ {[9/19]-2065/g1g2 1.295}
45. Kxg2 {[]/ 0.002} Rg7+ {[12/19]mate:-4/g2h3 1.079}
46. Rg3 {[51]31993/g7g5 g3g5 h6g5 f 1.619} Rg5 {[25/6]mate:-3/f4c7 2.036}
47. Rxg5 {[49]31992/ 0.963} hxg5 {[56/4]mate:-2/f4c7 1.027}
48. Qc7 {[127]31997/g5g4 0.097} g4 {[56/1]mate:-1/ 0.067}
49. Qh7# 1-0
[/pgn]

lucasart · Post by **lucasart** » Mon Feb 11, 2013 3:44 am

abik wrote:
lucasart wrote:How did Critter 1.2 loose a game to DiscoCheck ? Did something go wrong (lost on time for example) ?
Here is the game, Lucas.

[pgn]
[Event "Chess for Android Tournament"]
[Site "United States"]
[Date "2013.02.09"]
[Round "2"]
[White "DiscoCheck 4.0.1"]
[Black "Critter 1.2 32-bit"]
[Result "1-0"]
[PlyCount "97"]
[TimeControl "1/1"]
[Device "Nexus 7"]

1. e4 c5
2. Nf3 e6
3. d4 cxd4
4. Nxd4 Nc6
5. Nb5 Nf6
6. N1c3 d6
7. Bf4 e5
8. Bg5 a6
9. Na3 b5
10. Bxf6 gxf6
11. Nd5 f5
12. c3 Bg7
13. exf5 Bxf5 {from PGN 0.008}
14. Bd3 {[12]17/ 1.76} e4 {[9/14]24/d3c2 1.081}
15. Be2 {[11]-17/ 1.918} O-O {[9/11]45/e1g1 1.366}
16. O-O {[11]-17/d8h4 1.633} Ne7 {[8/10]34/a3c2 1.434}
17. Nc2 {[11]7/f5d7 d1d2 g7e5 d 1.573} Be6 {[8/12]12/d5e7 1.463}
18. Nxe7+ {[11]29/d8e7 a2a4 b5a4 1.526} Qxe7 {[9/16]-4/a2a4 0.997}
19. a4 {[11]35/e7d7 c2d4 e6c4 e 1.007} Qc7 {[9/14]-12/c2d4 0.994}
20. Nd4 {[11]54/b5b4 c3b4 d6d5 a 2.009} b4 {[8/13]-19/c3b4 1.276}
21. cxb4 {[11]53/d6d5 a1c1 c7f4 0.72} Be5 {[9/16]-13/g2g3 1.004}
22. Rc1 {[13]98/ 1.996} Qb7 {[9/16]-51/d4e6 1.092}
23. Qd2 {[11]117/e6d7 1.91} Bd7 {[9/12]-46/b4b5 1.303}
24. b5 {[11]99/a6b5 d4b5 b7b6 b 1.696} axb5 {[8/13]-46/d4b5 1.022}
25. Nxb5 {[10]103/b7b6 b2b3 g8h8 d 0.973} Qb6 {[9/16]-53/c1c4 1.425}
26. b3 {[11]119/g8h8 1.58} Be6 {[8/10]-76/e2c4 1.785}
27. Bc4 {[10]139/f8c8 c4e6 f7e6 d 1.211} Qd8 {[8/14]-113/c4d5 1.777}
28. Bd5 {[10]181/a8a6 d5b7 a6a5 b 1.225} Ra6 {[9/13]-133/d5e6 1.751}
29. Bxe4 {[9]148/ 0.254} Bxh2+ {[8/14]-164/g1h2 1.235}
30. Kxh2 {[11]233/d8h4 0.76} Qh4+ {[10/21]-245/h2g1 1.614}
31. Kg1 {[]/ 0.002} Qxe4 {[10/17]-246/c1c3 1.048}
32. Rc3 {[11]289/e4e5 c3g3 g8h8 f 1.335} Bf5 {[9/15]-238/b5c7 1.476}
33. Nc7 {[11]310/a6a7 d2d6 a7a5 c 1.528} Ra7 {[9/15]-291/f1e1 2.112}
34. Qxd6 {[10]322/ 0.888} Bg6 {[8/10]-239/c7d5 1.432}
35. Rfc1 {[10]321/a7a5 c3e3 e4h4 c 1.565} Ra5 {[9/14]-235/c7b5 1.411}
36. Re3 {[11]330/e4h4 c7d5 h4d8 d 1.592} Qb7 {[9/19]-272/c7b5 1.221}
37. Ne8 {[11]354/b7a6 e8f6 g8g7 d 1.78} Ra6 {[9/16]-305/d6d4 1.469}
38. Qd4 {[12]362/ 1.527} f6 {[9/21]-375/c1c7 1.064}
39. Rc7 {[12]711/b7a8 c7g7 1.933} Qa8 {[8/15]-393/d4d7 1.399}
40. Rg7+ {[12]721/g8h8 g7g6 a8a7 g 1.606} Kh8 {[10/20]-547/d4d7 1.025}
41. Rxg6 {[14]744/a8a7 g6f6 f8f6 d 1.972} Rf7 {[7/15]-913/e8f6 1.007}
42. Rxf6 {[10]1227/a6f6 e8f6 h7h6 e 0.996} Raxf6 {[9/19]-1296/e8f6 1.028}
43. Nxf6 {[10]2129/h7h6 d4f4 f7h7 e 1.725} h6 {[9/21]-1323/b3b4 1.024}
44. Qf4 {[11]18848/f7h7 e3e7 a8g8 e 1.225} Qxg2+ {[9/19]-2065/g1g2 1.295}
45. Kxg2 {[]/ 0.002} Rg7+ {[12/19]mate:-4/g2h3 1.079}
46. Rg3 {[51]31993/g7g5 g3g5 h6g5 f 1.619} Rg5 {[25/6]mate:-3/f4c7 2.036}
47. Rxg5 {[49]31992/ 0.963} hxg5 {[56/4]mate:-2/f4c7 1.027}
48. Qc7 {[127]31997/g5g4 0.097} g4 {[56/1]mate:-1/ 0.067}
49. Qh7# 1-0
[/pgn]

OK, so it won fair and square. Critter seems to have accidently overlooked some tactics.

If I may suggest, could you cap the booklines to 7 or 8 moves let's say ? This will allow engines to develop their own strategy, rather than start the game from an already boring position with developpement finished and many pieces exchanged.

abik · Post by **abik** » Mon Feb 11, 2013 3:49 am

lucasart wrote:If I may suggest, could you cap the booklines to 7 or 8 moves let's say ? This will allow engines to develop their own strategy, rather than start the game from an already boring position with developpement finished and many pieces exchanged.

This test tournament is simply from both sides of the first Nunn position. For the real tournament, I am planning to run from both sides of Albert Silver's Silversuite positions, or perhaps the Silversuite gambit positions. Does that sound interesting enough?

abik · Post by **abik** » Mon Feb 11, 2013 6:12 am

Two updates, and more test tournaments. Many more engines to follow, but the weekend is over here now

Code: Select all

                     1  2  3  4  5  6  
1   RedQueen 1.1.2   ** 1½ ½0 11 11 11   8.0/10  28.75
2   Pepito v1.59     0½ ** ½1 11 11 11   8.0/10  28.25
3   GNU Chess 6.0.2  ½1 ½0 ** ½1 11 11   7.5/10
4   greko98-ab       00 00 ½0 ** 11 11   4.5/10
5   Iota             00 00 00 00 ** 11   2.0/10
6   Pawny 0.3.1      00 00 00 00 00 **   0.0/10

Disqualified&#58; Iota &#40;uses too much time&#41;, pawny-031-ja &#40;illegal moves&#41;

                         1  2  3  4  5  6  
1   Critter 1.6a 32-bit  ** ½1 01 11 11 11   8.5/10  31.75
2   Stockfish 2.3.1      ½0 ** 11 11 11 11   8.5/10  30.25
3   Gaviota v0.86        10 00 ** 11 11 11   7.0/10
4   Rotor 0.7            00 00 00 ** 11 11   4.0/10
5   SUFF 0.3a JA         00 00 00 00 ** 1½   1.5/10
6   Simplex 0.9.8        00 00 00 00 0½ **   0.5/10

Disqualified&#58; sissa-20-ja &#40;illegal moves&#41;, suff-03a-ja &#40;uses too much time&#41;

2013 Tournament between Android Engines

2013 Tournament between Android Engines

Re: 2013 Tournament between Android Engines

Re: 2013 Tournament between Android Engines

Re: 2013 Tournament between Android Engines

Re: 2013 Tournament between Android Engines

Re: 2013 Tournament between Android Engines

Re: 2013 Tournament between Android Engines

Re: 2013 Tournament between Android Engines

Re: 2013 Tournament between Android Engines

Re: 2013 Tournament between Android Engines