2013 Tournament between Android Engines

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
abik
Posts: 823
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

Group A tournament finished: we have a winner!

Post by abik »

Five seconds-per-move tournament in Group A played from both sides of all positions in the Silversuite gambit opening suite. The Komodo DEV engine crashed in a few fixed positions, and the games had to be adjudicated, unfortunately.

Games available at the tournament site.

This concludes my 2013 Android engines tournament.

Congratulations to Richard Vida for Critter's victory, his second Android tournament victory!

Code: Select all

                   1         2         3         4         5                                                
1 Critter 1.6a     *         27.5-22.5 38.0-12.0 38.0-12.0 48.0- 2.0  151.5/200
2 Stockfish 2.3.1  22.5-27.5 *         42.0-8.0  37.5-12.5 45.5- 4.5  147.5/200
3 Toga II 3.0      12.0-38.0  8.0-42.0 *         43.0- 7.0 39.0-11.0  102.0/200
4 Komodo DEV       12.0-38.0 12.5-37.5  7.0-43.0 *         31.0-19.0   62.5/200
5 MinkoChess arm    2.0-48.0  4.5-45.5 11.0-39.0 19.0-31.0             36.5/200
User avatar
abik
Posts: 823
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

Estimated ELO ratings

Post by abik »

Estimated ELO ratings of the engines, based on all qualification and tournament games (computed by the Chessbase ELO tool).

Code: Select all

1    Critter 1.6a 32-bit      2891
2    Stockfish 2.3.1          2854
3    Toga II 3.0              2763
4    Gaviota v0.86            2689
5    Komodo DEV               2670
6    Toga II 1.4.1SE          2650
7    DiscoCheck 4.0.1         2635
8    Arasan 15.2 JA           2601
9    MinkoChess arm           2593
10   Texel 1.01 32-bit        2575
11   crafty-235-android-ja    2568
12   Arasan 15.1              2564
13   Rotor 0.7                2549
14   Arasan 14.0.1            2535
15   Rodent 0.18.0            2527
16   cheng3 1.07 JA           2524
17   Daydreamer 1.75 JA       2505
18   scorpio-27-ja            2487
19   Pepito v1.59             2479
20   GarboChess 3             2467
21   Rotor 0.8                2465
22   sloppy-023-ja            2445
23   betsabe-II-130--ja       2429
24   danasah-488-ja           2422
25   phalanx-xxii-ja          2421
26   tucano104-ab             2406
27   typhoon-android-ja       2404
28   GNU Chess 6.0.2          2383
29   RedQueen 1.1.2           2367
30   greko98-ab               2363
31   Sungorus 1.4 JA          2350
32   TJchess 1.01U            2349
33   Jazz 6.40 JA             2344
34   natwarlal-014-ja         2316
35   scidlet-261b2-ja         2316
36   myrddin-086-ja           2316
37   kmtchess-121-ja          2305
38   gk-090-ja                2232
39   sjeng-112-ja             2224
40   BikJump v2.1P            2209
41   ZCT-0.3.2500             2184
42   AdroitChess 0.3          2136
43   tscp181-ab               2103
44   Diablo 0.5.1             2103
45   exchess-054-beta-ja      2101
46   zzzzzz-351-ja            2093
47   fairymax48l-ab           2076
48   surprise-43-b13-ja       2054
49   myrddin0.85j             2041
50   umax48w                  2019
51   VIRUTOR CHESS            1973
52   Chess for Android        1909
53   toledo-nanochess-2010-ja 1813
54   Simplex 0.9.8            1725
55   olithink-531-ja          1724
jd1
Posts: 269
Joined: Wed Oct 24, 2012 2:07 am

Re: Group A tournament finished: we have a winner!

Post by jd1 »

abik wrote:Five seconds-per-move tournament in Group A played from both sides of all positions in the Silversuite gambit opening suite. The Komodo DEV engine crashed in a few fixed positions, and the games had to be adjudicated, unfortunately.

Games available at the tournament site.

This concludes my 2013 Android engines tournament.

Congratulations to Richard Vida for Critter's victory, his second Android tournament victory!

Code: Select all

                   1         2         3         4         5                                                
1 Critter 1.6a     *         27.5-22.5 38.0-12.0 38.0-12.0 48.0- 2.0  151.5/200
2 Stockfish 2.3.1  22.5-27.5 *         42.0-8.0  37.5-12.5 45.5- 4.5  147.5/200
3 Toga II 3.0      12.0-38.0  8.0-42.0 *         43.0- 7.0 39.0-11.0  102.0/200
4 Komodo DEV       12.0-38.0 12.5-37.5  7.0-43.0 *         31.0-19.0   62.5/200
5 MinkoChess arm    2.0-48.0  4.5-45.5 11.0-39.0 19.0-31.0             36.5/200
Thanks for running this, Aart, and congratulations to Richard! I wonder what was wrong with Komodo - even the old Komodo 3 beats Toga II 3.0 (very) easily on my Samsung Galaxy.

Jerry
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Estimated ELO ratings

Post by michiguel »

abik wrote:Estimated ELO ratings of the engines, based on all qualification and tournament games (computed by the Chessbase ELO tool).

Code: Select all

1    Critter 1.6a 32-bit      2891
2    Stockfish 2.3.1          2854
3    Toga II 3.0              2763
4    Gaviota v0.86            2689
5    Komodo DEV               2670
6    Toga II 1.4.1SE          2650
7    DiscoCheck 4.0.1         2635
8    Arasan 15.2 JA           2601
9    MinkoChess arm           2593
10   Texel 1.01 32-bit        2575
11   crafty-235-android-ja    2568
12   Arasan 15.1              2564
13   Rotor 0.7                2549
14   Arasan 14.0.1            2535
15   Rodent 0.18.0            2527
16   cheng3 1.07 JA           2524
17   Daydreamer 1.75 JA       2505
18   scorpio-27-ja            2487
19   Pepito v1.59             2479
20   GarboChess 3             2467
21   Rotor 0.8                2465
22   sloppy-023-ja            2445
23   betsabe-II-130--ja       2429
24   danasah-488-ja           2422
25   phalanx-xxii-ja          2421
26   tucano104-ab             2406
27   typhoon-android-ja       2404
28   GNU Chess 6.0.2          2383
29   RedQueen 1.1.2           2367
30   greko98-ab               2363
31   Sungorus 1.4 JA          2350
32   TJchess 1.01U            2349
33   Jazz 6.40 JA             2344
34   natwarlal-014-ja         2316
35   scidlet-261b2-ja         2316
36   myrddin-086-ja           2316
37   kmtchess-121-ja          2305
38   gk-090-ja                2232
39   sjeng-112-ja             2224
40   BikJump v2.1P            2209
41   ZCT-0.3.2500             2184
42   AdroitChess 0.3          2136
43   tscp181-ab               2103
44   Diablo 0.5.1             2103
45   exchess-054-beta-ja      2101
46   zzzzzz-351-ja            2093
47   fairymax48l-ab           2076
48   surprise-43-b13-ja       2054
49   myrddin0.85j             2041
50   umax48w                  2019
51   VIRUTOR CHESS            1973
52   Chess for Android        1909
53   toledo-nanochess-2010-ja 1813
54   Simplex 0.9.8            1725
55   olithink-531-ja          1724
Not bad at all for the bird...

Miguel
User avatar
abik
Posts: 823
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

Re: Group A tournament finished: we have a winner!

Post by abik »

jd1 wrote:Thanks for running this, Aart, and congratulations to Richard! I wonder what was wrong with Komodo - even the old Komodo 3 beats Toga II 3.0 (very) easily on my Samsung Galaxy.

Jerry
One is glad to be of service!

The Komodo engine used was a private development version that Don very kindly allowed me to use. I feel bad that it crashed in a few positions, but there was really not much I could do about it. I am sure that the production version of Komodo will do much better, so don't draw too many conclusions from the development version's performance.