Android UCI engine tournament

[abik]

Using an upcoming feature in Chess for Android, I conducted a full tournament between 17 currently available UCI engines for Android as well as the simple built-in Java engine. The tournament consisted of pair-wise matches between all engines for 10 games with random book opening play, one second-per-move, 32MB hash, and 8MB tablebases cache with the 3- and 4-piece Nalimov, Gaviota, Scorpio, Robbobases endgames on SD card. The 1530 games lasted about two days running full time on a Nexus One phone (without a single crash!). The results are shown below.

Code: Select all

1  Stockfish 2.0                   157.5/170
2  RobboLito 0.085g3l              152.5/170
3  IvanHoe-Beta version 999947c    145.0/170
4  Komodo32 1.3 JA                 137.0/170
5  Toga II 1.4.1SE                 130.5/170
6  Pepito v1.59                    104.0/170
7  Daydreamer 1.75 JA              100.5/170
8  Rotor 0.6a                       98.0/170
9  gaviota v0.80.0.107              87.5/170 4647.75
10 GNU Chess 5.07.170.7b            87.5/170 4455.25
11 RedQueen 0.9.8                   75.5/170
12 GreKo 8.0                        71.0/170
13 Jazz v444 JA                     50.5/170
14 BikJump v2.1P                    49.0/170
15 Diablo 0.5.1                     38.5/170
16 ZCT-0.3.2500                     34.0/170
17 Chess for Android                10.5/170
18 Simplex 0.9.7 rev 180             1.0/170

[abik]

A tournament with more games between the top engines, same settings. Congrats to the stockfish team for winning the Android UCI engines tournament!

Code: Select all

                                 1            2            3            4            5            6                          
1   Stockfish 2.0                ***********  50.5 - 49.5  60.0 - 40.0  68.5 - 31.5  69.5 - 30.5  75.0 - 25.0     323.5/500
2   Stockfish 2.1                49.5 - 50.5  ***********  57.0 - 43.0  57.5 - 42.5  70.5 - 29.5  82.0 - 18.0     316.5/500
3   RobboLito 0.085e4l           40.0 - 60.0  43.0 - 57.0  ***********  49.5 - 50.5  58.5 - 41.5  59.5 - 40.5     250.5/500
4   RobboLito 0.085g3l           31.5 - 68.5  42.5 - 57.5  50.5 - 49.5  ***********  56.0 - 44.0  59.5 - 40.5     240.0/500
5   IvanHoe-Beta version 999947c 30.5 - 69.5  29.5 - 70.5  41.5 - 58.5  44.0 - 56.0  ***********  51.0 - 49.0     196.5/500
6   Komodo32 1.3 JA              25.0 - 75.0  18.0 - 82.0  40.5 - 59.5  40.5 - 59.5  49.0 - 51.0  ***********     173.0/500

[abik]

Congrats to Don Dailey and Larry Kaufman for releasing an impressive new version of Komodo! Here are the results of a quick one-second per move tournament, 32MB hash, between two available Android versions on a Nexus S.

Code: Select all

1   Komodo32 2 AB     +58/-12/=30 73.00%   73.0/100
2   Komodo32 1.3 JA   +12/-58/=30 27.00%   27.0/100

And the results of a tournament on a Nexus One between top engines.

Code: Select all

      
                        1            2            3                                   
1   Stockfish 2.0       ***          48.5 - 51.5  59.0 - 41.0    107.5/200
2   RobboLito 0.085e4l  51.5 - 48.5  **           50.0 - 50.0    101.5/200
3   Komodo32 2.01 AB    41.0 - 59.0  50.0 - 50.0  **              91.0/200