Android tournament with longer time controls

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
abik
Posts: 823
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

Re: Grouping

Post by abik »

Michel wrote:On the negative side: the improvements in my two latest released versions
seem to have little (if any) positive effect on android.... :-(
Well, the qualification round was done at one second-per-move, while the full round in each group will be played at 30 seconds-per-move. This obviously may have an impact on the relative strength of engines (already I see ZCT performing much better, for instance). If you have any preference for what GNU version I should use, I will be happy to change the version number used in group C.
User avatar
abik
Posts: 823
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

Re: Grouping

Post by abik »

As requested by the author, I have compiled GreKo 8.2 for Android. This version will replace GreKo 8.0 in the tournament. Both binaries are available at UCI and XBoard Engines for Android.
User avatar
abik
Posts: 823
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

Group F completed: congrats to Jazz!

Post by abik »

Group F has just finished a complete thirty seconds-per-move tournament, played from both sides of all positions in the Nunn opening suite under the conditions described earlier.

Congratulations to Evert Glebbeek for Jazz's promotion to Group E.

All games can be downloaded from the tournament page.

Code: Select all

                 1         2          3         4         5                    
1 Jazz v5.01 JA     *      15.5-4.5   18.0-2.0  18.5-1.5  19.5-0.5  71.5/80  <= PROMOTED TO E
2 ZCT-0.3.2500   4.5-15.5      *      13.5-6.5  17.0-3.0  16.0-4.0  51.0/80
3 BikJump v2.1   2.0-18.0   6.5-13.5      *     12.5-7.5  12.0-8.0  33.0/80
4 tscp181        1.5-18.5   3.0-17.0   7.5-12.5     *     12.5-7.5  24.5/80
5 umax48w        0.5-19.5   4.0-16.0   8.0-12.0  7.5-12.5     *     20.0/80
User avatar
abik
Posts: 823
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

group E comleted: congrats to RedQueen

Post by abik »

After burning cycles on my Nexus One for many days, Group E has just finished a complete thirty seconds-per-move tournament in Chess for Android, played from both sides of all positions in the Nunn opening suite under the conditions described earlier.

Congratulations to Ben-Hur Carlos Vieira Langoni Jr for RedQueen's promotion to Group D.

All games can be downloaded from the tournament page.

Code: Select all

                    1         2         3         4         5                    
1 RedQueen 0.9.8 JA     *     10.0-10.0 14.5-5.5  17.0-3.0  19.5-0.5  61.0/80  => PROMOTED TO D
2 greko8.2          10.0-10.0     *     14.5-5.5  16.0-4.0  18.5-1.5  59.0/80
3 Sungorus 1.4 JA    5.5-14.5  5.5-14.5     *     13.0-7.0  16.0-4.0  40.0/80
4 Jazz v5.01 JA      3.0-17.0  4.0-16.0  7.0-13.0      *    14.5-5.5  28.5/80
5 DoubleCheck 1.3    0.5-19.5  1.5-18.5  4.0-16.0  5.5-14.5     *     11.5/80
User avatar
abik
Posts: 823
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

Group D completed: congrats Daydreamer!

Post by abik »

After still many more cycles on my Nexus One, Group D has just finished a complete thirty seconds-per-move tournament in Chess for Android, played from both sides of all positions in the Nunn opening suite under the conditions described earlier. Quite a shuffle-up in the results this time compared to the qualification tournament.

Congratulations to Aaron Becker for Daydreamer's promotion to Group C.

All games can be downloaded from the tournament page.

Code: Select all

                      1        2         3         4        5                    
1 Daydreamer 1.75 JA     *     12.0-8.0  11.0-9.0  14.5-5.5 16.0-4.0  53.5/80 => PROMOTED TO C
2 sloppy              8.0-12.0     *     14.0-6.0  10.5-9.5 16.0-4.0  48.5/80
3 RedQueen 0.9.8 JA   9.0-11.0  6.0-14.0     *     11.5-8.5 14.0-6.0  40.5/80
4 gaviota v0.84       5.5-14.5  9.5-10.5  8.5-11.5     *    15.0-5.0  38.5/80
5 Diablo 0.5.1b JA    4.0-16.0  4.0-16.0  6.0-14.0  5.0-15.0    *     19.0/80
User avatar
abik
Posts: 823
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

Group C completed: congrats GarboChess!

Post by abik »

Group C has finished a complete thirty seconds-per-move tournament in Chess for Android, played from both sides of all positions in the Nunn opening suite under the conditions described earlier.

Congratulations to Gary Linscott for GarboChess' promotion to Group B.
All games can be downloaded from the tournament page.

Code: Select all

                           1         2          3          4         5                    
1 GarboChess3                 *      10.5-9.5    9.5-10.5  15.0-5.0  16.0-4.0   51.0/80  => PROMOTED TO B
2 Daydreamer 1.75 JA        9.5-10.5     *      12.0-8.0   14.5-5.5  13.0-7.0   49.0/80
3 GNU Chess 5.07.153.3b-32 10.5-9.5   8.0-12.0      *      11.0-9.0  16.0-4.0   45.5/80
4 Pepito v1.59              5.0-15.0  5.5-14.5   9.0-11.0      *      9.0-11.0  28.5/80
5 Rotor 0.6a                4.0-16.0  7.0-13.0   4.0-16.0  11.0-9.0      *      26.0/80
User avatar
Don
Posts: 5106
Joined: Tue Apr 29, 2008 4:27 pm

Re: Qualification Tournament Completed

Post by Don »

It's hard to believe that Komodo 2 is stronger than Komodo 3 here. There was a pretty enormous improvement between these 2 versions. Did your testing show Komodo 2 on Android to be stronger?

Don
abik wrote:Below the results of a qualification tournament on Chess for Android from both sides of the first Nunn position at one-second per move on a Nexus One (1GHz Snapdragon). Where applicable, UCI engines were given an 8MB hash table and 1MB endgame tablebases cache (the complete 3- and 4-piece Nalimov, Gaviota, Scorpio, and Robbobases endgame tablebases reside on SD card). XBoard engines play at their default settings. Since the Nexus One is a single-core device, "pondering" was disabled

The qualification results are used to split the engines into separate groups. Engines in each group will play each other at longer time controls, starting with the lowest group. The number one in each group will promote to the next group.

All games can be downloaded from the tournament page.

Code: Select all

                                    1  2  3  4  5  6  7  8  9  0  1  2  3  4  5  6  7  8  9  0  1  2  3  4  5  6  7  8  
1   Critter 1.2 32-bit              ** ½0 ½1 10 11 11 11 11 11 1½ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11  50.5/54
2   Stockfish 2.1.1 JA              ½1 ** 01 0½ 11 11 11 01 11 11 ½1 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11  49.5/54
3   RobboLito 0.085g3l x86          ½0 10 ** 01 10 11 11 11 11 11 01 11 11 11 ½1 11 11 11 11 11 11 11 11 11 11 11 11 11  48.0/54
4   Komodo32 2AB                    01 1½ 10 ** 01 ½½ 11 10 11 11 11 11 01 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11  47.5/54
5   IvanHoe-Beta version 999947c-r  00 00 01 10 ** 11 11 1½ 10 11 11 ½1 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11  46.0/54
6   crafty                          00 00 00 ½½ 00 ** 01 11 01 ½1 ½½ ½1 11 ½1 ½1 ½1 11 1½ 11 11 11 11 11 11 11 11 11 11  39.0/54
7   Toga II 1.4.1SE                 00 00 00 00 00 10 ** 01 11 11 1½ ½1 1½ 11 01 ½½ ½1 11 11 11 11 11 11 11 11 11 11 11  38.0/54
8   scorpio                         00 10 00 01 0½ 00 10 ** 0½ ½½ 11 01 ½1 1½ 11 10 11 10 01 11 11 11 11 ½1 11 11 11 11  35.5/54
9   GarboChess3                     00 00 00 00 01 10 00 1½ ** 00 01 10 11 01 ½½ 11 11 1½ 11 ½1 11 11 11 11 11 11 11 11  34.5/54
10  Rotor 0.6a                      0½ 00 00 00 00 ½0 00 ½½ 11 ** ½½ 01 11 10 1½ ½½ 01 10 11 11 11 11 11 11 11 11 11 11  33.5/54
11  GNU Chess 5.07.153.3b-32        00 ½0 10 00 00 ½½ 0½ 00 10 ½½ ** 10 11 01 ½½ 11 ½½ 1½ ½1 11 11 1½ 1½ 11 11 11 11 11  33.0/54
12  Pepito v1.59                    00 00 00 00 ½0 ½0 ½0 10 01 10 01 ** ½0 ½½ 11 ½0 ½0 1½ 11 11 01 11 11 1½ 11 11 11 11  30.0/54
13  Daydreamer 1.75 JA              00 00 00 10 00 00 0½ ½0 00 00 00 ½1 ** 11 10 11 11 ½0 10 11 ½1 11 11 11 11 11 11 11  29.5/54
14  gaviota v0.84                   00 00 00 00 00 ½0 00 0½ 10 01 10 ½½ 00 ** ½½ 10 1½ 11 1½ 01 11 11 11 11 11 11 11 11  29.0/54
15  Diablo 0.5.1b JA                00 00 ½0 00 00 ½0 10 00 ½½ 0½ ½½ 00 01 ½½ ** 10 ½1 ½½ 0½ 11 11 11 11 11 11 11 11 11  28.5/54
16  sloppy                          00 00 00 00 00 ½0 ½½ 01 00 ½½ 00 ½1 00 01 01 ** ½0 ½1 11 11 11 1½ 11 11 11 11 11 11  28.5/54
17  RedQueen 0.9.8 JA               00 00 00 00 00 00 ½0 00 00 10 ½½ ½1 00 0½ ½0 ½1 ** 11 01 11 11 1½ 11 11 11 11 11 11  27.0/54
18  Sungorus 1.4 JA                 00 00 00 00 00 0½ 00 01 0½ 01 0½ 0½ ½1 00 ½½ ½0 00 ** 11 11 1½ 1½ 11 11 11 11 11 11  26.0/54
19  GreKo 8.0                       00 00 00 00 00 00 00 10 00 00 ½0 00 01 0½ 1½ 00 10 00 ** ½1 11 11 10 11 11 11 11 11  22.0/54
20  DoubleCheck 1.3                 00 00 00 00 00 00 00 00 ½0 00 00 00 00 10 00 00 00 00 ½0 ** 01 01 1½ 11 11 11 11 11  15.5/54
21  Jazz v5.01 JA                   00 00 00 00 00 00 00 00 00 00 00 10 ½0 00 00 00 00 0½ 00 10 ** 11 00 1½ 11 11 11 11  14.5/54
22  BikJump v2.1P                   00 00 00 00 00 00 00 00 00 00 0½ 00 00 00 00 0½ 0½ 0½ 00 10 00 ** 11 1½ 11 ½1 11 11  14.0/54
23  ZCT-0.3.2500                    00 00 00 00 00 00 00 00 00 00 0½ 00 00 00 00 00 00 00 01 0½ 11 00 ** 11 11 11 11 11  14.0/54
24  tscp181                         00 00 00 00 00 00 00 ½0 00 00 00 0½ 00 00 00 00 00 00 00 00 0½ 0½ 00 ** 1½ 11 11 11   9.5/54
25  umax48w                         00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0½ ** ½1 10 11   5.0/54
26  fairymax48q                     00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ½0 00 00 ½0 ** 1½ 11   4.5/54
27  Chess for Android               00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 0½ ** 11   3.5/54
28  Simplex 0.9.7 rev 180           00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 **   0.0/54
User avatar
abik
Posts: 823
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

Re: Qualification Tournament Completed

Post by abik »

Don wrote:It's hard to believe that Komodo 2 is stronger than Komodo 3 here. There was a pretty enormous improvement between these 2 versions. Did your testing show Komodo 2 on Android to be stronger?
Don
Hi Don,

I conducted a pre-qualification tournament between different versions of each engine to select a representative for the qualification tournament (see results earlier in this posting). These were played at 1-second per move though, the full tournament is played at 30-seconds per move. Perhaps Komodo 3 plays stronger at longer time controls?

Since group A has not started yet in the ongoing tournament, I will be happy to use Komodo 3 instead if you prefer. Please let me know before group B is done.
User avatar
Don
Posts: 5106
Joined: Tue Apr 29, 2008 4:27 pm

Re: Qualification Tournament Completed

Post by Don »

abik wrote:
Don wrote:It's hard to believe that Komodo 2 is stronger than Komodo 3 here. There was a pretty enormous improvement between these 2 versions. Did your testing show Komodo 2 on Android to be stronger?
Don
Hi Don,

I conducted a pre-qualification tournament between different versions of each engine to select a representative for the qualification tournament (see results earlier in this posting). These were played at 1-second per move though, the full tournament is played at 30-seconds per move. Perhaps Komodo 3 plays stronger at longer time controls?

Since group A has not started yet in the ongoing tournament, I will be happy to use Komodo 3 instead if you prefer. Please let me know before group B is done.
No, just go with what tested best. I was just curious. I would however be interesting in knowing how many games were played and what the error margins and rating difference was.

Now that I think about it, I think Komodo 3 was only a relatively small advance from Komodo 2, it was the jump from 1.3 to komodo 2 that was huge.
bhlangonijr
Posts: 482
Joined: Thu Oct 16, 2008 4:23 am
Location: Milky Way

Re: Grouping

Post by bhlangonijr »

abik wrote:As requested by the author, I have compiled GreKo 8.2 for Android. This version will replace GreKo 8.0 in the tournament. Both binaries are available at UCI and XBoard Engines for Android.
Hello Aart,

Nice Tourney! :)

BTW, there is also a new version for RedQueen (1.0.0). It has some minor optimizations for 32 bit systems...
http://sourceforge.net/projects/redqueenchess/

Regards,