Survival of the Fittest 2

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

enhorning
Posts: 342
Joined: Wed Jan 05, 2011 10:05 pm

Re: Survival of the Fittest 2

Post by enhorning »

Daniel Shawul wrote:I prefer you played variants instead but this is good too.
I will get back to variants as well! The past months have been very busy though, with moving between countries, and for now, this takes less effort to set up and run.

Also factoring in is that I've been playing more Fide chess myself lately and less variants :) Following the live Tromsö world cup coverage got me into vanilla chess again for a while.
cetormenter
Posts: 170
Joined: Sun Oct 28, 2012 9:46 pm

Re: Survival of the Fittest 2

Post by cetormenter »

Hmm Nirvana is having a really poor showing in this tournament. I hope this is only due to its poor time management and the fact that it does not understand incremental time controls.

Is there somewhere where I can download the pgn for this tournament?
jd1
Posts: 269
Joined: Wed Oct 24, 2012 2:07 am

Re: Survival of the Fittest 2

Post by jd1 »

enhorning wrote:Standings after almost 75% of the games played:

Code: Select all

    Engine                   Score   Cr Qu To Mi Gl Te Mu To Sc Bo Ga Oc Ne Ex Ic Ch Ro Bu Di Th Ni    S-B
01: Crafty 23.6 [4c]         21.5/30 ·· =  1= == =0 1= 1  0= 1  1  01 =1 =  =  1  1  =1 1  11 1  11  293.75
02: Quazar 0.4 [1c]          20.0/30 =  ·· =1 =1 1= =1 1  01 1= 1  0  1  0  =0 =  =  11 10 =  1  11  286.75
03: Toga II 3.0 [4c]         19.5/30 0= =0 ·· 0  =  1  01 =  =  10 11 1= 11 1  =  =  11 1  1= 1= =   266.00
04: MinkoChess 1.3 [4c]      19.0/30 == =0 1  ·· 1  1  == =  =  == == 1  10 1  11 =0 0  1  =1 1= 1   268.75
05: Glaurung 2.2 [4c]        18.0/30 =1 0= =  0  ·· 0  1= =  0  1= 10 == 10 1  =  11 1  =  =1 =1 1   245.50
06: Texel 1.02 [1c]          17.5/30 0= =0 0  0  1  ·· 00 1  0  =0 1  =  =1 11 10 =1 =  11 1  11 1   220.75
07: Murka 3 [1c]             17.0/30 0  0  10 == 0= 11 ·· =1 1= =  =  01 =  1  0  =  11 11 =  1  00  246.00
08: Tornado 4.88 [4c]        17.0/30 1= 10 =  =  =  0  =0 ·· 0  11 1= =  01 00 1= 01 1  =  =  11 1   238.00
09: Scorpio 2.7.6 [4c]       17.0/29 0  0= =  =  1  1  0= 1  ·· == 1  =  == 1= 01 =0 0  11 1  11 =   230.25
10: Booot 5.2.0 [1c]         17.0/30 0  0  01 == 0= =1 =  00 == ·· 0  0  0  11 11 1  =  11 1  1  11  218.25
11: Gaviota 0.86 [4c]        15.5/29 10 1  00 == 01 0  =  0= 0  1  ·· 10 1  0  1  1  =1 =  10 1  =1  212.25
12: Octochess r5190 [4c]     15.5/29 =0 0  0= 0  == =  10 =  =  1  01 ·· =1 0  1  =  =1 =  1= 1  1=  204.25
13: Nemo 1.0.1 beta [1c]     14.0/30 =  1  00 01 01 =0 =  10 == 1  0  =0 ·· 1  0  0  11 0  =0 =  11  197.75
14: ExChess 7.18 [4c]        14.0/29 =  =1 0  0  0  00 0  11 0= 00 1  1  0  ·· 01 =1 1  10 1  == 1   187.50
15: Ice 1.0 v1619 [1c]       13.5/29 0  =  =  00 =  01 1  0= 10 00 0  0  1  10 ·· 01 =  =1 =  11 1   171.50
16: Cheng4 0.35a [4c]        11.5/29 0  =  =  =1 00 =0 =  10 =1 0  0  =  1  =0 10 ·· 0  00 =  10 1   166.25
17: Rodent 1.1 [1c]          11.0/29 =0 00 00 1  0  =  00 0  1  =  =0 =0 00 0  =  1  ·· =  1= 1  11  134.00
18: BugChess2 1.9 [4c]       10.5/29 0  01 0  0  =  00 00 =  00 00 =  =  1  01 =0 11 =  ·· 0  1= 1   130.25
19: Dirty 20Apr2013 [1c]     10.0/29 00 =  0= =0 =0 0  =  =  0  0  01 0= =1 0  =  =  0= 1  ·· 0  =1  135.50
20: Thinker 5.4d Active [4c] 6.0/30  0  0  0= 0= =0 00 0  00 00 0  0  0  =  == 00 01 0  0= 1  ·· =    78.50
21: NirvanaChess 1.2 [1c]    5.0/29  00 00 =  0  0  0  11 0  =  00 =0 0= 00 0  0  0  00 0  =0 =  ··   75.75

310 of 420 games played
Suggestions for engines to use in the next round are welcome - I'll drop the bottom 7-10 engines and replace them with new ones.
Thanks for running this, I've been keeping an eye on your tournaments (also the variants :)

Jerry
enhorning
Posts: 342
Joined: Wed Jan 05, 2011 10:05 pm

Re: Survival of the Fittest 2

Post by enhorning »

cetormenter wrote:Hmm Nirvana is having a really poor showing in this tournament. I hope this is only due to its poor time management and the fact that it does not understand incremental time controls.

Is there somewhere where I can download the pgn for this tournament?
I was going to wait until it was finished, but I've put up the partial pgn at https://www.dropbox.com/s/wtj90h6jle0vd ... al%202.pgn for now.

Remember that Nirvana is also only using 1 core... the majority of the engines can use and are using 4 cores.
cetormenter
Posts: 170
Joined: Sun Oct 28, 2012 9:46 pm

Re: Survival of the Fittest 2

Post by cetormenter »

enhorning wrote:I was going to wait until it was finished, but I've put up the partial pgn at https://www.dropbox.com/s/wtj90h6jle0vd ... al%202.pgn for now.

Remember that Nirvana is also only using 1 core... the majority of the engines can use and are using 4 cores.
Ah, sorry. Your other thread had links for every update. I thought I was missing something somewhere.

I understand that it is slightly handicapped in terms of hardware. I was comparing its performance to an equally strong opponent, iCE. They are within the error bars of each other for both 40/4 and 40/40 on CCRL.

Anyways, thank you very much for running this tournament. I have already been able to fix at least one bug because of the pgn you have provided.
enhorning
Posts: 342
Joined: Wed Jan 05, 2011 10:05 pm

Re: Survival of the Fittest 2

Post by enhorning »

cetormenter wrote:
enhorning wrote:I was going to wait until it was finished, but I've put up the partial pgn at https://www.dropbox.com/s/wtj90h6jle0vd ... al%202.pgn for now.
Your other thread had links for every update. I thought I was missing something somewhere.

I understand that it is slightly handicapped in terms of hardware. I was comparing its performance to an equally strong opponent, iCE. They are within the error bars of each other for both 40/4 and 40/40 on CCRL.
Just organizer laziness - I didn't know that anybody actually looked at the intermittent pgn updates - but it's easy enough to put them up.

Ice is performing surprisingly well. It's also out-performing Dirty, despite being rated below that on the rating lists, and it's managing wins (through king attacks in the games I've noticed) against some of the top programs, e.g. this short game against Toga II:
[pgn][Event "Survival 2"]
[Site "ENHORNING"]
[Date "2013.10.23"]
[Round "2"]
[White "Ice 1.0 v1619 [1c]"]
[Black "Toga II 3.0 [4c]"]
[Result "1-0"]
[BlackElo "2687"]
[ECO "B15"]
[Opening "Caro-Kann"]
[Time "19:45:49"]
[Variation "Tartakower, 6.c3"]
[WhiteElo "2410"]
[TimeControl "360+4"]
[Termination "normal"]
[PlyCount "77"]
[WhiteType "program"]
[BlackType "program"]

1. e4 c6 2. d4 d5 3. Nc3 dxe4 {-0.50/18 11} 4. Nxe4 {0.00/99 0} Nf6
{-0.52/18 22} 5. Nxf6+ {0.00/99 0} exf6 {-0.52/19 14} 6. c3 {0.00/99 0} Bd6
{-0.41/18 16} 7. Bd3 {+0.53/16 11} O-O {-0.35/18 9} 8. Ne2 {+0.73/16 11}
Qc7 {-0.31/19 15} 9. Qc2 {+1.07/16 11} g6 {-0.40/18 9} 10. h4 {+1.10/17 10}
Be6 {-0.45/18 12} 11. h5 {+1.20/17 9} f5 {-0.57/18 9} 12. Bg5 {+0.88/16 10}
Re8 {-0.54/17 20} 13. O-O-O {+0.89/15 10} Qa5 {-0.50/17 10} 14. a4
{+1.20/15 10} Qb6 {-0.44/18 12} 15. Qd2 {+0.78/15 10} Bb3 {-0.49/18 14} 16.
hxg6 {+0.69/16 11} fxg6 {-0.44/17 11} 17. Bc2 {+0.72/15 10} Nd7 {-0.39/17
10} 18. Qd3 {+0.99/15 14} a5 {-0.31/16 7} 19. g4 {+2.78/15 9} Be6 {-1.87/15
11} 20. Rxh7 {+4.50/15 9} Nf8 {-3.18/17 16} 21. Rh6 {+4.68/15 7} Qa6
{-3.51/16 15} 22. Qd2 {+5.42/15 8} Qc4 {-4.22/15 12} 23. Nf4 {+5.57/14 9}
Bd5 {-5.07/15 14} 24. gxf5 {+6.86/14 8} Re4 {-6.14/16 38} 25. b3 {+8.65/17
34} Qa6 {-6.46/16 6} 26. c4 {+8.26/14 8} Bb4 {-6.48/14 5} 27. Qd3
{+10.32/14 6} Ba3+ {-9.78/16 55} 28. Kb1 {+10.32/13 8} Nh7 {-10.85/14 9}
29. Qg3 {+16.97/14 30} Nf8 {-12.58/13 6} 30. Qh3 {+24.06/14 27} Kf7
{-33.90/17 72} 31. fxg6+ {+38.51/14 22} Ke8 {-34.35/15 5} 32. g7 {+38.51/13
7} Qb6 {-40.97/12 6} 33. cxd5 {+44.01/12 6} Qd8 {-38.53/11 4} 34. g8=Q
{+46.38/12 6} Qxg5 {-297.44/12 4} 35. Qxg5 {+M9/13 6} Re2 {-M5/13 3} 36.
Rh8 {+M4/9 0} Be7 {-M3/63 3} 37. Rxf8+ {+M3/5 0} Kxf8 {-M2/63 2} 38. Qh8+
{+M2/4 0} Kf7 {-M1/4 0} 39. Bg6# {+M1/3 0} 1-0[/pgn]
enhorning
Posts: 342
Joined: Wed Jan 05, 2011 10:05 pm

Re: Survival of the Fittest 2

Post by enhorning »

Final standings:

Code: Select all

    Engine                   Score   Qu Cr To Mi Sc Gl To Ex Bo Oc Te Mu Ga Ic Ne Bu Ch Di Ro Th Ni    S-B
01: Quazar 0.4 [1c]          27.0/40 ·· =1 =1 =1 1= 1= 01 =0 11 10 =1 11 01 == 00 10 =1 =1 11 1= 11  522.75
02: Crafty 23.6 [4c]         27.0/40 =0 ·· 1= == 11 =0 0= =0 1= =1 1= 11 01 10 =1 10 11 11 =1 11 11  499.75
03: Toga II 3.0 [4c]         25.5/40 =0 0= ·· 0= == =1 =1 1= 10 1= 1= 01 11 =0 11 11 =1 1= 11 1= =0  483.50
04: MinkoChess 1.3 [4c]      25.0/40 =0 == 1= ·· == 1= =0 11 == 1= 1= == == 11 10 11 =0 =1 01 1= 1=  483.00
05: Scorpio 2.7.6 [4c]       24.0/40 0= 00 == == ·· 11 1= 1= == =1 1= 0= 1= 01 == 11 =0 1= 01 11 =1  453.25
06: Glaurung 2.2 [4c]        24.0/40 0= =1 =0 0= 00 ·· =1 10 1= == 01 1= 10 =1 10 =1 11 =1 11 =1 1=  441.00
07: Tornado 4.88 [4c]        23.0/40 10 1= =0 =1 0= =0 ·· 00 11 == 01 =0 1= 1= 01 == 01 == 11 11 11  425.50
08: ExChess 7.18 [4c]        23.0/40 =1 =1 0= 00 0= 01 11 ·· 00 1= 00 01 11 01 01 10 =1 11 11 == 11  425.00
09: Booot 5.2.0 [1c]         23.0/40 00 0= 01 == == 0= 00 11 ·· 00 =1 =0 01 11 01 11 11 11 =1 1= 11  404.75
10: Octochess r5190 [4c]     22.5/40 01 =0 0= 0= =0 == == 0= 11 ·· == 10 01 11 =1 == == 1= =1 11 1=  413.00
11: Texel 1.02 [1c]          22.5/40 =0 0= 0= 0= 0= 10 10 11 =0 == ·· 00 1= 10 =1 11 =1 11 =1 11 1=  398.75
12: Murka 3 [1c]             22.0/40 00 00 10 == 1= 0= =1 10 =1 01 11 ·· =1 0= =0 11 =1 == 11 11 00  417.25
13: Gaviota 0.86 [4c]        20.0/40 10 10 00 == 0= 01 0= 00 10 10 0= =0 ·· 11 10 =1 11 10 =1 1= =1  362.50
14: Ice 1.0 v1619 [1c]       18.5/40 == 01 =1 00 10 =0 0= 10 00 00 01 1= 00 ·· 10 =1 01 == =1 11 1=  339.50
15: Nemo 1.0.1 beta [1c]     18.0/40 11 =0 00 01 == 01 10 10 10 =0 =0 =1 01 01 ·· 00 00 =0 11 =0 11  357.25
16: BugChess2 1.9 [4c]       15.5/40 01 01 00 00 00 =0 == 01 00 == 00 00 =0 =0 11 ·· 11 01 =0 1= 11  272.25
17: Cheng4 0.35a [4c]        15.0/40 =0 00 =0 =1 =1 00 10 =0 00 == =0 =0 00 10 11 00 ·· =0 01 10 11  280.25
18: Dirty 20Apr2013 [1c]     13.5/40 =0 00 0= =0 0= =0 == 00 00 0= 00 == 01 == =1 10 =1 ·· 0= 0= =1  247.00
19: Rodent 1.1 [1c]          12.0/40 00 =0 00 10 10 00 00 00 =0 =0 =0 00 =0 =0 00 =1 10 1= ·· 10 11  202.25
20: Thinker 5.4d Active [4c] 10.0/40 0= 00 0= 0= 00 =0 00 == 0= 00 00 00 0= 00 =1 0= 01 1= 01 ·· =0  181.75
21: NirvanaChess 1.2 [1c]    9.0/40  00 00 =1 0= =0 0= 00 00 00 0= 0= 11 =0 0= 00 00 00 =0 00 =1 ··  182.25

420 games played / Tournament is finished
Complete PGN file can be downloaded from: https://www.dropbox.com/s/wtj90h6jle0vd ... al%202.pgn

Just as last time, I will drop those engines that scored less than 50%, which means Gaviota once again barely survives, scoring exactly 50% twice in a row, whereas Ice 1.0, Nemo 1.0.1, BugChess2 1.9, Cheng4 0.35a, Dirty 20Apr2013, Rodent 1.1, Thinker 5.4d Active, and NirvanaChess 1.2 will not be returning for the next round.

Suggestions for engines to replace those are welcome, otherwise, I'll just go with my own selection.

Accumulated bayeselo ratings from my Survival tournaments:

Code: Select all

ResultSet-EloRating>ratings
Rank Name                          Elo    +    - games score oppo. draws
   1 Toga II 3.0 [4c]             2707   62   62    80   73%  2535   33%
   2 Quazar 0.4 [1c]              2689   63   63    80   69%  2536   28%
   3 Crafty 23.6 [4c]             2654   60   60    80   65%  2538   35%
   4 Scorpio 2.7.6 [4c]           2637   59   59    80   63%  2539   36%
   5 Glaurung 2.2 [4c]            2626   82   82    40   60%  2556   35%
   6 Octochess r5190 [4c]         2616   57   57    80   61%  2540   44%
   7 MinkoChess 1.3 [4c]          2616   57   57    80   60%  2540   45%
   8 Tornado 4.88 [4c]            2609   83   83    40   58%  2557   35%
   9 Booot 5.2.0 [1c]             2601   59   59    80   58%  2540   31%
  10 Murka 3 [1c]                 2597   59   59    80   58%  2541   35%
  11 ExChess 7.18 [4c]            2591   60   60    80   57%  2541   29%
  12 Texel 1.02 [1c]              2576   60   60    80   54%  2542   29%
  13 Nemo 1.0.1 beta [1c]         2554   61   61    80   51%  2543   30%
  14 Gaviota 0.86 [4c]            2536   61   61    80   50%  2544   30%
  15 Ice 1.0 v1619 [1c]           2533   84   84    40   46%  2561   28%
  16 BugChess2 1.9 [4c]           2511   60   60    80   46%  2545   26%
  17 Arasan 16.1 [4c]             2503   82   82    40   45%  2529   35%
  18 Fruit 2.3.1 [1c]             2498   82   82    40   46%  2529   38%
  19 Shredder Classic 4 [1c]      2485   82   82    40   44%  2530   38%
  20 Cheng4 0.35a [4c]            2477   87   87    40   38%  2563   25%
  21 Dirty 20Apr2013 [1c]         2459   82   82    40   34%  2564   43%
  22 Rodent 1.1 [1c]              2411   88   88    40   30%  2567   20%
  23 Thinker 5.4d Active [4c]     2385   88   88    40   25%  2568   30%
  24 Slow Chess Blitz WV2.1 [1c]  2384   89   89    40   30%  2535   25%
  25 Deuterium 13.1.31.113 [1c]   2371   86   86    40   28%  2535   30%
  26 Ruffian 1.05 [1c]            2368   87   87    40   26%  2535   33%
  27 NirvanaChess 1.2 [1c]        2360   91   91    40   23%  2569   25%
  28 Pro Deo 1.85 [1c]            2340   94   94    40   26%  2537   18%
  29 Jonny 4 [4c]                 2242  104  104    40   15%  2542   15%