Igorrit vs Rybka 3 noomen test suite 90+30

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Igorrit vs Rybka 3 noomen test suite 90+30

Post by yanquis1972 »

figured i'd try to keep a log here.

i have just aborted the match to try the new v7 build, but Iggy had taken his first lead in the match, +4 =3 -3 by winning a spanish that rybka only managed to draw. i have not observed the games and will gladly post as the match is ongoing/when its completed if there is interest. and i can figure out how to find them. :D

i got +80 elo in blitz in limited testing so i am curious how that changes at tournament TC. i do feel that the noomen test suite might inhibit Iggy a bit as it seemed to gain some slight advantages in the opening (i was using a heavily truncated book).
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Igorrit vs Rybka 3 noomen test suite 90+30

Post by yanquis1972 »

so far, just 3 more draws to report. i have decided to stick with v5fix of igorrit until a more advanced proven, stable version comes out. i hope to post the full games if i can figure out how. i think it might be enlightening to some.

i suppose it is rather pointless (to many) to say but unlike while watching the blitz games between the two, this does feel very much like watching two versions of the same engine play each other so far...(that i've hardly seen any of the games)
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Igorrit vs Rybka 3 noomen test suite 90+30

Post by yanquis1972 »

no fresh blood to report yet today, unfortunately.

+4 =7 -3 in favor of Igorrit.
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Igorrit vs Rybka 3 noomen test suite 90+30

Post by yanquis1972 »

Igorrit now +2 on the match after outplaying rybka in caro late middlegame
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Igorrit vs Rybka 3 noomen test suite 90+30

Post by beram »

yanquis1972 wrote:Igorrit now +2 on the match after outplaying rybka in caro late middlegame
I am running a testmatch Nunn2 (=50 games) at 25 min each on Centrino Dual Core T4300 at 2100 Mhz.
standings sofar: Igorrit 0.086v7 2CPU - Rybka 3 2CPU : +9 =9 -6

grts Bram, enjoy the revolution 8-)
User avatar
M ANSARI
Posts: 3707
Joined: Thu Mar 16, 2006 7:10 pm

Re: Igorrit vs Rybka 3 noomen test suite 90+30

Post by M ANSARI »

Are you guys testing with Rybka 3 with contempt 0? Otherwise all you are doing is seeing how contempt affects the game. Make sure in your testing that you use the core value of Rybka 3 which is contempt 0. Contempt 15 was done to take advantage of weaker engines ... I have tried matches between R3 contempt 0 and contempt 15 and contempt 15 makes the engine refuse draws in totally drawn positions and will make it try to win even though its analysis evaluation says it is drawn. This pollutes the results especially if you go back and analyse the games with R3 since analysis mode is contempt 0.
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Igorrit vs Rybka 3 noomen test suite 90+30

Post by beram »

I have tested Rybka against R..g3 with contempt = 0 and Rybka performed less. So my last tests are with contempt = 15, which is Rybkas standard value.
kingliveson

Re: Igorrit vs Rybka 3 noomen test suite 90+30

Post by kingliveson »

beram wrote:I have tested Rybka against R..g3 with contempt = 0 and Rybka performed less. So my last tests are with contempt = 15, which is Rybkas standard value.
The last tests I have done with contempt 0 result in more losses for Rybka so I just use default settings. I am open minded about this...I will try again.
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Igorrit vs Rybka 3 noomen test suite 90+30

Post by yanquis1972 »

i am using contempt 15, but this was actually mainly because a)it's default b)paul's testing (abbreviated unfortunately) of long TC matches b/w rybka & robbo suggested contempt 15 is fine. also in my own analysis i sometimes find that turning contempt up actually helps in terms of finding moves. i think it may hurt the accuracy of the evaluation more than the actual engine play.


Igorrit now +3 overall after picking up another victory overnight (discarding the loss on time by v7 when it thought it had a superior position; i believe i repeated that game with v5 and it was a draw)
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: Igorrit vs Rybka 3 noomen test suite 90+30

Post by yanquis1972 »

igorrit draws more blood. now +4 on the match...i think this game is especially interesting as while i have not looked at it closely rybka seemed to appropriately give herself a decent edge in the early middlegame, where black has much better pieces but at cost of a pawn. i am not sure how rybka lost this game. i hope M ANSARI or someone will take a look at it.


[Date "2010.01.14"]
[Round "10"]
[White "Igorrit version 0086v5 fix"]
[Black "Rybka 3"]
[Result "1-0"]
[ECO "B12"]
[Annotator "-0.04;-0.15"]
[PlyCount "115"]
[TimeControl "40/5400+30:0/0:900+30"]

1. e4 c6 2. d4 d5 3. e5 Bf5 4. Nc3 e6
5. g4 Bg6 6. Nge2 c5 7. Be3 Nc6 8. dxc5 h5 {Both last book move} 9. Nd4 {-0.04/
22 230} a6 {-0.15/18 255} 10. Nxc6 {-0.06/23 284} bxc6 {-0.15/16 0} 11. gxh5 {
(g5) -0.06/23 63} Bxh5 {-0.32/19 357} 12. Be2 {-0.09/23 62} Bxe2 {-0.26/19 159}
13. Nxe2 {(Qxe2) -0.12/24 206} Ne7 {-0.32/19 194} 14. Bd4 {-0.14/25 765} Qb8 {
-0.34/20 316} 15. Ng3 {(Qd2) -0.08/24 589} Ng6 {-0.41/19 141} 16. Qe2 {-0.07/
24 291} Nf4 {-0.25/19 212} 17. Qd2 {(Qf3) -0.07/24 75} Ng2+ {(Rh4) -0.38/18 115
} 18. Kd1 {-0.17/25 1437} Rh4 {-0.29/18 225} 19. c3 {-0.21/24 364} Qb5 {-0.38/
19 155} 20. Ne2 {-0.15/23 343} g6 {(Rb8) -0.32/19 306} 21. Kc2 {-0.13/23 78}
Bh6 {-0.24/19 228} 22. Qd1 {-0.08/23 68} Rb8 {(Nf4) -0.32/20 307} 23. b3 {-0.
01/23 172} a5 {(Nf4) -0.24/20 262} 24. Rb1 {0.00/25 132} a4 {-0.17/21 517} 25.
Qd3 {0.00/25 37} axb3+ {-0.17/21 207} 26. axb3 {0.06/24 53} Qb7 {(Qxd3+) -0.11/
21 200} 27. b4 {0.12/25 171} Nf4 {-0.08/20 218} 28. Nxf4 {0.16/24 113} Bxf4 {
0.00/21 163} 29. Ra1 {0.21/24 97} Qc7 {0.00/19 605} 30. Qe2 {(Rhe1) 0.22/23 48}
Rh5 {0.00/19 118} 31. Rhe1 {0.35/22 51} Kf8 {0.00/20 109} 32. Ra6 {(h3) 0.47/
22 90} Rc8 {(Kg7) 0.32/17 240} 33. Kb3 {0.94/23 141} Rf5 {(Kg7) 0.45/18 202}
34. Rea1 {0.86/26 164} Kg7 {(Qd8) 0.45/20 146} 35. h3 {(Ra7) 0.86/25 177} Qd8 {
0.45/19 96} 36. Ra7 {0.70/23 98} Qg5 {0.47/19 178} 37. Re1 {(Qg4) 1.04/22 62}
Qh4 {0.51/16 73} 38. Qd3 {0.99/20 12} Bg5 {(Qd8) 0.44/18 116} 39. Rg1 {0.94/23
63} Bf4 {(Bd8) 0.91/16 88} 40. Qa6 {1.31/22 62} Qd8 {1.05/17 71} 41. Qb7 {1.47/
19 1} Qg8 {(Qe8) 1.25/18 181} 42. Qd7 {1.87/22 41} Kh6 {1.29/18 216} 43. Re1 {
1.93/23 91} Qh8 {1.29/18 183} 44. Ra6 {2.05/23 102} Kg7 {1.38/18 125} 45. Rxc6
{2.05/22 16} Rd8 {1.18/18 109} 46. Qb7 {(Qc7) 1.77/23 415} Rb8 {1.38/17 30} 47.
Qa6 {(Qc7) 2.98/21 223} Qxh3 {1.34/14 35} 48. Rxe6 {3.40/18 38} fxe6 {2.75/15
72} 49. Qa7+ {3.40/17 0} Rf7 {2.74/16 53} 50. Qxb8 {3.49/20 44} Qf3 {(Qd3) 2.
74/15 64} 51. c6 {4.03/18 30} Qd3 {3.13/15 54} 52. Qb6 {4.03/17 0} Qc4+ {3.52/
14 47} 53. Kb2 {4.38/19 43} Qd3 {(g5) 3.81/15 42} 54. Ra1 {4.50/18 10} Bg5 {
(Re7) 3.88/15 38} 55. c7 {(Kb3) 6.15/21 131} Qe2+ {3.55/13 36} 56. Ka3 {6.15/
20 0} Qc4 {3.55/12 34} 57. f4 {(Qxe6) 6.15/22 19} Rxc7 {5.11/14 31} 58. fxg5 {
adjud. 6.15/20 0} 1-0