Houdini 1.5 v Rybka 4 at long time control

PawnStormZ · Post by **PawnStormZ** » Sat Mar 26, 2011 5:53 pm

Game 212** - Draw **adjusted to remove 12 games = 200

[Event "adjustments"]
[Site "ChessPalace"]
[Date "2011.03.25"]
[Round "106.2"]
[White "Houdini_1.5"]
[Black "Rybka_4"]
[Result "1/2-1/2"]
[Time "4:11:50 PM"]
[TimeControl "40/7200:20/3600:1800+10"]
[PlyCount "181"]
[Number "212"]
[Termination "GUI adjudication"]
[WhiteType "program"]
[BlackType "program"]
[Variant "normal"]
[SetUp "1"]
[FEN "r4rk1/ppq2ppp/2nbpn2/1B1p1b2/1B1P4/1Q2PN2/PP3PPP/RN3RK1 w - - 0 1"]

[d] r4rk1/ppq2ppp/2nbpn2/1B1p1b2/1B1P4/1Q2PN2/PP3PPP/RN3RK1 w - - 0 1
{ I7 920 x64 }
1.Bxd6 {[%eval 7,27] [%emt 00:03:18] [%clk 1:56:41]} Qxd6 {[%eval 4,19] [%emt 00:00:37] [%clk 1:59:22]}
2.Bxc6 {[%eval 7,27] [%emt 00:02:26] [%clk 1:54:14]} bxc6 {[%eval 4,24] [%emt 00:03:56] [%clk 1:55:25]}
3.Qa3 {[%eval 9,28] [%emt 00:03:49] [%clk 1:50:25]} Qxa3 {[%eval 5,23] [%emt 00:02:52] [%clk 1:52:33]}
4.Nxa3 {[%eval 9,28] [%emt 00:02:40] [%clk 1:47:44]} Nd7 {[%eval 5,22] [%emt 00:04:40] [%clk 1:47:52]}
5.Rfc1 {[%eval 9,29] [%emt 00:03:29] [%clk 1:44:15]} Rab8 {[%eval 6,23] [%emt 00:01:55] [%clk 1:45:57]}
6.b3 {[%eval 9,28] [%emt 00:03:19] [%clk 1:40:55]} Rfc8 {[%eval 8,23] [%emt 00:26:29] [%clk 1:19:28]}
7.Rc3 {[%eval 8,27] [%emt 00:03:48] [%clk 1:37:06]} h5 {[%eval 6,20] [%emt 00:01:28] [%clk 1:17:59]}
8.Rac1 {[%eval 10,26] [%emt 00:03:23] [%clk 1:33:43]} Rb6 {[%eval 7,20] [%emt 00:00:45] [%clk 1:17:14]}
9.Nc2 {[%eval 9,25] [%emt 00:02:13] [%clk 1:31:29]} a5 {[%eval 6,20] [%emt 00:01:21] [%clk 1:15:52]}
10.Kf1 {[%eval 5,25] [%emt 00:05:36] [%clk 1:25:52]} Kf8 {[%eval 0,21] [%emt 00:02:17] [%clk 1:13:35]}
11.a4 {[%eval 2,24] [%emt 00:02:25] [%clk 1:23:26]} Bxc2 {[%eval -1,22] [%emt 00:04:03] [%clk 1:09:31]}
12.R1xc2 {[%eval 5,25] [%emt 00:02:21] [%clk 1:21:05]} Ke7 {[%eval -2,21] [%emt 00:01:21] [%clk 1:08:10]}
13.Ne1 {[%eval 1,25] [%emt 00:02:56] [%clk 1:18:09]} e5 {[%eval -1,22] [%emt 00:03:17] [%clk 1:04:53]}
14.dxe5 {[%eval -2,25] [%emt 00:02:12] [%clk 1:15:57]} Nxe5 {[%eval -1,21] [%emt 00:01:10] [%clk 1:03:43]}
15.Ke2 {[%eval -5,27] [%emt 00:02:47] [%clk 1:13:10]} g6 {[%eval -3,21] [%emt 00:02:05] [%clk 1:01:37]}
16.Rc1 {[%eval -5,26] [%emt 00:03:13] [%clk 1:09:56]} Nd7 {[%eval -4,21] [%emt 00:02:43] [%clk 0:58:53]}
17.h3 {[%eval -4,25] [%emt 00:02:34] [%clk 1:07:21]} Kd6 {[%eval -1,21] [%emt 00:01:51] [%clk 0:57:01]}
18.Nf3 {[%eval 0,27] [%emt 00:02:54] [%clk 1:04:27]} Rb4 {[%eval 0,22] [%emt 00:01:01] [%clk 0:55:59]}
19.Nd4 {[%eval -1,25] [%emt 00:02:12] [%clk 1:02:14]} c5 {[%eval 0,22] [%emt 00:00:17] [%clk 0:55:42]}
20.Nc2 {[%eval -2,25] [%emt 00:02:15] [%clk 0:59:58]} Re4 {[%eval 0,22] [%emt 00:01:29] [%clk 0:54:13]}
21.Nd4 {[%eval 11,26] [%emt 00:02:58] [%clk 0:57:00]} Rf8 {[%eval 0,22] [%emt 00:02:08] [%clk 0:52:04]}
22.Nb5+ {[%eval 16,26] [%emt 00:02:39] [%clk 0:54:20]} Kc6 {[%eval 0,22] [%emt 00:00:37] [%clk 0:51:26]}
23.Rd3 {[%eval 16,25] [%emt 00:02:24] [%clk 0:51:56]} Rb4 {[%eval 0,24] [%emt 00:03:22] [%clk 0:48:04]}
24.Nd4+ {[%eval 14,25] [%emt 00:04:20] [%clk 0:47:35]} Kd6 {[%eval 0,25] [%emt 00:00:46] [%clk 0:47:18]}
25.Nc2 {[%eval 13,27] [%emt 00:02:23] [%clk 0:45:12]} Rb6 {[%eval 0,22] [%emt 00:02:17] [%clk 0:45:00]}
26.Na3 {[%eval 20,27] [%emt 00:03:30] [%clk 0:41:42]} Ke6 {[%eval 5,22] [%emt 00:04:13] [%clk 0:40:47]}
27.Nb5 {[%eval 18,24] [%emt 00:02:16] [%clk 0:39:26]} Rc8 {[%eval 6,21] [%emt 00:01:22] [%clk 0:39:24]}
28.f3 {[%eval 17,25] [%emt 00:03:41] [%clk 0:35:45]} Rbb8 {[%eval 1,22] [%emt 00:04:43] [%clk 0:34:40]}
29.Rdc3 {[%eval 17,25] [%emt 00:02:26] [%clk 0:33:19]} Rg8 {[%eval 0,21] [%emt 00:02:00] [%clk 0:32:40]}
30.g3 {[%eval 16,23] [%emt 00:03:26] [%clk 0:29:52]} f5 {[%eval 0,23] [%emt 00:02:12] [%clk 0:30:28]}
31.h4 {[%eval 13,24] [%emt 00:02:30] [%clk 0:27:21]} Rgd8 {[%eval 0,25] [%emt 00:03:25] [%clk 0:27:02]}
32.Kf1 {[%eval 13,25] [%emt 00:03:55] [%clk 0:23:26]} Rb6 {[%eval 0,23] [%emt 00:02:15] [%clk 0:24:46]}
33.Rd1 {[%eval 19,27] [%emt 00:02:22] [%clk 0:21:04]} Rb7 {[%eval 0,25] [%emt 00:05:21] [%clk 0:19:25]}
34.Kg1 {[%eval 19,27] [%emt 00:02:32] [%clk 0:18:31]} Re8 {[%eval 0,25] [%emt 00:03:08] [%clk 0:16:17]}
35.Kh1 {[%eval 19,28] [%emt 00:02:39] [%clk 0:15:51]} Ke5 {[%eval 0,24] [%emt 00:02:09] [%clk 0:14:07]}
36.Kg2 {[%eval 19,28] [%emt 00:03:49] [%clk 0:12:02]} Rd8 {[%eval 1,24] [%emt 00:03:41] [%clk 0:10:26]}
37.Rc2 {[%eval 19,25] [%emt 00:04:23] [%clk 0:07:38]} Rdb8 {[%eval 1,23] [%emt 00:01:07] [%clk 0:09:19]}
38.Rcc1 {[%eval 19,25] [%emt 00:01:55] [%clk 0:05:43]} Re8 {[%eval 1,24] [%emt 00:01:40] [%clk 0:07:38]}
39.Rd2 {[%eval 19,26] [%emt 00:02:10] [%clk 0:03:33]} Reb8 {[%eval 1,24] [%emt 00:02:25] [%clk 0:05:12]}
40.Kf1 {[%eval 14,25] [%emt 00:03:32] [%clk 0:00:00]} Rc8 {[%eval 0,24] [%emt 00:01:56] [%clk 0:03:16]}
41.Rdc2 {[%eval 15,25] [%emt 00:02:18] [%clk 0:57:41]} Rbb8 {[%eval 0,26] [%emt 00:02:49] [%clk 1:00:27]}
42.Kg2 {[%eval 15,25] [%emt 00:03:50] [%clk 0:53:51]} Ke6 {[%eval 0,26] [%emt 00:02:39] [%clk 0:57:47]}
43.Rc3 {[%eval 14,25] [%emt 00:02:37] [%clk 0:51:13]} Rd8 {[%eval 0,25] [%emt 00:03:49] [%clk 0:53:57]}
44.R1c2 {[%eval 15,26] [%emt 00:02:37] [%clk 0:48:36]} Rb7 {[%eval 0,24] [%emt 00:02:58] [%clk 0:50:59]}
45.Rd2 {[%eval 15,26] [%emt 00:02:31] [%clk 0:46:04]} Rdb8 {[%eval 0,26] [%emt 00:02:21] [%clk 0:48:37]}
46.Rd1 {[%eval 15,26] [%emt 00:03:22] [%clk 0:42:42]} Ke5 {[%eval 0,26] [%emt 00:02:53] [%clk 0:45:43]}
47.Re1 {[%eval 15,26] [%emt 00:02:44] [%clk 0:39:57]} Re8 {[%eval 0,25] [%emt 00:02:36] [%clk 0:43:07]}
48.Rc2 {[%eval 15,27] [%emt 00:03:46] [%clk 0:36:11]} Ke6 {[%eval 0,25] [%emt 00:02:39] [%clk 0:40:27]}
49.Rec1 {[%eval 15,26] [%emt 00:03:26] [%clk 0:32:44]} Rc8 {[%eval 0,26] [%emt 00:03:46] [%clk 0:36:40]}
50.Rc3 {[%eval 15,26] [%emt 00:03:04] [%clk 0:29:39]} Rd8 {[%eval 0,26] [%emt 00:03:33] [%clk 0:33:07]}
51.Rd3 {[%eval 15,26] [%emt 00:02:20] [%clk 0:27:19]} Rdb8 {[%eval 0,24] [%emt 00:05:43] [%clk 0:27:24]}
52.Rdd1 {[%eval 15,27] [%emt 00:02:23] [%clk 0:24:55]} Ke5 {[%eval 0,24] [%emt 00:02:16] [%clk 0:25:07]}
53.Rc2 {[%eval 15,26] [%emt 00:02:59] [%clk 0:21:56]} Ke6 {[%eval 0,26] [%emt 00:03:15] [%clk 0:21:52]}
54.Rd3 {[%eval 15,26] [%emt 00:02:37] [%clk 0:19:19]} Rd8 {[%eval 0,26] [%emt 00:03:24] [%clk 0:18:27]}
55.Rdd2 {[%eval 15,28] [%emt 00:03:19] [%clk 0:15:59]} Rdb8 {[%eval 0,24] [%emt 00:03:43] [%clk 0:14:44]}
56.Rc3 {[%eval 10,27] [%emt 00:07:56] [%clk 0:08:02]} Re8 {[%eval 0,24] [%emt 00:02:17] [%clk 0:12:26]}
57.Rd1 {[%eval 15,27] [%emt 00:01:54] [%clk 0:06:08]} Ke5 {[%eval 0,26] [%emt 00:02:31] [%clk 0:09:54]}
58.Kf2 {[%eval 15,26] [%emt 00:01:36] [%clk 0:04:31]} Rc8 {[%eval 0,25] [%emt 00:02:20] [%clk 0:07:33]}
59.Rdc1 {[%eval 15,26] [%emt 00:02:13] [%clk 0:02:18]} Ke6 {[%eval 0,25] [%emt 00:02:06] [%clk 0:05:27]}
60.Ke2 {[%eval 15,25] [%emt 00:02:18] [%clk 0:00:00]} Ke5 {[%eval 0,25] [%emt 00:02:13] [%clk 0:03:14]}
61.R1c2 {[%eval 15,24] [%emt 00:00:30] [%clk 0:29:30]} Rbb8 {[%eval 0,25] [%emt 00:01:36] [%clk 0:31:38]}
62.Kf2 {[%eval 14,23] [%emt 00:00:36] [%clk 0:29:04]} Rb7 {[%eval 0,23] [%emt 00:01:15] [%clk 0:30:32]}
63.Kg2 {[%eval 13,23] [%emt 00:00:36] [%clk 0:28:37]} Rb6 {[%eval 0,23] [%emt 00:00:55] [%clk 0:29:46]}
64.Rc1 {[%eval 13,22] [%emt 00:00:35] [%clk 0:28:12]} Rb7 {[%eval 0,23] [%emt 00:01:00] [%clk 0:28:56]}
65.Kg1 {[%eval 13,23] [%emt 00:00:26] [%clk 0:27:56]} Rb6 {[%eval 0,24] [%emt 00:01:01] [%clk 0:28:05]}
66.Kf2 {[%eval 13,23] [%emt 00:00:26] [%clk 0:27:39]} Rb7 {[%eval 0,25] [%emt 00:00:56] [%clk 0:27:18]}
67.R3c2 {[%eval 13,23] [%emt 00:00:25] [%clk 0:27:23]} Rbb8 {[%eval 0,25] [%emt 00:01:31] [%clk 0:25:57]}
68.Kg1 {[%eval 13,23] [%emt 00:00:26] [%clk 0:27:07]} Rb7 {[%eval 0,23] [%emt 00:01:16] [%clk 0:24:50]}
69.Kh1 {[%eval 12,23] [%emt 00:00:37] [%clk 0:26:39]} Rc6 {[%eval 0,23] [%emt 00:00:51] [%clk 0:24:09]}
70.Kg2 {[%eval 10,22] [%emt 00:00:24] [%clk 0:26:25]} Rc8 {[%eval 0,26] [%emt 00:01:17] [%clk 0:23:01]}
71.Kh3 {[%eval 9,22] [%emt 00:00:40] [%clk 0:25:54]} Rd8 {[%eval 0,24] [%emt 00:01:39] [%clk 0:21:32]}
72.Rd2 {[%eval 11,23] [%emt 00:00:23] [%clk 0:25:41]} Ke6 {[%eval 0,23] [%emt 00:00:47] [%clk 0:20:54]}
73.Kg2 {[%eval 10,22] [%emt 00:00:31] [%clk 0:25:19]} Ke5 {[%eval 0,23] [%emt 00:00:25] [%clk 0:20:38]}
74.Rc3 {[%eval 7,22] [%emt 00:00:27] [%clk 0:25:01]} Rg8 {[%eval 0,25] [%emt 00:01:04] [%clk 0:19:43]}
75.Rcc2 {[%eval 6,23] [%emt 00:00:33] [%clk 0:24:37]} Rgb8 {[%eval 0,25] [%emt 00:01:08] [%clk 0:18:45]}
76.Kg1 {[%eval 5,22] [%emt 00:00:22] [%clk 0:24:25]} Rh8 {[%eval 0,23] [%emt 00:00:39] [%clk 0:18:16]}
77.Kh2 {[%eval 5,23] [%emt 00:00:21] [%clk 0:24:13]} Rh7 {[%eval 0,23] [%emt 00:00:50] [%clk 0:17:35]}
78.Rd1 {[%eval 2,24] [%emt 00:00:31] [%clk 0:23:52]} Ke6 {[%eval 0,24] [%emt 00:00:33] [%clk 0:17:12]}
79.Rcd2 {[%eval 2,24] [%emt 00:00:22] [%clk 0:23:39]} Nf6 {[%eval 0,25] [%emt 00:00:50] [%clk 0:16:32]}
80.Rc1 {[%eval 2,25] [%emt 00:00:21] [%clk 0:23:28]} Nd7 {[%eval 0,24] [%emt 00:00:05] [%clk 0:16:36]}
81.f4 {[%eval 1,26] [%emt 00:00:22] [%clk 0:23:15]} Rg7 {[%eval 0,24] [%emt 00:00:32] [%clk 0:16:14]}
82.Kh1 {[%eval 1,25] [%emt 00:00:20] [%clk 0:23:04]} Rf7 {[%eval 0,25] [%emt 00:00:53] [%clk 0:15:31]}
83.Kg2 {[%eval 1,25] [%emt 00:00:20] [%clk 0:22:53]} Re7 {[%eval 0,25] [%emt 00:00:51] [%clk 0:14:50]}
84.Rdc2 {[%eval 1,24] [%emt 00:00:20] [%clk 0:22:43]} Rb6 {[%eval 0,24] [%emt 00:00:39] [%clk 0:14:20]}
85.Rc3 {[%eval 1,24] [%emt 00:00:30] [%clk 0:22:22]} Rb8 {[%eval 0,24] [%emt 00:00:38] [%clk 0:13:52]}
86.Kf1 {[%eval 1,24] [%emt 00:00:22] [%clk 0:22:10]} Rc8 {[%eval 0,23] [%emt 00:00:27] [%clk 0:13:35]}
87.R1c2 {[%eval 1,25] [%emt 00:00:27] [%clk 0:21:52]} Kf6 {[%eval 0,23] [%emt 00:00:24] [%clk 0:13:20]}
88.Kg2 {[%eval 1,25] [%emt 00:00:26] [%clk 0:21:35]} Kg7 {[%eval 0,24] [%emt 00:00:42] [%clk 0:12:48]}
89.Nd6 {[%eval 1,27] [%emt 00:00:23] [%clk 0:21:21]} Rc7 {[%eval 0,24] [%emt 00:00:22] [%clk 0:12:36]}
90.Kf3 {[%eval 1,27] [%emt 00:00:24] [%clk 0:21:07]} Re6 {[%eval 0,24] [%emt 00:00:19] [%clk 0:12:27]}
91.Nb5 {[%eval 1,25] [%emt 00:00:00] [%clk 0:21:17]}
1/2-1/2

PawnStormZ · Post by **PawnStormZ** » Sat Mar 26, 2011 6:46 pm

Standings after game 200 **

Houdini_1.5 121.5 + 59 = 125 - 16
Rybka_4 78.5 + 16 = 125 - 59

**Results adjusted from 212 completed games to remove 6 wins each due to unfair starting positions.

Original 200 game PGN file - http://www.datafilehost.com/download-79c32e1d.html

**Adjusted 200 game PGN file - http://www.datafilehost.com/download-4fe5fb72.html

Uri Blass · Post by **Uri Blass** » Mon Mar 28, 2011 9:58 am

thanks for the results.
I think that it may more interesting to do a match between Houdini1.5 1 cpu and Rybka4 4 cpu from the same positions.

We have no significant difference between the rating of them based on the CCRL list

http://www.computerchess.org.uk/ccrl/40 ... t_all.html

http://www.computerchess.org.uk/ccrl/40 ... t_all.html

Laskos · Post by **Laskos** » Mon Mar 28, 2011 11:30 am

PawnStormZ wrote:Standings after game 200 **

Houdini_1.5 121.5 + 59 = 125 - 16
Rybka_4 78.5 + 16 = 125 - 59

**Results adjusted from 212 completed games to remove 6 wins each due to unfair starting positions.

Original 200 game PGN file - http://www.datafilehost.com/download-79c32e1d.html

**Adjusted 200 game PGN file - http://www.datafilehost.com/download-4fe5fb72.html

Thanks Pal.

+76 Elo points for Houdini.
Draw ratio = 62.5%
Win/Loss ratio = 3.7 for Houdini.

Standard Deviation = 14 Elo points
76 +/- 14 Elo points for Houdini 68% confidence, 76 +/- 28 Elo points 95% confidence.

Impressive results, and one of the best, if not THE best LTC test on strong hardware with top engines.

Kai

gerold · Post by **gerold** » Mon Mar 28, 2011 4:00 pm

PawnStormZ wrote:Standings after game 200 **

Houdini_1.5 121.5 + 59 = 125 - 16
Rybka_4 78.5 + 16 = 125 - 59

**Results adjusted from 212 completed games to remove 6 wins each due to unfair starting positions.

Original 200 game PGN file - http://www.datafilehost.com/download-79c32e1d.html

**Adjusted 200 game PGN file - http://www.datafilehost.com/download-4fe5fb72.html

Thanks for your testing and games Pal.

Best,
Gerold.

Matthias Gemuh · Post by **Matthias Gemuh** » Mon Mar 28, 2011 7:00 pm

Uri Blass wrote:thanks for the results.
I think that it may more interesting to do a match between Houdini1.5 1 cpu and Rybka4 4 cpu from the same positions.

We have no significant difference between the rating of them based on the CCRL list

http://www.computerchess.org.uk/ccrl/40 ... t_all.html

http://www.computerchess.org.uk/ccrl/40 ... t_all.html

Uri, you are very scientific.
I would have said "Houdini1.5 1 cpu and Rybka4.1 4 cpu from the same positions".

Matthias.

ernest · Post by **ernest** » Fri Apr 15, 2011 4:13 am

paulo wrote:DR4.1 might be slightly better than DR4 but Houdini is so superior

Are you watching the current TCEC match?

ernest · Post by **ernest** » Fri Apr 15, 2011 4:18 am

PawnStormZ wrote: I was actually thinking about another tourney, but not just Houdini v Rybka.

Well Pal, in view of what's happening in the current TCEC match (but only 11 games out of 40 have been played), maybe you will reconsider...

M ANSARI · Post by **M ANSARI** » Fri Apr 15, 2011 8:15 am

Rybka 4 has a serious stall bug which would make games that reach to depth 13 or higher play poor moves. The hash gets corrupted and the search will get stuck and produce moves that are at very low depth even though a lot of time was spent on search. So you could reach a point where the engine is spending the time of a depth 22 move and when it does finally move it will play a move from it's depth 13 hash. Rybka 4.1 has improved that, and while I am not totally confident that it does not stall ... the stalls seem to be at much higher depth (17 or higher). I think a big change other than fixing the stall bug, is that the time wasted during the stalls is now actually utilized for search. Also it does seem that there is no more corruption of hash, and Rybka 4.1 no longer plays one move game losing blunders.

PawnStormZ · Post by **PawnStormZ** » Sat Apr 16, 2011 6:46 am

Hi Ernest.

I am quite surprised by the TCEC results, both in the A-div and this one-on-one. Maybe another match with the new Rybka v Houdini is worthwhile.

Anyone have thoughts on why this has happened? Is it the openings, or is there really such an improvement in strength when the author said that there would not be? I understand what M Ansari is saying about the "stall-bug", but then why did Vas say that there would not be much of an improvement after fixing it?

I will not start another match while Martin's is still running, but if people are interested, I will consider another long match. Any recommendations for a good (fair and even) but short opening book would be welcome.

Take care