TCEC 10

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: TCEC 10

Post by kranium »

sovaz1997 wrote:There is not much difference in statistics between Houdini and Komodo: http://www.sp-cc.de/long-thinkingtime.htm:

Houdini-Komodo: 741 (+118,=529,- 94)
Seems very likely Houdini is stronger...

games = 741
win% = 0.516194
elo = +11.2569
los = 0.945045
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: TCEC 10

Post by kranium »

Guenther wrote:
There is no statistical evidence that Houdini or Komodo is better.
No one so far produced a significant amount of games that would proof one of them being better.
You don't need a large # of games if the margin of victory is big enough...

http://www.computerchess.org.uk/ccrl/40 ... 4-bit_4CPU

Houdini 6 vs Komodo 11.2
(+10−1=46)

games = 57
win% = 0.578947
elo = +55.3211
los = 0.994617
User avatar
Guenther
Posts: 4606
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: TCEC 10

Post by Guenther »

kranium wrote:
Guenther wrote:
There is no statistical evidence that Houdini or Komodo is better.
No one so far produced a significant amount of games that would proof one of them being better.
You don't need a large # of games if the margin of victory is big enough...

http://www.computerchess.org.uk/ccrl/40 ... 4-bit_4CPU

Houdini 6 vs Komodo 11.2
(+10−1=46)

games = 57
win% = 0.578947
elo = +55.3211
los = 0.994617
This is cherry picking a 57 games interim match result.
Why not posting the full results table with other games included?

Code: Select all

2       Houdini 6 64-bit 4CPU   3412    +22     -22     69.7%   -128.3  54.5%   664
3       Komodo 11.2 64-bit 4CPU 3398    +19     -19     67.4%   -113.9  53.8%   864
Nothing to conclude with that error bars - we still know nothing and
this is just for 4 cpus and not TCEC hardware...
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: TCEC 10

Post by kranium »

Guenther wrote:
kranium wrote:
Guenther wrote:
There is no statistical evidence that Houdini or Komodo is better.
No one so far produced a significant amount of games that would proof one of them being better.
You don't need a large # of games if the margin of victory is big enough...

http://www.computerchess.org.uk/ccrl/40 ... 4-bit_4CPU

Houdini 6 vs Komodo 11.2
(+10−1=46)

games = 57
win% = 0.578947
elo = +55.3211
los = 0.994617
This is cherry picking a 57 games interim match result.
Why not posting the full results table with other games included?

Code: Select all

2       Houdini 6 64-bit 4CPU   3412    +22     -22     69.7%   -128.3  54.5%   664
3       Komodo 11.2 64-bit 4CPU 3398    +19     -19     67.4%   -113.9  53.8%   864
Nothing to conclude with that error bars - we still know nothing and
this is just for 4 cpus and not TCEC hardware...

The point was LOS calculation, which can be applied to 2 engines only
Weren't you talking about Houdini vs Komodo, like now in TCEC...?

If so, there's plenty of data like the 2 examples I posted above.

http://www.cegt.net/40_40%20Rating%20Li ... ion/8.html

Houdini 6.0 x64 1CPU -3360 vs Komodo 11.2 x64 1CPU - 3332

+ 22 = 66 - 12

games = 100
win% = 0.55
elo = +34.8601
los = 0.950873
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: TCEC 10

Post by corres »

[quote="Guenther"]

There is no statistical evidence that Houdini or Komodo is better.
No one so far produced a significant amount of games that would proof one of them being better.

[/quote]

You are right.
But the one question is "What is the better engine?" and the other question is
"What engine may be the winner of TCEC?"
To give the right answer to the question one we would get lot of thousand games.
To give the right answer to the second question we have enough games yet.
In my opinion there is a small difference between Houidini and Kimodo in Elo number but the advantage is in the side of Houdini.
User avatar
AdminX
Posts: 6340
Joined: Mon Mar 13, 2006 2:34 pm
Location: Acworth, GA

Re: TCEC 10

Post by AdminX »

Congratulations Robert on winning the TCEC Season 10.
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
Scacchista1977
Posts: 49
Joined: Thu Nov 10, 2016 11:40 am
Location: Italy
Full name: Aleandro Rossi

Re: TCEC 10

Post by Scacchista1977 »

Meanwhile, Houdini is winning with black ...
User avatar
AdminX
Posts: 6340
Joined: Mon Mar 13, 2006 2:34 pm
Location: Acworth, GA

Re: TCEC 10

Post by AdminX »

Image
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
Geonerd
Posts: 79
Joined: Fri Mar 10, 2017 1:44 am

Re: TCEC 10

Post by Geonerd »

AdminX wrote:Congratulations Robert on winning the TCEC Season 10.
Indeed!
User avatar
Leto
Posts: 2071
Joined: Thu May 04, 2006 3:40 am
Location: Dune

Re: TCEC 10

Post by Leto »

Congrats Robert on winning TCEC 10. You should issue a challenge to Google's Deepmind's AlphaZero.