3 Champs

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Hugo
Posts: 782
Joined: Tue Dec 01, 2009 11:10 am

Re: 3 Champs

Post by Hugo »

ReplayZone added, full PGN at the end of the page.

http://www.clemens-keck.de/3Champs/3champs.htm

Updates 1x a day

regards, Clemens
Lyudmil Tsvetkov
Posts: 6052
Joined: Tue Jun 12, 2012 12:41 pm

Re: 3 Champs

Post by Lyudmil Tsvetkov »

I think this is the real Yokohama.

Undoubtedly the strongest tournament in computer chess ever, considerably stronger than the Houdini-Cluster Rybka match.

Game 6 is a foretaste of how I see computer chess in 10 years' time.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: 3 Champs

Post by zullil »

Hugo wrote:I am playing a small tournament. Only 3 participants

Houdini 3 pro, spilt depth 12


Engines: 64 bit, 8 cpu, 2048Mb hashtables, ponder ON, no tablebases at all, no large pages

Clemens K
Is split depth=12 really best for Houdini running 8 threads? It seems rather high to me, based on testing with Stockfish and Critter.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: 3 Champs

Post by mwyoung »

lkaufman wrote:
mwyoung wrote:
I will predict Stockfish 180813 will win this tournament, my early testing suggest at faster time controls. Stockfish 180813 has surpassed Houdini 3, and Houdini 3 may no longer be the strongest chess engine. I doubt a longer time control on much faster hardware will change the results, going by past Stockfish testing.

It will be interesting to watch...
At what level "faster time controls" and with how many cores did you test? Have you run a significant number of games? At bullet speeds, the latest SF still lags behind Komodo 5.1r2 by about ten elo based on 2k games, and of course in bullet chess Komodo is no match for Houdini 3. Since both Komodo and SF gain on Houdini with increased depth, this should be a pretty close contest.
I played 40 games of 40/3mins. In a head to head match Houdini 3 Vs. Stockfish 180813. Stockfish won by 62.5%

Stockfish has only been out for a short time, but I ran this test to see if this version was worth further testing. With that score, and a LOS of almost 95%. It is worth testing further, as either Stockfish was very lucky, or it is better. The results could be wrong as you know in this kind of quick test, but the odds are it is ok to make my prediction with this little evidence, since Stockfish in the past plays even better with more time.

That is why I used the word suggest, as this is only my prediction and why. I don't have a LOS of 100%, but unlike past stockfish versions, it will not take a huge number of games to show superiority with a win % close to 60. If it can maintain that kind of edge in further testing. I will know more in a few days, doing a ratings test now with all top programs at 40/10mins.

I ran my quick test on a i7 CPU, with 4 cores, ponder off, 512 mb hash. Same opening book of GM games to 6 moves. Each program plays the opening with both colors.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
Hugo
Posts: 782
Joined: Tue Dec 01, 2009 11:10 am

Re: 3 Champs

Post by Hugo »

zullil wrote:
Hugo wrote:I am playing a small tournament. Only 3 participants

Houdini 3 pro, spilt depth 12


Engines: 64 bit, 8 cpu, 2048Mb hashtables, ponder ON, no tablebases at all, no large pages

Clemens K
Is split depth=12 really best for Houdini running 8 threads? It seems rather high to me, based on testing with Stockfish and Critter.
in autotune SD 10 was 16624kNs and Sd 12 was 16738kNs so I decided to use SD12

regards, Clemens
Vinvin
Posts: 5312
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: 3 Champs

Post by Vinvin »

Things become more regular ...

1 Stockfish 180813 64 SSE4.2 x8 : 7.0 / 12
2 Houdini 3 Pro x64 sd12x8 : 5.5 / 12
3 Komodo 1036.03 64-bit x8 : 5.5 / 12
Vinvin
Posts: 5312
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: 3 Champs

Post by Vinvin »

More and more regular :-)

Code: Select all

1 	Houdini 3 Pro x64 sd12x8          11.0 / 20 	 
2 	Stockfish 180813 64 SSE4.2 x8     10.5 / 20 	 
3 	Komodo 1036.03 64-bit x8	        8.5 / 20 	 
Vinvin
Posts: 5312
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: 3 Champs

Post by Vinvin »

After 26th round, balanced ...

Code: Select all

1 	Houdini 3 Pro x64 sd12x8	     13.5 / 26 	 
2 	Komodo 1036.03 64-bit x8	     13.0 / 26 	 
3 	Stockfish 180813 64 SSE4.2 x8	12.5 / 26 	 
Hugo
Posts: 782
Joined: Tue Dec 01, 2009 11:10 am

Re: 3 Champs

Post by Hugo »

Hi All

half of the tournament is done now.
Image
Stockfish is a little behind Houdini and Komodo, but there are still a lot of games to play.
Good luck to the 3 Champs for the next half of the tour! :-)

regards, Clemens Keck




Hugo wrote:I am playing a small tournament. Only 3 participants

Houdini 3 pro, spilt depth 12

Stockfish dev (latest), Min Split Depth=7, Idle Threads Sleep=false

Komodo dev (close to r2 release)

Conditions:
Hardware: Supermicro Workstation with two Intel Xeon E5 2687 W 8core cpu @ 3.4 GHz, hyperthreading OFF
Engines: 64 bit, 8 cpu, 2048Mb hashtables, ponder ON, no tablebases at all, no large pages
GUI: Fritz 13, 80GB Nalimov tablebases
Playing mode: 60+15, 22 selected openings to play with reversed colors, 132 games in total

Link for livegame and crosstable : http://www.clemens-keck.de/3Champs/
Link for games: http://www.clemens-keck.de/3Champs/games.pgn

enjoy

Clemens K
Vinvin
Posts: 5312
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: 3 Champs

Post by Vinvin »

Stockfish closed the gap, Komodo take the lead. This Komodo release seems stronger than the last official one. But only 52 games.

Code: Select all

1 	Komodo 1036.03 64-bit x8       28.5 / 52 	 
2 	Houdini 3 Pro x64 sd12x8       25.5 / 52 	 
3 	Stockfish 180813 64 SSE4.2 x8  24.0 / 52