TCEC Season 7 - Main Thread

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

BubbaTough
Posts: 1154
Joined: Fri Jun 23, 2006 5:18 am

Re: TCEC Season 7 - Main Thread

Post by BubbaTough »

S.Taylor wrote:
Martin Thoresen wrote:
This is the first time EVER in TCEC history that a Stage is played without books. Yes, that's right, in Stage 2 the engines are on their own from the very first move.
Does anyone think this might not be fair in that some programs may be designed to play from a position AFTER enough opening moves, and were not equipped to play the first few very intelligently whilst others are?
I think of it the opposite way. I think it is an appropriate reward to those engines whose authors have actually worked at making sure there engines are good at making opening moves.

-Sam
S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: TCEC Season 7 - Main Thread

Post by S.Taylor »

BubbaTough wrote:
S.Taylor wrote:
Martin Thoresen wrote:
This is the first time EVER in TCEC history that a Stage is played without books. Yes, that's right, in Stage 2 the engines are on their own from the very first move.
Does anyone think this might not be fair in that some programs may be designed to play from a position AFTER enough opening moves, and were not equipped to play the first few very intelligently whilst others are?
I think of it the opposite way. I think it is an appropriate reward to those engines whose authors have actually worked at making sure there engines are good at making opening moves.

-Sam
I agree that those engines might be rewarded best in Fisherandom chess, but with regular chess, some programmers might feel that the right opening book is designed to take care of any important line played by the other side, and therefore didn't give any specific opening instructions, besides general play. But the first few moves might require a very different list of instructions than after the first few moves.

Or is this not true?

And if it is, then doesn't this make it great for fisherandom?
S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: TCEC Season 7 - Main Thread

Post by S.Taylor »

BubbaTough wrote:
S.Taylor wrote:
Martin Thoresen wrote:
This is the first time EVER in TCEC history that a Stage is played without books. Yes, that's right, in Stage 2 the engines are on their own from the very first move.
Does anyone think this might not be fair in that some programs may be designed to play from a position AFTER enough opening moves, and were not equipped to play the first few very intelligently whilst others are?
I think of it the opposite way. I think it is an appropriate reward to those engines whose authors have actually worked at making sure there engines are good at making opening moves.

-Sam
If you make a tournament of 100 games all starting from a particular rare endgame position, which requires particular knowledge to deliver mate, then we would find that all those engines who were given that knowedge will win every game, and all those were not, will NOT win any game.

So we would be proving nothing! Just ask the programmer.

I was wondering if that might be comparable here, but to a smaller extent.
BubbaTough
Posts: 1154
Joined: Fri Jun 23, 2006 5:18 am

Re: TCEC Season 7 - Main Thread

Post by BubbaTough »

S.Taylor wrote:
BubbaTough wrote:
S.Taylor wrote:
Martin Thoresen wrote:
This is the first time EVER in TCEC history that a Stage is played without books. Yes, that's right, in Stage 2 the engines are on their own from the very first move.
Does anyone think this might not be fair in that some programs may be designed to play from a position AFTER enough opening moves, and were not equipped to play the first few very intelligently whilst others are?
I think of it the opposite way. I think it is an appropriate reward to those engines whose authors have actually worked at making sure there engines are good at making opening moves.

-Sam
If you make a tournament of 100 games all starting from a particular rare endgame position, which requires particular knowledge to deliver mate, then we would find that all those engines who were given that knowedge will win every game, and all those were not, will NOT win any game.

So we would be proving nothing! Just ask the programmer.

I was wondering if that might be comparable here, but to a smaller extent.
I think you are making a good analogy. I agree it is comparable in that engines tested from the start position and positions close to the start position (after 1 or 2 or 3 moves) will probably have a slight advantage over engines that only start testing later in the opening. The difference in my mind, is that a rare endgame rarely comes up in a game, while the start position always comes up in a game. So it seems to me that if a tournament is supposed to test an engine's ability to play chess from start to finish, it is nice to actually start at the start.

Of course, there are issues with doing this over and over and getting repeat games or repeat decisive portions of games, but that is a bit tangential to the topic we are discussing :).
S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: TCEC Season 7 - Main Thread

Post by S.Taylor »

Game 1 of stage 2 was very nice.
The games between the big 3 are 13, 62, and 81.
I'll be very much looking forward to see their openings and how it continues.

Are there engines which would play the opening moves better than these "big 3"?
S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: TCEC Season 7 - Main Thread

Post by S.Taylor »

Game 2, I'm strongly skeptical if the end position was a won ending. I think it was very likely a draw.

(It says win rule. But I still think it might be the wrong verdict.)


editing now:

maybe end position was lost for white, but it was still a drawn ending a few moves back, perhaps. White could have blockaded any win with his king and bishop.
Uri Blass
Posts: 10279
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: TCEC Season 7 - Main Thread

Post by Uri Blass »

S.Taylor wrote:Game 1 of stage 2 was very nice.
The games between the big 3 are 13, 62, and 81.
I'll be very much looking forward to see their openings and how it continues.

Are there engines which would play the opening moves better than these "big 3"?
Chiron already beat houdini with black in game 10 with 1.d4 d5 2.Nf3 a6

It is funny that houdini cannot punish black for 2...a6 that is against the chess principles.

Houdini blundered in the following position by 76.b5 but the main question is what are houdini's mistakes that allowed chiron even to get equality.

Maybe after 1.d4 d5 2.Nf3 a6 3.c4 e6 4.cxd5 exd5 5.Bg5 is wrong and better is 5.Nc3

Here is the position when houdini blundered and lost.
[D]1q2r2k/Rp5p/2p3r1/Q2p1pn1/PP1P4/3NP1Pp/2R2P2/7K w - - 13 76
Martin Thoresen
Posts: 1833
Joined: Thu Jun 22, 2006 12:07 am

Re: TCEC Season 7 - Main Thread

Post by Martin Thoresen »

Stage 2 standings after 3 of 13 rounds:

Code: Select all

 N Engine           Rtng Pts Gm   SB Ch Gu Ko Ho St Ju Na Se Te Cr Jo Pr Ha Ce

 1 Chiron 2         3049 2.5  3 3.75 ··       1        1              =       
 2 Gull 3           3116 2.5  3 2.00    ·· =                          1     1 
 3 Komodo 1318      3230 2.0  3 2.75    =  ··    =                       1    
 4 Houdini 4        3224 2.0  3 2.50 0        ··             1  1             
 5 Stockfish 231014 3243 2.0  3 2.50       =     ·· =                       1 
 6 Junior 13.3      3000 2.0  3 2.25             =  ··             1     =    
 7 Naum 4.6         3074 1.5  3 2.00 0                 ·· 1     =             
 8 Senpai 1         2875 1.5  3 1.50                   0  ··    =  1          
 9 Texel 1.05a9     2984 1.5  3 0.75          0              ··       1     = 
10 Critter 1.6a     3110 1.0  3 1.50          0        =  =     ··            
11 Jonny 6          2960 1.0  3 0.50                0     0        ··    1    
12 Protector 1.8b1  3000 0.5  3 1.25 =  0                    0        ··      
13 Hannibal 1.5x12  2998 0.5  3 1.00       0        =              0     ··   
14 Cheng4 0.36c+    2867 0.5  3 0.75    0        0           =              ··
Live page:
http://tcec.chessdom.com/live.php

Game archive:
http://tcec.chessdom.com/archive.php
Martin Thoresen
Posts: 1833
Joined: Thu Jun 22, 2006 12:07 am

Re: TCEC Season 7 - Main Thread

Post by Martin Thoresen »

Stage 2 standings after 5 of 13 rounds:

Code: Select all

 N Engine           Rtng Pts Gm   SB Ko Ho Gu St Ch Ju Cr Na Se Te Pr Jo Ha Ce

 1 Komodo 1318      3230 4.0  5 9.75 ··    =  =  1              1        1    
 2 Houdini 4        3224 4.0  5 8.50    ··       0     1  1  1  1             
 3 Gull 3           3116 4.0  5 7.00 =     ··       =              1     1  1 
 4 Stockfish 231014 3243 3.5  5 6.50 =        ··    =                 1  =  1 
 5 Chiron 2         3049 3.0  5 7.25 0  1        ··       1        =        = 
 6 Junior 13.3      3000 3.0  5 6.75       =  =     ··          =     1  =    
 7 Critter 1.6a     3110 2.5  5 3.75    0              ·· =  =     =        1 
 8 Naum 4.6         3074 2.0  5 4.00    0        0     =  ·· 1        =       
 9 Senpai 1         2875 2.0  5 3.50    0              =  0  ··    =  1       
10 Texel 1.05a9     2984 2.0  5 3.50 0  0           =           ·· 1        = 
11 Protector 1.8b1  3000 1.5  5 3.75       0     =     =     =  0  ··         
12 Jonny 6          2960 1.5  5 2.00          0     0     =  0        ·· 1    
13 Hannibal 1.5x12  2998 1.0  5 3.25 0     0  =     =                 0  ··   
14 Cheng4 0.36c+    2867 1.0  5 2.50       0  0  =     0        =           ··
Live page:
http://tcec.chessdom.com/live.php

Game archive:
http://tcec.chessdom.com/archive.php
Uri Blass
Posts: 10279
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: TCEC Season 7 - Main Thread

Post by Uri Blass »

It seems that it will be possible to prove for all programs that they are not deterministic even only based on the pgn of this tournament

If I am not wrong
All the program except Houdini already played different openings when the opponent played the same moves and probably with more games we will see it also for houdini.

I wonder what happens if you play 1000 games with no opening book between the same 2 programs.

What is the probability that 2 random games are going to be equal in the first n moves for different values of n?