A0 subtlety
Moderators: hgm, Harvey Williamson, bob
Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
A0 subtlety
Was a set of input planes representing a position at time (t - T + 1) oriented for the side to move at time t or time (t - T + 1)?
-
- Posts: 3560
- Joined: Tue Mar 14, 2006 10:34 am
- Location: Ethiopia
- Contact:
Re: A0 subtlety
All the history input planes are oriented for the current side to move, i.e. at time t.
Re: A0 subtlety
Would it matter if they weren’t?Daniel Shawul wrote: ↑Mon Feb 11, 2019 5:08 pmAll the history input planes are oriented for the current side to move, i.e. at time t.
(That’s a serious question btw)
Chris Whittington
Ontological Terrorist
Lead Philosopher Computer Chess
Comrade Commissar Aspergers Liberation Front
Ostranenye Catalyst
Zero tolerance personal comments
5-4-8 tritype, INTP, BCF 221
facebook: chris.whittington.522
twitter: Skool_Dog
Ontological Terrorist
Lead Philosopher Computer Chess
Comrade Commissar Aspergers Liberation Front
Ostranenye Catalyst
Zero tolerance personal comments
5-4-8 tritype, INTP, BCF 221
facebook: chris.whittington.522
twitter: Skool_Dog
-
- Posts: 3560
- Joined: Tue Mar 14, 2006 10:34 am
- Location: Ethiopia
- Contact:
Re: A0 subtlety
I suppose not but it would make it a little bit harder because the network has to learn to flip the boardchrisw wrote: ↑Thu Feb 14, 2019 3:28 pmWould it matter if they weren’t?Daniel Shawul wrote: ↑Mon Feb 11, 2019 5:08 pmAll the history input planes are oriented for the current side to move, i.e. at time t.
(That’s a serious question btw)
every step in the history. I do not think history planes matter much anyway to begin with.
Re: A0 subtlety
I thought it would depend on how the convolution filters were tracking the data (in what order). Does it track 3x3 across each 8x8 map of chessboard cells, and then combine those outputs - so I suppose it must be best to combine a1 to a1 region and so on, rather than a1 to a8. Difficult to wrap head around.Daniel Shawul wrote: ↑Thu Feb 14, 2019 4:14 pmI suppose not but it would make it a little bit harder because the network has to learn to flip the boardchrisw wrote: ↑Thu Feb 14, 2019 3:28 pmWould it matter if they weren’t?Daniel Shawul wrote: ↑Mon Feb 11, 2019 5:08 pmAll the history input planes are oriented for the current side to move, i.e. at time t.
(That’s a serious question btw)
every step in the history. I do not think history planes matter much anyway to begin with.
Chris Whittington
Ontological Terrorist
Lead Philosopher Computer Chess
Comrade Commissar Aspergers Liberation Front
Ostranenye Catalyst
Zero tolerance personal comments
5-4-8 tritype, INTP, BCF 221
facebook: chris.whittington.522
twitter: Skool_Dog
Ontological Terrorist
Lead Philosopher Computer Chess
Comrade Commissar Aspergers Liberation Front
Ostranenye Catalyst
Zero tolerance personal comments
5-4-8 tritype, INTP, BCF 221
facebook: chris.whittington.522
twitter: Skool_Dog
-
- Posts: 912
- Joined: Tue Mar 09, 2010 2:46 pm
- Location: New York
- Full name: Álvaro Begué (RuyDos)
Re: A0 subtlety
I agree with this. However, it's very likely that the history inputs are mostly irrelevant, as Daniel Shawul mentioned.chrisw wrote: ↑Thu Feb 14, 2019 5:44 pmI thought it would depend on how the convolution filters were tracking the data (in what order). Does it track 3x3 across each 8x8 map of chessboard cells, and then combine those outputs - so I suppose it must be best to combine a1 to a1 region and so on, rather than a1 to a8. Difficult to wrap head around.Daniel Shawul wrote: ↑Thu Feb 14, 2019 4:14 pmI suppose not but it would make it a little bit harder because the network has to learn to flip the boardchrisw wrote: ↑Thu Feb 14, 2019 3:28 pmWould it matter if they weren’t?Daniel Shawul wrote: ↑Mon Feb 11, 2019 5:08 pmAll the history input planes are oriented for the current side to move, i.e. at time t.
(That’s a serious question btw)
every step in the history. I do not think history planes matter much anyway to begin with.
Re: A0 subtlety
well, for me, it is clear that they, or some form of equivalence, are vital. Attempts at explanations have met with uniform blank looks or raised eyebrows, so I’ll just stick with this view, and we’ll see. It won’t be the first time.AlvaroBegue wrote: ↑Thu Feb 14, 2019 10:55 pmI agree with this. However, it's very likely that the history inputs are mostly irrelevant, as Daniel Shawul mentioned.chrisw wrote: ↑Thu Feb 14, 2019 5:44 pmI thought it would depend on how the convolution filters were tracking the data (in what order). Does it track 3x3 across each 8x8 map of chessboard cells, and then combine those outputs - so I suppose it must be best to combine a1 to a1 region and so on, rather than a1 to a8. Difficult to wrap head around.Daniel Shawul wrote: ↑Thu Feb 14, 2019 4:14 pmI suppose not but it would make it a little bit harder because the network has to learn to flip the boardchrisw wrote: ↑Thu Feb 14, 2019 3:28 pmWould it matter if they weren’t?Daniel Shawul wrote: ↑Mon Feb 11, 2019 5:08 pmAll the history input planes are oriented for the current side to move, i.e. at time t.
(That’s a serious question btw)
every step in the history. I do not think history planes matter much anyway to begin with.
Chris Whittington
Ontological Terrorist
Lead Philosopher Computer Chess
Comrade Commissar Aspergers Liberation Front
Ostranenye Catalyst
Zero tolerance personal comments
5-4-8 tritype, INTP, BCF 221
facebook: chris.whittington.522
twitter: Skool_Dog
Ontological Terrorist
Lead Philosopher Computer Chess
Comrade Commissar Aspergers Liberation Front
Ostranenye Catalyst
Zero tolerance personal comments
5-4-8 tritype, INTP, BCF 221
facebook: chris.whittington.522
twitter: Skool_Dog
Re: A0 subtlety
If the input is always oriented for the side to move, then should the policy output also be mirrored for black? Like if the best move was g8f6 the policy output would b1c3?
-
- Posts: 3560
- Joined: Tue Mar 14, 2006 10:34 am
- Location: Ethiopia
- Contact:
Re: A0 subtlety
I always evaluate for white to move, so the board has to be flipped horizontally when it is black to move and ofcourse all moves are flipped as well
So g8f6 becomes g1f3 (not b1c3). Btw this has nothing to do with your original question of history planes.
@chrisw Good point on the a1->a8 mapping. Indeed the innder dot product over the volume (channels) will be messed up if the history planes are not aligned properly.
Re: A0 subtlety
@Daniel Shawul
How strong is your policy network on it's own?
How strong is your policy network on it's own?