ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

AlphaGo Zero And AlphaZero, RomiChess done better
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: General Topics Flat
View previous topic :: View next topic  
Author Message
Michael Sherwin



Joined: 26 May 2006
Posts: 2561
Location: OH, USA

PostPost subject: Re: AlphaGo Zero And AlphaZero, RomiChess done better    Posted: Thu Dec 07, 2017 10:58 pm Reply to topic Reply with quote

jdart wrote:
It is a neural network based system, and quite a bit has been written about the Go program that preceded it. I do not think it is a big mystery what they did.

Re reinforcement learning, Andrew Tridgell applied this to chess in the late 90's:

https://chessprogramming.wikispaces.com/KnightCap

https://www.cs.princeton.edu/courses/archive/fall06/cos402/papers/chess-RL.pdf

He got good learning progress but not great results in terms of final program strength.

--Jon


So I was not the first. Like Bob said, there is nothing new under the Sun. However, Romi did achive superior results in Leo Dicksman's class tournaments gaining two classes and about to gain a third class before his hard drive crashed and he lost Romi's learn file.

I googled reinforcement learning and found no connection to Pavlov's dog experiments in which he rewarded correct behavior and punished wrong behavior, except when Romi is mentioned.

My goal was to create computer chess learning that mimicked how humans learn. So I took two examples of that and adapted them for computer chess. Humans copy moves and that is, monkey see monkey do learning, that gets it name from monkeys watching humans wash potatoes in a stream and then doing it themselves. The second one (reinforcement learning) is just staying with what is working or trying something else if it is not. I think somewhere in what I did was some originality?
_________________
Regards,
Mike
Back to top
View user's profile Send private message
Display posts from previous:   
Subject Author Date/Time
AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Thu Dec 07, 2017 11:45 am
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Richard Delorme Thu Dec 07, 2017 12:16 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Thu Dec 07, 2017 12:29 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Norman Schmidt Thu Dec 07, 2017 2:26 pm
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Norman Schmidt Thu Dec 07, 2017 2:34 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better John Hartmann Thu Dec 07, 2017 2:40 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Norman Schmidt Thu Dec 07, 2017 3:00 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Thu Dec 07, 2017 2:58 pm
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Milos Stanisavljevic Thu Dec 07, 2017 4:50 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Norman Schmidt Thu Dec 07, 2017 5:27 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Milos Stanisavljevic Thu Dec 07, 2017 5:42 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Norman Schmidt Thu Dec 07, 2017 5:57 pm
                                                Re: AlphaGo Zero And AlphaZero, RomiChess done better Milos Stanisavljevic Thu Dec 07, 2017 6:07 pm
                                                      Re: AlphaGo Zero And AlphaZero, RomiChess done better Jacob Wilkins Thu Dec 07, 2017 7:42 pm
                                                            Re: AlphaGo Zero And AlphaZero, RomiChess done better Milos Stanisavljevic Thu Dec 07, 2017 7:47 pm
                                                                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Jacob Wilkins Thu Dec 07, 2017 7:52 pm
                                                                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Milos Stanisavljevic Thu Dec 07, 2017 8:03 pm
                                                                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Jacob Wilkins Thu Dec 07, 2017 8:10 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Steve Maughan Thu Dec 07, 2017 3:43 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Thu Dec 07, 2017 10:22 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Jon Dart Thu Dec 07, 2017 8:12 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Thu Dec 07, 2017 10:58 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Fri Dec 08, 2017 12:15 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Fri Dec 08, 2017 7:18 am
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Werner Schüle Fri Dec 08, 2017 12:48 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Fri Dec 08, 2017 10:44 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Fri Dec 08, 2017 11:25 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Fri Dec 08, 2017 2:40 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Fri Dec 08, 2017 11:07 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Fri Dec 08, 2017 11:29 pm
                                                Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 12:04 am
                                                      Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Sat Dec 09, 2017 9:25 am
                                                            Re: AlphaGo Zero And AlphaZero, RomiChess done better Ian Osgood Sat Dec 09, 2017 4:03 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Fri Dec 08, 2017 10:34 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Fri Dec 08, 2017 10:57 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Sun Dec 10, 2017 8:50 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sun Dec 10, 2017 1:12 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Sun Dec 10, 2017 2:32 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Daniel Shawul Fri Dec 08, 2017 11:47 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 12:23 am
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 12:54 am
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 3:43 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 4:56 am
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 8:39 am
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 9:35 am
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 10:07 am
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better John Rebert Sat Dec 09, 2017 11:15 am
                                                Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Sat Dec 09, 2017 11:49 am
                                                Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 5:44 pm
                                                      Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 5:52 pm
                                                            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 6:36 pm
                                                                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 6:40 pm
                                                                        Re: AlphaGo Zero And AlphaZero, RomiChess done better John Rebert Sat Dec 09, 2017 8:05 pm
                                                                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Robin Messemer Sat Dec 09, 2017 9:37 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 3:38 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Sat Dec 09, 2017 11:39 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better John Rebert Sat Dec 09, 2017 11:46 am
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Sat Dec 09, 2017 12:02 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better John Rebert Sat Dec 09, 2017 12:14 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Sat Dec 09, 2017 12:59 pm
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 5:49 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Aloisio Ponti Sun Dec 10, 2017 5:36 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Pang Sun Dec 10, 2017 9:24 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Sun Dec 10, 2017 11:15 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Carl Langan Mon Dec 11, 2017 12:13 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Mon Dec 11, 2017 4:24 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Ronald de Man Mon Dec 11, 2017 9:22 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Mon Dec 11, 2017 11:09 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Tue Dec 12, 2017 8:52 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Uri Blass Tue Dec 12, 2017 3:14 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Uri Blass Tue Dec 12, 2017 3:29 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Tue Dec 12, 2017 5:59 pm
                                                Re: AlphaGo Zero And AlphaZero, RomiChess done better Ronald de Man Tue Dec 12, 2017 7:47 pm
                                                      Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Wed Dec 13, 2017 8:45 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Ulysses P. Wed Dec 13, 2017 10:03 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Rasmus Althoff Wed Dec 13, 2017 10:21 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Ulysses P. Wed Dec 13, 2017 10:48 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Mon Dec 11, 2017 2:58 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Mon Dec 11, 2017 3:33 pm
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Tue Dec 12, 2017 11:39 am
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Tue Dec 12, 2017 12:15 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Tue Dec 12, 2017 12:29 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Tue Dec 12, 2017 8:11 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: General Topics

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads