ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

AlphaGo Zero And AlphaZero, RomiChess done better
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: General Topics Flat
View previous topic :: View next topic  
Author Message
Michael Sherwin



Joined: 26 May 2006
Posts: 2537
Location: OH, USA

PostPost subject: AlphaGo Zero And AlphaZero, RomiChess done better    Posted: Thu Dec 07, 2017 11:45 am Reply to topic Reply with quote

In January of 2006 IIRC (not exactly sure) I released RomiChess ver P2a. The new version had learning. It had two types of learning, monkey see monkey do and learning adapted from Pavlov's dog experiments. I did not know it at the time but the second type of learning was called reinforcement learning. I just found out very recently that reinforcement learning was invented for robotics control in 1957 the year that I was born, strange. Anyway, as far as I know I reinvented it and was the first to put reinforcement learning into a chess program. The reason i'm apparently patting myself on the back is rather to let people know that I recognise certain aspects of this AlphaZero phenom. For example, using Glaurung 2.x as a test opponent Romi played 20 matches against Glaurung using the ten Nunn positions. On pass one Romi scored 5% against Glaurung. On the 20th pass Romi scored 95%. That is how powerful the learning is! The moves that Romi learned to beat Glaurung were very distinctive looking. They are learned moves so they are not determined by a natural chess playing evaluation but rather an evaluation tweaked by learned rewards and penalties. Looking at the games between AlphaZero and Stockfish I see the same kind of learned moves. In RomiChess one can start with a new learn.dat file and put millionbase.pgn in the same directory as Romi and type merge millionbase.pgn and Romi will learn from all those games. When reading about AlphaZero there is mostly made up reporting. That is what reporters do. They take one or two known facts and make up a many page article that is mostly bunk. The AlphaZero team has released very little actual info. They released that it uses reinforcement learning and that a database of games were loaded in. Beyond that not much is known. But looking at the games against Stockfish it looks as though AlphaZero either trained against Stockfish before the recorded match or entered a pgn of Stockfish games. Stockfish does have some type of randomness to its moves so it can't be totally dominated like Romi dominated Glaurung that had no randomness. So basically take an engine about as strong as Stockfish and give it reinforcement learning and the result is exactly as expected!
_________________
Regards,
Mike
Back to top
View user's profile Send private message
Display posts from previous:   
Subject Author Date/Time
AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Thu Dec 07, 2017 11:45 am
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Richard Delorme Thu Dec 07, 2017 12:16 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Thu Dec 07, 2017 12:29 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Norman Schmidt Thu Dec 07, 2017 2:26 pm
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Norman Schmidt Thu Dec 07, 2017 2:34 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better John Hartmann Thu Dec 07, 2017 2:40 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Norman Schmidt Thu Dec 07, 2017 3:00 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Thu Dec 07, 2017 2:58 pm
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Milos Stanisavljevic Thu Dec 07, 2017 4:50 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Norman Schmidt Thu Dec 07, 2017 5:27 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Milos Stanisavljevic Thu Dec 07, 2017 5:42 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Norman Schmidt Thu Dec 07, 2017 5:57 pm
                                                Re: AlphaGo Zero And AlphaZero, RomiChess done better Milos Stanisavljevic Thu Dec 07, 2017 6:07 pm
                                                      Re: AlphaGo Zero And AlphaZero, RomiChess done better Jacob Wilkins Thu Dec 07, 2017 7:42 pm
                                                            Re: AlphaGo Zero And AlphaZero, RomiChess done better Milos Stanisavljevic Thu Dec 07, 2017 7:47 pm
                                                                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Jacob Wilkins Thu Dec 07, 2017 7:52 pm
                                                                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Milos Stanisavljevic Thu Dec 07, 2017 8:03 pm
                                                                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Jacob Wilkins Thu Dec 07, 2017 8:10 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Steve Maughan Thu Dec 07, 2017 3:43 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Thu Dec 07, 2017 10:22 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Jon Dart Thu Dec 07, 2017 8:12 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Thu Dec 07, 2017 10:58 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Fri Dec 08, 2017 12:15 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Fri Dec 08, 2017 7:18 am
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Werner Schüle Fri Dec 08, 2017 12:48 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Fri Dec 08, 2017 10:44 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Fri Dec 08, 2017 11:25 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Fri Dec 08, 2017 2:40 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Fri Dec 08, 2017 11:07 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Fri Dec 08, 2017 11:29 pm
                                                Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 12:04 am
                                                      Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Sat Dec 09, 2017 9:25 am
                                                            Re: AlphaGo Zero And AlphaZero, RomiChess done better Ian Osgood Sat Dec 09, 2017 4:03 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Fri Dec 08, 2017 10:34 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Fri Dec 08, 2017 10:57 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Sun Dec 10, 2017 8:50 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sun Dec 10, 2017 1:12 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Sun Dec 10, 2017 2:32 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Daniel Shawul Fri Dec 08, 2017 11:47 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 12:23 am
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 12:54 am
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 3:43 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 4:56 am
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 8:39 am
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 9:35 am
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 10:07 am
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better John Rebert Sat Dec 09, 2017 11:15 am
                                                Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Sat Dec 09, 2017 11:49 am
                                                Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 5:44 pm
                                                      Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 5:52 pm
                                                            Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 6:36 pm
                                                                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 6:40 pm
                                                                        Re: AlphaGo Zero And AlphaZero, RomiChess done better John Rebert Sat Dec 09, 2017 8:05 pm
                                                                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Robin Messemer Sat Dec 09, 2017 9:37 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Erin Dame Sat Dec 09, 2017 3:38 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Sat Dec 09, 2017 11:39 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better John Rebert Sat Dec 09, 2017 11:46 am
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Sat Dec 09, 2017 12:02 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better John Rebert Sat Dec 09, 2017 12:14 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better szabo, robert Sat Dec 09, 2017 12:59 pm
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Sat Dec 09, 2017 5:49 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Aloisio Ponti Sun Dec 10, 2017 5:36 pm
      Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Pang Sun Dec 10, 2017 9:24 pm
            Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Sun Dec 10, 2017 11:15 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Carl Langan Mon Dec 11, 2017 12:13 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Mon Dec 11, 2017 4:24 pm
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Ronald de Man Mon Dec 11, 2017 9:22 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Mon Dec 11, 2017 11:09 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Uri Blass Tue Dec 12, 2017 3:14 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Uri Blass Tue Dec 12, 2017 3:29 pm
                                          Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Tue Dec 12, 2017 5:59 pm
                                                Re: AlphaGo Zero And AlphaZero, RomiChess done better Ronald de Man Tue Dec 12, 2017 7:47 pm
                  Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Mon Dec 11, 2017 2:58 am
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Mon Dec 11, 2017 3:33 pm
                        Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Tue Dec 12, 2017 11:39 am
                              Re: AlphaGo Zero And AlphaZero, RomiChess done better Michael Sherwin Tue Dec 12, 2017 12:15 pm
                                    Re: AlphaGo Zero And AlphaZero, RomiChess done better Rodolfo Leoni Tue Dec 12, 2017 12:29 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: General Topics

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads