Hierarchical Control for Bipedal Locomotion using Central Pattern Generators and Neural Networks

URN urn:nbn:de:gbv:18-228-7-2378
URL
Dokumentart: Masterarbeit, Diplomarbeit
Institut: Fachbereich Informatik
Sprache: Englisch
Erstellungsjahr: 2017
Publikationsdatum:
Freie Schlagwörter (Englisch): Bipedal Locomotion , Reinforcement Learning , Neural Networks
DDC-Sachgruppe: Informatik
BK - Klassifikation: 54.72

Kurzfassung auf Englisch:

The walking movement of humans is graceful and robust. This movement is the result of synchronization between the neural mechanisms which generate rhythmic motion, and the dynamics of the skeletal structure. The overall movement is optimized by high-level control centers. Drawing inspiration from this mechanism, a hierarchical controller for bipedal locomotion of robots is proposed in this thesis. Artificial central pattern generators (CPGs) mimic the behavior of the neural mechanisms which produce rhythmic motion in animals. Many existing methods use CPG networks for bipedal locomotion, but most of them focus solely on the CPGs. The proposed controller augments the functionality of a CPG network by adding a novel high-level controller on top of it. Thus, at the lower level, a CPG network with feedback pathways controls the individual joints. The parameters of the CPG network are optimized by a genetic algorithm. At the higher level, a neural network modulates the output of the CPG network in order to optimize the robot's movements with respect to an overall objective. In this case, the objective is to minimize the lateral deviation while walking. The neural network is trained using reinforcement learning. The proposed controller was successfully used to produce stable bipedal locomotion for the NICO robot in simulation. Results of experiments show that the high-level controller was able to improve the performance of the low-level CPG network. Additionally, by comparing the performance of CPG networks with and without feedback mechanisms, the relative effectiveness of low-level feedback has been shown. The proposed controller is not strongly coupled to a particular robot model and is modular in design. The results obtained, by using this controller in simulation, encourage its use on the physical robot in the future.

Hinweis zum Urherberrecht

Für Dokumente, die in elektronischer Form über Datenenetze angeboten werden, gilt uneingeschränkt das Urheberrechtsgesetz (UrhG). Insbesondere gilt:

Einzelne Vervielfältigungen, z.B. Kopien und Ausdrucke, dürfen nur zum privaten und sonstigen eigenen Gebrauch angefertigt werden (Paragraph 53 Urheberrecht). Die Herstellung und Verbreitung von weiteren Reproduktionen ist nur mit ausdrücklicher Genehmigung des Urhebers gestattet.

Der Benutzer ist für die Einhaltung der Rechtsvorschriften selbst verantwortlich und kann bei Mißbrauch haftbar gemacht werden.