Luck, Kevin Sebastian (2014)
Latent Space Reinforcement Learning.
Technische Universität Darmstadt
Bachelorarbeit, Erstveröffentlichung
Kurzbeschreibung (Abstract)
Often we have to handle high dimensional spaces if we want to learn motor skills for robots. In policy search tasks we have to find several parameters to learn a desired movement. This high dimensionality in parameters can be challenging for reinforcement algorithms, since more samples for finding an optimal solution are needed with every additional dimension. On the other hand, if the robot has a high number of actuators, an inherent correlation between these can be found for a specific motor task, which we can exploit for a faster convergence. One possibility is to use techniques to reduce the dimensionality of the space, which is used as a pre-processing step or as an independent process in most applications. In this thesis we present a novel algorithm which combines the theory of policy search and probabilistic dimensionality reduction to uncover the hidden structure of high dimensional action spaces. Evaluations on an inverse kinematics task indicate that the presented algorithm is able to outperform the reference algorithms PoWER and CMA-ES, especially in high dimensional spaces. Furthermore we evaluate our algorithm on a real-world task. In this task, a NAO robot learns to lift his leg while keeping balance. The issue of collecting samples for learning on a real robot in such a task, which is often very time and cost consuming, is considered in here by using a small number of samples in each iteration.
Typ des Eintrags: | Bachelorarbeit | ||||
---|---|---|---|---|---|
Erschienen: | 2014 | ||||
Autor(en): | Luck, Kevin Sebastian | ||||
Art des Eintrags: | Erstveröffentlichung | ||||
Titel: | Latent Space Reinforcement Learning | ||||
Sprache: | Englisch | ||||
Referenten: | Peters, Prof. Dr. Jan ; Ben Amor, Dr. Heni ; Neumann, Dr. Gerhard | ||||
Publikationsjahr: | 6 Mai 2014 | ||||
Ort: | Darmstadt | ||||
URL / URN: | http://tuprints.ulb.tu-darmstadt.de/3832 | ||||
Kurzbeschreibung (Abstract): | Often we have to handle high dimensional spaces if we want to learn motor skills for robots. In policy search tasks we have to find several parameters to learn a desired movement. This high dimensionality in parameters can be challenging for reinforcement algorithms, since more samples for finding an optimal solution are needed with every additional dimension. On the other hand, if the robot has a high number of actuators, an inherent correlation between these can be found for a specific motor task, which we can exploit for a faster convergence. One possibility is to use techniques to reduce the dimensionality of the space, which is used as a pre-processing step or as an independent process in most applications. In this thesis we present a novel algorithm which combines the theory of policy search and probabilistic dimensionality reduction to uncover the hidden structure of high dimensional action spaces. Evaluations on an inverse kinematics task indicate that the presented algorithm is able to outperform the reference algorithms PoWER and CMA-ES, especially in high dimensional spaces. Furthermore we evaluate our algorithm on a real-world task. In this task, a NAO robot learns to lift his leg while keeping balance. The issue of collecting samples for learning on a real robot in such a task, which is often very time and cost consuming, is considered in here by using a small number of samples in each iteration. |
||||
Alternatives oder übersetztes Abstract: |
|
||||
Freie Schlagworte: | Reinforcement Learning, Policy Search, Dimensionality Reduktion | ||||
URN: | urn:nbn:de:tuda-tuprints-38321 | ||||
Fachbereich(e)/-gebiet(e): | 20 Fachbereich Informatik 20 Fachbereich Informatik > Intelligente Autonome Systeme |
||||
Hinterlegungsdatum: | 18 Mai 2014 19:55 | ||||
Letzte Änderung: | 18 Mai 2014 19:55 | ||||
PPN: | |||||
Referenten: | Peters, Prof. Dr. Jan ; Ben Amor, Dr. Heni ; Neumann, Dr. Gerhard | ||||
Export: | |||||
Suche nach Titel in: | TUfind oder in Google |
Frage zum Eintrag |
Optionen (nur für Redakteure)
Redaktionelle Details anzeigen |