Robot motion adaptation through user intervention and reinforcement learning
10.1016/j.patrec.2017.06.017
Inclou dades d'ús des de 2022
Cita com:
hdl:2117/119158
Tipus de documentArticle
Data publicació2018-04-01
EditorElsevier
Condicions d'accésAccés obert
Llevat que s'hi indiqui el contrari, els
continguts d'aquesta obra estan subjectes a la llicència de Creative Commons
:
Reconeixement-NoComercial-SenseObraDerivada 3.0 Espanya
Abstract
Assistant robots are designed to perform specific tasks for the user, but their performance is rarely optimal, hence they are required to adapt to user preferences or new task requirements. In the previous work, the potential of an interactive learning framework based on user intervention and reinforcement learning (RL) was assessed. The framework allowed the user to correct an unfitted segment of the robot trajectory by using hand movements to guide the robot along a corrective path. So far, only the usability of the framework was evaluated through experiments with users. In the current work, the framework is described in detail and its ability to learn from a set of sample trajectories using an RL algorithm is analyzed. To evaluate the learning performance, three versions of the framework are proposed that differ in the method used to obtain the sample trajectories, which are: human-guided learning, autonomous learning, and combined human-guided with autonomous learning. The results show that the combination of the human-guided and autonomous learning achieved the best performance, and although it needed a higher number of sample trajectories than the human-guided learning, it also required less user involvement. Autonomous learning alone obtained the lowest reward value and needed the highest number of sample trajectories.
Descripció
© <year>. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/
CitacióJevtic, A., Colomé, A., Alenyà, G., Torras, C. Robot motion adaptation through user intervention and reinforcement learning. "Pattern recognition letters", 1 Abril 2018, vol. 105, p. 67-75.
ISSN0167-8655
Versió de l'editorhttps://www.sciencedirect.com/science/article/pii/S0167865517302234
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
1895-Robot-moti ... reinforcement-learning.pdf | 1,818Mb | Visualitza/Obre |