Learning complex manipulation skills with causal structure and multi-sensory fusion
Visualitza/Obre
Final_Thesis___Miquel_Oller_Oliveras.pdf (30,89Mb) (Accés restringit)
Tipus de documentTreball Final de Grau
Data2018-10-19
Condicions d'accésAccés restringit per decisió de l'autor
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
Abstract
This thesis explores an efficient learning, inference, control and planning for complex manip- ulation skills based on integrating tactile and visual information. Considering how humans are able to integrate tactile and visual stimuli to execute complex manipulation, we base this work in emulating the human causal reasoning in a robot that learns to play Jenga, a complex game that requires physical interaction to be played. Unlike most current robotic learning methodologies which exploit recent progress in computer vision and deep learning to acquire data-hungry pixel-to-action policies, we exploit force and basic intuitive structure such as causality to learn probabilistic models. The game mechanics are formulated as a generative process using a temporal hierarchical Bayesian model, with representations for both behavioral arches-types and noisy block states. This captures causal relationships in force and visual domain after a short exploration phase. Once the learning is done, the robot uses the learned representations to infer the block behavior patterns and states, and then adjust its behavior in both action and game strategy, emulating the way humans play the game.
Descripció
The details of the work will be defined once the student arrives at the destination institution.
TitulacióGRAU EN CIÈNCIES I TECNOLOGIES DE TELECOMUNICACIÓ (Pla 2010)
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
Final_Thesis___Miquel_Oller_Oliveras.pdf![]() | 30,89Mb | Accés restringit |