Multi-FinGAN: generative coarse-to-fine sampling of multi-finger grasps
10.1109/ICRA48506.2021.9561228
Inclou dades d'ús des de 2022
Cita com:
hdl:2117/361996
Tipus de documentText en actes de congrés
Data publicació2021
Condicions d'accésAccés obert
Llevat que s'hi indiqui el contrari, els
continguts d'aquesta obra estan subjectes a la llicència de Creative Commons
:
Reconeixement-NoComercial-SenseObraDerivada 3.0 Espanya
Abstract
While there exists many methods for manipulating rigid objects with parallel-jaw grippers, grasping with multi- finger robotic hands remains a quite unexplored research topic. Reasoning and planning collision-free trajectories on the additional degrees of freedom of several fingers represents an important challenge that, so far, involves computationally costly and slow processes. In this work, we present Multi-FinGAN, a fast generative multi-finger grasp sampling method that synthesizes high quality grasps directly from RGB-D images in about a second. We achieve this by training in an end-to-end fashion a coarse-to-fine model composed of a classification network that distinguishes grasp types according to a specific taxonomy and a refinement network that produces refined grasp poses and joint angles. We experimentally validate and benchmark our method against a standard grasp-sampling method on 790 grasps in simulation and 20 grasps on a real Franka Emika Panda. All experimental results using our method show consistent improvements both in terms of grasp quality metrics and grasp success rate. Remarkably, our approach is up to 20-30 times faster than the baseline, a significant improvement that opens the door to feedback-based grasp re-planning and task informative grasping. Code is available at https://irobotics.aalto.fi/multi-fingan/.
Descripció
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
CitacióLundell, J. [et al.]. Multi-FinGAN: generative coarse-to-fine sampling of multi-finger grasps. A: IEEE International Conference on Robotics and Automation. "2021 International Conference on Robotics and Automation (ICRA 2021): Xi'an, China: May 30 - June 4, 2021". 2021, p. 4495-4501. DOI 10.1109/ICRA48506.2021.9561228.
Versió de l'editorhttps://ieeexplore.ieee.org/document/9561228
Col·leccions
- IRI - Institut de Robòtica i Informàtica Industrial, CSIC-UPC - Ponències/Comunicacions de congressos [575]
- ROBiri - Grup de Percepció i Manipulació Robotitzada de l'IRI - Ponències/Comunicacions de congressos [251]
- Doctorat en Automàtica, Robòtica i Visió - Ponències/Comunicacions de congressos [165]
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
2516-Multi-FinG ... ulti-Finger-Grasps (1).pdf | 4,414Mb | Visualitza/Obre |