Show simple item record

dc.contributor.authorCanal Camprodon, Gerard
dc.contributor.authorEscalera, Sergio
dc.contributor.authorAngulo Bahón, Cecilio
dc.contributor.otherUniversitat Politècnica de Catalunya. Departament d'Enginyeria de Sistemes, Automàtica i Informàtica Industrial
dc.date.accessioned2016-11-09T09:53:11Z
dc.date.available2018-08-31T00:30:14Z
dc.date.issued2016
dc.identifier.citationCanal, G., Escalera, S., Angulo, C. A real-time human-robot interaction system based on gestures for assistive scenarios. "Computer vision and image understanding", 2016, vol. 149, p. 65-77.
dc.identifier.issn1077-3142
dc.identifier.urihttp://hdl.handle.net/2117/95870
dc.description.abstractNatural and intuitive human interaction with robotic systems is a key point to develop robots assisting people in an easy and effective way. In this paper, a Human Robot Interaction (HRI) system able to recognize gestures usually employed in human non-verbal communication is introduced, and an in-depth study of its usability is performed. The system deals with dynamic gestures such as waving or nodding which are recognized using a Dynamic Time Warping approach based on gesture specific features computed from depth maps. A static gesture consisting in pointing at an object is also recognized. The pointed location is then estimated in order to detect candidate objects the user may refer to. When the pointed object is unclear for the robot, a disambiguation procedure by means of either a verbal or gestural dialogue is performed. This skill would lead to the robot picking an object in behalf of the user, which could present difficulties to do it by itself. The overall system — which is composed by a NAO and Wifibot robots, a KinectTM v2 sensor and two laptops — is firstly evaluated in a structured lab setup. Then, a broad set of user tests has been completed, which allows to assess correct performance in terms of recognition rates, easiness of use and response times.
dc.format.extent13 p.
dc.language.isoeng
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/3.0/es/
dc.subjectÀrees temàtiques de la UPC::Informàtica
dc.subject.lcshHuman-robot interaction
dc.subject.otherGesture recognition
dc.subject.otherHuman Robot Interaction
dc.subject.otherDynamic Time Warping
dc.subject.otherPointing location estimation
dc.subject.otherRecognition
dc.subject.otherModel
dc.titleA real-time human-robot interaction system based on gestures for assistive scenarios
dc.typeArticle
dc.subject.lemacInteracció persona-robot
dc.contributor.groupUniversitat Politècnica de Catalunya. ROBiri - Grup de Robòtica de l'IRI
dc.contributor.groupUniversitat Politècnica de Catalunya. GREC - Grup de Recerca en Enginyeria del Coneixement
dc.identifier.doi10.1016/j.cviu.2016.03.004
dc.relation.publisherversionhttp://www.sciencedirect.com/science/article/pii/S107731421600076X
dc.rights.accessOpen Access
local.identifier.drac18736003
dc.description.versionPostprint (author's final draft)
local.citation.authorCanal, G.; Escalera, S.; Angulo, C.
local.citation.publicationNameComputer vision and image understanding
local.citation.volume149
local.citation.startingPage65
local.citation.endingPage77


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record

Attribution-NonCommercial-NoDerivs 3.0 Spain
Except where otherwise noted, content on this work is licensed under a Creative Commons license : Attribution-NonCommercial-NoDerivs 3.0 Spain