Recovering pose and 3D deformable shape from multi-instance image ensembles
10.1007/978-3-319-54190-7_18
Inclou dades d'ús des de 2022
Cita com:
hdl:2117/105583
Tipus de documentText en actes de congrés
Data publicació2017
EditorSpringer
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
Abstract
In recent years, there has been a growing interest on tackling the Non-Rigid Structure from Motion problem (NRSfM), where the shape of a deformable object and the pose of a moving camera are simultaneously estimated from a monocular video sequence. Existing solutions are limited to single objects and continuous, smoothly changing sequences. In this paper we extend NRSfM to a multi-instance domain, in which the images do not need to have temporal consistency, allowing for instance, to jointly reconstruct the face of multiple persons from an unordered list of images. For this purpose, we present a new formulation of the problem based on a dual low-rank shape representation, that simultaneously captures the between- and within-individual deformations. The parameters of this model are learned using a variant of the probabilistic linear discriminant analysis that requires consecutive batches of expectation and maximization steps. The resulting approach estimates 3D deformable shape and pose of multiple instances from only 2D point observations on a collection images, without requiring pre-trained 3D data, and is shown to be robust to noisy measurements and missing points. We provide quantitative and qualitative evaluation on both synthetic and real data, and show consistent benefits compared to current state of the art.
Descripció
The final publication is available at link.springer.com
CitacióAgudo, A., Moreno-Noguer, F. Recovering pose and 3D deformable shape from multi-instance image ensembles. A: Asian Conference on Computer Vision. "Lecture Notes in Computer Science Colection Number: 10114". Taipei: Springer, 2017, p. 291-307.
ISBN978-3-319-54192-1
Versió de l'editorhttps://link.springer.com/chapter/10.1007%2F978-3-319-54190-7_18
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
1789-Recovering ... tance-Image-Ensembles-.pdf | 2,459Mb | Visualitza/Obre |