Unsupervised 3D reconstruction and grouping of rigid and non-rigid categories
Cita com:
hdl:2117/367073
Tipus de documentArticle
Data publicació2022
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
Abstract
In this paper we present an approach to jointly recover camera pose, 3D shape, and object and deformation type grouping, from incomplete 2D annotations in a multi-instance collection of RGB images. Our approach is able to handle indistinctly both rigid and non-rigid categories. This advances existing work, which only addresses the problem for one single object or, they assume the groups to be known a priori when multiple instances are handled. In order to address this broader version of the problem, we encode object deformation by means of multiple unions of subspaces, that is able to span from small rigid motion to complex deformations. The model parameters are learned via Augmented Lagrange Multipliers, in a completely unsupervised manner that does not require any training data at all. Extensive experimental evaluation is provided in a wide variety of synthetic and real scenarios, including rigid and non-rigid categories with small and large deformations. We obtain state-of-the-art solutions in terms of 3D reconstruction accuracy, while also providing grouping results that allow splitting the input images into object instances and their associated type of deformation.
Descripció
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
CitacióAgudo, A. Unsupervised 3D reconstruction and grouping of rigid and non-rigid categories. "IEEE transactions on pattern analysis and machine intelligence", 2022, vol. 44, núm. 1, p. 519-532.
ISSN0162-8828
Versió de l'editorhttps://ieeexplore.ieee.org/document/9137388
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
2344-Unsupervis ... d-Non-Rigid-Categories.pdf | 16,46Mb | Visualitza/Obre |