SMPLicit: Topology-aware generative model for clothed people
10.1109/CVPR46437.2021.01170
Inclou dades d'ús des de 2022
Cita com:
hdl:2117/365385
Tipus de documentText en actes de congrés
Data publicació2021
EditorInstitute of Electrical and Electronics Engineers (IEEE)
Condicions d'accésAccés obert
Llevat que s'hi indiqui el contrari, els
continguts d'aquesta obra estan subjectes a la llicència de Creative Commons
:
Reconeixement-NoComercial-SenseObraDerivada 3.0 Espanya
ProjecteENTENDER EL MOVIMIENTO HUMANO PARA ADAPTAR EL COMPORTAMIENTO DE UN ROBOT (AEI-TIN2017-90086-R)
Abstract
In this paper we introduce SMPLicit, a novel generative model to jointly represent body pose, shape and clothing geometry. In contrast to existing learning-based approaches that require training specific models for each type of garment, SMPLicit can represent in a unified manner different garment topologies (eg from sleeveless tops to hoodies and to open jackets), while controlling other properties like the garment size or tightness/looseness. We show our model to be applicable to a large variety of garments including T-shirts, hoodies, jackets, shorts, pants, skirts, shoes and even hair. The representation flexibility of SMPLicit builds upon an implicit model conditioned with the SMPL human body parameters and a learnable latent space which is semantically interpretable and aligned with the clothing attributes. The proposed model is fully differentiable, allowing for its use into larger end-to-end trainable systems. In the experimental section, we demonstrate SMPLicit can be readily used for fitting 3D scans and for 3D reconstruction in images of dressed people. In both cases we are able to go beyond state of the art, by retrieving complex garment geometries, handling situations with multiple clothing layers and providing a tool for easy outfit editing. To stimulate further research in this direction, we will make our code and model publicly available at http://www.iri.upc.edu/people/ecorona/smplicit/.
Descripció
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
CitacióCorona, E. [et al.]. SMPLicit: Topology-aware generative model for clothed people. A: IEEE Conference on Computer Vision and Pattern Recognition. "2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition: Virtual, 19-25 June 2021: proceedings". Institute of Electrical and Electronics Engineers (IEEE), 2021, p. 11870-11880. ISBN 978-1-6654-4509-2. DOI 10.1109/CVPR46437.2021.01170.
ISBN978-1-6654-4509-2
Versió de l'editorhttps://ieeexplore.ieee.org/document/9578167
Col·leccions
- IRI - Institut de Robòtica i Informàtica Industrial, CSIC-UPC - Ponències/Comunicacions de congressos [576]
- VIS - Visió Artificial i Sistemes Intel·ligents - Ponències/Comunicacions de congressos [292]
- ROBiri - Grup de Percepció i Manipulació Robotitzada de l'IRI - Ponències/Comunicacions de congressos [252]
- Doctorat en Automàtica, Robòtica i Visió - Ponències/Comunicacions de congressos [166]
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
2511-SMPLicit_- ... del-for-Clothed-People.pdf | 3,609Mb | Visualitza/Obre |