Hallucinating dense optical flow from sparse lidar for autonomous vehicles
Cita com:
hdl:2117/129399
Tipus de documentText en actes de congrés
Data publicació2018
EditorInstitute of Electrical and Electronics Engineers (IEEE)
Condicions d'accésAccés obert
Llevat que s'hi indiqui el contrari, els
continguts d'aquesta obra estan subjectes a la llicència de Creative Commons
:
Reconeixement-NoComercial-SenseObraDerivada 3.0 Espanya
Abstract
In this paper we propose a novel approach to estimate dense optical flow from sparse lidar data acquired on an autonomous vehicle. This is intended to be used as a drop-in replacement of any image-based optical flow system when images are not reliable due to e.g. adverse weather conditions or at night. In order to infer high resolution 2D flows from discrete range data we devise a three-block architecture of multiscale filters that combines multiple intermediate objectives, both in the lidar and image domain. To train this network we introduce a dataset with approximately 20K lidar samples of the Kitti dataset which we have augmented with a pseudo ground-truth image-based optical flow computed using FlowNet2. We demonstrate the effectiveness of our approach on Kitti, and show that despite using the low-resolution and sparse measurements of the lidar, we can regress dense optical flow maps which are at par with those estimated with image-based methods.
Descripció
© 20xx IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
CitacióVaquero, V.; Sanfeliu, A.; Moreno-Noguer, F. Hallucinating dense optical flow from sparse lidar for autonomous vehicles. A: International Conference on Pattern Recognition. "2018 24th International Conference on Pattern Recognition (ICPR)". Institute of Electrical and Electronics Engineers (IEEE), 2018, p. 1959-1964.
Versió de l'editorhttps://ieeexplore.ieee.org/document/8545803
Col·leccions
- IRI - Institut de Robòtica i Informàtica Industrial, CSIC-UPC - Ponències/Comunicacions de congressos [575]
- Departament d'Enginyeria de Sistemes, Automàtica i Informàtica Industrial - Ponències/Comunicacions de congressos [1.497]
- VIS - Visió Artificial i Sistemes Intel·ligents - Ponències/Comunicacions de congressos [292]
- ROBiri - Grup de Percepció i Manipulació Robotitzada de l'IRI - Ponències/Comunicacions de congressos [251]
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
2067-Hallucinat ... or-Autonomous-Vehicles.pdf | 1,346Mb | Visualitza/Obre |