Online learning and detection of faces with low human supervision
Rights accessOpen Access
All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder
ProjectENTENDER EL MOVIMIENTO HUMANO PARA ADAPTAR EL COMPORTAMIENTO DE UN ROBOT (AEI-TIN2017-90086-R)
We present an efficient,online,and interactive approach for computing a classifier, called Wild Lady Ferns (WiLFs), for face learning and detection using small human supervision. More precisely, on the one hand, WiLFs combine online boosting and extremely randomized trees (Random Ferns) to compute progressively an efficient and discriminative classifier. On the other hand, WiLFs use an interactive human-machine approach that combines two complementary learning strategies to reduce considerably the degree of human supervision during learning. While the first strategy corresponds to query-by-boosting active learning, that requests human assistance over difficult samples in function of the classifier confidence, the second strategy refers to a memory-based learning which uses ¿ Exemplar-based Nearest Neighbors (¿ENN) to assist automatically the classifier. A pre-trained Convolutional Neural Network (CNN) is used to perform ¿ENN with high-level feature descriptors. The proposed approach is therefore fast (WilFs run in 1 FPS using a code not fully optimized), accurate (we obtain detection rates over 82% in complex datasets), and labor-saving (human assistance percentages of less than 20%). As a byproduct, we demonstrate that WiLFs also perform semi-automatic annotation during learning, as while the classifier is being computed, WiLFs are discovering faces instances in input images which are used subsequently for training online the classifier. The advantages of our approach are demonstrated in synthetic and publicly available databases, showing comparable detection rates as offline approaches that require larger amounts of handmade training data.
The final publication is available at link.springer.com
CitationVillamizar, M.A.; Sanfeliu, A.; Moreno-Noguer, F. Online learning and detection of faces with low human supervision. "The visual computer", 2019, vol. 35, p. 349-370.
- ROBiri - Grup de Percepció i Manipulació Robotitzada de l'IRI - Articles de revista 
- Departament d'Enginyeria de Sistemes, Automàtica i Informàtica Industrial - Articles de revista [1.370]
- IRI - Institut de Robòtica i Informàtica Industrial, CSIC-UPC - Articles de revista 
- VIS - Visió Artificial i Sistemes Intel·ligents - Articles de revista