LEMoRe: A lifelog engine for moments retrieval at the NTCIR-lifelog LSAT task
View/Open
Cita com:
hdl:2117/90372
Document typeConference lecture
Defense date2016
Rights accessOpen Access
All rights reserved. This work is protected by the corresponding intellectual and industrial
property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public
communication or transformation of this work are prohibited without permission of the copyright holder
Abstract
Semantic image retrieval from large amounts of egocentric visual data requires to leverage powerful techniques for filling in the semantic gap. This paper introduces LEMoRe, a Lifelog Engine for Moments Retrieval, developed in the context of the Lifelog Semantic Access Task (LSAT) of the the NTCIR-12 challenge and discusses its performance variation on different trials. LEMoRe integrates classical image descriptors with high-level semantic concepts extracted by Convolutional Neural Networks (CNN), powered by a graphic user interface that uses natural language processing. Although this is just a first attempt towards interactive image retrieval from large egocentric datasets and there is a large room for improvement of the system components and the user interface, the structure of the system itself and the way the single components cooperate are very promising.
Citationde Oliveira Barra, G., Cartas, A., Bolaños, M., Dimiccoli, M., Giro, X., Radeva, P. LEMoRe: A lifelog engine for moments retrieval at the NTCIR-lifelog LSAT task. A: NII Testbeds and Community for Information access Research project. "Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies". Tokyo: 2016.
Files | Description | Size | Format | View |
---|---|---|---|---|
03-NTCIR12-LIFELOG-BarraG.pdf | 3,390Mb | View/Open |