Ir al contenido (pulsa Retorno)

Universitat Politècnica de Catalunya

    • Català
    • Castellano
    • English
    • LoginRegisterLog in (no UPC users)
  • mailContact Us
  • world English 
    • Català
    • Castellano
    • English
  • userLogin   
      LoginRegisterLog in (no UPC users)

UPCommons. Global access to UPC knowledge

57.064 UPC E-Prints
You are here:
View Item 
  •   DSpace Home
  • E-prints
  • Centres de recerca
  • BSC - Barcelona Supercomputing Center
  • Computer Applications in Science & Engineering
  • Ponències/Comunicacions de congressos
  • View Item
  •   DSpace Home
  • E-prints
  • Centres de recerca
  • BSC - Barcelona Supercomputing Center
  • Computer Applications in Science & Engineering
  • Ponències/Comunicacions de congressos
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Improving object detection in paintings based on time contexts

Thumbnail
View/Open
Improving_object_detection_in_paintings_based_ontime_contexts.pdf (3,115Mb)
Share:
 
 
10.1109/ICDMW51313.2020.00133
 
  View Usage Statistics
Cita com:
hdl:2117/341517

Show full item record
Marinescu, Maria CristinaMés informacióMés informació
Reshetnikov, Artem
More López, Joaquim
Document typeConference report
Defense date2020
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Rights accessOpen Access
All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder
Abstract
This paper proposes a novel approach to object detection for the Cultural Heritage domain, which relies on combining Deep Learning and semantic metadata about candidate objects extracted from existing sources such as Wikidata, dictionaries, or Google NGram. Working with cultural heritage presents challenges not present in every-day images. In computer vision, object detection models are usually trained with datasets whose classes are not imaginary concepts, and have neither symbolic nor time-specific dimensions. Apart from this conceptual problem, the paintings are limited in number and represent the same concept in potentially very different styles. Finally, the metadata associated with the images is often poor or inexistent, which makes it hard to properly train a model. Our approach can improve the precision of object detection by placing the classes detected by a neural network model in time, based on the dates of their first known use. By taking into account the time of inception of objects such as the TV, cell phone, or scissors, and the appearance of some objects in the geographical space that corresponds to a painting (e.g. bananas or broccoli in 15th century Europe), we can correct and refine the detected objects based on their chronologic probability.
CitationMarinescu, M.; Reshetnikov, A.; More, J. Improving object detection in paintings based on time contexts. A: IEEE International Conference On Data Mining. "20th IEEE International Conference on Data Mining Workshops: 17-20 November 2020, virtual conference: proceedings". Institute of Electrical and Electronics Engineers (IEEE), 2020, p. 926-932. ISBN 978-1-7281-9012-9. DOI 10.1109/ICDMW51313.2020.00133. 
URIhttp://hdl.handle.net/2117/341517
DOI10.1109/ICDMW51313.2020.00133
ISBN978-1-7281-9012-9
Publisher versionhttps://ieeexplore.ieee.org/document/9346513
Collections
  • Computer Applications in Science & Engineering - Ponències/Comunicacions de congressos [65]
  • Departament d'Arquitectura de Computadors - Ponències/Comunicacions de congressos [1.773]
Share:
 
  View Usage Statistics

Show full item record

FilesDescriptionSizeFormatView
Improving_objec ... _based_ontime_contexts.pdf3,115MbPDFView/Open

Browse

This CollectionBy Issue DateAuthorsOther contributionsTitlesSubjectsThis repositoryCommunities & CollectionsBy Issue DateAuthorsOther contributionsTitlesSubjects

© UPC Obrir en finestra nova . Servei de Biblioteques, Publicacions i Arxius

info.biblioteques@upc.edu

  • About This Repository
  • Contact Us
  • Send Feedback
  • Inici de la pàgina