Mostra el registre d'ítem simple
On the representativeness of convolutional neural networks layers
dc.contributor.author | García Gasulla, Darío |
dc.contributor.author | Moreno, Jonatan |
dc.contributor.author | Ramos-Pollan, Raúl |
dc.contributor.author | Casadiegos Barrios, Romel |
dc.contributor.author | Béjar Alonso, Javier |
dc.contributor.author | Cortés García, Claudio Ulises |
dc.contributor.author | Ayguadé Parra, Eduard |
dc.contributor.author | Labarta Mancho, Jesús José |
dc.contributor.author | Suzumura, Toyotaro |
dc.contributor.other | Universitat Politècnica de Catalunya. Departament de Ciències de la Computació |
dc.contributor.other | Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors |
dc.contributor.other | Barcelona Supercomputing Center |
dc.date.accessioned | 2016-11-11T10:34:34Z |
dc.date.available | 2016-11-11T10:34:34Z |
dc.date.issued | 2016 |
dc.identifier.citation | García, D., Moreno, J., Ramos-Pollan, R., Barrios, R., Béjar, J., Cortés, C., Ayguadé, E., Labarta, J., Suzumura, T. On the representativeness of convolutional neural networks layers. A: "Artificial Intelligence Research and Development: proceedings of the 19th International Conference of the Catalan Association for Artificial Intelligence: Barcelona, Catalonia, Spain, October 19–21, 2016". IOS PRESS EBOOKS, 2016, p. 29-38. |
dc.identifier.isbn | 978-1-61499-695-8 |
dc.identifier.uri | http://hdl.handle.net/2117/96526 |
dc.description.abstract | Convolutional Neural Networks (CNN) are the most popular of deep network models due to their applicability and success in image processing. Although plenty of effort has been made in designing and training better discriminative CNNs, little is yet known about the internal features these models learn. Questions like, what specific knowledge is coded within CNN layers, and how can it be used for other purposes besides discrimination, remain to be answered. To advance in the resolution of these questions, in this work we extract features from CNN layers, building vector representations from CNN activations. The resultant vector embedding is used to represent first images and then known image classes. On those representations we perform an unsupervised clustering process, with the goal of studying the hidden semantics captured in the embedding space. Several abstract entities untaught to the network emerge in this process, effectively defining a taxonomy of knowledge as perceived by the CNN. We evaluate and interpret these sets using WordNet, while studying the different behaviours exhibited by the layers of a CNN model according to their depth. Our results indicate that, while top (i.e., deeper) layers provide the most representative space, low layers also define descriptive dimensions. |
dc.description.sponsorship | This work was partially supported by the IBM/BSC Technology Center for Supercomputing (Joint Study Agreement, No. W156463), by the Spanish Government through Programa Severo Ochoa (SEV-2015-0493), by the Spanish Ministry of Science and Technology through TIN2015-65316-P project and by the Generalitat de Catalunya (contracts 2014-SGR-1051). |
dc.format.extent | 10 p. |
dc.language.iso | eng |
dc.publisher | IOS PRESS EBOOKS |
dc.subject | Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial |
dc.subject.lcsh | Neural networks (Computer science) |
dc.subject.lcsh | Image processing |
dc.subject.other | Convolutional neural networks |
dc.subject.other | Visual embeddings |
dc.subject.other | Unsupervised learning |
dc.title | On the representativeness of convolutional neural networks layers |
dc.type | Part of book or chapter of book |
dc.subject.lemac | Xarxes neuronals (Informàtica) |
dc.subject.lemac | Imatges -- Processament |
dc.contributor.group | Universitat Politècnica de Catalunya. KEMLG - Grup d'Enginyeria del Coneixement i Aprenentatge Automàtic |
dc.contributor.group | Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions |
dc.identifier.doi | 10.3233/978-1-61499-696-5-29 |
dc.description.peerreviewed | Peer Reviewed |
dc.relation.publisherversion | http://ebooks.iospress.nl/volumearticle/45307 |
dc.rights.access | Open Access |
local.identifier.drac | 19257322 |
dc.description.version | Postprint (author's final draft) |
dc.relation.projectid | info:eu-repo/grantAgreement/MINECO//TIN2015-65316-P/ES/COMPUTACION DE ALTAS PRESTACIONES VII/ |
local.citation.author | García, D.; Moreno, J.; Ramos-Pollan, R.; Barrios, R.; Béjar, J.; Cortés, C.; Ayguadé, E.; Labarta, J.; Suzumura, T. |
local.citation.publicationName | Artificial Intelligence Research and Development: proceedings of the 19th International Conference of the Catalan Association for Artificial Intelligence: Barcelona, Catalonia, Spain, October 19–21, 2016 |
local.citation.startingPage | 29 |
local.citation.endingPage | 38 |
Fitxers d'aquest items
Aquest ítem apareix a les col·leccions següents
-
Capítols de llibre [15]
-
Capítols de llibre [29]
-
Capítols de llibre [22]
-
Capítols de llibre [86]
-
Capítols de llibre [80]