Mostra el registre d'ítem simple
Towards information profiling: data lake content metadata management
dc.contributor.author | Al-serafi, Ayman Mounir Mohamed |
dc.contributor.author | Abelló Gamazo, Alberto |
dc.contributor.author | Romero Moral, Óscar |
dc.contributor.author | Calders, Toon |
dc.contributor.other | Universitat Politècnica de Catalunya. Departament d'Enginyeria de Serveis i Sistemes d'Informació |
dc.date.accessioned | 2017-02-08T16:20:42Z |
dc.date.available | 2017-02-08T16:20:42Z |
dc.date.issued | 2016 |
dc.identifier.citation | Al-serafi, A., Abello, A., Romero, O., Calders, T. Towards information profiling: data lake content metadata management. A: Workshop on Data Integration and Applications. "ICDMW 2016: IEEE 16th International Conference on Data Mining Workshops, 12-15 December 2016, Barcelona, Catalonia, Spain". Barcelona: Institute of Electrical and Electronics Engineers (IEEE), 2016, p. 178-185. |
dc.identifier.isbn | 978-1-5090-5472-5 |
dc.identifier.uri | http://hdl.handle.net/2117/100712 |
dc.description.abstract | There is currently a burst of Big Data (BD) processed and stored in huge raw data repositories, commonly called Data Lakes (DL). These BD require new techniques of data integration and schema alignment in order to make the data usable by its consumers and to discover the relationships linking their content. This can be provided by metadata services which discover and describe their content. However, there is currently a lack of a systematic approach for such kind of metadata discovery and management. Thus, we propose a framework for the profiling of informational content stored in the DL, which we call information profiling. The profiles are stored as metadata to support data analysis. We formally define a metadata management process which identifies the key activities required to effectively handle this.We demonstrate the alternative techniques and performance of our process using a prototype implementation handling a real-life case-study from the OpenML DL, which showcases the value and feasibility of our approach. |
dc.format.extent | 8 p. |
dc.language.iso | eng |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) |
dc.subject | Àrees temàtiques de la UPC::Informàtica::Enginyeria del software |
dc.subject.lcsh | Metadata |
dc.subject.lcsh | Content management |
dc.subject.other | Metadata |
dc.subject.other | Information profiling |
dc.subject.other | Data lake |
dc.subject.other | Content management |
dc.title | Towards information profiling: data lake content metadata management |
dc.type | Conference report |
dc.subject.lemac | Metadades |
dc.subject.lemac | Tecnologia de la informació -- Gestió |
dc.contributor.group | Universitat Politècnica de Catalunya. MPI - Modelització i Processament de la Informació |
dc.identifier.doi | 10.1109/ICDMW.2016.0033 |
dc.description.peerreviewed | Peer Reviewed |
dc.relation.publisherversion | http://ieeexplore.ieee.org/document/7836664/ |
dc.rights.access | Open Access |
local.identifier.drac | 19680707 |
dc.description.version | Postprint (author's final draft) |
local.citation.author | Al-serafi, A.; Abello, A.; Romero, O.; Calders, T. |
local.citation.contributor | Workshop on Data Integration and Applications |
local.citation.pubplace | Barcelona |
local.citation.publicationName | ICDMW 2016: IEEE 16th International Conference on Data Mining Workshops, 12-15 December 2016, Barcelona, Catalonia, Spain |
local.citation.startingPage | 178 |
local.citation.endingPage | 185 |