Towards information profiling: data lake content metadata management
Visualitza/Obre
Cita com:
hdl:2117/100712
Tipus de documentText en actes de congrés
Data publicació2016
EditorInstitute of Electrical and Electronics Engineers (IEEE)
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
Abstract
There is currently a burst of Big Data (BD) processed and stored in huge raw data repositories, commonly called Data Lakes (DL). These BD require new techniques of data integration and schema alignment in order to make the data usable by its consumers and to discover the relationships linking their content. This can be provided by metadata services which discover and describe their content. However, there is currently a lack of a systematic approach for such kind of metadata discovery and management. Thus, we propose a framework for the profiling of informational content stored in the DL, which we call information profiling. The profiles are stored as metadata to support data analysis. We formally define a metadata management process which identifies the key activities required to effectively handle this.We demonstrate the alternative techniques and performance of our process using a prototype implementation handling a real-life case-study from the OpenML DL, which showcases the value and feasibility of our approach.
CitacióAl-serafi, A., Abello, A., Romero, O., Calders, T. Towards information profiling: data lake content metadata management. A: Workshop on Data Integration and Applications. "ICDMW 2016: IEEE 16th International Conference on Data Mining Workshops, 12-15 December 2016, Barcelona, Catalonia, Spain". Barcelona: Institute of Electrical and Electronics Engineers (IEEE), 2016, p. 178-185.
ISBN978-1-5090-5472-5
Versió de l'editorhttp://ieeexplore.ieee.org/document/7836664/
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
CM4DL Paper DINA V9 - Camera-ready.pdf | 499,4Kb | Visualitza/Obre |