Show simple item record

dc.contributor.authorNadal Francesch, Sergi
dc.contributor.authorAbelló Gamazo, Alberto
dc.contributor.authorRomero Moral, Óscar
dc.contributor.authorVansummeren, Stijn
dc.contributor.authorVassiliadis, Panos
dc.contributor.otherUniversitat Politècnica de Catalunya. Departament d'Enginyeria de Serveis i Sistemes d'Informació
dc.date.accessioned2019-01-31T11:07:11Z
dc.date.available2019-01-31T11:07:11Z
dc.date.issued2018
dc.identifier.citationNadal, S. [et al.]. MDM: governing evolution in big data ecosystems. A: International Conference on Extending Database Technology. "Advances in Database Technology, EDBT 2018, 21st International Conference on Extending Database Technology: Vienna, Austria, March 26–29, 2018: proceedings". Konstanz: OpenProceedings, 2018, p. 682-685.
dc.identifier.isbn978-3-89318-078-3
dc.identifier.urihttp://hdl.handle.net/2117/128004
dc.description.abstractOn-demand integration of multiple data sources is a critical requirement in many Big Data settings. This has been coined as the data variety challenge, which refers to the complexity of dealing with an heterogeneous set of data sources to enable their integrated analysis. In Big Data settings, data sources are commonly represented by external REST APIs, which provide data in their original format and continously apply changes in their structure (i.e., schema). Thus, data analysts face the challenge to integrate such multiple sources, and then continuosly adapt their analytical processes to changes in the schema. To address this challenges, in this paper, we present the Metadata Management System, shortly MDM, a tool that supports data stewards and analysts to manage the integration and analysis of multiple heterogeneous sources under schema evolution. MDM adopts a vocabulary-based integration-oriented ontology to conceptualize the domain of interest and relies on local-as-view mappings to link it with the sources. MDM provides user-friendly mechanisms to manage the ontology and mappings. Finally, a query rewriting algorithm ensures that queries posed to the ontology are correctly resolved to the sources in the presence of multiple schema versions, a transparent process to data analysts. On-site, we will showcase using real-world examples how MDM facilitates the management of multiple evolving data sources and enables its integrated analysis.
dc.format.extent4 p.
dc.language.isoeng
dc.publisherOpenProceedings
dc.rightsAttribution-NonCommercial-NoDerivs 3.0 Spain
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/3.0/es/
dc.subjectÀrees temàtiques de la UPC::Informàtica::Sistemes d'informació
dc.subject.lcshOntologies (Information retrieval)
dc.subject.lcshBig data
dc.subject.otherMetadata Management System
dc.subject.otherMDM
dc.titleMDM: governing evolution in big data ecosystems
dc.typeConference lecture
dc.subject.lemacOntologies (Informàtica)
dc.subject.lemacMacrodades
dc.contributor.groupUniversitat Politècnica de Catalunya. inSSIDE - integrated Software, Service, Information and Data Engineering
dc.contributor.groupUniversitat Politècnica de Catalunya. IMP - Information Modeling and Processing
dc.identifier.doi10.5441/002/edbt.2018.84
dc.description.peerreviewedPeer Reviewed
dc.relation.publisherversionhttps://openproceedings.org/2018/conf/edbt/paper-307.pdf
dc.rights.accessOpen Access
local.identifier.drac23613534
dc.description.versionPostprint (published version)
dc.relation.projectidinfo:eu-repo/grantAgreement/MINECO/1PE/TIN2016-79269-R
dc.relation.projectidinfo:eu-repo/grantAgreement/EC/H2020/644018/EU/SUpporting evolution and adaptation of PERsonalized Software by Exploiting contextual Data and End-user feedback/SUPERSEDE
local.citation.authorNadal, S.; Abelló, A.; Romero, O.; Vansummeren, S.; Vassiliadis , P.
local.citation.contributorInternational Conference on Extending Database Technology
local.citation.pubplaceKonstanz
local.citation.publicationNameAdvances in Database Technology, EDBT 2018, 21st International Conference on Extending Database Technology: Vienna, Austria, March 26–29, 2018: proceedings
local.citation.startingPage682
local.citation.endingPage685


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record

Attribution-NonCommercial-NoDerivs 3.0 Spain
Except where otherwise noted, content on this work is licensed under a Creative Commons license : Attribution-NonCommercial-NoDerivs 3.0 Spain