Show simple item record

dc.contributorAbelló Gamazo, Alberto
dc.contributor.authorMendt Peters, Tamara Desiree
dc.contributor.otherUniversitat Politècnica de Catalunya. Departament d'Enginyeria de Serveis i Sistemes d'Informació
dc.description.abstractShared nothing parallel data ow systems aim to bridge the gap between MapReduce and RDBMSs by combining parallel execution of second order functions with operator based optimizations. In parallel systems, job latency is strongly affected by data shuffling and unbalanced data across nodes, thus the degree of parallelism and the data partition- ing functions must be carefully considered when choosing optimization strategies. However, it is hard to make good optimization choices with- out any information about the distribution of the data. We attempt to overcome this challenge in shared nothing parallel data ows by tracking statistics of data sets during query runtime. We use data streaming algo- rithms to track statistics so as to affect job latency as little as possible. We discuss how collected statistics can potentially be used to improve execution plans during runtime.
dc.publisherUniversitat Politècnica de Catalunya
dc.subjectÀrees temàtiques de la UPC::Informàtica
dc.subject.lcshParallel computers
dc.titleCardinality Estimation in Shared-Nothing Parallel Dataflow Engines
dc.typeMaster thesis
dc.subject.lemacOrdinadors paral·lels
dc.rights.accessOpen Access
dc.audience.mediatorFacultat d'Informàtica de Barcelona

Files in this item


This item appears in the following Collection(s)

Show simple item record

All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder