Show simple item record

dc.contributor.authorIserte, Sergio
dc.contributor.authorMayo, Rafael
dc.contributor.authorQuintana-Ortí, Enrique S.
dc.contributor.authorBeltran Querol, Vicenç
dc.contributor.authorPeña, Antonio J.
dc.contributor.otherBarcelona Supercomputing Center
dc.identifier.citationIserte, S. [et al.]. Efficient Scalable Computing through Flexible Applications and Adaptive Workloads. A: "2017 46th International Conference on Parallel Processing Workshops (ICPPW)". IEEE, 2017, p. 180-189.
dc.description.abstractIn this paper we introduce a methodology for dynamic job reconfiguration driven by the programming model runtime in collaboration with the global resource manager. We improve the system throughput by exploiting malleability techniques (in terms of number of MPI ranks) through the reallocation of resources assigned to a job during its execution. In our proposal, the OmpSs runtime reconfigures the number of MPI ranks during the execution of an application in cooperation with the Slurm workload manager. In addition, we take advantage of OmpSs offload semantics to allow application developers deal with data redistribution. By combining these elements a job is able to expand itself in order to exploit idle nodes or be shrunk if other queued jobs could be initiated. This novel approach adapts the system workload in order to increase the throughput as well as make a smarter use of the underlying resources. Our experiments demonstrate that this approach can reduce the total execution time of a practical workload by more than 40% while reducing the amount of resources by 30%.
dc.description.sponsorshipThis work is supported by the Project TIN2014-53495-R and TIN2015-65316-P from MINECO and FEDER. Antonio J. Peña is cofinanced by MINECO under Juan de la Cierva fellowship number IJCI-2015-23266. Special thanks to José I. Aliaga for the conjugate gradient code.
dc.format.extent10 p.
dc.rightsAttribution-NonCommercial-NoDerivs 3.0 Spain
dc.subjectÀrees temàtiques de la UPC::Enginyeria elèctrica
dc.subject.lcshDynamic programming
dc.subject.otherDynamic scheduling
dc.subject.otherResource management
dc.subject.otherAdaptation models
dc.subject.otherDynamic programming
dc.subject.otherJob Reconfiguration
dc.subject.otherDynamic Reallocation
dc.subject.otherSmart Resource Utilization
dc.subject.otherScale-Malleable workload
dc.titleEfficient Scalable Computing through Flexible Applications and Adaptive Workloads
dc.typeConference lecture
dc.subject.lemacProgramació dinàmica
dc.subject.lemacEnginyeria de sistemes
dc.description.peerreviewedPeer Reviewed
dc.rights.accessOpen Access
dc.description.versionPostprint (author's final draft)
local.citation.publicationName2017 46th International Conference on Parallel Processing Workshops (ICPPW)

Files in this item


This item appears in the following Collection(s)

Show simple item record

Attribution-NonCommercial-NoDerivs 3.0 Spain
Except where otherwise noted, content on this work is licensed under a Creative Commons license : Attribution-NonCommercial-NoDerivs 3.0 Spain