Optimizing computation-communication overlap in asynchronous task-based programs
Visualitza/Obre
Cita com:
hdl:2117/177259
Tipus de documentText en actes de congrés
Data publicació2019
EditorAssociation for Computing Machinery (ACM)
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
Abstract
Asynchronous task-based programming models are gaining popularity to address the programmability and performance challenges in high performance computing. One of the main attractions of these models and runtimes is their potential to automatically expose and exploit overlap of computation with communication. However, we find that inefficient interactions between these programming models and the underlying messaging layer (in most cases, MPI) limit the achievable computation-communication overlap and negatively impact the performance of parallel programs. We address this challenge by exposing and exploiting information about MPI internals in a task-based runtime system to make better task-creation and scheduling decisions. In particular, we present two mechanisms for exchanging information between MPI and a task-based runtime, and analyze their trade-offs. Further, we present a detailed evaluation of the proposed mechanisms implemented in MPI and a task-based runtime. We show performance improvements of up to 16.3% and 34.5% for proxy applications with point-to-point and collective communication, respectively.
CitacióCastillo, E. [et al.]. Optimizing computation-communication overlap in asynchronous task-based programs. A: International Conference on Supercomputing. "ICS 2019: International Conference on Supercomputing: June 26-28, 2019, Phoenix, AZ". New York: Association for Computing Machinery (ACM), 2019, p. 380-391.
ISBN978-1-4503-6079-1
Versió de l'editorhttps://dl.acm.org/citation.cfm?id=3330379
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
main.pdf | 732,5Kb | Visualitza/Obre |