Performance meets programmabilty: Enabling native Python MPI tasks in PyCOMPSs
Document typeConference report
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Rights accessOpen Access
European Commission's projectExaQUte - EXAscale Quantification of Uncertainties for Technology and Science Simulation (EC-H2020-800898)
The increasing complexity of modern and future computing systems makes it challenging to develop applications that aim for maximum performance. Hybrid parallel programming models offer new ways to exploit the capabilities of the underlying infrastructure. However, the performance gain is sometimes accompanied by increased programming complexity. We introduce an extension to PyCOMPSs, a high-level task-based parallel programming model for Python applications, to support tasks that use MPI natively as part of the task model. Without compromising application's programmability, using Native MPI tasks in PyCOMPSs offers up to 3x improvement in total performance for compute intensive applications and up to 1.9x improvement in total performance for I/O intensive applications over sequential implementation of the tasks.
©2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
CitationElshazly, H. [et al.]. Performance meets programmabilty: Enabling native Python MPI tasks in PyCOMPSs. A: Euromicro International Conference on Parallel, Distributed, and Network-Based Processing. "2020 28th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2020: Västerås, Sweden, 11-13 March 2020: proceedings". Institute of Electrical and Electronics Engineers (IEEE), 2020, p. 63-66. ISBN 978-1-7281-6582-0. DOI 10.1109/PDP50117.2020.00016.
- Doctorat en Arquitectura de Computadors - Ponències/Comunicacions de congressos 
- Computer Sciences - Ponències/Comunicacions de congressos 
- CAP - Grup de Computació d'Altes Prestacions - Ponències/Comunicacions de congressos 
- Departament d'Arquitectura de Computadors - Ponències/Comunicacions de congressos [1.690]