Application-level differential checkpointing for HPC applications with dynamic datasets
Visualitza/Obre
Cita com:
hdl:2117/188786
Tipus de documentText en actes de congrés
Data publicació2019
EditorInstitute of Electrical and Electronics Engineers (IEEE)
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
ProjecteDEEP-EST - DEEP (EC-H2020-754304)
LEGaTO - Low Energy Toolset for Heterogeneous Computing (EC-H2020-780681)
LEGaTO - Low Energy Toolset for Heterogeneous Computing (EC-H2020-780681)
Abstract
High-performance computing (HPC) requires resilience techniques such as checkpointing in order to tolerate failures in supercomputers. As the number of nodes and memory in supercomputers keeps on increasing, the size of checkpoint data also increases dramatically, sometimes causing an I/O bottleneck. Differential checkpointing (dCP) aims to minimize the checkpointing overhead by only writing data differences. This is typically implemented at the memory page level, sometimes complemented with hashing algorithms. However, such a technique is unable to cope with dynamic-size datasets. In this work, we present a novel dCP implementation with a new file format that allows fragmentation of protected datasets in order to support dynamic sizes. We identify dirty data blocks using hash algorithms. In order to evaluate the dCP performance, we ported the HPC applications xPic, LULESH 2.0 and Heat2D and analyze them regarding their potential of reducing I/O with dCP and how this data reduction influences the checkpoint performance. In our experiments, we achieve reductions of up to 62% of the checkpoint time.
CitacióKeller, K.; Bautista, L. A. Application-level differential checkpointing for HPC applications with dynamic datasets. A: IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing. "CCGrig 2019 Cyprus: 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing: proceedings". Institute of Electrical and Electronics Engineers (IEEE), 2019, p. 52-61.
ISBN978-1-7281-0912-1
Versió de l'editorhttps://ieeexplore.ieee.org/document/8752865
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
Keller et al.pdf | 492,6Kb | Visualitza/Obre |