Unified fault-tolerance framework for hybrid task-parallel message-passing applications
Rights accessOpen Access
European Commission's projectMONT-BLANC 2 - Mont-Blanc 2, European scalable and power efficient HPC platform based onlow-power embedded technology (EC-FP7-610402)
We present a unified fault-tolerance framework for task-parallel message-passing applications to mitigate transient errors. First, we propose a fault-tolerant message-logging protocol that only requires the restart of the task that experienced the error and transparently handles any message passing interface calls inside the task. In our experiments we demonstrate that our fault-tolerant solution has a reasonable overhead, with a maximum observed overhead of 4.5%. We also show that fine-grained parallelization is important for hiding the overheads related to the protocol as well as the recovery of tasks. Secondly, we develop a mathematical model to unify task-level checkpointing and our protocol with system-wide checkpointing in order to provide complete failure coverage. We provide closed formulas for the optimal checkpointing interval and the performance score of the unified scheme. Experimental results show that the performance improvement can be as high as 98% with the unified scheme.
CitationSubasi, Omer [et al.]. Unified fault-tolerance framework for hybrid task-parallel message-passing applications. "International Journal of High Performance Computing Applications", 26 Setembre 2016.
All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder