Sciweavers

Share
ICPADS
2010
IEEE

Hybrid Checkpointing for MPI Jobs in HPC Environments

8 years 9 months ago
Hybrid Checkpointing for MPI Jobs in HPC Environments
As the core count in high-performance computing systems keeps increasing, faults are becoming common place. Checkpointing addresses such faults but captures full process images even though only a subset of the process image changes between checkpoints. We have designed a hybrid checkpointing technique for MPI tasks of high-performance applications. This technique alternates between full and incremental checkpoints: At incremental checkpoints, only data changed since the last checkpoint is captured. Our implementation integrates new BLCR and LAM/MPI features that complement traditional full checkpoints. This results in significantly reduced checkpoint sizes and overheads with only moderate increases in restart overhead. After accounting for cost and savings, benefits due to incremental checkpoints are an order of magnitude larger than overheads on restarts. We further derive qualitative results indicating an optimal balance between full/incremental checkpoints of our novel approach at ...
Chao Wang, Frank Mueller, Christian Engelmann, Ste
Added 12 Feb 2011
Updated 12 Feb 2011
Type Journal
Year 2010
Where ICPADS
Authors Chao Wang, Frank Mueller, Christian Engelmann, Stephen L. Scott
Comments (0)
books