Performance Evaluation of Collective Write Algorithms in MPI I/O

MPI is the de-facto standard for message passing in parallel scientific applications. MPI-IO is a part of the MPI-2 specification defining file I/O operations in the MPI world. MPI-IO enables performance optimizations for collective file I/O operations as it acts as a portability layer between the application and the file system. The goal of this study is to optimize collective file I/O operations. Three different algorithms for performing collective I/O operations have been developed, implemented, and evaluated on a PVFS2 file system and over NFS. The results indicate that different algorithms promise the highest write bandwidth for different number of processors, application settings and file systems, making a one-size-fits-all solution inefficient.

• Type: Conference
• Year: 2009
• Where: ICCS
• Authors: Mohamad Chaarawi, Suneet Chandok, Edgar Gabriel
• Keywords: Collective file I/o, I/O Operations, ICCS 2009, file I/o Operations