Performance Analysis of MPI Collective Operations

Previous studies of application usage show that the performance of collective communications are critical for high-performance computing and are often overlooked when compared to the point-to-point performance. In this paper, we analyze and attempt to improve intra-cluster collective communication in the context of the widely deployed MPI programming paradigm by extending accepted models of point-to-point communication, such as Hockney, LogP/LogGP, and PLogP. The predictions from the models were compared to the experimentally gathered data and our findings were used to optimize the implementation of collective operations in the FT-MPI library.

• Type: Conference
• Year: 2005
• Where: IPPS
• Authors: Jelena Pjesivac-Grbovic, Thara Angskun, George Bosilca, Graham E. Fagg, Edgar Gabriel, Jack Dongarra
• Keywords: Collective Communication, Distributed And Parallel Computing, Intra-cluster Collective Communication, IPPS 2005, Point-to-point Performance