On optimizing collective communication

In this paper we discuss issues related to the highperformance implementation of collective communications operations on distributed-memory computer architectures. Using a combination of known techniques (many of which were first proposed in the 1980s and early 1990s) along with careful exploitation of communication modes supported by MPI, we have developed implementations that have improved performance in most situations compared to those currently supported by public domain implementations of MPI such as MPICH. Performance results from a large Intel Pentium 4 (R) processor cluster are included.

• Type: Conference
• Year: 2004
• Where: CLUSTER
• Authors: E. W. Chan, M. F. Heimlich, Avi Purkayastha, Robert A. van de Geijn
• Keywords: CLUSTER 2004, Collective Communications Operations, Distributed And Parallel Computing, Large Intel Pentium, Public Domain Implementations