Sciweavers

IJHPCA
2010

The Importance of Non-Data-Communication Overheads in MPI

13 years 2 months ago
The Importance of Non-Data-Communication Overheads in MPI
With processor speeds no longer doubling every 18-24 months owing to the exponential increase in power consumption and heat dissipation, modern HEC systems tend to rely lesser on the performance of single processing units. Instead, they rely on achieving high-performance by using the parallelism of a massive number of low-frequency/low-power processing cores. Using such low-frequency cores, however, puts a premium on end-host pre- and post-communication processing required within communication stacks, such as the message passing interface (MPI) implementation. Similarly, small amounts of serialization within the communication stack that were acceptable on small/medium systems can be brutal on massively parallel systems. Thus, in this paper, we study the different non-data-communication overheads within the MPI implementation on the IBM Blue Gene/P system. Specifically, we analyze various aspects of MPI, including the MPI stack overhead itself, overhead of allocating and queueing requ...
Pavan Balaji, Anthony Chan, William Gropp, Rajeev
Added 27 Jan 2011
Updated 27 Jan 2011
Type Journal
Year 2010
Where IJHPCA
Authors Pavan Balaji, Anthony Chan, William Gropp, Rajeev Thakur, Ewing L. Lusk
Comments (0)