Sciweavers

Share
ICS
2010
Tsinghua U.

Overlapping communication and computation by using a hybrid MPI/SMPSs approach

9 years 1 months ago
Overlapping communication and computation by using a hybrid MPI/SMPSs approach
– Communication overhead is one of the dominant factors that affect performance in high-performance computing systems. To reduce the negative impact of communication, programmers overlap communication and computation by using asynchronous communication primitives. This increases code complexity, requiring more effort to write parallel code and making less readable code. This paper presents the hybrid use of MPI and SMPSs (SMP superscalar), a task-based shared-memory programming model, enhanced with a restart mechanism allowing the programmer to introduce the asynchronism that is necessary to enable the effective communication/computation overlap in a productive way. We demonstrate the hybrid use of MPI/SMPSs with the high-performance LINPACK benchmark, which uses the lookahead technique to overlap communication and computation. MPI/SMPSs improves the performance of a pure MPI with look-ahead by 7,6% on a 1024 processors machine. In addition to better performance, hybrid MPI/SMPSs sub...
Vladimir Marjanovic, Jesús Labarta, Eduard
Added 19 Jul 2010
Updated 19 Jul 2010
Type Conference
Year 2010
Where ICS
Authors Vladimir Marjanovic, Jesús Labarta, Eduard Ayguadé, Mateo Valero
Comments (0)
books