Selecting the tile shape to reduce the total communication volume

In this paper we revisit the tile-shape selection problem, that has been extensively discussed in bibliography. An efficient approach is proposed for the selection of a suitable tile shape, based on the minimization of the process communication volume. We consider the large family of applications that arise from the discretization of partial differential equations (PDEs). Practical experience has shown that for such applications and distributed memory architectures, minimizing the total communication volume is more important than minimizing the total number of parallel execution steps. We formulate a new method to determine an appropriate communication-aware tile shape, i.e. the one that reduces the communication volume for a fixed number of processes. Our approach is equivalent to defining a proper Cartesian process grid with MPI Cart Create, which means that it can be incorporated in applications in a straightforward manner. Our experimental results illustrate that by selecting t...

• Type: Conference
• Year: 2006
• Where: IPPS
• Authors: Nikolaos Drosinos, Georgios I. Goumas, Nectarios Koziris
• Keywords: Communication Volume, Distributed And Parallel Computing, IPPS 2006, Parallel Execution Steps, Tile Shape