Sciweavers

HIPC
2005
Springer

The Impact of Noise on the Scaling of Collectives: A Theoretical Approach

13 years 9 months ago
The Impact of Noise on the Scaling of Collectives: A Theoretical Approach
The performance of parallel applications running on large clusters is known to degrade due to the interference of kernel and daemon activities on individual nodes, often referred to as noise. In this paper, we focus on an important class of parallel applications, which repeatedly perform computation, followed by a collective operation such as a barrier. We model this theoretically and demonstrate, in a rigorous way, the effect of noise on the scalability of such applications. We study three natural and important classes of noise distributions: The exponential distribution, the heavy-tailed distribution, and the Bernoulli distribution. We show that the systems scale well in the presence of exponential noise, but the performance goes down drastically in the presence of heavy-tailed or Bernoulli noise.
Saurabh Agarwal, Rahul Garg, Nisheeth K. Vishnoi
Added 27 Jun 2010
Updated 27 Jun 2010
Type Conference
Year 2005
Where HIPC
Authors Saurabh Agarwal, Rahul Garg, Nisheeth K. Vishnoi
Comments (0)