Sciweavers

Share
HPDC
2012
IEEE

Work stealing and persistence-based load balancers for iterative overdecomposed applications

7 years 2 months ago
Work stealing and persistence-based load balancers for iterative overdecomposed applications
Applications often involve iterative execution of identical or slowly evolving calculations. Such applications require incremental rebalancing to improve load balance across iterations. In this paper, we consider the design and evaluation of two distinct approaches to addressing this challenge: persistence-based load balancing and work stealing. The work to be performed is overdecomposed into tasks, enabling automatic rebalancing by the middleware. We present a hierarchical persistence-based rebalancing algorithm that performs localized incremental rebalancing. We also present an active-message-based retentive work stealing algorithm optimized for iterative applications on distributed memory machines. We demonstrate low overheads and high efficiencies on the full NERSC Hopper (146,400 cores) and ALCF Intrepid systems (163,840 cores), and on up to 128,000 cores on OLCF Titan. Categories and Subject Descriptors
Jonathan Lifflander, Sriram Krishnamoorthy, Laxmik
Added 29 Sep 2012
Updated 29 Sep 2012
Type Journal
Year 2012
Where HPDC
Authors Jonathan Lifflander, Sriram Krishnamoorthy, Laxmikant V. Kalé
Comments (0)
books