Sciweavers

ESOP
2012
Springer

Generate, Test, and Aggregate - A Calculation-based Framework for Systematic Parallel Programming with MapReduce

11 years 11 months ago
Generate, Test, and Aggregate - A Calculation-based Framework for Systematic Parallel Programming with MapReduce
Abstract. MapReduce, being inspired by the map and reduce primitives available in many functional languages, is the de facto standard for large scale data-intensive parallel programming. Although it has succeeded in popularizing the use of the two primitives for hiding the details of parallel computation, little effort has been made to emphasize the programming methodology behind, which has been intensively studied in the functional programming and program calculation fields. We show that MapReduce can be equipped with a programming theory in calculational form. By integrating the generate-and-test programing paradigm and semirings for aggregation of results, we propose a novel parallel programming framework for MapReduce. The framework consists of two important calculation theorems: the shortcut fusion theorem of semiring homomorphisms bridges the gap between specifications and efficient implementations, and the filter-embedding theorem helps to develop parallel programs in a syst...
Kento Emoto, Sebastian Fischer, Zhenjiang Hu
Added 21 Apr 2012
Updated 21 Apr 2012
Type Journal
Year 2012
Where ESOP
Authors Kento Emoto, Sebastian Fischer, Zhenjiang Hu
Comments (0)