Sciweavers

Share
ICDE
2011
IEEE

Hyracks: A flexible and extensible foundation for data-intensive computing

8 years 3 months ago
Hyracks: A flexible and extensible foundation for data-intensive computing
Abstract—Hyracks is a new partitioned-parallel software platform designed to run data-intensive computations on large shared-nothing clusters of computers. Hyracks allows users to express a computation as a DAG of data operators and connectors. Operators operate on partitions of input data and produce partitions of output data, while connectors repartition operators’ outputs to make the newly produced partitions available at the consuming operators. We describe the Hyracks end user model, for authors of dataflow jobs, and the extension model for users who wish to augment Hyracks’ built-in library with new operator and/or connector types. We also describe our initial Hyracks implementation. Since Hyracks is in roughly the same space as the open source Hadoop platform, we compare Hyracks with Hadoop experimentally for several different kinds of use cases. The initial results demonstrate that Hyracks has significant promise as a next-generation platform for dataintensive applicati...
Vinayak R. Borkar, Michael J. Carey, Raman Grover,
Added 21 Aug 2011
Updated 21 Aug 2011
Type Journal
Year 2011
Where ICDE
Authors Vinayak R. Borkar, Michael J. Carey, Raman Grover, Nicola Onose, Rares Vernica
Comments (0)
books