Fast scans and joins using flash drives

11 years 9 months ago
Fast scans and joins using flash drives
As access times to main memory and disks continue to diverge, faster non-volatile storage technologies become more attractive for speeding up data analysis applications. NAND flash is one such promising substitute for disks. Flash offers faster random reads than disk, consumes less power than disk, and is cheaper than DRAM. In this paper, we investigate alternative data layouts and join algorithms suited for systems that use flash drives as the non-volatile store. All of our techniques take advantage of the fast random reads of flash. We convert traditional sequential I/O algorithms to ones that use a mixture of sequential and random I/O to process less data in less time. Our measurements on commodity flash drives show that a column-major layout of data pages is faster than a traditional row-based layout for simple scans. We present a new join algorithm, RARE-join, designed for a column-based page layout on flash and compare it to a traditional hash join algorithm. Our analysis shows ...
Mehul A. Shah, Stavros Harizopoulos, Janet L. Wien
Added 19 Oct 2010
Updated 19 Oct 2010
Type Conference
Year 2008
Authors Mehul A. Shah, Stavros Harizopoulos, Janet L. Wiener, Goetz Graefe
Comments (0)