Everest: Scaling Down Peak Loads Through I/O Off-Loading

10 years 1 months ago
Everest: Scaling Down Peak Loads Through I/O Off-Loading
Bursts in data center workloads are a real problem for storage subsystems. Data volumes can experience peak I/O request rates that are over an order of magnitude higher than average load. This requires significant overprovisioning, and often still results in significant I/O request latency during peaks. In order to address this problem we propose Everest, which allows data written to an overloaded volume to be temporarily off-loaded into a short-term virtual store. Everest creates the short-term store by opportunistically pooling underutilized storage resources either on a server or across servers within the data center. Writes are temporarily off-loaded from overloaded volumes to lightly loaded volumes, thereby reducing the I/O load on the former. Everest is transparent to and usable by unmodified applications, and does not change the persistence or consistency of the storage system. We evaluate Everest using traces from a production Exchange mail server as well as
Dushyanth Narayanan, Austin Donnelly, Eno Thereska
Added 03 Dec 2009
Updated 03 Dec 2009
Type Conference
Year 2008
Where OSDI
Authors Dushyanth Narayanan, Austin Donnelly, Eno Thereska, Sameh Elnikety, Antony I. T. Rowstron
Comments (0)