New Results on the Performance Effects of Autocorrelated Flows in Systems

Temporal dependence within the workload of any computing or networking system has been widely recognized as a significant factor affecting performance. More specifically, burstiness, as a form of temporal dependency, is catastrophic for performance. We use the autocorrelation function in a workload flow to formalize burstiness and also to characterize temporal dependence within a flow. We present results from two application areas: load balancing in a homogeneous cluster environment and capacity planning in a multi-tiered e-commerce system. For the load balancing problem, we show that if autocorrelation exists in the arrival stream to the cluster, classic load balancing policies become ineffective and solutions that focus on “unbalancing” the load offer superior performance. For the case of multi-tiered systems, we show that if there is autocorrelation in the flows, we observe the surprising result that in spite of the fact that the bottleneck resource in the system is far fro...

• Type: Conference
• Year: 2007
• Where: IPPS
• Authors: Evgenia Smirni, Qi Zhang, Ningfang Mi, Alma Riska, Giuliano Casale
• Keywords: Autocorrelation, Distributed And Parallel Computing, IPPS 2007, Load Balancing Policies, Temporal Dependence