Adaptive Overload Control for Busy Internet Servers

13 years 6 months ago
Adaptive Overload Control for Busy Internet Servers
As Internet services become more popular and pervasive, a critical problem that arises is managing the performance of services under extreme overload. This paper presents a set of techniques for managing overload in complex, dynamic Internet services. These techniques are based on an adaptive admission control mechanism that attempts to bound the 90th-percentile response time of requests flowing through the service. This is accomplished by internally monitoring the performance of the service, which is decomposed into a set of event-driven stages connected with request queues. By controlling the rate at which each stage admits requests, the service can perform focused overload management, for example, by filtering only those requests that lead to resource bottlenecks. We present two extensions of this basic controller that provide class-based service differentiation as well as application-specific service degradation. We evaluate these mechanisms using a complex Webbased e-mail serv...
Matt Welsh, David E. Culler
Added 01 Nov 2010
Updated 01 Nov 2010
Type Conference
Year 2003
Authors Matt Welsh, David E. Culler
Comments (0)