116
click to vote
SIGMETRICS
2000
ACM
15 years 2 months ago
2000
ACM
In this paper we study how to make web servers (e.g., Apache) more crawler friendly. Current web servers offer the same interface to crawlers and regular web surfers, even though ...