22 search results - page 1 / 5 » Efficient URL caching for world wide web crawling |
WWW
2003
ACM
14 years 5 months ago
2003
ACM
Crawling the web is deceptively simple: the basic algorithm is (a) Fetch a page (b) Parse it to extract all linked URLs (c) For all the URLs not seen before, repeat (a)?(c). Howev...
WWW
2001
ACM
14 years 5 months ago
2001
ACM
The enormous growth of the world wide web in recent years has made it important to perform resource discovery e ciently. Consequently, several new ideas have been proposed in rece...
SIGIR
2003
ACM
13 years 9 months ago
2003
ACM
This paper describes a decentralized peer-to-peer model for building a Web crawler. Most of the current systems use a centralized client-server model, in which the crawl is done by...
WWW
2002
ACM
14 years 5 months ago
2002
ACM
Aliasing occurs in Web transactions when requests containing different URLs elicit replies containing identical data payloads. Conventional caches associate stored data with URLs ...
SIGCOMM
1996
ACM
13 years 8 months ago
1996
ACM
World-Wide Web proxy servers that cache documents can potentially reduce three quantities: the number of requests that reach popular servers, the volume of network trac resulting ...