178 search results - page 3 / 36 » Scheduling Algorithms for Web Crawling |
WWW
2008
ACM
14 years 6 months ago
2008
ACM
It is crucial for a web crawler to distinguish between ephemeral and persistent content. Ephemeral content (e.g., quote of the day) is usually not worth crawling, because by the t...
WWW
2003
ACM
14 years 6 months ago
2003
ACM
The computation of page importance in a huge dynamic graph has recently attracted a lot of attention because of the web. Page importance, or page rank is defined as the fixpoint o...
DMIN
2007
13 years 7 months ago
2007
—User profiles derived from Web navigation data are used in important e-commerce applications such as Web personalization, recommender systems, and Web analytics. In the open en...
WWW
2009
ACM
14 years 6 months ago
2009
ACM
Comprehensive coverage of the public web is crucial to web search engines. Search engines use crawlers to retrieve pages and then discover new ones by extracting the pages' o...
ICDE
2007
IEEE
14 years 7 months ago
2007
IEEE
We describe DSPHERE1 - a decentralized system for crawling, indexing, searching and ranking of documents in the World Wide Web. Unlike most of the existing search technologies tha...