102 search results - page 2 / 21 » Agent-Based Approach for Web Crawling |
ADBIS
2004
Springer
13 years 10 months ago
2004
Springer
Abstract. Distributed crawling has shown that it can overcome important limitations of the centralized crawling paradigm. However, the distributed nature of current distributed cra...
CN
1999
13 years 4 months ago
1999
The rapid growth of the World-Wide Web poses unprecedented scaling challenges for general-purpose crawlers and search engines. In this paper we describe a new hypertext resource d...
ICDE
2007
IEEE
14 years 6 months ago
2007
IEEE
We describe DSPHERE1 - a decentralized system for crawling, indexing, searching and ranking of documents in the World Wide Web. Unlike most of the existing search technologies tha...
IADIS
2004
13 years 6 months ago
2004
There is a great amount of information on the web that can not be accessed by conventional crawler engines. This portion of the web is usually called hidden web data. To be able t...
ER
2004
Springer
13 years 10 months ago
2004
Springer
The emerging paradigm of web services promises to bring to distributed computing the same flexibility that the web has brought to the publication and search of information contain...