9 search results - page 1 / 2 » Parallel crawlers |
WWW
2002
ACM
14 years 5 months ago
2002
ACM
In this paper we study how we can design an effective parallel crawler. As the size of the Web grows, it becomes imperative to parallelize a crawling process, in order to finish d...
WWW
2007
ACM
14 years 5 months ago
2007
ACM
Given a huge online social network, how do we retrieve information from it through crawling? Even better, how do we improve the crawling performance by using parallel crawlers tha...
ICETE
2007
13 years 6 months ago
2007
GPC
2010
Springer
13 years 6 months ago
2010
Springer
This paper advocated the use of ontology-supported website models to provide a semantic level solution for an information agent so that it can provide fast, precise, and stable que...
PDP
2008
IEEE
13 years 11 months ago
2008
IEEE
This paper describes the design of a crawler devised to perform the periodic retrieval of Web documents for a search engine able to accept on-line updates in a concurrent manner. ...