299 search results - page 22 / 60 » User-centric Web crawling |
WWW
2002
ACM
15 years 10 months ago
2002
ACM
In this paper we study how we can design an effective parallel crawler. As the size of the Web grows, it becomes imperative to parallelize a crawling process, in order to finish d...
CAISE
2010
Springer
14 years 8 months ago
2010
Springer
Search computing is a novel discipline whose goal is to answer complex, multi-domain queries. Such queries typically require combining in their results domain knowledge extracted ...
WWW
2008
ACM
15 years 10 months ago
2008
ACM
This paper shares our experience in designing a web crawler that can download billions of pages using a single-server implementation and models its performance. We show that with ...
JIS
2008
14 years 9 months ago
2008
This paper deals with one aspect of the index quality of search engines: index freshness. The purpose is to analyse the update strategies of the major Web search engines Google, Y...
WWW
2008
ACM
15 years 10 months ago
2008
ACM
We study in this paper the Web forum crawling problem, which is a very fundamental step in many Web applications, such as search engine and Web data mining. As a typical user-crea...