472 search results - page 21 / 95 » Crawling the Hidden Web |
83
Voted
ADCS
2004
14 years 11 months ago
2004
Previous work on domain specific search services in the area of depressive illness has documented the significant human cost required to setup and maintain closed-crawl parameters....
173
click to vote
SIGMOD
2006
ACM
15 years 9 months ago
2006
ACM
Text is ubiquitous and, not surprisingly, many important applications rely on textual data for a variety of tasks. As a notable example, information extraction applications derive...
WWW
2002
ACM
15 years 10 months ago
2002
ACM
In this paper we study how we can design an effective parallel crawler. As the size of the Web grows, it becomes imperative to parallelize a crawling process, in order to finish d...
WWW
2008
ACM
15 years 10 months ago
2008
ACM
This paper shares our experience in designing a web crawler that can download billions of pages using a single-server implementation and models its performance. We show that with ...
WWW
2008
ACM
15 years 10 months ago
2008
ACM
We study in this paper the Web forum crawling problem, which is a very fundamental step in many Web applications, such as search engine and Web data mining. As a typical user-crea...