77
Voted
WWW
2001
ACM
15 years 10 months ago
2001
ACM
Current-day crawlers retrieve content only from the publicly indexable Web, i.e., the set of Web pages reachable purely by following hypertext links, ignoring search forms and pag...