WWW
2008
ACM
14 years 7 months ago
2008
ACM
It is crucial for a web crawler to distinguish between ephemeral and persistent content. Ephemeral content (e.g., quote of the day) is usually not worth crawling, because by the t...