Web Contents Tracking by Learning of Page Grammars

13 years 10 months ago

Download www.ifis.mu-luebeck.de

A signiﬁcant fraction of Web data is available only for short periods of time. We consider methods to keep track and to record such dynamic information automatically. The main problems are to ﬁnd adequate reload times for Web data in order to reduce network trafﬁc, to improve the freshness of obtained data and to reduce the risk of loosing information. Previous approaches usually improve reload strategies for Web data by considering the change dynamics of pages, by modeling the behavior statistically and then by applying suitable reload strategies. Based on this approach we ﬁrst give a precise deﬁnition of data changes on the Web. Page changes are described by a page decomposition which is based on the estimation of grammars. Based on this decomposition segments of Web pages are identiﬁed. The change behavior of individual segments is recorded and applied to optimize reload strategies. We show that the completeness of obtained data and the network trafﬁc may be improved ...

Dirk Kukulenz, Christoph Reinke, Nils Hoeller

Real-time Traffic