Sciweavers

Share
JIIS
2002

Hidden Markov Models for Text Categorization in Multi-Page Documents

9 years 9 months ago
Hidden Markov Models for Text Categorization in Multi-Page Documents
In the traditional setting, text categorization is formulated as a concept learning problem where each instance is a single isolated document. However, this perspective is not appropriate in the case of many digital libraries that offer as contents scanned and optically read books or magazines. In this paper, we propose a more general formulation of text categorization, allowing documents to be organized as sequences of pages. We introduce a novel hybrid system specifically designed for multi-page text documents. The architecture relies on hidden Markov models whose emissions are bag-of-words resulting from a multinomial word event model, as in the generative portion of the Naive Bayes classifier. The rationale behind our proposal is that taking into account contextual information provided by the whole page sequence can help disambiguation and improves single page classification accuracy. Our results on two datasets of scanned journals from the Making of America collection confirm the ...
Paolo Frasconi, Giovanni Soda, Alessandro Vullo
Added 22 Dec 2010
Updated 22 Dec 2010
Type Journal
Year 2002
Where JIIS
Authors Paolo Frasconi, Giovanni Soda, Alessandro Vullo
Comments (0)
books