Sciweavers

Share
LREC
2010

The Web Library of Babel: evaluating genre collections

10 years 10 months ago
The Web Library of Babel: evaluating genre collections
We present experiments in automatic genre classification on web corpora, comparing a wide variety of features on several different genreannotated datasets (HGC, I-EN, KI-04, KRYS-I, MGC and SANTINIS). We investigate the performance of several types of features (POS n-grams, character n-grams and word n-grams) and show that simple character n-grams perform best on current collections because of their ability to generalise both lexical and syntactic phenomena related to genres. However, we also show that these impressive results might not be transferrable to the wider web due to the lack of comparability between different annotation labels (many webpages cannot be described in terms of the genre labels in individual collections), lack of representativeness of existing collections (many genres are represented by webpages coming from a small number of sources) as well as problems in the reliability of genre annotation (many pages from the web are difficult to interpret in terms of the l...
Serge Sharoff, Zhili Wu, Katja Markert
Added 29 Jan 2011
Updated 29 Jan 2011
Type Journal
Year 2010
Where LREC
Authors Serge Sharoff, Zhili Wu, Katja Markert
Comments (0)
books