Sciweavers

Share
EMNLP
2009

Toward Completeness in Concept Extraction and Classification

11 years 3 months ago
Toward Completeness in Concept Extraction and Classification
Many algorithms extract terms from text together with some kind of taxonomic classification (is-a) link. However, the general approaches used today, and specifically the methods of evaluating results, exhibit serious shortcomings. Harvesting without focusing on a specific conceptual area may deliver large numbers of terms, but they are scattered over an immense concept space, making Recall judgments impossible. Regarding Precision, simply judging the correctness of terms and their individual classification links may provide high scores, but this doesn't help with the eventual assembly of terms into a single coherent taxonomy. Furthermore, since there is no correct and complete gold standard to measure against, most work invents some ad hoc evaluation measure. We present an algorithm that is more precise and complete than previous ones for identifying from web text just those concepts `below' a given seed term. Comparing the results to WordNet, we find that the algorithm miss...
Eduard H. Hovy, Zornitsa Kozareva, Ellen Riloff
Added 17 Feb 2011
Updated 17 Feb 2011
Type Journal
Year 2009
Where EMNLP
Authors Eduard H. Hovy, Zornitsa Kozareva, Ellen Riloff
Comments (0)
books