Learning to link with wikipedia

13 years 8 months ago
Learning to link with wikipedia
This paper describes how to automatically cross-reference documents with Wikipedia: the largest knowledge base ever known. It explains how machine learning can be used to identify significant terms within unstructured text, and enrich it with links to the appropriate Wikipedia articles. The resulting link detector and disambiguator performs very well, with recall and precision of almost 75%. This performance is constant whether the system is evaluated on Wikipedia articles or "real world" documents. This work has implications far beyond enriching documents with explanatory links. It can provide structured knowledge about any unstructured fragment of text. Any task that is currently addressed with bags of words--indexing, clustering, retrieval, and summarization to name a few--could use the techniques described here to draw on a vast network of concepts and semantics. Categories and Subject Descriptors I.2.7 [Artificial Intelligence]: Natural Language Processing
David N. Milne, Ian H. Witten
Added 12 Oct 2010
Updated 12 Oct 2010
Type Conference
Year 2008
Where CIKM
Authors David N. Milne, Ian H. Witten
Comments (0)