Automatic Domain Adaptation for Parsing

9 years 5 days ago
Automatic Domain Adaptation for Parsing
Current statistical parsers tend to perform well only on their training domain and nearby genres. While strong performance on a few related domains is sufficient for many situations, it is advantageous for parsers to be able to generalize to a wide variety of domains. When parsing document collections involving heterogeneous domains (e.g. the web), the optimal parsing model for each document is typically not obvious. We study this problem as a new task -- multiple source parser adaptation. Our system trains on corpora from many different domains. It learns not only statistics of those domains but quantitative measures of domain differences and how those differences affect parsing accuracy. Given a specific target text, the resulting system proposes linear combinations of parsing models trained on the source corpora. Tested across six domains, our system outperforms all non-oracle baselines including the best domain-independent parsing model. Thus, we are able to demonstrate the value ...
David McClosky, Eugene Charniak, Mark Johnson
Added 14 Feb 2011
Updated 14 Feb 2011
Type Journal
Year 2010
Authors David McClosky, Eugene Charniak, Mark Johnson
Comments (0)