Sciweavers

ACL
2015

Learning Word Representations by Jointly Modeling Syntagmatic and Paradigmatic Relations

8 years 18 days ago
Learning Word Representations by Jointly Modeling Syntagmatic and Paradigmatic Relations
Vector space representation of words has been widely used to capture fine-grained linguistic regularities, and proven to be successful in various natural language processing tasks in recent years. However, existing models for learning word representations focus on either syntagmatic or paradigmatic relations alone. In this paper, we argue that it is beneficial to jointly modeling both relations so that we can not only encode different types of linguistic properties in a unified way, but also boost the representation learning due to the mutual enhancement between these two types of relations. We propose two novel distributional models for word representation using both syntagmatic and paradigmatic relations via a joint training objective. The proposed models are trained on a public Wikipedia corpus, and the learned representations are evaluated on word analogy and word similarity tasks. The results demonstrate that the proposed models can perform significantly better than all the s...
Fei Sun, Jiafeng Guo, Yanyan Lan, Jun Xu, Xueqi Ch
Added 13 Apr 2016
Updated 13 Apr 2016
Type Journal
Year 2015
Where ACL
Authors Fei Sun, Jiafeng Guo, Yanyan Lan, Jun Xu, Xueqi Cheng
Comments (0)