Sciweavers

Share
ACL
2003

Reliable Measures for Aligning Japanese-English News Articles and Sentences

11 years 9 months ago
Reliable Measures for Aligning Japanese-English News Articles and Sentences
We have aligned Japanese and English news articles and sentences to make a large parallel corpus. We first used a method based on cross-language information retrieval (CLIR) to align the Japanese and English articles and then used a method based on dynamic programming (DP) matching to align the Japanese and English sentences in these articles. However, the results included many incorrect alignments. To remove these, we propose two measures (scores) that evaluate the validity of alignments. The measure for article alignment uses similarities in sentences aligned by DP matching and that for sentence alignment uses similarities in articles aligned by CLIR. They enhance each other to improve the accuracy of alignment. Using these measures, we have successfully constructed a largescale article and sentence alignment corpus available to the public.
Masao Utiyama, Hitoshi Isahara
Added 31 Oct 2010
Updated 31 Oct 2010
Type Conference
Year 2003
Where ACL
Authors Masao Utiyama, Hitoshi Isahara
Comments (0)
books