资源论文Unsupervised Parallel Sentence Extraction with Parallel SegmentDetection Helps Machine Translation

Unsupervised Parallel Sentence Extraction with Parallel SegmentDetection Helps Machine Translation

2019-09-18 | |  116 |   48 |   0 0 0
Abstract Mining parallel sentences from comparable corpora is important. Most previous work relies on supervised systems, which are trained on parallel data, thus their applicability is problematic in low-resource scenarios. Recent developments in building unsupervised bilingual word embeddings made it possible to mine parallel sentences based on cosine similarities of source and target language words. We show that relying only on this information is not enough, since sentences often have similar words but different meanings. We detect continuous parallel segments in sentence pair candidates and rely on them when mining parallel sentences. We show better mining accuracy on three language pairs in a standard shared task on artificial data. We also provide the first experiments showing that parallel sentences mined from real life sources improve unsupervised MT. Our code is available, we hope it will be used to support low-resource MT research.

上一篇:Unsupervised Information Extraction: Regularizing DiscriminativeApproaches with Relation Distribution Losses

下一篇:A Unified Linear-Time Framework for Sentence-Level Discourse Parsing

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...