资源分类
》 资源 》论文》Better Character Language Modeling Through Morphology

Better Character Language Modeling Through Morphology

2019-09-19 | |  100 |   50 |   0 0 0
Abstract We incorporate morphological supervision into character language models (CLMs) via multitasking and show that this addition improves bits-per-character (BPC) performance across 24 languages, even when the morphology data and language modeling data are disjoint. Analyzing the CLMs shows that in- flected words benefit more from explicitly modeling morphology than uninflected words, and that morphological supervision improves performance even as the amount of language modeling data grows. We then transfer morphological supervision across languages to improve language modeling performance in the low-resource setting.

上一篇：Barack’s Wife Hillary: Using Knowledge Graphs for Fact-Aware Language Modeling

下一篇：Dynamically Fused Graph Network for Multi-hop Reasoning

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • Learning to learn...

    The move from hand-designed features to learned...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...