资源论文Adversarial Multitask Learning for Joint Multi-Feature and Multi-Dialect Morphological Modeling

Adversarial Multitask Learning for Joint Multi-Feature and Multi-Dialect Morphological Modeling

2019-09-18 | |  145 |   123 |   0 0 0
Abstract Morphological tagging is challenging for morphologically rich languages due to the large target space and the need for more training data to minimize model sparsity. Dialectal variants of morphologically rich languages suffer more as they tend to be more noisy and have less resources. In this paper we explore the use of multitask learning and adversarial training to address morphological richness and dialectal variations in the context of full morphological tagging. We use multitask learning for joint morphological modeling for the features within two dialects, and as a knowledge-transfer scheme for crossdialectal modeling. We use adversarial training to learn dialect invariant features that can help the knowledge-transfer scheme from the high to low-resource variants. We work with two dialectal variants: Modern Standard Arabic (high-resource “dialect”1 ) and Egyptian Arabic (low-resource dialect) as a case study. Our models achieve state-of-the-art results for both. Furthermore, adversarial training provides more significant improvement when using smaller training datasets in particular.

上一篇:Accelerating Sparse Matrix Operations in Neural Networks on Graphics Processing Units

下一篇:Are You Convinced? Choosing the More Convincing Evidence with a Siamese Network

用户评价
全部评价

热门资源

  • Deep Cross-media ...

    Cross-media retrieval is a research hotspot in ...

  • Regularizing RNNs...

    Recently, caption generation with an encoder-de...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Joint Pose and Ex...

    Facial expression recognition (FER) is a challe...

  • Supervised Descen...

    Many computer vision problems (e.