资源论文Empirical Linguistic Study of Sentence Embeddings

Empirical Linguistic Study of Sentence Embeddings

2019-09-20 | |  110 |   54 |   0 0 0
Abstract The purpose of the research is to answer the question whether linguistic information is retained in vector representations of sentences. We introduce a method of analysing the content of sentence embeddings based on universal probing tasks, along with the classification datasets for two contrasting languages. We perform a series of probing and downstream experiments with different types of sentence embeddings, followed by a thorough analysis of the experimental results. Aside from dependency parser-based embeddings, linguistic information is retained best in the recently proposed LASER sentence embeddings.

上一篇:What You Say and How You Say It Matters: Predicting Financial Risk Using Verbal and Vocal Cues

下一篇:#YouToo? Detection of Personal Recollections of Sexual Harassment on Social Media

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • Learning to learn...

    The move from hand-designed features to learned...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...