资源论文Densely Connected CNN with Multi-scale Feature Attention for Text Classification

Densely Connected CNN with Multi-scale Feature Attention for Text Classification

2019-11-07 | |  50 |   48 |   0
Abstract Text classification is a fundamental problem in natural language processing. As a popular deep learning model, convolutional neural network(CNN) has demonstrated great success in this task. However, most existing CNN models apply convolution filters of fixed window size, thereby unable to learn variable n-gram features flexibly. In this paper, we present a densely connected CNN with multi-scale feature attention for text classification. The dense connections build short-cut paths between upstream and downstream convolutional blocks, which enable the model to compose features of larger scale from those of smaller scale, and thus produce variable n-gram features. Furthermore, a multi-scale feature attention is developed to adaptively select multi-scale features for classification. Extensive experiments demonstrate that our model obtains competitive performance against state-of-the-art baselines on six benchmark datasets. Attention visualization further reveals the model’s ability to select proper n-gram features for text classification. Our code is available at: https://github.com/wangshy31/DenselyConnected-CNN-with-Multiscale-FeatureAttention.git.

上一篇:A Reinforced Topic-Aware Convolutional Sequence-to-Sequence Model for Abstractive Text Summarization

下一篇:Transition-based Adversarial Network for Cross-lingual Aspect Extraction Wenya Wang†‡ and Sinno Jialin Pan†

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...