资源论文Semi-Supervised Deep Learning with Memory

Semi-Supervised Deep Learning with Memory

2019-10-29 | |  81 |   48 |   0

Abstract. We consider the semi-supervised multi-class classifification problem of learning from sparse labelled and abundant unlabelled training data. To address this problem, existing semi-supervised deep learning methods often rely on the up-to-date “network-in-training” to formulate the semi-supervised learning objective. This ignores both the discriminative feature representation and the model inference uncertainty revealed by the network in the preceding learning iterations, referred to as the memory of model learning. In this work, we propose a novel Memory-Assisted Deep Neural Network (MA-DNN) capable of exploiting the memory of model learning to enable semi-supervised learning. Specifically, we introduce a memory mechanism into the network training process as an assimilation-accommodation interaction between the network and an external memory module. Experiments demonstrate the advantages of the proposed MA-DNN model over the state-of-the-art semisupervised deep learning methods on three image classifification benchmark datasets: SVHN, CIFAR10, and CIFAR100

上一篇:Transductive Semi-Supervised Deep Learning using Min-Max Features

下一篇:Collaborative Deep Reinforcement Learning for Multi-Object Tracking

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...