资源论文Quadruply Stochastic Gradients for Large Scale Nonlinear Semi-Supervised AUC Optimization

Quadruply Stochastic Gradients for Large Scale Nonlinear Semi-Supervised AUC Optimization

2019-10-08 | |  96 |   55 |   0

Abstract Semi-supervised learning is pervasive in real-world applications, where only a few labeled data are available and large amounts of instances remain unlabeled. Since AUC is an important model evaluation metric in classifification, directly optimizing AUC in semi-supervised learning scenario has drawn much attention in the machine learning community. Recently, it has been shown that one could fifind an unbiased solution for the semi-supervised AUC maximization problem without knowing the class prior distribution. However, this method is hardly scalable for nonlinear classifification problems with kernels. To address this problem, in this paper, we propose a novel scalable quadruply stochastic gradient algorithm (QSG-S2AUC) for nonlinear semi-supervised AUC optimization. In each iteration of the stochastic optimization process, our method randomly samples a positive instance, a negative instance, an unlabeled instance and their random features to compute the gradient and then update the model by using this quadruply stochastic gradient to approach the optimal solution. More importantly, we prove that QSGS2AUC can converge to the optimal solution in O(1/t), where t is the iteration number. Extensive experimental results on a variety of benchmark datasets show that QSG-S2AUC is far more effifi- cient than the existing state-of-the-art algorithms for semi-supervised AUC maximization, while retaining the similar generalization performance

上一篇:Interpolation Consistency Training for Semi-Supervised Learning

下一篇:An Atari Model Zoo for Analyzing, Visualizing, and Comparing Deep Reinforcement Learning Agents

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • Learning to learn...

    The move from hand-designed features to learned...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...