资源论文improving the generalization performance of multi class svm via angular regularization

improving the generalization performance of multi class svm via angular regularization

2019-10-31 | |  41 |   35 |   0
Abstract classification, one core issue is to regularize the coefficient vectors to reduce overfitting. Various regularizers have been proposed such as `2 , `1 , and trace norm. In this paper, we introduce a new type of regularization approach – angular regularization, that encourages the coefficient vectors to have larger angles such that class regions can be widen to flexibly accommodate unseen samples. We propose a novel angular regularizer based on the singular values of the coefficient matrix, where the uniformity of singular values reduces the correlation among different classes and drives the angles between coefficient vectors to increase. In generalization error analysis, we show that decreasing this regularizer effectively reduces generalization error bound. On various datasets, we demonstrate the efficacy of the regularizer in reducing overfitting.

上一篇:diverse weighted bipartite b matching

下一篇:dynamic weighted majority for incremental learning of imbalanced data streams with concept drift

用户评价
全部评价

热门资源

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to learn...

    The move from hand-designed features to learned...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...