资源论文A New PAC-Bayesian Perspective on Domain Adaptation

A New PAC-Bayesian Perspective on Domain Adaptation

2020-03-06 | |  67 |   51 |   0

Abstract

We study the issue of PAC-Bayesian domain adaptation: We want to learn, from a source domain, a majority vote model dedicated to a target one. Our theoretical contribution brings a new perspective by deriving an upper-bound on the target risk where the distributions’ divergence— expressed as a ratio—controls the trade-off between a source error measure and the target voters’ disagreement. Our bound suggests that one has to focus on regions where the source data is informative. From this result, we derive a PACBayesian generalization bound, and specialize it to linear classifiers. Then, we infer a learning a gorithm and perform experiments on real data.

上一篇:Why Most Decisions Are Easy in Tetris—And Perhaps in Other Sequential Decision Problems, As Well

下一篇:Energetic Natural Gradient Descent

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...