资源论文LEARNING TO BALANCE :BAYESIAN META -L EARNING FOR IMBALANCED ANDO UT- OF -DISTRIBUTION TASKS

LEARNING TO BALANCE :BAYESIAN META -L EARNING FOR IMBALANCED ANDO UT- OF -DISTRIBUTION TASKS

2020-01-02 | |  63 |   60 |   0

Abstract

While tasks could come with varying the number of instances and classes in realistic settings, the existing meta-learning approaches for few-shot classification assume that the number of instances per task and class is fixed. Due to such restriction, they learn to equally utilize the meta-knowledge across all the tasks, even when the number of instances per task and class largely varies. Moreover, they do not consider distributional difference in unseen tasks, on which the meta-knowledge may have less usefulness depending on the task relatedness. To overcome these limitations, we propose a novel meta-learning model that adaptively balances the effect of the meta-learning and task-specific learning within each task. Through the learning of the balancing variables, we can decide whether to obtain a solution by relying on the meta-knowledge or task-specific learning. We formulate this objective into a Bayesian inference framework and tackle it using variational inference. We validate our Bayesian Task-Adaptive Meta-Learning (Bayesian TAML) on two realistic taskand class-imbalanced datasets, on which it significantly outperforms existing meta-learning approaches. Further ablation study confirms the effectiveness of each balancing component and the Bayesian learning framework.

上一篇:ECONOMY STATISTICAL RECURRENT UNITS FORI NFERRING NONLINEAR GRANGER CAUSALITY

下一篇:FROM INFERENCE TO GENERATION :E ND -TO -ENDF ULLY SELF -SUPERVISED GENERATION OF HUMANFACE FROM SPEECH

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...