资源论文Structured Variational Learning of Bayesian Neural Networks with Horseshoe Priors

Structured Variational Learning of Bayesian Neural Networks with Horseshoe Priors

2020-03-11 | |  94 |   38 |   0

Abstract

Bayesian Neural Networks (BNNs) have recently received increasing attention for their ability to provide well-calibrated posterior uncertainties. However, model selection—even choosing the number of nodes—remains an open question. Recent work has proposed the use of a horseshoe prior over node pre-activations of a Bayesian neural network, which effectively turns off nodes that do not help explain the data. In this work, we propose several modeling and inference advances that consistently improve the compactness of the model learned while maintaining predictive performance, especially in smallersample settings including reinforcement learning.

上一篇:Analyzing Uncertainty in Neural Machine Translation

下一篇:Data Summarization at Scale: A Two-Stage Submodular Approach

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...