资源论文An Efficient Minibatch Acceptance Test for Metropolis-Hastings?

An Efficient Minibatch Acceptance Test for Metropolis-Hastings?

2019-11-06 | |  38 |   29 |   0
Abstract We present a novel Metropolis-Hastings method for large datasets that uses small expected-size minibatches of data. Previous work on reducing the cost of Metropolis-Hastings tests yields only constant factor reductions versus using the full dataset for each sample. Here we present a method that can be tuned to provide arbitrarily small batch sizes, by adjusting either proposal step size or temperature. Our test uses the noise-tolerant Barker acceptance test with a novel additive correction variable. The resulting test has similar cost to a normal SGD update. Our experiments demonstrate several orderof-magnitude speedups over previous work.

上一篇:Recursive Spoken Instruction-Based One-Shot Object and Action Learning

下一篇:Marathon Race Planning: A Case-Based Reasoning Approach

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...