资源论文The Randomized Midpoint Method for Log-Concave Sampling

The Randomized Midpoint Method for Log-Concave Sampling

2020-02-23 | |  43 |   32 |   0

Abstract

Sampling from log-concave distributions is a well researched problem that has many applications in statistics and machine learning. We study the distributions of the form 图片.png where 图片.png has an L-Lipschitz gradient and is m-strongly convex. In our paper, we propose a Markov chain Monte Carlo (MCMC) algorithm based on the underdamped Langevin diffusion (ULD). It can achieve  图片.png error (in 2-Wasserstein distance) in 图片.png steps, where 图片.png is the effective diameter of the problem and 图片.png is the condition number. Our algorithm performs significantly faster than the previ- ously best known algorithm for solving this problem, which requires 图片.png steps [7, 15]. Moreover, our algorithm can be easily parallelized to require only 图片.png parallel steps. To solve the sampling problem, we propose a new framework to discretize stochastic differential equations. We apply this framework to discretize and simulate ULD, which converges to the target distribution p* . The framework can be used to solve not only the log-concave sampling problem, but any problem that involves simulating (stochastic) differential equations.

上一篇:CondConv: Conditionally Parameterized Convolutions for Efficient Inference

下一篇:The Implicit Metropolis-Hastings Algorithm

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...