资源论文Asymptotic Guarantees for Learning Generative Models with the Sliced-Wasserstein Distance

Asymptotic Guarantees for Learning Generative Models with the Sliced-Wasserstein Distance

2020-02-21 | |  60 |   42 |   0

Abstract

Minimum expected distance estimation (MEDE) algorithms have been widely used for probabilistic models with intractable likelihood functions and they have become increasingly popular due to their use in implicit generative modeling (e.g. Wasserstein generative adversarial networks, Wasserstein autoencoders). Emerging from computational optimal transport, the Sliced-Wasserstein (SW) distance has become a popular choice in MEDE thanks to its simplicity and computational benefits. While several studies have reported empirical success on generative modeling with SW, the theoretical properties of such estimators have not yet been established. In this study, we investigate the asymptotic properties of estimators that are obtained by minimizing SW. We first show that convergence in SW implies weak convergence of probability measures in general Wasserstein spaces. Then we show that estimators obtained by minimizing SW (and also an approximate version of SW) are asymptotically consistent. We finally prove a central limit theorem, which characterizes? the asymptotic distribution of the estimators and establish a convergence rate of 图片.png, where n denotes the number of observed data points. We illustrate the validity of our theory on both synthetic data and neural networks.

上一篇:Principal Component Projection and Regression in Nearly Linear Time through Asymmetric SVRG

下一篇:Exponentially convergent stochastic k-PCA without variance reduction

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...