资源论文Zonotope Hit-and-run for Efficient Sampling from Projection DPPs

Zonotope Hit-and-run for Efficient Sampling from Projection DPPs

2020-03-09 | |  64 |   48 |   0

Abstract

Determinantal point processes (DPPs) are distributions over sets of items that model diversity us ing kernels. Their applications in machine learning include summary extraction and recommendation systems. Yet, the cost of sampling from a DPP is prohibitive in large-scale applications, which has triggered an effort towards efficient approximate samplers. We build a novel MCMC sampler that combines ideas from combinatorial geometry, linear programming, and Monte Carlo methods to sample from DPPs with a fixed sample cardinality, also called projection DPPs. Our sampler leverages the ability of the hit-and-run MCMC kernel to efficiently move across convex bodies. Previous theoretical results yield a fast mixing time of our chain when targeting a distribution that is close to a projection DPP, but not DPP in general. Our empirical results demonstrate that this extends to sampling projection DPPs, i.e., our sampler is more sample-efficient than previous approaches which in turn translates to faster convergence when dealing with costlyto-evaluate functions, such as summary extraction in our experiments.

上一篇:Leveraging Union of Subspace Structure to Improve Constrained Clustering

下一篇:Learning Important Features Through Propagating Activation Differences

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • Learning to learn...

    The move from hand-designed features to learned...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...