资源论文Improving Performance of Topic Models by Variable Grouping

Improving Performance of Topic Models by Variable Grouping

2019-11-12 | |  62 |   48 |   0
Abstract Topic models have a wide range of applications, including modeling of text documents, images, user preferences, product rankings, and many others. However, learning optimal models may be dif?cult, especially for large problems. The reason is that inference techniques such as Gibbs sampling often converge to suboptimal models due to the abundance of local minima in large datasets. In this paper, we propose a general method of improving the performance of topic models. The method, called ‘grouping transform’, works by introducing auxiliary variables which represent assignments of the original model tokens to groups. Using these auxiliary variables, it becomes possible to resample an entire group of tokens at a time. This allows the sampler to make larger state space moves. As a result, better models are learned and performance is improved. The proposed ideas are illustrated on several topic models and several text and image datasets. We show that the grouping transform signi?cantly improves performance over standard models.

上一篇:A Framework for Incorporating General Domain Knowledge into Latent Dirichlet Allocation Using First-Order Logic

下一篇:Learning a Distance Metric by Empirical Loss Minimization Wei Bian and Dacheng Tao

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...