资源论文Lifting Techniques for Sequential Decision Making and Probabilistic Inference (Extended Abstract)

Lifting Techniques for Sequential Decision Making and Probabilistic Inference (Extended Abstract)

2019-11-25 | |  43 |   33 |   0
Abstract Many traditional AI algorithms fail to scale as the size of state space increases exponentially with the number of features. One way to reduce computation in such scenarios is to reduce the problem size by grouping symmetric states together and then running the algorithm on the reduced problem. The focus of this work is to exploit symmetry in problems of sequential decision making and probabilistic inference. Our recent workASAPUCT defines new State-Action Pair (SAP) symmetries in Markov Decision Processes. We also apply these SAP symmetries in Monte Carlo Tree Search (MCTS) framework. In probabilistic inference, we expand the notion of unconditional symmetries to contextual symmetries and apply them in Markov Chain Monte Carlo (MCMC) methods. In future, we plan to explore interesting links in symmetry exploitation in different problems and aim to develop a generic symmetry based framework.

上一篇:Online Fair Division Redux

下一篇:Combining Logic and Probability: P-log Perspective

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...