资源论文Adaptive Thompson Sampling Stacks for Memory Bounded Open-Loop Planning

Adaptive Thompson Sampling Stacks for Memory Bounded Open-Loop Planning

2019-10-10 | |  62 |   31 |   0
Abstract We propose Stable Yet Memory Bounded OpenLoop (SYMBOL) planning, a general memory bounded approach to partially observable openloop planning. SYMBOL maintains an adaptive stack of Thompson Sampling bandits, whose size is bounded by the planning horizon and can be automatically adapted according to the underlying domain without any prior domain knowledge beyond a generative model. We empirically test SYMBOL in four large POMDP benchmark problems to demonstrate its effectiveness and robustness w.r.t. the choice of hyperparameters and evaluate its adaptive memory consumption. We also compare its performance with other open-loop planning algorithms and POMCP.

上一篇:A Survey on Hierarchical Planning – One Abstract Idea, Many Concrete Realizations

下一篇:Adversarial Transfer for Named Entity Boundary Detection with Pointer Networks

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • Learning to learn...

    The move from hand-designed features to learned...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...