资源论文Automated Generation of Interaction Graphs for Value-Factored Dec-POMDPs William Yeoh Akshat Kumar Shlomo Zilberstein

Automated Generation of Interaction Graphs for Value-Factored Dec-POMDPs William Yeoh Akshat Kumar Shlomo Zilberstein

2019-11-11 | |  92 |   43 |   0
Abstract The Decentralized Partially Observable Markov Decision Process (Dec-POMDP) is a powerful model for multiagent planning under uncertainty, but its applicability i hindered by its high complexity – solving Dec-POMDPs optimally is NEXP-hard. Recently, Kumar et al. introduced the Value Factorization (VF) framework, which exploits decomposable value functions that can be factored into subfunctions. This framework has been shown to be a generalization of several models that leverage sparse agent interactions such as TI-Dec-MDPs, NDPOMDPs and TD-POMDPs. Existing algorithms for these models assume that the interaction graph of the problem is given. In this paper, we introduce three algorithms to automatically generate interaction graphs for models within the VF framework and establish lower and upper bounds on the expected reward of an optimal joint policy. We illustrate experimentally the benefits of thes techniques for sensor placement in a decentralized tracking application.

上一篇:Scaling-Up Security Games with Boundedly Rational Adversaries: A Cutting-Plane Approach

下一篇:A Reputation Management Approach for Resource Constrained Trustee Agents

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...