Abstract

A helicopter agent has to plan trajectories to track multiple ground targets from the air. The agent has partial information of each target’s pose, and must reason about its uncertainty of the targets’ poses when planning subsequent actions. We present an online, forward-search algorithm for planning under uncertainty by representing the agent’s belief of each target’s pose as a multimodal Gaussian belief. We exploit this parametric belief representation to directly compute the distribution of posterior beliefs after actions are taken. This analytic computation not only enables us to plan in problems with continuous observation spaces, but also allows the agent to search deeper by considering policies composed of multi-step action sequences; deeper searches better enable the agent to keep the targets welllocalized. We present experimental results in simulation, as well as demonstrate the algorithm on an actual quadrotor helicopter tracking multiple vehicles on a road network constructed indoors.