Abstract

Our objective is to count (and localize) object instances in an image interactively. We target the regime where individual object detectors do not work reliably due to crowding, or overlap, or size of the instances, and take the ap- proach of estimating an object density. Our main contribution is an interactive counting system, along with solutions for its main components. Thus, we develop a feature vocabulary that can be effi- ciently learnt on-the-fly as a u ser provides dot annotations – this enables densities to be generated in an interactive system. Furthermore, we show that object den- sity can be estimated simply, accurately and efficiently using ridge regression – this matches the counting accuracy of the much more costly learning-to-count method. Finally, we propose two novel visualization methods for region counts that are efficient and effective – these enable integral count regions to be displayed to quickly determine annotation points for relevance feedback. The interactive system is demonstrated on a variety of visual material, includ- ing photographs, microscopy and satellite images.