Abstract

SpatialBoost extends AdaBoost to incorporate spatial rea- soning. We demonstrate the e?ectiveness of SpatialBoost on the problem of interactive image segmentation. Our application takes as input a tri- map of the original image, trains SpatialBoost on the pixels of the ob ject and the background and use the trained classifier to classify the unlabeled pixels. The spatial reasoning is introduced in the form of weak classifiers that attempt to infer pixel label from the pixel labels of surrounding pixels, after each boosting iteration. We call this variant of AdaBoost — SpatialBoost. We then extend the application to work with “GrabCut”. In GrabCut the user casually marks a rectangle around the ob ject, in- stead of tediously marking a tri-map, and we pose the segmentation as the problem of learning with outliers, where we know that only positive pixels (i.e. pixels that are assumed to belong to the ob ject) might be outliers and in fact should belong to the background.