Abstract

We propose an approach for segmenting the individualbuildings in typical skyline images. Our approach is basedon a Markov Random Field (MRF) formulation that exploitsthe fact that such images contain overlapping objects ofsimilar shapes exhibiting a “tiered” structure. Our con-tributions are the following: (1) A dataset of 120 high-resolution skyline images from twelve different cities with over 4,000 individually labeled buildings that allows us to quantitatively evaluate the performance of various segmen-tation methods, (2) An analysis of low-level features that are useful for segmentation of buildings, and (3) A shapeconstrained MRF formulation that enforces shape priors over the regions. For simple shapes such as rectangles, our formulation is significantly faster to optimize than a standard MRF approach, while also being more accurate. We experimentally evaluate various MRF formulations and demonstrate the effectiveness of our approach in segmenting skyline images.