Rooftop Detection and 3D Building Modeling from Aerial Images

This paper presents a new procedure for rooftop detection and 3D building modeling from aerial images. After an over-segmentation of the aerial image, the rooftop regions are coarsely detected by employing multi-scale SIFT-like features and visual object recognition. In order to refine the detected result and remove the non-rooftop regions, we further resort to explore the 3D information of the rooftop by 3D reconstruction. Wherein, we employ a hierarchical strategy to obtain the corner correspondence between images based on an asymmetry correlation corner matching. We determine whether a candidate region is a rooftop or not according to its height information relative to the ground plane. Finally, the 3D building model with texture mapping based on one of the images is given. Experimental results are shown on real aerial scenes.