Abstract

Internet photo collections naturally contain a large va-riety of illumination conditions, with the largest differencebetween day and night images. Current modeling tech-niques do not embrace the broad illumination range oftenleading to reconstruction failure or severe artifacts. Wepresent an algorithm that leverages the appearance varietyto obtain more complete and accurate scene geometry along with consistent multi-illumination appearance information. The proposed method relies on automatic scene appearancegrouping, which is used to obtain separate dense 3D mod-els. Subsequent model fusion combines the separate models into a complete and accurate reconstruction of the scene. In addition, we propose a method to derive the appearance information for the model under the different illumination conditions, even for scene parts that are not observed under one illumination condition. To achieve this, we develop a cross-illumination color transfer technique. We evaluate our method on a large variety of landmarks from across Europe reconstructed from a database of 7.4M images.