Abstract
A vast majority of contemporary cameras employ rolling
shutter (RS) mechanism to capture images. Due to the sequential mechanism, images acquired with a moving camera are subjected to rolling shutter effect which manifests as
geometric distortions. In this work, we consider the specific
scenario of a fast moving camera wherein the rolling shutter distortions not only are predominant but also become
depth-dependent which in turn results in intra-frame occlusions. To this end, we develop a first-of-its-kind pipeline to
recover the latent image of a 3D scene from a set of such
RS distorted images. The proposed approach sequentially
recovers both the camera motion and scene structure while
accounting for RS and occlusion effects. Subsequently, we
perform depth and occlusion-aware rectification of RS images to yield the desired latent image. Our experiments on
synthetic and real image sequences reveal that the proposed
approach achieves state-of-the-art results.