Fight ill-posedness with ill-posedness:
Single-shot variational depth super-resolution from shading
Abstract
We put forward a principled variational approach for
up-sampling a single depth map to the resolution of the
companion color image provided by an RGB-D sensor. We
combine heterogeneous depth and color data in order to
jointly solve the ill-posed depth super-resolution and shapefrom-shading problems. The low-frequency geometric information necessary to disambiguate shape-from-shading
is extracted from the low-resolution depth measurements
and, symmetrically, the high-resolution photometric clues
in the RGB image provide the high-frequency information
required to disambiguate depth super-resolution.