Abstract

In recent years, fluorescence analysis of scenes has re-ceived attention. Fluorescence can provide additional in-formation about scenes, and has been used in applicationssuch as camera spectral sensitivity estimation, 3D recon-struction, and color relighting. In particular, hyperspec-tral images of reflective-fluorescent scenes provide a richamount of data. However, due to the complex nature offluorescence, hyperspectral imaging methods rely on specialized equipment such as hyperspectral cameras and specialized illuminants. In this paper, we propose a more practical approach to hyperspectral imaging of reflectivefluorescent scenes using only a conventional RGB camera and varied colored illuminants. The key idea of our ap-proach is to exploit a unique property of fluorescence: the chromaticity of fluorescence emissions are invariant under different illuminants. This allows us to robustly estimate spectral reflectance and fluorescence emission chromaticity. We then show that given the spectral reflectance and fluorescent chromaticity, the fluorescence absorption and emission spectra can also be estimated. We demonstrate in results that all scene spectra can be accurately estimated from RGB images. Finally, we show that our method can be used to accurately relight scenes under novel lighting.