Abstract

3D reconstruction of transparent and specular objectsis a very challenging topic in computer vision. For trans-parent and specular objects, which have complex interiorand exterior structures that can reflect and refract lightin a complex fashion, it is difficult, if not impossible, to use either passive stereo or the traditional structured lightmethods to do the reconstruction. We propose a frequencybased 3D reconstruction method, which incorporates the frequency-based matting method. Similar to the structured light methods, a set of frequency-based patterns are projected onto the object, and a camera captures the scene.Each pixel of the captured image is analyzed along the timeaxis and the corresponding signal is transformed to the frequency-domain using the Discrete Fourier Transform. Since the frequency is only determined by the source that creates it, the frequency of the signal can uniquely identify the location of the pixel in the patterns. In this way, the correspondences between the pixels in the captured images and the points in the patterns can be acquired. Using a new labelling procedure, the surface of transparent and specular objects can be reconstructed with very encouraging results.