3D Reconstruction under Light Ray Distortion from Parametric Focal Cameras
Publication date: Available online 10 November 2018
Source: Pattern Recognition Letters
Author(s): Satoshi Morinaka, Fumihiko Sakaue, Jun Sato, Kazuhisa Ishimaru, Naoki Kawasaki
In this paper, we propose a new method for reconstructing 3D objects under light ray distortion caused by unknown refractive media. The proposed method can reconstruct 3D scene, even if light rays projected into the cameras are refracted by unknown refractive media, such as glasses and raindrops. For this objective, we represent light ray projection of multiple cameras by using a pair of planes shared by the multiple cameras in the scene. By using this model, intrinsic and extrinsic camera parameters as well as the refractive properties of the refractive media can be represented efficiently. By using the newly defined camera model, we propose a method for recovering 3D points and camera parameters with refractive properties simultaneously. The experimental results show the efficiency of the proposed camera model and reconstruction method.