[9p-Z10-1~11] 【CS.3】 3.3 情報フォトニクス・画像工学と4.4 Information Photonicsのコードシェアセッション

▲ [9p-Z10-4] [INVITED] Deep Depth from Aberration Map

〇Masako Kashiwagi¹、Nao Mishima¹、Tatsuo Kozakaya¹、Shinsaku Hiura² (1.Toshiba、2.Univ. of Hyogo)

キーワード：computational photography, lens aberration, depth estimation

Passive and convenient depth estimation from single-shot image is still an open problem. Existing depth from defocus methods require multiple input images or special hardware customization. Recent deep monocular depth estimation is also limited to an image with sufficient contextual information. In this work, we propose a novel method which realizes a single-shot deep depth measurement based on physical depth cue using only an off-the-shelf camera and lens. When a defocused image is taken by a camera, it contains various types of aberrations corresponding to distances and positions in the image plane. We named these complexly compound aberrations as Aberration Map (A-Map) and we found that A-Map can be utilized as a reliable physical depth cue. Additionally, our deep network named A-Map Analysis Network (AMA-Net) is also proposed, which can effectively learn and estimate depth via A-Map. To evaluate the validity and robustness of our approach, we have conducted extensive experiments using real outdoor scenes. The qualitative result shows our approach achieved highly accurate depth measurement and highly robust performance.