日本地球惑星科学連合2024年大会

講演情報

[J] 口頭発表

セッション記号 P (宇宙惑星科学) » P-PS 惑星科学

[P-PS09] 月の科学と探査

2024年5月27日(月) 13:45 〜 15:15 101 (幕張メッセ国際会議場)

コンビーナ:西野 真木(宇宙航空研究開発機構宇宙科学研究所)、鹿山 雅裕(東京大学大学院総合文化研究科広域科学専攻広域システム科学系)、仲内 悠祐(立命館大学)、小野寺 圭祐(東京大学地震研究所)、座長:三宅 洋平(神戸大学大学院システム情報学研究科)、長岡 央(立命館大学)


14:45 〜 15:00

[PPS09-15] A deep learning-based local feature method and its application in photogrammetry on the Moon and Mars

*Jiageng Zhong1、Jianguo Yan1、Ming Li1 (1.State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University)

キーワード:3D reconstruction, image matching, deep learning, rover imagery

Topographic reconstruction of planetary surfaces is crucial for engineering applications and scientific research in planetary exploration missions. Typical reconstruction methods are usually based on photogrammetric techniques, which estimate three-dimensional structures from a set of two-dimensional images. For image alignment, it requires invariant features for correspondence search. Scale-Invariant Feature Transform (SIFT) is one of the most famous and widely used local feature methods. However, hand-crafted features like SIFT perform poorly under weak texture and low light conditions, leading to unsuccessful image matching and the failure of 3D reconstruction. Robust local descriptors based on deep learning outperform handcrafted descriptors, given the greater robustness of convolutional neural networks compared to hand-engineered representations. Therefore, we propose a novel and robust deep learning-based local feature method for planetary terrain reconstruction. We also integrate it with advanced computer vision techniques to establish a 3D terrain surface reconstruction workflow. Through experiments on the images from the Yutu-2 lunar rover and Tianwen-1 Mars rover, we verify the effectiveness and superiority of the proposed method and workflow. It proves to be suitable not only for high-resolution terrain reconstruction but also for other related tasks.