[2O6-OS-16a] OS-16

[2O6-OS-16a-01] Development and evaluation of Neural Simulator for autonomous driving systems

〇Junnosuke Kamohara^1,3, Koya Sakamoto^2,3, Akihito Ohsato⁴, Shintaro Tomie⁴, Masaya Kataoka⁴, Makoto Kawano⁵ (1. Tohoku University, 2. Kyoto University, 3. Matsuo Institute, 4. TIER IV, Inc., 5. The University of Tokyo)

Keywords:Autonomous Driving, Simulator, Computer Vision, NeRF

High-quality, large-scale simulators are pivotal in conducting system testing for developing autonomous driving systems, ensuring safety and efficiency. Traditional simulators, typically based on game engines, necessitate the creation of three-dimensional environments that mimic real-world driving scenarios. Nevertheless, creating and maintaining these digital environments incur significant expenses associated with reflecting evolving real-world conditions. Furthermore, the gap arises in physical properties, such as geometric shapes and optical properties, compared to the real world.
To address these limitations, recent research has focused on developing neural simulators, leveraging Neural Radiance Fields (NeRF), a deep learning model facilitating view synthesis, to construct simulation environments. However, the assessment of neural simulators is currently constrained to the validation of reconstruction accuracy alone, necessitating additional validation efforts to explore their applicability within real-world autonomous driving systems.
This study presents a comprehensive analysis encompassing the data acquisition methodology, reconstruction accuracy assessments, and evaluation of practical applications in autonomous driving tasks.