[M-GI35] Earth and planetary informatics with huge data management

[MGI35-05] Introducing a real-time projection system for remote video in VR space using a 360-degree camera and a PTZ camera

*Tomohiro Kawanabe¹, Ken T. Murata¹, Kazunori Yamamoto¹, Junji Tokairin¹, Tsutomu Nagatsuma¹, Tomokazu Kawaguchi², Kei Sato², Shuhei Okayama³, Hiroyuki Tamura³, Toshiki Aoki⁴ (1.National Institute of Information and Communications Technology, 2.Kami Agriculture High School, 3.PHOTRON LIMITED, 4.CLEALINK TECHNOLOGY Co., Ltd.)

Keywords:Visual IoT, Agriculture, Remote training

The base of the VR market has expanded with the advent of inexpensive stand-alone VR headsets nowadays, VR devices are no longer special, and it is expected that they will be applied and used as virtual experience devices in various fields in the future. The authors have been researching and developing a regional monitoring video transmission system using visual IoT, and have proposed the introduction of an IP network camera with a remote PTZ (pan/tilt/zoom) function. In parallel with this, we are also researching and developing a system that displays 3D WebGIS (Web-based 3D geographic information system) in a VR headset using WebVR. Applying these results, we have developed a prototype system that allows us to observe the PTZ camera image and 360-degree camera image at a remote location are simultaneously on the VR headset using the above-mentioned video transmission system. The entire space can be observed with the 360-degree image and allows to observe any location with a detailed real-time image using a PTZ camera if necessary (Fig. 1). This system is installed at Miyagi Prefectural Kami Agriculture High School and is being tested for the purpose of remote agricultural training. One of the features of this system is that using hpvt: video transmission protocol that guarantees high real-time performance and video transmission quality even in a 4G / LTE mobile communication network where the bandwidth and delay amount fluctuate greatly due to unstable bandwidth and delay amount. It was confirmed that full HD image quality video can be displayed at 25 fps under this system experimental environment, and the PTZ operation using the VR hand controller was completed within about 1 second. This system is capable of viewing images with a sense of realism that cannot be obtained with a normal flat display, and since the system can be configured at a relatively low cost, it is considered to be useful in various fields including the field of earth science.