[3ATE] Art & Tech Exhibition B

[T-08B] Study on Telexistence LXXXVIII
Foveated Streaming: Optimizing video streaming for Telexistence systems using eye-gaze based foveation

○MHD Yamen Saraiji¹, Kouta Minamizawa¹, Susumu Tachi² (1. Keio University Graduate School of Media Design, 2. Institute of Gerontology, The University of Tokyo)

Current Telexistence systems use full resolution image stream that is sent over the network to the user side. However, due to performance and network limitations, the resolution is significantly limited and thus can not provide sufficient details for the human eyes. This paper addresses the topic of increasing spatial visual acuity in telexistence related applications by taking the advantage of human eyes retina properties. Instead of streaming full resolution images over the network, hierarchical, multi-resolution image regions are sent to the user based on his eyes gaze position. Using this method, it's possible to increase the spatial visual information perceived by the user, while significantly reducing network bandwidth and increasing processing performance of the sender/receiver sides. Here we present the overall system including the challenges in maintaining per-frame eye gaze synchronization over the network, and quantitative and qualitative studies verifying the effectiveness of foveated streaming are described.

■URL：http://www.embodiedmedia.org