Hand Gesture and Speech Switchable Text Input Method for Wearable Augmented/Virtual Reality Devices

Ziyao Cheng, Qiang Chu, Gang Li, Chao Ping Chen

doi:https://doi.org/10.36463/idw.2021.0676

10:50 AM - 11:10 AM

[PRJ6-1] Hand Gesture and Speech Switchable Text Input Method for Wearable Augmented/Virtual Reality Devices

*Ziyao Cheng¹, Qiang Chu¹, Gang Li¹, Chao Ping Chen¹ (1.Shanghai Jiao Tong University (China))

augmented/virtual reality, text input method, hand gesture recognition, speech recognition

https://doi.org/10.36463/idw.2021.0676

We propose a hybrid text input method that caters to wearable augmented/virtual reality devices. When traditional input peripherals, e.g. mice and keyboards, are not available, this method can be an alternative by enabling users to type letters, numbers and symbols via either hand gesture or speech.

Proceedings of the International Display Workshops Volume 28 (IDW '21)

[PRJ6-1] Hand Gesture and Speech Switchable Text Input Method for Wearable Augmented/Virtual Reality Devices