Back to articles
Articles
Volume: 31 | Article ID: art00011
Image
Enhancing Mobile VR Immersion: A Multimodal System of Neural Networks Approach to an IMU Gesture Controller
Juan Ni˜no
Jocelyne Kiss
Geoffrey Edwards
Ernesto Morales
Sherezada Ochoa
Bruno Bernier
  DOI :  10.2352/ISSN.2470-1173.2019.2.ERVR-184  Published Online :  January 2019
Abstract

An effect of immersion is a desirable quality in VR interfaces and its improvement has received a lot of attention in recent years. However, enhancing immersion by eliciting feelings of embodiment and presence through multimodal interactions often requires expensive and bulky dedicated tracking systems. This renders these interactions prohibitable for mobile VR platforms. Our work focused on developing a voice and motion gesture controller with tactile feedback to induce physical sensations and arouse the feeling of embodiment and presence in mobile VR platforms. A mobile virtual reality interface was designed to validate our system through a user experiment. The results indicate that the feelings of presence, embodiment and overall immersion in the mobile VR interface were increased by the use of our system.

Journal Title : Electronic Imaging
Publisher Name : Society for Imaging Science and Technology
Publisher Location : 7003 Kilworth Lane, Springfield, VA 22151 USA
Subject Areas :
Views 49
Downloads 8
 DOI 10.2352/ISSN.2470-1173.2019.2.ERVR-184
 articleview.views 49
 articleview.downloads 8
  Cite this article 

Juan Ni˜no, Jocelyne Kiss, Geoffrey Edwards, Ernesto Morales, Sherezada Ochoa, Bruno Bernier, "Enhancing Mobile VR Immersion: A Multimodal System of Neural Networks Approach to an IMU Gesture Controller"  in Proc. IS&T Int’l. Symp. on Electronic Imaging: The Engineering Reality of Virtual Reality,  2019,  pp 184-1 - 184-6,  https://doi.org/10.2352/ISSN.2470-1173.2019.2.ERVR-184

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2019
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA
10.2352/ISSN.2470-1173.2019.2.ERVR-184
2470-1173(20190113)2019:2L.1841;1-
ei_24701173_v2019n2_input/s11.xml
/ist/ei/2019/00002019/00000002/art00011
Articles
Enhancing Mobile VR Immersion: A Multimodal System of Neural Networks Approach to an IMU Gesture Controller
Ni˜noJuan
KissJocelyne
EdwardsGeoffrey
MoralesErnesto
OchoaSherezada
BernierBruno
13012019
2019
2
184-1
184-6
2019
An effect of immersion is a desirable quality in VR interfaces and its improvement has received a lot of attention in recent years. However, enhancing immersion by eliciting feelings of embodiment and presence through multimodal interactions often requires expensive and bulky dedicated tracking systems. This renders these interactions prohibitable for mobile VR platforms. Our work focused on developing a voice and motion gesture controller with tactile feedback to induce physical sensations and arouse the feeling of embodiment and presence in mobile VR platforms. A mobile virtual reality interface was designed to validate our system through a user experiment. The results indicate that the feelings of presence, embodiment and overall immersion in the mobile VR interface were increased by the use of our system.
Mobile VR interfaceMultimodal gesture controllermobile VR controller