Back to articles
Regular Articles
Volume: 62 | Article ID: jist0537
Image
Augmented Cross-modality: Translating the Physiological Responses, Knowledge and Impression to Audio-visual Information in Virtual Reality
  DOI :  10.2352/J.ImagingSci.Technol.2018.62.6.060402  Published OnlineNovember 2018
Abstract
Abstract

This paper proposes the method of interaction design to present haptic experience as intended in virtual reality (VR). The method that we named “Augmented Cross-Modality” is to translate the physiological responses, knowledge and impression about the experience in real world into audio-visual stimuli and add them to the interaction in VR. In this study, as expressions for presenting a haptic experience of gripping an object strongly and lifting a heavy object, we design hand tremor, strong gripping and increasing heart rate in VR. The objective is, at first, to enhance a sense of strain of a body with these augmented cross-modal expressions and then, change the quality of the total haptic experience and as a result, make it closer to the experience of lifting a heavy object. This method is evaluated by several rating scales, interviews and force sensors attached to a VR controller. The result suggests that the expressions of this method enhancing a haptic experience of strong gripping in almost all participants and the effectiveness were confirmed.

Subject Areas :
Views 109
Downloads 5
 articleview.views 109
 articleview.downloads 5
  Cite this article 

Yutaro Hirao, Takashi Kawai, "Augmented Cross-modality: Translating the Physiological Responses, Knowledge and Impression to Audio-visual Information in Virtual Realityin Journal of Imaging Science and Technology,  2018,  pp 060402-1 - 060402-8,  https://doi.org/10.2352/J.ImagingSci.Technol.2018.62.6.060402

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2018
  Article timeline 
  • received June 2018
  • accepted October 2018
  • PublishedNovember 2018

Preprint submitted to:
  Login or subscribe to view the content