<!DOCTYPE article PUBLIC '-//NLM//DTD Journal Publishing DTD v2.1 20050630//EN' 'http://uploads.ingentaconnect.com/docs/dtd/ingenta-journalpublishing.dtd'>
<article article-type="research-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="aggregator">72010604</journal-id>
      <journal-title>Electronic Imaging</journal-title>
      <issn pub-type="ppub">2470-1173</issn><issn pub-type="epub"></issn>
      <publisher>
        <publisher-name>Society for Imaging Science and Technology</publisher-name>
        <publisher-loc>7003 Kilworth Lane, Springfield, VA 22151 USA</publisher-loc>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.2352/J.ImagingSci.Technol.2018.62.6.060402</article-id>
      <article-id pub-id-type="sici">2470-1173(20190113)2019:2L.604021;1-</article-id>
      <article-id pub-id-type="publisher-id">ei_24701173_v2019n2_input/s12.xml</article-id>
      <article-id pub-id-type="other">/ist/ei/2019/00002019/00000002/art00015</article-id>
      <article-categories>
        <subj-group>
          <subject>Articles</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Augmented Cross-modality: Translating the Physiological Responses, Knowledge and Impression to Audio-visual Information in Virtual Reality</article-title>
      </title-group>
      <contrib-group>
        <contrib>
          <name>
            <surname>Hirao</surname>
            <given-names>Yutaro</given-names>
          </name>
        </contrib>
        <contrib>
          <name>
            <surname>Kawai</surname>
            <given-names>Takashi</given-names>
          </name>
        </contrib>
      </contrib-group>
      <pub-date>
        <day>13</day>
        <month>01</month>
        <year>2019</year>
      </pub-date>
      <volume>2019</volume>
      <issue>2</issue>
      <fpage>60402-1</fpage>
      <lpage>60402-8</lpage>
      <permissions>
        <copyright-year>2019</copyright-year>
      </permissions>
      <abstract>
        <p>
          <italic>This paper proposes the method of interaction design to present haptic experience as intended in virtual reality (VR). The method that we named “Augmented Cross-Modality” is to translate the physiological responses, knowledge and impression about the experience in real
 world into audio-visual stimuli and add them to the interaction in VR. In this study, as expressions for presenting a haptic experience of gripping an object strongly and lifting a heavy object, we design hand tremor, strong gripping and increasing heart rate in VR. The objective is, at first,
 to enhance a sense of strain of a body with these augmented cross-modal expressions and then, change the quality of the total haptic experience and as a result, make it closer to the experience of lifting a heavy object. This method is evaluated by several rating scales, interviews and force
 sensors attached to a VR controller. The result suggests that the expressions of this method enhancing a haptic experience of strong gripping in almost all participants and the effectiveness were confirmed.</italic>
        </p>
      </abstract>
      <kwd-group>
        <kwd>virtual reality</kwd>
        <kwd>cross-modality</kwd>
        <kwd>haptics</kwd>
        <kwd>perception</kwd>
        <kwd>physiological responses</kwd>
      </kwd-group>
    </article-meta>
  </front>
</article>
