Realistic simulation and perceived “immersion” within a multimodal display for telecommunication and entertainment can be enhanced, or completely mitigated, as a function of inter-modal timing asynchronies between the multimodal rendering systems (system-system asynchrony). Tolerable asynchronies are have been extensively examined for auditory-visual stimuli but less so for auditory-haptic cues. Realistic simulation and perceived “immersion” can be enhanced, or completely mitigated, as a function of inter-modal timing asynchronies between the multimodal rendering systems. Data are presented from two experiments where auditory stimuli are varied in time of arrival (lead-lag) relative to a tactile pulse. Results indicate variability between participants in terms of overall sensitivity. Generally, sensitivity is greater for auditory stimuli leading haptic stimuli, compared to the opposite condition.

Authors: Adelstein, Bernard; Anderson, Mark; BEGAULT, Durand; McClain, Byran
Affiliations: NASA Ames Research Center; QSS Group, Inc.; San Jose State University Foundation(See document for exact affiliation information.)
AES Convention: 118 (May 2005) Paper Number: 6511
Publication Date: May 1, 2005 Import into BibTeX
Subject: Psychoacoustics, Perception, Listening Tests
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=13227

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 118Papers)   /118/6511.pdf

Start a discussion about this paper!