Realistic simulation and perceived “immersion” within a multimodal display for telecommunication and entertainment can be enhanced, or completely mitigated, as a function of inter-modal timing asynchronies between the multimodal rendering systems (system-system asynchrony). Tolerable asynchronies are have been extensively examined for auditory-visual stimuli but less so for auditory-haptic cues. Realistic simulation and perceived “immersion” can be enhanced, or completely mitigated, as a function of inter-modal timing asynchronies between the multimodal rendering systems. Data are presented from two experiments where auditory stimuli are varied in time of arrival (lead-lag) relative to a tactile pulse. Results indicate variability between participants in terms of overall sensitivity. Generally, sensitivity is greater for auditory stimuli leading haptic stimuli, compared to the opposite condition.
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!
This paper costs $33 for non-members and is free for AES members and E-Library subscribers.