Perception of Simultaneity and Detection of Asynchrony between Audio and Structural Vibration in Multimodal Music Reproduction
In music reproduction incorporating haptic display there is a need to know the human observer’s tolerance for asynchrony between presentations of audio (airborne vibration) and haptic content (in this case whole-body vibration). Two methods for measuring the human tolerance for such audio-haptic asynchrony were employed in experiments using recorded musical instrument sound as stimuli: judgments of the time-order of arrival of airborne versus structure-borne vibration, and judgments of subjective simultaneity that required no report of which component arrived first. Optimal intermodal delay values derived from the time-order judgments were related to the direct judgments of simultaneity for the same set of stimuli.
Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!
This paper costs $33 for non-members, $5 for AES members and is free for E-Library subscribers.