Perception of Simultaneity and Detection of Asynchrony between Audio and Structural Vibration in Multimodal Music Reproduction
In music reproduction incorporating haptic display there is a need to know the human observer’s tolerance for asynchrony between presentations of audio (airborne vibration) and haptic content (in this case whole-body vibration). Two methods for measuring the human tolerance for such audio-haptic asynchrony were employed in experiments using recorded musical instrument sound as stimuli: judgments of the time-order of arrival of airborne versus structure-borne vibration, and judgments of subjective simultaneity that required no report of which component arrived first. Optimal intermodal delay values derived from the time-order judgments were related to the direct judgments of simultaneity for the same set of stimuli.
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!
This paper costs $33 for non-members and is temporarily free for AES members.