AES E-Library

A Method for Multimodal Auralization of Audio-Tactile Stimuli from Acoustic and Structural Measurements

A new method for the reproduction of sound and vibration for arbitrary musical source material based on physical measurements is presented. Tactile signals are created by the convolution of ”uncoupled” vibration with impulse responses derived from mechanical impedance measurements. Audio signals are created by the convolution of anechoic sound with binaural room impulse responses. Playback is accomplished through headphones and a calibrated motion platform. Benefits of the method include the ability to make multimodal, side-by-side listening tests for audio-tactile stimuli perceived in real music performance situations. Details of the method are discussed along with obstacles and applications. Structural response measurements are presented as validation of the need for measured vibration signals in audio-tactile displays.

Authors: Abercrombie, Clemeth; Braasch, Jonas
Affiliation: Rensselaer Polytechnic Institute, Troy, NY, USA
AES Convention:127 (October 2009) Paper Number:7867 Import into BibTeX
Subject:Audio in Multimodal Applications

Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 127Papers)   /127/7867.pdf

Start a discussion about this paper!