Despite many studies investigating auditory spatial impressions in rooms, few have addressed the impact of simultaneous visual cues on localization and the perception of spaciousness. The current research presents an immersive audiovisual environment, in which participants were instructed to make spatial congruency and auditory width judgements in dynamic cross-modal environments. The results of these psychophysical tests suggest the importance of consilient audio-visual presentation to the legibility of an auditory scene. Supporting data was accumulated in five rooms of monotonically ascending volumes and varying reverberation times. Participants were given an audio-visual matching test, in which they were instructed to align the auditory width of a performing ensemble to a varying set of audio and visual cues in rooms. Results show that both auditory and visual factors affect the collected responses, and that the two sensory modalities coincide in distinct interactions.

Authors: Valente, Daniel L.; Myrbeck, Shane A.; Braasch, Jonas
Affiliations: Rensselaer Polytechnic Institute, Troy, NY, USA; Arup Acoustics, San Francisco, CA, USA; Boys Town National Research Hospital, Omaha, NE, USA(See document for exact affiliation information.)
AES Convention: 127 (October 2009) Paper Number: 7937
Publication Date: October 1, 2009 Import into BibTeX
Subject: Multichannel Sound and Imaging
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=15131

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 127Papers)   /127/7937.pdf

Start a discussion about this paper!