We present an integrated set of audio-visual tracking and synthesis tools to aid matching of the audio to the video position in both horizontal and periphonic sound reinforcement systems. Compensation for screen size and loudspeaker layout for high definition formats is incorporated and the spatial localisation of the source is rendered using advanced spatialisation techniques. A subjective comparison of several original and enhanced film sequences using the Vector Base Amplitude Panning (VBAP) method is presented. The results show that the encoding of non-contradictory audio-visual spatial information, for presentation on different loudspeaker layouts significantly improves the naturalness of the listening/viewing experience.

Authors: Boland, Frank; Dahyot, Rozenn; Kearney, Gavin
Affiliation: Trinity College Dublin
AES Convention: 124 (May 2008) Paper Number: 7365
Publication Date: May 1, 2008 Import into BibTeX
Subject: Spatial Audio Perception and Processing
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=14495

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 124Papers)   /124/7365.pdf

Start a discussion about this paper!