AES E-Library

A Platform for Audiovisual Telepresence Using Model- and Data-Based Wave-Field Synthesis

We present a platform for real-time transmission of immersive audiovisual impressions using model- and data-based audio wave-field analysis/synthesis and panoramic video capturing/projection. The audio subsystem considered in this paper is based on microphone arrays with different element counts and directivities as well as weakly directional loudspeaker arrays. We report on both linear and circular setups that feed different wave-field synthesis systems. In an attempt to extend this, we present first findings for a data-based approach derived using experimental simulations. This data-based wave-field analysis/synthesis (WFAS) approach uses a combination of cylindrical-harmonic decomposition of cardioid array signals and enforces causal plane wave synthesis by angular windowing and a directional delay term. Specifically, our contributions include (1) a high-resolution telepresence environment that is omnidirectional in both the auditory and visual modality, as well as (2) a study of data-based WFAS realistic microphone directivities as a contribution towards for real-time holophonic reproduction.

Authors: Heinrich, Gregor; Jung, Christoph; Hahn, Volker; Leitner, Michael
Affiliations: Fraunhofer IGD; vsonix GmbH(See document for exact affiliation information.)
AES Convention:125 (October 2008) Paper Number:7608 Import into BibTeX
Subject:Innovative Audio Applications

Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 125Papers)   /125/7608.pdf

Start a discussion about this paper!