Ambisonics and rotation matrices are a natural fit for 360° video and virtual, augmented or mixed reality experiences where spatial audio representation and transformation are required. As such, ambisonics has been widely adopted in AR/VR production workflows. For fully immersive experiences, however, extensions to support arbitrary six-degree-of-freedom listener movement in a sound scene are necessary. This paper introduces extensions to ambisonics formats to support authoring, encoding, decoding, and rendering depth information to enable full 3D immersive audio suitable for true 3D, volumetric, or light field video. The paper describes ambisonic decoding architectures that support depth rendering and 6DoF with both legacy ambisonic content and the proposed encoding extensions and discusses an end-to-end solution for spatial audio transmission or streaming.

Authors: Stein, Edward; Goodwin, Michael M.
Affiliation: DTS/Xperi, Inc., Los Gatos, CA, USA
AES Conference: 2019 AES International Conference on Headphone Technology (August 2019)
Paper Number: 23
Publication Date: August 21, 2019 Import into BibTeX
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=20514

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:   /conf/2019/headphone/2019_headphone_technology_paper_23.pdf

Start a discussion about this paper!