We propose a perceptually-based approach to creating immersive soundscapes for VR applications. We leverage stereophonic content obtained from XY microphones as a basic building block that can be easily recorded, edited, and combined to provide a more compelling experience than can be obtained from recording at a single location. Central to our approach is a novel up-conversion algorithm that derives a nearly full-spherical parametric soundfield, including height information, from an XY recording. This approach enables a simpler, improved capture, when compared to alternative soundfield recording techniques. It can also take advantage of new object-based delivery formats for flexible delivery and playback.

Authors: Tsingos, Nicolas; Govindaraju, Pradeep; Zhou, Cong; Nadkarni, Abhay
Affiliation: Dolby Laboratories, San Francisco, CA, USA
AES Conference: 2016 AES International Conference on Audio for Virtual and Augmented Reality (September 2016)
Paper Number: 8-1
Publication Date: September 21, 2016 Import into BibTeX
Subject: Capture, Rendering, and Mixing for VR
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=18497

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:   /conf/2016/avar/avar_2016_paper_5.pdf

Start a discussion about this paper!