We demonstrate the first integration of wave acoustics in a virtual reality operating system. The Windows mixed reality shell hosts third-party applications inside a 3D virtual home, propagating sound from these applications throughout the environment to provide a natural user interface. Rather than applying manually-designed reverberation volumes or ray-traced geometric acoustics, we use wave acoustics that robustly captures cues like diffracted occlusion and reverberation propagating through portals while reducing the design and maintenance burden. We describe our rendering implementation, materials-based design techniques, reverberation tuning, dynamic range management, and temporal smoothing that ensure a natural listening experience across unpredictable audio content and user motion.

Authors: Godin, Keith W.; Rohrer, Ryan; Snyder, John; Raghuvanshi, Nikunj
Affiliation: Microsoft Corp., Redmond, WA, USA
AES Conference: 2018 AES International Conference on Audio for Virtual and Augmented Reality (August 2018)
Paper Number: P7-3
Publication Date: August 11, 2018 Import into BibTeX
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=19671

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:   /conf/2018/avar/2018_avar_paper_7.pdf

Start a discussion about this paper!