Virtual Reality (VR) systems have been intensely explored, with several research communities investigating the different modalities involved. Regarding the audio modality, one of the main issues is the generation of sound that is perceptually coherent with the visual reproduction. Here, we propose a pipeline for creating plausible interactive reverb using visual information: first, we characterize real environment acoustics given a pair of spherical cameras; then, we reproduce reverberant spatial sound, by using the estimated acoustics, within a VR scene. The evaluation is made by extracting the room impulse responses (RIRs) of four virtually rendered rooms. Results show agreement, in terms of objective metrics, between the synthesized acoustics and the ones calculated from RIRs recorded within the respective real rooms.

Authors: Remaggi, Luca; Kim, Hansung; Jackson, Philip J. B.; Hilton, Adrian
Affiliation: University of Surrey, Guildford, Surrey, UK
AES Conference: 2019 AES International Conference on Immersive and Interactive Audio (March 2019)
Paper Number: 65
Publication Date: March 17, 2019 Import into BibTeX
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=20445

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:   /conf/2019/iia/iia_2019_paper_65.pdf

Start a discussion about this paper!