Capturing Spatial Room Information for Reproduction in XR Listening Environments
×
Cite This
Citation & Abstract
M. Matsakis, P. Songmuang, and K. Zhang, "Capturing Spatial Room Information for Reproduction in XR Listening Environments," Paper 10588, (2022 May.). doi:
M. Matsakis, P. Songmuang, and K. Zhang, "Capturing Spatial Room Information for Reproduction in XR Listening Environments," Paper 10588, (2022 May.). doi:
Abstract: An expansion on previous work involving “holographic sound recording” (HSR), this research delves into how sound sources for directional ambience should be captured for reproduction in a 6-DOF listening environment. We propose and compare two systems of ambient capture for extended reality (XR) using studio-grade microphones and first-order soundfield microphones. Both systems are based on the Hamasaki-square ambience capture technique. The Twins-Hamasaki Array utilizes four Sennheiser MKH800 Twins while the Ambeo-Hamasaki Array uses four Sennheiser Ambeo microphones. In a preliminary musical recording and exploration of both techniques, the spatial capture from these arrays, along with additional holophonic spot systems, were reproduced using Steam Audio in Unity’s 3D engine. Preliminary analysis was conducted with expert listeners to examine these proposed systems using perceptual audio attributes.The systems were compared with each other as well as a virtual ambient space generated using Steam Audio as a reference point for auditory room reconstruction in XR. Initial analysis shows progress towards a methodology for capturing directional room reflections using Hamasaki-based arrays.
@article{matsakis2022capturing,
author={matsakis, michael and songmuang, parichat and zhang, kathleen},
journal={journal of the audio engineering society},
title={capturing spatial room information for reproduction in xr listening environments},
year={2022},
volume={},
number={},
pages={},
doi={},
month={may},}
@article{matsakis2022capturing,
author={matsakis, michael and songmuang, parichat and zhang, kathleen},
journal={journal of the audio engineering society},
title={capturing spatial room information for reproduction in xr listening environments},
year={2022},
volume={},
number={},
pages={},
doi={},
month={may},
abstract={an expansion on previous work involving “holographic sound recording” (hsr), this research delves into how sound sources for directional ambience should be captured for reproduction in a 6-dof listening environment. we propose and compare two systems of ambient capture for extended reality (xr) using studio-grade microphones and first-order soundfield microphones. both systems are based on the hamasaki-square ambience capture technique. the twins-hamasaki array utilizes four sennheiser mkh800 twins while the ambeo-hamasaki array uses four sennheiser ambeo microphones. in a preliminary musical recording and exploration of both techniques, the spatial capture from these arrays, along with additional holophonic spot systems, were reproduced using steam audio in unity’s 3d engine. preliminary analysis was conducted with expert listeners to examine these proposed systems using perceptual audio attributes.the systems were compared with each other as well as a virtual ambient space generated using steam audio as a reference point for auditory room reconstruction in xr. initial analysis shows progress towards a methodology for capturing directional room reflections using hamasaki-based arrays.},}
TY - paper
TI - Capturing Spatial Room Information for Reproduction in XR Listening Environments
SP -
EP -
AU - Matsakis, Michael
AU - Songmuang, Parichat
AU - Zhang, Kathleen
PY - 2022
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - May 2022
TY - paper
TI - Capturing Spatial Room Information for Reproduction in XR Listening Environments
SP -
EP -
AU - Matsakis, Michael
AU - Songmuang, Parichat
AU - Zhang, Kathleen
PY - 2022
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - May 2022
AB - An expansion on previous work involving “holographic sound recording” (HSR), this research delves into how sound sources for directional ambience should be captured for reproduction in a 6-DOF listening environment. We propose and compare two systems of ambient capture for extended reality (XR) using studio-grade microphones and first-order soundfield microphones. Both systems are based on the Hamasaki-square ambience capture technique. The Twins-Hamasaki Array utilizes four Sennheiser MKH800 Twins while the Ambeo-Hamasaki Array uses four Sennheiser Ambeo microphones. In a preliminary musical recording and exploration of both techniques, the spatial capture from these arrays, along with additional holophonic spot systems, were reproduced using Steam Audio in Unity’s 3D engine. Preliminary analysis was conducted with expert listeners to examine these proposed systems using perceptual audio attributes.The systems were compared with each other as well as a virtual ambient space generated using Steam Audio as a reference point for auditory room reconstruction in XR. Initial analysis shows progress towards a methodology for capturing directional room reflections using Hamasaki-based arrays.
An expansion on previous work involving “holographic sound recording” (HSR), this research delves into how sound sources for directional ambience should be captured for reproduction in a 6-DOF listening environment. We propose and compare two systems of ambient capture for extended reality (XR) using studio-grade microphones and first-order soundfield microphones. Both systems are based on the Hamasaki-square ambience capture technique. The Twins-Hamasaki Array utilizes four Sennheiser MKH800 Twins while the Ambeo-Hamasaki Array uses four Sennheiser Ambeo microphones. In a preliminary musical recording and exploration of both techniques, the spatial capture from these arrays, along with additional holophonic spot systems, were reproduced using Steam Audio in Unity’s 3D engine. Preliminary analysis was conducted with expert listeners to examine these proposed systems using perceptual audio attributes.The systems were compared with each other as well as a virtual ambient space generated using Steam Audio as a reference point for auditory room reconstruction in XR. Initial analysis shows progress towards a methodology for capturing directional room reflections using Hamasaki-based arrays.
Open Access
Authors:
Matsakis, Michael; Songmuang, Parichat; Zhang, Kathleen
Affiliations:
New York University, NY, USA; McGill University, Montreal, QC, Canada(See document for exact affiliation information.)
AES Convention:
152 (May 2022)
Paper Number:
10588
Publication Date:
May 2, 2022Import into BibTeX
Subject:
Extended Reality Audio
Permalink:
http://www.aes.org/e-lib/browse.cfm?elib=21701