A Neural Beamforming Front-end for Distributed Microphone Arrays
×
Cite This
Citation & Abstract
J. Ziegler, L. Schröder, A. Koch, and A. Schilling, "A Neural Beamforming Front-end for Distributed Microphone Arrays," Paper 10508, (2021 October.). doi:
J. Ziegler, L. Schröder, A. Koch, and A. Schilling, "A Neural Beamforming Front-end for Distributed Microphone Arrays," Paper 10508, (2021 October.). doi:
Abstract: Robust real-time audio signal enhancement increasingly relies on multichannel microphone arrays for signal acquisition. Sophisticated beamforming algorithms have been developed to maximize the benefit of multiple microphones. With the recent success of deep learning models created for audio signal processing, the task of Neural Beamforming remains an open research topic. This paper presents a Neural Beamformer architecture capable of performing spatial beamforming with microphones randomly distributed over very large areas, even in negative signal-to-noise ratio environments with multiple noise sources and reverberation. The proposed method combines adaptive, nonlinear filtering and the computation of spatial relations with state-of-the-art mask estimation networks. The resulting End-to-End network architecture is fully differentiable and provides excellent signal separation performance. Combining a small number of principal building blocks, the method is capable of low-latency, domain-specific signal enhancement even in challenging environments.
@article{ziegler2021a,
author={ziegler, jonathan and schröder, leon and koch, andreas and schilling, andreas},
journal={journal of the audio engineering society},
title={a neural beamforming front-end for distributed microphone arrays},
year={2021},
volume={},
number={},
pages={},
doi={},
month={october},}
@article{ziegler2021a,
author={ziegler, jonathan and schröder, leon and koch, andreas and schilling, andreas},
journal={journal of the audio engineering society},
title={a neural beamforming front-end for distributed microphone arrays},
year={2021},
volume={},
number={},
pages={},
doi={},
month={october},
abstract={robust real-time audio signal enhancement increasingly relies on multichannel microphone arrays for signal acquisition. sophisticated beamforming algorithms have been developed to maximize the benefit of multiple microphones. with the recent success of deep learning models created for audio signal processing, the task of neural beamforming remains an open research topic. this paper presents a neural beamformer architecture capable of performing spatial beamforming with microphones randomly distributed over very large areas, even in negative signal-to-noise ratio environments with multiple noise sources and reverberation. the proposed method combines adaptive, nonlinear filtering and the computation of spatial relations with state-of-the-art mask estimation networks. the resulting end-to-end network architecture is fully differentiable and provides excellent signal separation performance. combining a small number of principal building blocks, the method is capable of low-latency, domain-specific signal enhancement even in challenging environments.},}
TY - paper
TI - A Neural Beamforming Front-end for Distributed Microphone Arrays
SP -
EP -
AU - Ziegler, Jonathan
AU - Schröder, Leon
AU - Koch, Andreas
AU - Schilling, Andreas
PY - 2021
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - October 2021
TY - paper
TI - A Neural Beamforming Front-end for Distributed Microphone Arrays
SP -
EP -
AU - Ziegler, Jonathan
AU - Schröder, Leon
AU - Koch, Andreas
AU - Schilling, Andreas
PY - 2021
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - October 2021
AB - Robust real-time audio signal enhancement increasingly relies on multichannel microphone arrays for signal acquisition. Sophisticated beamforming algorithms have been developed to maximize the benefit of multiple microphones. With the recent success of deep learning models created for audio signal processing, the task of Neural Beamforming remains an open research topic. This paper presents a Neural Beamformer architecture capable of performing spatial beamforming with microphones randomly distributed over very large areas, even in negative signal-to-noise ratio environments with multiple noise sources and reverberation. The proposed method combines adaptive, nonlinear filtering and the computation of spatial relations with state-of-the-art mask estimation networks. The resulting End-to-End network architecture is fully differentiable and provides excellent signal separation performance. Combining a small number of principal building blocks, the method is capable of low-latency, domain-specific signal enhancement even in challenging environments.
Robust real-time audio signal enhancement increasingly relies on multichannel microphone arrays for signal acquisition. Sophisticated beamforming algorithms have been developed to maximize the benefit of multiple microphones. With the recent success of deep learning models created for audio signal processing, the task of Neural Beamforming remains an open research topic. This paper presents a Neural Beamformer architecture capable of performing spatial beamforming with microphones randomly distributed over very large areas, even in negative signal-to-noise ratio environments with multiple noise sources and reverberation. The proposed method combines adaptive, nonlinear filtering and the computation of spatial relations with state-of-the-art mask estimation networks. The resulting End-to-End network architecture is fully differentiable and provides excellent signal separation performance. Combining a small number of principal building blocks, the method is capable of low-latency, domain-specific signal enhancement even in challenging environments.
Authors:
Ziegler, Jonathan; Schröder, Leon; Koch, Andreas; Schilling, Andreas
Affiliations:
Stuttgart Media University, Stuttgart, Germany; Eberhard Karls University, Tübingen, Germany(See document for exact affiliation information.)
AES Convention:
151 (October 2021)
Paper Number:
10508
Publication Date:
October 13, 2021Import into BibTeX
Subject:
Audio Signal Processing
Permalink:
http://www.aes.org/e-lib/browse.cfm?elib=21472