Recent developments in neural network-based speech enhancement ask for a robust subjective metric that can be used for comparing performance of a different noise suppression algorithms (for non-stationary noises), that would closely match costly and time-consuming subjective user tests. The article describes results of a comparison between subjective scores obtained using MUSHRA methodology vs. automated evaluation with objective metrics i.e. POLQA, 3QUEST, STOI & ESTOI, on a set of recordings processed by 2 different denoising algorithms for close & far speaker distance. Correlation coefficient is calculated between subjective scores and examined metrics. The results are based on recordings simulated using an in-house simulation toolchain, based on impulse responses from actual laptop device used in low reverb quiet room.
https://www.aes.org/e-lib/browse.cfm?elib=20911
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!
This paper costs $33 for non-members and is free for AES members and E-Library subscribers.
Learn more about the AES E-Library
The Engineering Briefs at this Convention were selected on the basis of a submitted synopsis, ensuring that they are of interest to AES members, and are not overly commercial. These briefs have been reproduced from the authors' advance manuscripts, without editing, corrections, or consideration by the Review Board. The AES takes no responsibility for their contents. Paper copies are not available, but any member can freely access these briefs. Members are encouraged to provide comments that enhance their usefulness.
Start a discussion about this paper!
