Mobile phones include noise suppression to facilitate use in noisy environments; therefore listening tests in accordance with ITU-T P.835 are appropriate for comparing handset performance. Objective speech quality measures are an often used cheaper alternative; however the results can be misleading, as rank order compared to listening tests is not always preserved. We compare the outputs of PESQ, POLQA, and 3Quest with the results of P.835 listening tests. As expected, measures intended for use with noise suppression perform that task better than tools that were not initially designed to do so. However, improved measures, that aim to preserve rank order while minimizing both maximum error and RMSE, would improve the reliability of comparative evaluations in background noise.

Authors: Francois, Holly; Isabelle, Scott; Oh, Eunmi
Affiliations: Samsung Electronics R&D Institute UK, Staines-Upon Thames, Surrey, UK; Knowles Inc., Mountain View, CA, USA; Samsung Electronics Co., Ltd., Seoul, Korea(See document for exact affiliation information.)
AES Convention: 140 (May 2016) Paper Number: 9532
Publication Date: May 26, 2016 Import into BibTeX
Subject: Audio Quality
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=18231

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 140Papers)   /conv/140/9532.pdf

Start a discussion about this paper!