A recent work presented the subjective ratings from an extensive perceptual quality evaluation of audio signals, where isolated coding artifact types of varying strength were introduced. We use these ratings as perceptual reference for studying the performance of 11 well-known tools for objective audio quality evaluation: PEAQ, PEMO-Q, ViSQOLAudio, HAAQI, PESQ, POLQA, fwSNRseg, dLLR, LKR, BSSEval, and PEASS. Some tools achieve high correlation with subjective data for specific artifact types (Pearson's r > 0.90, Kendall's t > 0.70), corroborating their value during the development of a specific algorithm. Still, the performance of each tool varies depending on the artifact type and no tool reliably assesses artifacts from parametric audio coding. Nowadays, perceptual evaluation remains irreplaceable, especially when comparing different coding schemes introducing different artifacts.

Authors: Torcoli, Matteo; Dick, Sascha
Affiliations: Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; International Audio Laboratories Erlangen, a joint institution of Universität Erlangen-Nürnberg and Fraunhofer IIS, Erlangen, Germany(See document for exact affiliation information.)
AES Convention: 144 (May 2018) Paper Number: 9951
Publication Date: May 14, 2018 Import into BibTeX
Subject: Posters: Perception
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=19468

Download Now (497 KB)

This paper is Open Access which means you can download it for free.

Learn more about the AES E-Library

E-Library Location:   /conv/144/9951.pdf

Start a discussion about this paper!