AES E-Library

Potential Biases in MUSHRA Listening Tests

The method described in the ITU-R BS.1534-1 standard, commonly known as MUSHRA (MUltiple Stimulus with Hidden Reference and Anchors), is widely used for the evaluation of systems exhibiting intermediate quality levels, in particular low-bit rate codecs. This paper demonstrates that this method, despite its popularity, is not immune to biases. In two different experiments designed to investigate potential biases in the MUSHRA test, systematic discrepancies in the results were observed with a magnitude up to 22%. The data indicates that these discrepancies could be attributed to the stimulus spacing and range equalizing biases.

Authors: Zielinski, Slawomir; Hardisty, Philip; Hummersone, Christopher; Rumsey, Francis
Affiliation: University of Surrey
AES Convention:123 (October 2007) Paper Number:7179 Import into BibTeX
Subject:Perception

Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 123Papers)   /123/7179.pdf

Start a discussion about this paper!