AES E-Library

N. Schinkel-Bielefeld, and AN. KA. Leschanowsky, "How Much Is the Use of a Rating Scale by a Listener Influenced by Anchors and by the Listener's Experience?," Paper 9311, (2015 May.). doi: N. Schinkel-Bielefeld, and AN. KA. Leschanowsky, "How Much Is the Use of a Rating Scale by a Listener Influenced by Anchors and by the Listener's Experience?," Paper 9311, (2015 May.). doi:
Abstract: It has been postulated that anchors in multi-stimulus listening tests for audio quality evaluation should have an item-independent quality, as listeners will likely shift their rating scale if the quality of the anchor varies. However, expert listeners have a very stable internal rating scale, which can be seen from the repeatability of their results when performing the same test multiple times. So they may stick to their usual scale even if the anchor varies. We find that listeners do not shift their rating scale by the full amount the anchor is shifted but only up to 60% of that. Nevertheless this makes quantitative comparisons between different test results difficult even if the anchor varies only by 5 Mushra points.

@article{schinkel-bielefeld2015how,
author={schinkel-bielefeld, nadja and leschanowsky, anna katharina},
journal={journal of the audio engineering society},
title={how much is the use of a rating scale by a listener influenced by anchors and by the listener's experience?},
year={2015},
volume={},
number={},
pages={},
doi={},
month={may},} @article{schinkel-bielefeld2015how,
author={schinkel-bielefeld, nadja and leschanowsky, anna katharina},
journal={journal of the audio engineering society},
title={how much is the use of a rating scale by a listener influenced by anchors and by the listener's experience?},
year={2015},
volume={},
number={},
pages={},
doi={},
month={may},
abstract={it has been postulated that anchors in multi-stimulus listening tests for audio quality evaluation should have an item-independent quality, as listeners will likely shift their rating scale if the quality of the anchor varies. however, expert listeners have a very stable internal rating scale, which can be seen from the repeatability of their results when performing the same test multiple times. so they may stick to their usual scale even if the anchor varies. we find that listeners do not shift their rating scale by the full amount the anchor is shifted but only up to 60% of that. nevertheless this makes quantitative comparisons between different test results difficult even if the anchor varies only by 5 mushra points.},}

TY - paper
TI - How Much Is the Use of a Rating Scale by a Listener Influenced by Anchors and by the Listener's Experience?
SP - EP -
AU - Schinkel-Bielefeld, Nadja
AU - Leschanowsky, Anna Katharina
PY - 2015
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - May 2015 TY - paper
TI - How Much Is the Use of a Rating Scale by a Listener Influenced by Anchors and by the Listener's Experience?
SP - EP -
AU - Schinkel-Bielefeld, Nadja
AU - Leschanowsky, Anna Katharina
PY - 2015
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - May 2015
AB - It has been postulated that anchors in multi-stimulus listening tests for audio quality evaluation should have an item-independent quality, as listeners will likely shift their rating scale if the quality of the anchor varies. However, expert listeners have a very stable internal rating scale, which can be seen from the repeatability of their results when performing the same test multiple times. So they may stick to their usual scale even if the anchor varies. We find that listeners do not shift their rating scale by the full amount the anchor is shifted but only up to 60% of that. Nevertheless this makes quantitative comparisons between different test results difficult even if the anchor varies only by 5 Mushra points.