The need to perform subjective evaluations of audio is forever present. Such techniques are know to be inefficient and prone to unreliability. This can be partially overcome by using so-called expert as opposed to naive listeners. Expertise is addressed in some depth to clarify its meaning and to illustrate the benefits in terms of reliability and repeatability of listening tests. The generalized listener selection (GLS) procedure is presented for establishing permanent expert listening panels for a wide range of subjective tests. The method allows for the rapid selection and assessment of listeners based upon a number of criteria. Correct sampling of the population is achieved by an assessment of on-line questionnaires, followed by an audiometric evaluation. The last stage of the GLS procedure consists of three listening tests, identical in structure, designed to evaluate the discrimination skills and reliability of subjects. Means for the assessment of both intrarater reliability and interrater agreement are presented.
https://www.aes.org/e-lib/browse.cfm?elib=9985
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!
This paper costs $33 for non-members and is free for AES members and E-Library subscribers.
Learn more about the AES E-Library
Start a discussion about this paper!
