AES New York 2009 Friday, October 9, 2:30 pm — 4:30 pm
W3 - Lies, Damn Lies, and Statistics
Thomas Sporer, Fraunhofer Institute for Digital Media Technology - Ilmenau, Germany
Jon Boley, LSB Audio, LLC - Lafayette, IN, USA
Poppy Crum, Johns Hopkins School of Medicine - Baltimore, MD, USA
Jon Shlens, New York University - New York, NY, USA
Listening tests have become an important part of the development of audio systems (CODECS, loudspeakers, etc.). Unfortunately, even the simplest statistics (mean and standard deviation) are often misused. This workshop will start with a basic introduction to statistics, but room will be given to discuss the pertinence of some commonly-used tests and alternative methods will be proposed, thereby making it interesting for more experienced statisticians as well. The following topics will be covered (among others): experimental design, distributions, hypothesis testing, confidence intervals, analysis of paired comparisons and ranking data, and common pitfalls potentially leading to wrong conclusions.