Digital Analysis of Quantisation Errors in Digital Signal Processing
We propose a sine wave with slowly decaying envelope as a test signal for signal processors using floating-point arithmetic. Rounding errors in the filter will cause amplitude (or phase) irregularities in the reproduced sine wave, and simulations show that certain filters implemented in 24-bit arithmetic will cause effects detectable through a 16-bit communication channel.
Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!
This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.