AES E-Library

Perceptual Evaluation of Principal-Component-Based Synthesis of Musical Timbres

Harmonic-based analysis and resynthesis of musical instrument tones, for example, using the phase vocoder method, is a valuable technique, but its data representation is very large. However, this data set is usually highly redundant. Principal components analysis (PCA) can be used to encode such data into a smaller set of orthogonal basis vectors with minimal loss of information. Techniques for applying PCA to such data are explored, and the aural impact of the method on three tones (cello, trombone, and clarinet) are studied in two perception experiments. Results show that nearly identical resyntheses can be produced with a 40-70% data reduction. A preprocessing step called variable-duration temporal partitioning (VDTP) is introduced, which also affords a natural-sounding method for time expansion and contraction of tones. An extension of the PCA technique is also introduced that implements a "timbre space," or coordinate system for interpolation among a group of musical instruments.

Authors: Sandell, Gregory J.; Martens, William L.
Affiliations: Parmly Hearing Institute, Loyola University, Chicago, IL ; Headspace, San Mateo, CA(See document for exact affiliation information.)
JAES Volume 43 Issue 12 pp. 1013-1028; December 1995 Import into BibTeX

Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD aes5)   /jrnl8997/1995/8614.pdf

Start a discussion about this paper!