A novel and light-weight voice conversion method is applied to manipulate a singer's identity and singing style in realtime. The proposed method is based on a non-linear spectral morphing method that uses proximity information for vowel templates of the source and the target singing materials. The proposed method is based on the STRAIGHT speech analysis, modification and resynthesis system, and it yields highly natural manipulated sounds. To deal with the difficulties in applying our vowel-based voice conversion method to singing voices, singular-value decomposition and robust statistical measures are introduced to handle the huge variability of vowel spectra and fundamental frequencies in singing voices. Distance measures for preparing vowel templates and calculating proximity information are designed based on a psychophysical frequency scale, the equivalent rectangular band, ERB_N rate.

Authors: Yoshida, Yuri; Nisimura, Ryuichi; Irino, Toshio; Kawahara, Hideki
Affiliation: Wakayama University, Wakayama City, Japan
AES Conference: 35th International Conference: Audio for Games (February 2009)
Paper Number: 6
Publication Date: February 1, 2009 Import into BibTeX
Subject: Audio for Games: Speech Processing and Analysis
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=15160

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 35thPapers)   /35/aes35-000025.pdf

Start a discussion about this paper!