The current paper focuses on the design and implementation of a phoneme recognition algorithm that is used to extract the appropriate parameters in order to drive a 3d graphics facial expression and animation procedure. This is used to emulate speech generation to 3d modeled digital characters. At the first development step, LPC, STFT analysis, wavelets, cepstrum and pattern recognition techniques were tested for phoneme recognition and speaker classification. Then, 3d graphics facial expressions and phonemes were related in a library. A client/server application that processes speech, combines library data via morphing techniques and generates a digital character, virtually speaking according to the given speech, was finally designed. Possible applications include cartoon dubbing and web based virtual teleconference.

Authors: Kalliris, George M.; Dimoulas, Charalampos A.; Papanikolaou, George V.; Avdelidis, Kostas; Passias, Taxiarchis N.; Stoitsis, John S.
Affiliation: Aristotle University of Thessaloniki, Thessaloniki, Greece
AES Convention: 112 (April 2002) Paper Number: 5626
Publication Date: April 1, 2002 Import into BibTeX
Subject: Signal Processing Forum
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=11340

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD aes19)   /pp2002/pp0205/000210.pdf

Start a discussion about this paper!