We propose a solution to enable speech-driven alien language synthesis in an in-game voice-chat system. Our technique selectively replaces the users input speech with a corresponding alien language output synthesized on-the-fly. It is optimized for a client-server architecture and uses a concatenative synthesis framework. To limit memory requirements, as well as preserve forwarding capabilities on the server, the concatenative synthesis is performed in the coded domain. For gaming applications, our approach can be used to selectively scramble the speech of opposing team members in order to provide compelling in-game voice feedback without exposing their strategy. The system has been implemented with multiple alien races in a virtual environment with effective, entertaining results.

Authors: Tsingos, Nicolas; Robinson, Charles
Affiliation: Dolby Laboratories, San Francisco, CA, USA
AES Conference: 41st International Conference: Audio for Games (February 2011)
Paper Number: 2-3
Publication Date: February 2, 2011 Import into BibTeX
Subject: Music, Synthesis, and Speech Processing
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=15767

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 41stPapers)   /conf/41/aes41-000035.pdf

Start a discussion about this paper!