AES E-Library

Real-Time Tracking of Speech Sources Using Binaural Audio and Orientation Tracking

This article presents a method for real-time estimation of the directions of speech sources from captured binaural audio. Accurate direction estimates are required in order to embed the sound sources correctly to the auditory environment of the far-end user in telecommunication between two augmented reality audio (ARA) users. The dependency of the estimation accuracy on the orientation of the near-end user is avoided in this method by combining the information from an orientation tracker to the direction estimates. The results from the anechoic experiments illustrate that the presented method can estimate the direction(s) of non-simultaneous speech source(s) in real-time, and that head movement improves the estimation accuracy of sources on the sides of the user.

Authors: Karjalainen, Matti; Takanen, Marko
Affiliation: Aalto University School of Science and Technology, Espoo, Aalto, Finland
AES Conference:40th International Conference: Spatial Audio: Sense the Sound of Space (October 2010)
Paper Number:P-13 Import into BibTeX
Subject:Spatial Audio

Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 40thPapers)   /conf/40/aes40-000044.pdf

Start a discussion about this paper!