AES Store

Journal Forum

Reflecting on Reflections - June 2014
1 comment

Quiet Thoughts on a Deafening Problem - May 2014
1 comment

Perceptual Effects of Dynamic Range Compression in Popular Music Recordings - January 2014
5 comments

Access Journal Forum

AES E-Library

Audio Processing in a Multimodal Framework

The EyesWeb system (www.eyesweb.org) is an open platform for real-time multimodal processing. It has now reached a mature stage, and is being used both for research in multimodal interfaces and for for applications such as naturally interacting systems for museum exhibits, performing arts, therapy and rehabilitation. This paper presents the latest development concerning audio processing in EyesWeb with a special focus on multimodal processing. The integrated audio processing support includes modules for the analysis and synthesis of audio streams, for musical processing through the MIDI protocol, and for interoperability with other audio processing platforms, technologies and standards. Advanced real-time audio support for the mapping of multimodal input into multimedia output is described in the full paper.

Authors:
Affiliations:
AES Convention: Paper Number:
Publication Date:
Subject:

Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:

Start a discussion about this paper!


 
Facebook   Twitter   LinkedIn   Google+   YouTube   RSS News Feeds  
AES - Audio Engineering Society