AES E-Library

Musical Movements—Gesture Based Audio Interfaces

Recent developments have led to the availability of consumer devices capable of recognising certain human movements and gestures. This paper is a study of novel gesture-based audio interfaces. The authors present two prototypes for interacting with audio/visual experiences. The first allows a user to ‘conduct’ a recording of an orchestral performance, controlling the tempo and dynamic. The paper describes the audio and visual capture of the orchestra and the design and construction of the audio-visual playback system. An analysis of this prototype, based on testing and feedback from a number of users, is also provided. The second prototype uses the gesture tracking algorithm to control a three-dimensional audio panner. This audio panner is tested and feedback from a number of professional engineers is analysed.

Authors: Churnside, Anthony; Pike, Chris; Leonard, Max
Affiliation: BBC R&D, Media City, Salford, UK
AES Convention:131 (October 2011) Paper Number:8496 Import into BibTeX
Subject:Applications in Audio

Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 131Papers)   /131/8496.pdf

Start a discussion about this paper!