AES E-Library

Towards a Telematic Visual-Conducting System

Recent advances in networking technology (higher bit rates and lower transmission latencies) enable new applications where musicians can play together remotely, over the Internet. This application requires an audio coder providing sufficient compression to avoid overloading a connection and delay jitter, and also having a very low encoding/decoding delay. Often it is also desirable to have a visual connection, particularly for a conductor of an orchestra. But a parallel video connection often overloads a low delay connection, and usually also leads to more jitter and delay in the audio connection. Hence our approach is to design a special conductor transmission scheme, using a standard computer mouse, for this purpose. We found that the data from this transmission scheme can easily be integrated in the audio data stream without affecting jitter and delay. Experiments showed that, depending on the tempo of the music, the conductor and the orchestra could tolerate round trip times of about 75 to 150~ms.

Authors: Carôt, Alexander; Schuller, Gerald
Affiliations: Anhalt University of Applied Sciences, Anhalt, Germany; Fraunhofer IDMT, Ilmenau, Germany(See document for exact affiliation information.)
AES Conference:44th International Conference: Audio Networking (November 2011)
Paper Number:16 Import into BibTeX
Subject:Networked Performance

Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 44thPapers)   /conf/44/aes44-000014.pdf

Start a discussion about this paper!