AES E-Library

AES E-Library

Augmented Reality to Improve Orchestra Conductors' Headphone Monitoring

Conductors face challenges when conducting the orchestra with headphones to synchronize with a soundtrack or a click track. We sent a survey to 12 international conductors to identify and classify those challenges. They primarily reported on balance issues, aggressive click tracks, and the difficulty of hearing the acoustic sound of the orchestra, leading 70% of them to remove one ear out of the headphones. A solution using augmented reality monitoring through binaural rendering and head tracking was tested in various situations and showed that it could successfully reproduce the acoustic sound of the orchestra into the headphones. Another perceptual experiment evaluated the potential of realism of this solution when merging two binaural auditory scenes recorded in the same acoustic space together. Results encourage us to further develop immersive monitoring systems for conductors, with the soundtrack integrated in the real acoustic space.

AES Convention: Paper Number:
Publication Date:

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:

Start a discussion about this paper!

AES - Audio Engineering Society