Input devices that operate in three-dimensions and six-degrees-of-freedom (6DOF) have been evolving over the past several decades, and much research has been done on the subject of capturing the gestures of performers in an effort to re-map them to digital instruments, but not much for 3D audio. The practice of 3D audio mixing and spatialization is no different from a musical performance in this respect. The gestures used by engineers are expressive and have complex metaphorical significance. The purpose of this project includes developing a 6DOF gestural control utilising the Leap Motion® controller for the Digital Workstation Pyramix®, which will work as a MIDI layover gestural control system to be used as a multi-dimensional controller and automation recorder.

Author: Quiroz, Diego
Affiliation: McGill University, Montreal, Quebec, Canada
AES Conference: 2018 AES International Conference on Spatial Reproduction - Aesthetics and Science (July 2018)
Paper Number: EB1-3
Publication Date: July 30, 2018 Import into BibTeX
Session Subject: gestural control; 3D audio; 3D panning; Pyramix Virtual Studio
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=19643

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:   /conf/2018/spatial/spatial_reproduction_2018_paper_58.pdf

Start a discussion about this paper!