AES E-Library

Linear Mixing Models for Active Listening of Music Productions in Realistic Studio Conditions

The mixing/demixing of audio signals as addressed in the signal processing literature (the “source separation” problem) and the music production in studio remain quite separated worlds. Scientific audio scene analysis rather focuses on “natural” mixtures and most often uses linear (convolutive) models of point sources placed in the same acoustic space. In contrast, the sound engineer can mix musical signals of very different nature and belonging to different acoustic spaces, and exploits many audio effects including non-linear processes. In the present paper we discuss these differences within the strongly emerging framework of active music listening, which is precisely at the crossroads of these two worlds: it consists in giving to the listener the ability to manipulate the different musical sources while listening to a musical piece. We propose a model that allows the description of a general studio mixing process as a linear stationary process of “generalized source image signals” considered as individual tracks. Such a model can be used to allow the recovery of the isolated tracks while preserving the professional sound quality of the mixture. A simple addition of these recovered tracks enables the end-user to recover the full-quality stereo mix, while these tracks can also be used for, e.g., basic remix / karaoke / soloing and re-orchestration applications.

Authors: Sturmel, Nicolas; Liutkus, Antoine; Pinel, Jonathan; Girin, Laurent; Marchand, Sylvain; Richard, Gaël; Badeau, Roland; Daudet, Laurent
Affiliations: GIPSA-Lab, Grenoble INP, Grenoble, France; Institut Langevin, ESPCI-CNRS, Université Paris Diderot, Paris, France; Institut Telecom, Telecom ParisTech, CNRS LTCI, Paris, France; Université de Bretagne Occidentale, Brest, France(See document for exact affiliation information.)
AES Convention:132 (April 2012) Paper Number:8594 Import into BibTeX
Subject:Sound Reinforcement and Studio Technologies

Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 132Papers)   /conv/132/8594.pdf

Start a discussion about this paper!