AES E-Library

C. Bui, A. Genovese, T. Bradley, and A. Roginska, "Multimodal Immersive Motion Capture (MIMiC): A workflow for musical performance," Engineering Brief 635, (2020 October.). doi: C. Bui, A. Genovese, T. Bradley, and A. Roginska, "Multimodal Immersive Motion Capture (MIMiC): A workflow for musical performance," Engineering Brief 635, (2020 October.). doi:
Abstract: This paper introduces a workflow to record paired motion capture and sound of musical performances using an infrared light-based tracking system. This paper discusses example production cases ranging from short loops to full performances, addressing the production challenges and compromises, substantially different from a regular audio recording process. Motion capture is very versatile and can be applied in many disciplines including musical pedagogy, distributed performances, machine learning, and as creative assets. Paired audio-mocap data can be rendered into similar visual content for interactive virtual environments, live performances or fixed media. This extensible workflow can be adapted and extended for different purposes in musical performances to promote further research and creative content development.

@article{bui2020multimodal,
author={bui, cindy and genovese, andrea and bradley, trey and roginska, agnieszka},
journal={journal of the audio engineering society},
title={multimodal immersive motion capture (mimic): a workflow for musical performance},
year={2020},
volume={},
number={},
pages={},
doi={},
month={october},} @article{bui2020multimodal,
author={bui, cindy and genovese, andrea and bradley, trey and roginska, agnieszka},
journal={journal of the audio engineering society},
title={multimodal immersive motion capture (mimic): a workflow for musical performance},
year={2020},
volume={},
number={},
pages={},
doi={},
month={october},
abstract={this paper introduces a workflow to record paired motion capture and sound of musical performances using an infrared light-based tracking system. this paper discusses example production cases ranging from short loops to full performances, addressing the production challenges and compromises, substantially different from a regular audio recording process. motion capture is very versatile and can be applied in many disciplines including musical pedagogy, distributed performances, machine learning, and as creative assets. paired audio-mocap data can be rendered into similar visual content for interactive virtual environments, live performances or fixed media. this extensible workflow can be adapted and extended for different purposes in musical performances to promote further research and creative content development.},}

TY - paper
TI - Multimodal Immersive Motion Capture (MIMiC): A workflow for musical performance
SP - EP -
AU - Bui, Cindy
AU - Genovese, Andrea
AU - Bradley, Trey
AU - Roginska, Agnieszka
PY - 2020
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - October 2020 TY - paper
TI - Multimodal Immersive Motion Capture (MIMiC): A workflow for musical performance
SP - EP -
AU - Bui, Cindy
AU - Genovese, Andrea
AU - Bradley, Trey
AU - Roginska, Agnieszka
PY - 2020
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - October 2020
AB - This paper introduces a workflow to record paired motion capture and sound of musical performances using an infrared light-based tracking system. This paper discusses example production cases ranging from short loops to full performances, addressing the production challenges and compromises, substantially different from a regular audio recording process. Motion capture is very versatile and can be applied in many disciplines including musical pedagogy, distributed performances, machine learning, and as creative assets. Paired audio-mocap data can be rendered into similar visual content for interactive virtual environments, live performances or fixed media. This extensible workflow can be adapted and extended for different purposes in musical performances to promote further research and creative content development.