AES E-Library

M. Graf, H. Chijioke Opara, and M. Barthet, "An Audio-Driven System for Real-Time Music Visualisation," Paper 10498, (2021 May.). doi: M. Graf, H. Chijioke Opara, and M. Barthet, "An Audio-Driven System for Real-Time Music Visualisation," Paper 10498, (2021 May.). doi:
Abstract: Computer-generated visualisations can accompany recorded or live music to create novel audiovisual experiences for audiences. We present a system to streamline the creation of audio-driven visualisations based on audio feature extraction and mapping interfaces. Its architecture is based on three modular software components: backend (audio plugin), frontend (3D game-like environment), and middleware (visual mapping interface). We conducted a user evaluation comprising two stages. Results from the first stage (34 participants) indicate that music visualisations generated with the system were significantly better at complementing the music than a baseline visualisation. Nine participants took part in the second stage involving interactive tasks. Overall, the system yielded a Creativity Support Index above average (68.1) and a System Usability Scale index (58.6) suggesting that ease of use can be improved. Thematic analysis revealed that participants enjoyed the system’s synchronicity and expressive capabilities, but found technical problems and difficulties understanding the audio feature terminology.

@article{graf2021an,
author={graf, max and chijioke opara, harold and barthet, mathieu},
journal={journal of the audio engineering society},
title={an audio-driven system for real-time music visualisation},
year={2021},
volume={},
number={},
pages={},
doi={},
month={may},} @article{graf2021an,
author={graf, max and chijioke opara, harold and barthet, mathieu},
journal={journal of the audio engineering society},
title={an audio-driven system for real-time music visualisation},
year={2021},
volume={},
number={},
pages={},
doi={},
month={may},
abstract={computer-generated visualisations can accompany recorded or live music to create novel audiovisual experiences for audiences. we present a system to streamline the creation of audio-driven visualisations based on audio feature extraction and mapping interfaces. its architecture is based on three modular software components: backend (audio plugin), frontend (3d game-like environment), and middleware (visual mapping interface). we conducted a user evaluation comprising two stages. results from the first stage (34 participants) indicate that music visualisations generated with the system were significantly better at complementing the music than a baseline visualisation. nine participants took part in the second stage involving interactive tasks. overall, the system yielded a creativity support index above average (68.1) and a system usability scale index (58.6) suggesting that ease of use can be improved. thematic analysis revealed that participants enjoyed the system’s synchronicity and expressive capabilities, but found technical problems and difficulties understanding the audio feature terminology.},}

TY - paper
TI - An Audio-Driven System for Real-Time Music Visualisation
SP - EP -
AU - Graf, Max
AU - Chijioke Opara, Harold
AU - Barthet, Mathieu
PY - 2021
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - May 2021 TY - paper
TI - An Audio-Driven System for Real-Time Music Visualisation
SP - EP -
AU - Graf, Max
AU - Chijioke Opara, Harold
AU - Barthet, Mathieu
PY - 2021
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - May 2021
AB - Computer-generated visualisations can accompany recorded or live music to create novel audiovisual experiences for audiences. We present a system to streamline the creation of audio-driven visualisations based on audio feature extraction and mapping interfaces. Its architecture is based on three modular software components: backend (audio plugin), frontend (3D game-like environment), and middleware (visual mapping interface). We conducted a user evaluation comprising two stages. Results from the first stage (34 participants) indicate that music visualisations generated with the system were significantly better at complementing the music than a baseline visualisation. Nine participants took part in the second stage involving interactive tasks. Overall, the system yielded a Creativity Support Index above average (68.1) and a System Usability Scale index (58.6) suggesting that ease of use can be improved. Thematic analysis revealed that participants enjoyed the system’s synchronicity and expressive capabilities, but found technical problems and difficulties understanding the audio feature terminology.