This work presents a system that is able to provide fine-grained time-dependent context while listening to recorded music. By utilizing acoustic fingerprinting techniques the system recognizes which music is playing in the environment and also determines an exact playback position. This makes it possible to provide context at exactly the right time. The design of the system can be used to augment listening experiences with lyrics, scores, tablature or even music videos. To test the concept, a prototype has been built that is able to give feedback that coincides with the beat of music playing in the users environment. The system is evaluated with respect to timing and is able to respond to beats within 16 ms on average.

Authors: Six, Joren; Leman, Marc
Affiliation: Ghent University, Ghent, Belgium
AES Conference: 2017 AES International Conference on Semantic Audio (June 2017)
Paper Number: P1-5
Publication Date: June 13, 2017 Import into BibTeX
Subject: Semantic Audio
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=18768

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:   /conf/2017/semantic/semantic_audio_2017_paper_28.pdf

Start a discussion about this paper!