New interactive music services have emerged, despite currently using proprietary file formats. Having a standardized file format could benefit the interoperability between these services. In this regard, the ISO/IEC Moving Picture Experts Group (MPEG) issued a new standard, the so called, MPEG-A: Interactive Music Application Format (IM AF). The purpose of this paper is to describe the design and implementation of an IM AF codec and its integration into Sonic Visualiser. In this way, the visualization of the chords or the pitch of the main melody aligned in time with the song's lyrics is achieved. Furthermore, this integration provides the semantic audio research community with a test-bed for further development and comparison of new Sonic Visualiser VAMP plug-ins, e.g., for the conversion of singing voice to text and/or automatic highlighting of lyrics for karaoke applications.

Authors: García, Jesús; Taglialatela, Costantino; Kudumakis, Panos; Barbancho, Isabel; Tardon, Lorenzo; Sandler, Mark
Affiliations: Queen Mary University of London, London, UK; Seconda Universita Degli Studi Di Napoli, Naples, Italy; Universidad de Málaga, Malaga, Spain(See document for exact affiliation information.)
AES Conference: 53rd International Conference: Semantic Audio (January 2014)
Paper Number: P1-11
Publication Date: January 27, 2014 Import into BibTeX
Subject: Audio Signal Processing and Feature Extraction
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=17097

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 53rdPapers)   /conf/53/aes53-000045.pdf

Start a discussion about this paper!