AES E-Library

KnuckleTap - Exploring the Possibilities of Audio Input in a Mobile Rhythmic Notepad Application

Apart from some significant contributions in the scientific community and a few notable product innovations, audio input for musical interaction purposes on mobile devices has until now been widely neglected as a control parameter. This situation does not correspond to the fact that musical ideas are often vocalized and developed by musicians using their voice or other sounding objects, nor does it take advantage of contemporary mobile devices' most rigid and reliable sensor - the microphone. As an example case exploiting these possibilities, we conceived a notepad application to track rhythmic ideas by recording taps on a surface with a smartphone's built-in microphone, refined by subsequent detection of onsets, clustering, instantaneous rearranging of the detected events, and export capabilities.

Authors: Rubisch, Julian; Jaksche, Michael
Affiliations: breakingwav.es, Vienna, Austria; St Poelten Univerrsity of Applied Sciences, St Poelten, Austria(See document for exact affiliation information.)
AES Convention:132 (April 2012) Paper Number:8661 Import into BibTeX
Subject:Posters: Education, Human Factors, and Applications

Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 132Papers)   /conv/132/8661.pdf

Start a discussion about this paper!