AES E-Library

AES E-Library

KnuckleTap - Exploring the Possibilities of Audio Input in a Mobile Rhythmic Notepad Application

Apart from some significant contributions in the scientific community and a few notable product innovations, audio input for musical interaction purposes on mobile devices has until now been widely neglected as a control parameter. This situation does not correspond to the fact that musical ideas are often vocalized and developed by musicians using their voice or other sounding objects, nor does it take advantage of contemporary mobile devices' most rigid and reliable sensor - the microphone. As an example case exploiting these possibilities, we conceived a notepad application to track rhythmic ideas by recording taps on a surface with a smartphone's built-in microphone, refined by subsequent detection of onsets, clustering, instantaneous rearranging of the detected events, and export capabilities.

AES Convention: Paper Number:
Publication Date:

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:

Start a discussion about this paper!

AES - Audio Engineering Society