This article presents the CASimIR framework for online experiments, its use for creating a music audio game, and initial results and analyses of the collected data. Gathering user data is essential to understand the semantics of music audio and CASimIR is a new open framework for creating games with a purpose and surveys to collect user data in the Web and social networks. Its design facilitates collaborative data annotation in dynamic environments by providing modules for managing media and annotation data, as well as functionality for creating and running online real-time multi-player games. Technical benefits of the extensible framework as well as its cost effectiveness are discussed. As a case-study, we present its use in Spot The Odd Song Out, a multi-player game for collecting annotations on musical similarity and rhythm and we analyse the quantity and quality of data obtained to date with this game. The results and lessons for future data collection projects in the context of shared and linked data are discussed.
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!
This paper costs $33 for non-members and is free for AES members and E-Library subscribers.