Manifold Learning Methods for Visualization and Browsing of Drum Machine Samples
×
Cite This
Citation & Abstract
J. Shier, K. McNally, G. Tzanetakis, and KY. GR. Brooks, "Manifold Learning Methods for Visualization and Browsing of Drum Machine Samples," J. Audio Eng. Soc., vol. 69, no. 1/2, pp. 40-53, (2021 January.). doi: https://doi.org/10.17743/jaes.2020.0064
J. Shier, K. McNally, G. Tzanetakis, and KY. GR. Brooks, "Manifold Learning Methods for Visualization and Browsing of Drum Machine Samples," J. Audio Eng. Soc., vol. 69 Issue 1/2 pp. 40-53, (2021 January.). doi: https://doi.org/10.17743/jaes.2020.0064
Abstract: The use of electronic drum samples is widespread in contemporary music productions, with music producers having an unprecedented number of samples available to them. The task of organizing and selecting from these large collections can be challenging and time consuming, which points to the need for improved methods for user interaction. This paper presents a system that computationally characterizes and organizes drum machine samples in two dimensions based on sound similarity. The goal of the work is to support the development of intuitive drum sample browsing systems. The methodology presented explores time segmentation, which isolates temporal subsets from the input signal prior to audio feature extraction, as a technique for improving similarity calculations. Manifold learning techniques are compared and evaluated for dimensionality reduction tasks, and used to organize and visualize audio collections in two dimensions. This methodology is evaluated using a combination of objective and subjective methods including audio classification tasks and a user listening study. Finally, we present an open-source audio plug-in developed using the JUCE software framework that incorporates the findings from this study into an application that can be used in the context of a music production environment.
@article{shier2021manifold,
author={shier, jordie and mcnally, kirk and tzanetakis, george and brooks, ky grace},
journal={journal of the audio engineering society},
title={manifold learning methods for visualization and browsing of drum machine samples},
year={2021},
volume={69},
number={1/2},
pages={40-53},
doi={https://doi.org/10.17743/jaes.2020.0064},
month={january},}
@article{shier2021manifold,
author={shier, jordie and mcnally, kirk and tzanetakis, george and brooks, ky grace},
journal={journal of the audio engineering society},
title={manifold learning methods for visualization and browsing of drum machine samples},
year={2021},
volume={69},
number={1/2},
pages={40-53},
doi={https://doi.org/10.17743/jaes.2020.0064},
month={january},
abstract={the use of electronic drum samples is widespread in contemporary music productions, with music producers having an unprecedented number of samples available to them. the task of organizing and selecting from these large collections can be challenging and time consuming, which points to the need for improved methods for user interaction. this paper presents a system that computationally characterizes and organizes drum machine samples in two dimensions based on sound similarity. the goal of the work is to support the development of intuitive drum sample browsing systems. the methodology presented explores time segmentation, which isolates temporal subsets from the input signal prior to audio feature extraction, as a technique for improving similarity calculations. manifold learning techniques are compared and evaluated for dimensionality reduction tasks, and used to organize and visualize audio collections in two dimensions. this methodology is evaluated using a combination of objective and subjective methods including audio classification tasks and a user listening study. finally, we present an open-source audio plug-in developed using the juce software framework that incorporates the findings from this study into an application that can be used in the context of a music production environment.},}
TY - paper
TI - Manifold Learning Methods for Visualization and Browsing of Drum Machine Samples
SP - 40
EP - 53
AU - Shier, Jordie
AU - McNally, Kirk
AU - Tzanetakis, George
AU - Brooks, Ky Grace
PY - 2021
JO - Journal of the Audio Engineering Society
IS - 1/2
VO - 69
VL - 69
Y1 - January 2021
TY - paper
TI - Manifold Learning Methods for Visualization and Browsing of Drum Machine Samples
SP - 40
EP - 53
AU - Shier, Jordie
AU - McNally, Kirk
AU - Tzanetakis, George
AU - Brooks, Ky Grace
PY - 2021
JO - Journal of the Audio Engineering Society
IS - 1/2
VO - 69
VL - 69
Y1 - January 2021
AB - The use of electronic drum samples is widespread in contemporary music productions, with music producers having an unprecedented number of samples available to them. The task of organizing and selecting from these large collections can be challenging and time consuming, which points to the need for improved methods for user interaction. This paper presents a system that computationally characterizes and organizes drum machine samples in two dimensions based on sound similarity. The goal of the work is to support the development of intuitive drum sample browsing systems. The methodology presented explores time segmentation, which isolates temporal subsets from the input signal prior to audio feature extraction, as a technique for improving similarity calculations. Manifold learning techniques are compared and evaluated for dimensionality reduction tasks, and used to organize and visualize audio collections in two dimensions. This methodology is evaluated using a combination of objective and subjective methods including audio classification tasks and a user listening study. Finally, we present an open-source audio plug-in developed using the JUCE software framework that incorporates the findings from this study into an application that can be used in the context of a music production environment.
The use of electronic drum samples is widespread in contemporary music productions, with music producers having an unprecedented number of samples available to them. The task of organizing and selecting from these large collections can be challenging and time consuming, which points to the need for improved methods for user interaction. This paper presents a system that computationally characterizes and organizes drum machine samples in two dimensions based on sound similarity. The goal of the work is to support the development of intuitive drum sample browsing systems. The methodology presented explores time segmentation, which isolates temporal subsets from the input signal prior to audio feature extraction, as a technique for improving similarity calculations. Manifold learning techniques are compared and evaluated for dimensionality reduction tasks, and used to organize and visualize audio collections in two dimensions. This methodology is evaluated using a combination of objective and subjective methods including audio classification tasks and a user listening study. Finally, we present an open-source audio plug-in developed using the JUCE software framework that incorporates the findings from this study into an application that can be used in the context of a music production environment.
Authors:
Shier, Jordie; McNally, Kirk; Tzanetakis, George; Brooks, Ky Grace
Affiliations:
University of Victoria, Victoria, Canada; University of Victoria, Victoria, Canada; University of Victoria, Victoria, Canada; Center for Interdisciplinary Research in Music Media and Technology (CIRMMT), McGill University, Montreal, Canada; School of Information Studies, McGill University, Montreal, Canada(See document for exact affiliation information.) JAES Volume 69 Issue 1/2 pp. 40-53; January 2021
Publication Date:
February 19, 2021Import into BibTeX
Permalink:
http://www.aes.org/e-lib/browse.cfm?elib=21015