The goal of this project is to automatically synthesise contact sounds such as scraping in continuous contact with a surface. This continuous information is much richer than simply triggering a sound sample. We investigated an 'ecological' granular synthesis algorithm and implemented it on a Windows PC using the OpenAL API and hardware acceleration on the soundcard. We integrated the algorithm into the Reachin Haptic API with haptic-audio latency below the 2ms threshold of perception. Using this system we found we could hear information such as the force, rate and timing of scraping gestures on the surface as well as properties such as stiffness, friction, roughness and bumpiness.

Authors: Barrass, Stephen; Adcock, Matt
Affiliation: CSIRO Mathematics and Information Sciences, Camberra, Australia
AES Conference: 22nd International Conference: Virtual, Synthetic, and Entertainment Audio (June 2002)
Paper Number: 000236
Publication Date: June 1, 2002 Import into BibTeX
Subject: Virtual, Synthetic and Entertainment Audio
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=11144

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD aes19)   /intl2002/2002es06/000236.pdf

Start a discussion about this paper!