The goal of this project is to automatically synthesise contact sounds such as scraping in continuous contact with a surface. This continuous information is much richer than simply triggering a sound sample. We investigated an 'ecological' granular synthesis algorithm and implemented it on a Windows PC using the OpenAL API and hardware acceleration on the soundcard. We integrated the algorithm into the Reachin Haptic API with haptic-audio latency below the 2ms threshold of perception. Using this system we found we could hear information such as the force, rate and timing of scraping gestures on the surface as well as properties such as stiffness, friction, roughness and bumpiness.
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!
This paper costs $33 for non-members and is free for AES members and E-Library subscribers.