Sonification of 3-dimensional shapes is challenging because there are fundamental differences between the human auditory and visual systems. Subjects were asked to explore the audio representations of top-projected shapes having different levels of visual complexity using several different strategies. After a 50-minute experience with each sonification technique, all subjects agreed that auditory patterns derived from cross-sectional profiles of virtual objects were robust and extremely easy for mental manipulation, enabling them to mentally rebuild virtual shapes. At the beginning of the test, subjects could not imagine that it would be possible to get a sense of a virtual shape by relying exclusively on ordinary MIDI sounds. Two other techniques were not successful.
https://www.aes.org/e-lib/browse.cfm?elib=17131
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!
This paper costs $33 for non-members and is free for AES members and E-Library subscribers.
Learn more about the AES E-Library
Start a discussion about this report!
