A multimodal interactive system for audio-haptic integration is presented in this paper. Preliminary subjective tests with a virtual reality setup were conducted with the goal of interpreting cognitive mechanisms and improving performances in orientation & mobility protocols for visually impaired subjects, where spatial representations need to be developed using residual sensory channels. An object recognition experiment was performed in order to investigate the contribution of dynamic spatial audio cues when integrated with haptic feedback. Audio cues took the form of anchor sound delivered through headphones using customized Head-related Transfer Functions (HRTFs). This setup was employed in the exploration of simplified virtual audio-tactile environments. Overall results on recognition time reveal a relationship between anchor position and object shape. Moreover, a qualitative analysis of the exploration paths highlights behavioral changes between unimodal and multimodal conditions.

Authors: Geronazzo, Michele; Bedin, Alberto; Brayda, Luca; Avanzini, Federico
Affiliations: Fondazione Istituto Italiano di Tecnologia, Genova, Italy; University of Padova, Padova, Italy(See document for exact affiliation information.)
AES Conference: 55th International Conference: Spatial Audio (August 2014)
Paper Number: P-1
Publication Date: August 26, 2014 Import into BibTeX
Subject: Posters
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=17357

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD 55thPapers)   /conf/55/aes55-000025.pdf

Start a discussion about this paper!