AES E-Library

AES E-Library

Multimodal Information Management: Evaluation of Auditory and Haptic Cues for NextGen Communication Displays

Auditory communication displays within the Next Generation Air Transport System (currently under development in the United States) will likely require an improvements in the user interface for selecting amongst multiple incoming messages. Interface design can impact both user performance and preference. Two design factors were evaluated: physical pressure-sensitive switches versus flatpanel "virtual switches," and auditory feedback from switch contact. Performance with stimuli using physical switches was 1.2 s faster than virtual switches (2.0 s vs. 3.2 s); auditory feedback provided a 0.6 s performance advantage (2.3 s vs. 2.9 s). The subjective results show a significant preference and superior performance for physical pressure-sensitive switches having audio feedback, compared to touch-panel virtual switches. The correlation between objective measures of performance and subjective ratings of preference and performance was shown to be high. Overall, the results indicate that any replacement of physical controls by virtual touch screens must be considered carefully, and should include audio feedback.

JAES Volume 62 Issue 6 pp. 375-385; June 2014
Publication Date:

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:


Start a discussion about this paper!

AES - Audio Engineering Society