AES E-Library

AES E-Library

Designing a Augmented Reality Auditory Training Game for in-situ training and diagnostic tool for the hearing impaired

Document Thumbnail

The World Health Organization reports that around 20% of the global population is affected by hearing impairment, a trend expected to only grow in the foreseeable future. Consequently, the development of accessible auditory training modules and diagnostic tools has become increasingly vital. In response, we propose an innovative Aug-mented Reality (AR)-based auditory training game that serves as an comprehensive auditory training/rehabilitation application for improving speech in noise perception and sound localization. Leveraging advancements in AR technology and mobile device computing power, our game incorporates audio-motor function into traditionally static training environments, with a design that focuses on enhancing selective auditory attention. The game challenges users to discriminate between two similarly pronounced words and identify the correct one in context, providing a novel approach to auditory training. A distinctive feature of our game is its ability to track the user’s movement relative to spatial audio sources. This tracking can provide valuable data for medical professionals, as the movements are visualized to a 2d mapping of their navigational data, revealing insights into the user’s auditory processing capabilities. Future work will assess the game’s training efficacy and its effectiveness as a diagnostic tool, alongside further enhancements to its auditory AR capabilities for real-time acoustic environment simulation.

Authors:
Affiliation:
AES Conference:
Paper Number:
Publication Date:
Subject:
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=22403

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:

Start a discussion about this paper!