HoloBand is a clinical tool for audiovisual music perception training in augmented reality (AR) using the Hololens 2 for the hard-of-hearing (HoH). It consists of two interfaces: a spatial environment in AR for the HoH user and a computer interface to control the training for speech and language pathologists (SLP). We adopt a participatory exploratory research approach to investigate novel ways of conducting timbre discrimination, audio localization, and pitch recognition. HoloBand is evaluated using a focus group with SLPs (n=6) and interpreted through inductive thematic analysis. Hololens 2 shows relevant contextual, visual capabilities to enhance music perception training. However, a closer integration into the clinical workflow and a task-oriented approach is necessary to bring real-life scenarios to the clinical setting.

Authors: Ivanyi, Balazs; Tsalidis, Christian; Naylor, Scott; Tjemsland, Truls; Adjorlu, Ali; Kepp, Nille Elise; Serafin, Stefania
Affiliations: Aalborg University, Copenhagen, Denmark; Copenhagen Hearing and Balance Centre, Rigshospitalet & University of Copenhagen, Copenhagen, Denmark(See document for exact affiliation information.)
AES Conference: 2022 AES International Conference on Audio for Virtual and Augmented Reality (August 2022)
Paper Number: 1
Publication Date: August 15, 2022 Import into BibTeX
Subject: Paper
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=21831

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:   /conf/2022/avar/2022_avar_paper_1.pdf

Start a discussion about this paper!