“Inside the Quartet” is a virtual reality experience that provides users with a first-person perspective of playing in a string quartet. The user can see and hear the music performance from the different players’ perspectives, experiencing how musicians communicate with gestures and eye contact from within the quartet. The VR experience shows recordings of the Kamus string quartet playing Sibelius’s string quartet in D-Minor op. 56 “Voces Intimae” in Ainola, Jean Sibelius’s home in Järvenpää, Finland. The audio production employed spot mics encoded to 5th-order Ambisonics, which were dynamically decoded to headphones during playback. The installation was shown at various music and VR festivals. Here, we describe the audio and video production, rendering workflow, and the challenges and future perspectives for similar VR experiences.

Authors: Meyer-Kahlen, Nils; Piiroinen, Petra; Vishwanath, Gautam; Juntunen, Petri; Tiainen, Eero; Schlecht, Sebastian J.
Affiliations: Aalto University, Espoo, Finland; Meidän Festivaali, Finland; Aalto University, Espoo, Finland; Aalto University, Espoo, Finland; Aalto University, Espoo, Finland; Aalto University, Espoo, Finland(See document for exact affiliation information.)
Express Paper 106; AES Convention 154; May 2023
Publication Date: May 13, 2023 Import into BibTeX
Subject: Spatial Audio
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=22078

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location:   /conv/154/epaper106.pdf

Start a discussion about this Spatial Audio!