AES Paris 2016
Workshop W7
Sunday, June 5, 11:30 — 12:30 (Room 352A)
W7 - Audio Recording and Productions for Virtual Reality/360-Degree Applications
Chair:Matthieu Parmentier, francetélévisions - Paris, France
Panelists:
Frank Melchior, BBC Research and Development - Salford, UK
Nils Peters, Qualcomm, Advanced Tech R&D - San Diego, CA, USA
Jan Plogsties, Fraunhofer Institute for Integrated Circuits IIS - Erlangen, Germany
Ville Pulkki, Aalto University - Espoo, Finland
Frederick Umminger, Sony Computer Entertainment America - San Mateo, CA, USA
Abstract:
At IBC, AES 139th, CES, and other events Virtual Reality has been a huge topic. VR producers more and more realize the potential and need for spatial audio processing for VR applications. This workshop will discuss the following topics:
• How to record audio for 360° video? —Mics: Can we use the same techniques as for Movie/TV productions? Or does a B-format mic do the trick?
• How to mix audio for 360/VR?—Formats: What are the formats to store and deliver, Channels, object or ambisonics, a combination or binaural?; Processing: How do we combine the different tracks? What Plugins and production tools are there?; Monitoring: How can we monitor what the user will hear?
• How to deliver audio for different VR applications?—Creating a VR app with spatial audio (SDKs, tools); User cases: mobile, VR glass, streaming, browser-based; Codec and limitations
• How to render audio for 360/VR?—Headphone rendering for VR glasses; Speaker playback for TV; What are resolution and latency requirements
• What quality aspects are important?—Accuracy and plausibility - What is the interaction with video?
 | This session is presented in association with the AES Technical Committee on Spatial Audio and AES Technical Committee on Broadcast and Online Delivery |
