Dancing Music: Integrated MIDI-Driven Synthesis and Spatialization for Virtual Reality
We describe a unique MIDI-based spatial sound system featuring a network-driven bank of four RSS-10s (Roland Sound Space Processors) driving an eight-transducer circumferential speaker array in a" 3D Theater", enabling a three-dimensional dynamic musical space. Sound sources can be choreographed by adding dynamic positional gestures to standard MIDI files. Our sequencing system interprets such files, partitioning their data into two streams: one for MIDI tonal events, sent to synthesizers, and the other for positional data, sent simultaneously to sound spatializers, clients in a multimodal musical control of sound spatialization, synchronizable with stereographic 3D contents, for spatializing music to give real presence to an audience.
Click to purchase paper or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!
This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.