The VideoHarp is an optical-scanning musical instrument controller which senses multiple-finger gestures. It works by detecting the images of a performer's fingertips. From the images, the position and velocity of each fingertip is deduced. This information is translated into MIDI, which is then used to drive synthesizers for sound production. The translation is programmable, enabling the instrument to be played using different articulation techniques. The VideoHarp may be played with harp-like or keyboard-like gestures, by bowing or drumming motions, or by motions with no analog in existing instrument technique.
This paper costs $20 for non-members, $5 for AES members and is free for E-Library subscribers.