This paper documents the design and play-testing of a videogame that incorporates electroencephalography (EEG) technology to augment traditional controls. A survival horror game was created using Unity3D. The player navigates the game using conventional keyboard and mouse movement, however, they also wear an Emotiv EPOC headset that transmits their level of calm to the game via OSC. In order to complete the game, the player must remain as calm as possible. An adaptive audio engine was developed to act as an auditory display for this complex parameter in lieu of a distracting visual indicator. Every element of the audio was designed to adapt to the constantly fluctuating value. Procedural audio modules were created in Max, where player EEG data was simultaneously mapped to a myriad of modulators. FMOD Studio was used for non-procedural elements due to its facilitation of real-time control parameters, as well as its integration with Unity3D.
Open
Access
https://www.aes.org/e-lib/browse.cfm?elib=18676
Download Now (858 KB)
This paper is Open Access which means you can download it for free.
Learn more about the AES E-Library
Start a discussion about this paper!
