This paper reports on early advances in the design of a browser-based ecosystem for creating new live coding languages, optimal for audio synthesis, machine learning, and machine listening. We present the rationale and challenges when applying the Web Audio API to the design of a high-performance signal synthesis engine, using an AudioWorklet-based solution and refactoring our digital signal processing library Maximilian.js. Furthermore, we contribute with the latest advances in Sema, a new user-friendly playground that integrates the signal engine to empower the live coding community to design their own idiosyncratic languages and interfaces. The evaluation shows that the system runs with high reliability and efficiency and low latency.

Authors: Bernardo, Francisco; Kiefer, Chris; Magnusson, Thor
Affiliation: Experimental Music Technologies Lab / Department of Music, University of Sussex, Brighton, UK
JAES Volume 68 Issue 10 pp. 756-766; October 2020
Publication Date: November 30, 2020 Import into BibTeX
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=20992

Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member and would like to subscribe to the E-Library then Join the AES!

This paper costs $33 for non-members and is free for AES members and E-Library subscribers.

Learn more about the AES E-Library

E-Library Location: (CD JAES68)   /jaes68/10/pg756.pdf

DOI: https://doi.org/10.17743/jaes.2020.0016

Start a discussion about this paper!