The Journal of the Audio Engineering Society — the official publication of the AES — is the only peer-reviewed journal devoted exclusively to audio technology. Published 10 times each year, it is available to all AES members and subscribers.
The Journal contains state-of-the-art review papers, technical papers, and engineering reports; standards committee work, convention and conference announcements, membership news, and book reviews.
Authors:Zang, Yongyi; Benetatos, Christodoulos; Duan, Zhiyao
Affiliation:Department of Electrical and Computer Engineering, University of Rochester, Rochester, NY; Department of Electrical and Computer Engineering, University of Rochester, Rochester, NY; Department of Electrical and Computer Engineering, University of Rochester, Rochester, NY
Download: PDF (HIGH Res) (4.6MB)
Download: PDF (LOW Res) (905KB)
Authors:Buffa, Michel; Lebrun, Jerome
Affiliation:Universitè Côte d’Azur, CNRS, INRIA, Sophia Antipolis, France; Universitè Côte d’Azur, CNRS, Sophia Antipolis, France
Since 2012 and the advent of the Web Audio API, the development of computer music applications within web browsers has become feasible. Recent improvements in this API and other advancements in web browser technology have significantly expanded the possibilities for new developments. Thanks to theWebAssembly and AudioWorklets APIs, code written in low-level languages (C/C++, Rust, . . .) orDomain Specific Languages can nowbe encapsulated and executed within browsers. Furthermore, using theWeb Components API, it is now possible to produce interoperable Web Audio plugins. This article reviews seven years of work toward real-time, lightweight, low-latency, perceptually faithful browser-based simulations of tube guitar amplifiers. Summarizing previous conference presentations, this article provides details on themilestones and many issues that had to be dealtwith during development to achieve these pioneering demonstrations of the potentialities of theWeb Audio API.Most of the simulations are provided as open-source and freely available. Recently, some versions were licensed and integrated into a well-known commercial Digital Audio Workstation. During these years, several user tests have been conducted with professional guitarists who all positively evaluated these simulations and favorably benchmarked them against the few available commercial browser-based competitors.
Download: PDF (HIGH Res) (16.6MB)
Download: PDF (LOW Res) (1.4MB)
Authors:Jung, Matthias; Clester, Ian
Affiliation:Department of Popular Music, Faculty of Fine Arts, University of Adger, Kristiansand, Norway; Center for Music Technology, Georgia Institute of Technology, Atlanta, GA
Artists and composers have explored the potential of mobile phones to enable audience interaction in live music concerts for the last two decades.However, studies of the compositional process and the systems' use by audience members remain scarce. This paper presents the design of three interactive modes for audience participation that invite audience members to influence both musical parameters and stage lighting of an electronic live music performance. Analysis of log data from the concert reveals users' interaction preferences and suggests five different types of participatory user behaviors, which are supported by results of a postconcert questionnaire. Finally, the paper considers design aspects for audience participation and proposes ideas for future implementations of distributed music systems.
Download: PDF (HIGH Res) (3.3MB)
Download: PDF (LOW Res) (512KB)
Authors:Clester, Ian; Freeman, Jason
Affiliation:Center for Music Technology, Georgia Institute of Technology, Atlanta, GA; Center for Music Technology, Georgia Institute of Technology, Atlanta, GA
Download: PDF (HIGH Res) (3.0MB)
Download: PDF (LOW Res) (517KB)
Authors:Matuszewski, Benjamin; Rottier, Otto
Affiliation:STMS Ircam-CNRS-Sorbonne Universitè, Paris, France; Software Engineer, Utrecht, The Netherlands
In this paper, the authors present two related libraries, web-audio-api-rs and nodeweb-audio-api, that provide a solution for using the Web Audio API outside the Web browsers. The first project is a low-level implementation of the Web Audio API written in the Rust language, and the second provides bindings of the core Rust library for the Node.js platform. The authors' approach here is to consider Web standards and specifications as tools for defining standardized APIs across different environments and languages, which they believe could benefit the audio community in a more general manner. Although such a proposition presents some portability limitations due to the differences between languages, the authors think it nevertheless opens up new possibilities in sharing documentation, resources, and components across a wide range of environments, platforms, and users. The paper first describes the general design and implementation of the authors' libraries. Then, it presents some benchmarks of these libraries against state-of-the-art implementation fromWeb browsers, and the performance improvements that have been made over the last year. Finally, it discusses the current known limitations of these libraries and proposes some directions for future work. The two projects are open-source, reasonably feature-complete, and ready to use in production applications.
Download: PDF (HIGH Res) (4.6MB)
Download: PDF (LOW Res) (1.3MB)
Authors:Dziwis, Damian; Von Coler, Henrik; Pörschmann, Christoph
Affiliation:Institute of Computer and Communication Technology, TH Köln - University of Applied Sciences, Cologne, Germany and Audio Communication Group, Technical University Berlin, Berlin, Germany; Audio Communication Group, Technical University Berlin, Berlin, Germany; Institute of Computer and Communication Technology, TH Köln - University of Applied Sciences, Cologne, Germany
As the potential of networked multiuser virtual environments increases under the concept of the metaverse, so do the interest and artistic possibilities of using them for live music performances. Live performances in online metaverse environments offer an easy and environmentally friendly way to bring together artists and audiences from all over the world. Virtualization also enables countless possibilities for designing and creating artistic experiences and new performance practices. For many years, live performances have been established on various virtual platforms, which differ significantly in terms of possible performance practices, user interaction, immersion, and usability. With Orchestra, we are developing an open-source toolbox that uses the Web Audio Application Programming Interface to realize live performances with various performance practices for web-based metaverse environments. Possibilities vary from live streaming of volumetric audio and video, live coding in multiple (including audiovisual) programming languages, to performing with generative algorithms or virtual instruments developed in PureData. These can be combined in various ways and also be used for telematic/networked music ensembles, interactive virtual installations, or novel performance concepts. In this paper, we describe the development and scope of the Orchestra toolbox, as well as use cases that illustrate the artistic possibilities.
Download: PDF (HIGH Res) (7.2MB)
Download: PDF (LOW Res) (694KB)