AES E-Library

T. Dipassio, MI. C.. Heilemann, and MA. F.. Bocko, "Audio Capture Using Structural Sensors on Vibrating Panel Surfaces," J. Audio Eng. Soc., vol. 70, no. 12, pp. 1027-1037, (2022 December.). doi: https://doi.org/10.17743/jaes.2022.0049 T. Dipassio, MI. C.. Heilemann, and MA. F.. Bocko, "Audio Capture Using Structural Sensors on Vibrating Panel Surfaces," J. Audio Eng. Soc., vol. 70 Issue 12 pp. 1027-1037, (2022 December.). doi: https://doi.org/10.17743/jaes.2022.0049
Abstract: The microphones and loudspeakers of modern compact electronic devices such as smartphones and tablets typically require case penetrations that leave the device vulnerable to environmental damage. To address this, the authors propose a surface-based audio interface that employs force actuators for reproduction and structural vibration sensors to record the vibrations of the display panel induced by incident acoustic waves. This paper reports experimental results showing that recorded speech signals are of sufficient quality to enable high-reliability automatic speech recognition despite degradation by the panel's resonant properties. The authors report the results of experiments in which acoustic waves containing speech were directed to several panels, and the subsequent vibrations of the panels' surfaces were recorded using structural sensors. The recording quality was characterized by measuring the speech transmission index, and the recordings were transcribed to text using an automatic speech recognition system from which the resulting word error rate was determined. Experiments showed that the word error rate (10%--13%) achieved for the audio signals recorded by the method described in this paper was comparable to that for audio captured by a high-quality studio microphone (10%). The authors also demonstrated a crosstalk cancellation method that enables the system to simultaneously record and play audio signals.

@article{dipassio2022audio,
author={dipassio, tre and heilemann, michael c. and bocko, mark f.},
journal={journal of the audio engineering society},
title={audio capture using structural sensors on vibrating panel surfaces},
year={2022},
volume={70},
number={12},
pages={1027-1037},
doi={https://doi.org/10.17743/jaes.2022.0049},
month={december},} @article{dipassio2022audio,
author={dipassio, tre and heilemann, michael c. and bocko, mark f.},
journal={journal of the audio engineering society},
title={audio capture using structural sensors on vibrating panel surfaces},
year={2022},
volume={70},
number={12},
pages={1027-1037},
doi={https://doi.org/10.17743/jaes.2022.0049},
month={december},
abstract={the microphones and loudspeakers of modern compact electronic devices such as smartphones and tablets typically require case penetrations that leave the device vulnerable to environmental damage. to address this, the authors propose a surface-based audio interface that employs force actuators for reproduction and structural vibration sensors to record the vibrations of the display panel induced by incident acoustic waves. this paper reports experimental results showing that recorded speech signals are of sufficient quality to enable high-reliability automatic speech recognition despite degradation by the panel's resonant properties. the authors report the results of experiments in which acoustic waves containing speech were directed to several panels, and the subsequent vibrations of the panels' surfaces were recorded using structural sensors. the recording quality was characterized by measuring the speech transmission index, and the recordings were transcribed to text using an automatic speech recognition system from which the resulting word error rate was determined. experiments showed that the word error rate (10%--13%) achieved for the audio signals recorded by the method described in this paper was comparable to that for audio captured by a high-quality studio microphone (10%). the authors also demonstrated a crosstalk cancellation method that enables the system to simultaneously record and play audio signals.},}

TY - paper
TI - Audio Capture Using Structural Sensors on Vibrating Panel Surfaces
SP - 1027 EP - 1037
AU - Dipassio, Tre
AU - Heilemann, Michael C.
AU - Bocko, Mark F.
PY - 2022
JO - Journal of the Audio Engineering Society
IS - 12
VO - 70
VL - 70
Y1 - December 2022 TY - paper
TI - Audio Capture Using Structural Sensors on Vibrating Panel Surfaces
SP - 1027 EP - 1037
AU - Dipassio, Tre
AU - Heilemann, Michael C.
AU - Bocko, Mark F.
PY - 2022
JO - Journal of the Audio Engineering Society
IS - 12
VO - 70
VL - 70
Y1 - December 2022
AB - The microphones and loudspeakers of modern compact electronic devices such as smartphones and tablets typically require case penetrations that leave the device vulnerable to environmental damage. To address this, the authors propose a surface-based audio interface that employs force actuators for reproduction and structural vibration sensors to record the vibrations of the display panel induced by incident acoustic waves. This paper reports experimental results showing that recorded speech signals are of sufficient quality to enable high-reliability automatic speech recognition despite degradation by the panel's resonant properties. The authors report the results of experiments in which acoustic waves containing speech were directed to several panels, and the subsequent vibrations of the panels' surfaces were recorded using structural sensors. The recording quality was characterized by measuring the speech transmission index, and the recordings were transcribed to text using an automatic speech recognition system from which the resulting word error rate was determined. Experiments showed that the word error rate (10%--13%) achieved for the audio signals recorded by the method described in this paper was comparable to that for audio captured by a high-quality studio microphone (10%). The authors also demonstrated a crosstalk cancellation method that enables the system to simultaneously record and play audio signals.