Log Complex Color for Visual Pattern Recognition of Total Sound
×
Cite This
Citation & Abstract
S. Wedekind, and P. Fraundorf, "Log Complex Color for Visual Pattern Recognition of Total Sound," Paper 9647, (2016 September.). doi:
S. Wedekind, and P. Fraundorf, "Log Complex Color for Visual Pattern Recognition of Total Sound," Paper 9647, (2016 September.). doi:
Abstract: While traditional audio visualization methods depict amplitude intensities vs. time, such as in a time-frequency spectrogram, and while some may use complex phase information to augment the amplitude representation, such as in a reassigned spectrogram, the phase data are not generally represented in their own right. By plotting amplitude intensity as brightness/saturation and phase-cycles as hue-variations, our complex spectrogram method displays both amplitude and phase information simultaneously, making such images canonical visual representations of the source wave. As a result, the original sound may be reconstructed (down to the original phases) from an image, simply by reversing our process. This allows humans to apply our highly-developed visual pattern recognition skills to complete audio data in new way.
@article{wedekind2016log,
author={wedekind, stephen and fraundorf, p.},
journal={journal of the audio engineering society},
title={log complex color for visual pattern recognition of total sound},
year={2016},
volume={},
number={},
pages={},
doi={},
month={september},}
@article{wedekind2016log,
author={wedekind, stephen and fraundorf, p.},
journal={journal of the audio engineering society},
title={log complex color for visual pattern recognition of total sound},
year={2016},
volume={},
number={},
pages={},
doi={},
month={september},
abstract={while traditional audio visualization methods depict amplitude intensities vs. time, such as in a time-frequency spectrogram, and while some may use complex phase information to augment the amplitude representation, such as in a reassigned spectrogram, the phase data are not generally represented in their own right. by plotting amplitude intensity as brightness/saturation and phase-cycles as hue-variations, our complex spectrogram method displays both amplitude and phase information simultaneously, making such images canonical visual representations of the source wave. as a result, the original sound may be reconstructed (down to the original phases) from an image, simply by reversing our process. this allows humans to apply our highly-developed visual pattern recognition skills to complete audio data in new way.},}
TY - paper
TI - Log Complex Color for Visual Pattern Recognition of Total Sound
SP -
EP -
AU - Wedekind, Stephen
AU - Fraundorf, P.
PY - 2016
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - September 2016
TY - paper
TI - Log Complex Color for Visual Pattern Recognition of Total Sound
SP -
EP -
AU - Wedekind, Stephen
AU - Fraundorf, P.
PY - 2016
JO - Journal of the Audio Engineering Society
IS -
VO -
VL -
Y1 - September 2016
AB - While traditional audio visualization methods depict amplitude intensities vs. time, such as in a time-frequency spectrogram, and while some may use complex phase information to augment the amplitude representation, such as in a reassigned spectrogram, the phase data are not generally represented in their own right. By plotting amplitude intensity as brightness/saturation and phase-cycles as hue-variations, our complex spectrogram method displays both amplitude and phase information simultaneously, making such images canonical visual representations of the source wave. As a result, the original sound may be reconstructed (down to the original phases) from an image, simply by reversing our process. This allows humans to apply our highly-developed visual pattern recognition skills to complete audio data in new way.
While traditional audio visualization methods depict amplitude intensities vs. time, such as in a time-frequency spectrogram, and while some may use complex phase information to augment the amplitude representation, such as in a reassigned spectrogram, the phase data are not generally represented in their own right. By plotting amplitude intensity as brightness/saturation and phase-cycles as hue-variations, our complex spectrogram method displays both amplitude and phase information simultaneously, making such images canonical visual representations of the source wave. As a result, the original sound may be reconstructed (down to the original phases) from an image, simply by reversing our process. This allows humans to apply our highly-developed visual pattern recognition skills to complete audio data in new way.
Authors:
Wedekind, Stephen; Fraundorf, P.
Affiliation:
University of Missouri - St. Louis, St. Louis, MO, USA
AES Convention:
141 (September 2016)
Paper Number:
9647
Publication Date:
September 20, 2016Import into BibTeX
Subject:
Signal Processing
Permalink:
http://www.aes.org/e-lib/browse.cfm?elib=18451