We present an interactive visualization tool to explore high-dimensional features of audiovisual data extracted from a video archive of live music performances. Our tool presents overviews of data features, similarities between song recordings, and details of the extracted visual and audio features. Features are extracted using neural networks, signal processing techniques, and audio analysis tools. Furthermore, we present a similarity metric to measure how different relevant recordings are compared to other videos. We illustrate our approach via use cases showing initial results to analyze song features, compare songs, identify outstanding songs, and detect song clusters.
Alexandra Diehl, Melike Çiloğlu, Renato Pajarola, "Interactive High-dimensional Audiovisual Feature Analysis of Live Song Concert Videos" in Electronic Imaging, 2024, pp 363-1 - 363-8, https://doi.org/10.2352/EI.2024.36.1.VDA-363