Examinando por Autor "Caiola, Valentina"

Mostrando 1 - 2 de 2
  • Miniatura
    Ítem
    Open your ears and take a look: a state-of-the-art report on the integration of sonification and visualization
    (John Wiley and Sons Inc, 2024-06) Enge, Kajetan; Elmquist, Elias; Caiola, Valentina; Rönnberg, Niklas; Rind, Alexander; Iber, Michael; Lenzi, Sara; Lan, Fangfei; Höldrich, Robert; Aigner, Wolfgang
    The research communities studying visualization and sonification for data display and analysis share exceptionally similar goals, essentially making data of any kind interpretable to humans. One community does so by using visual representations of data, and the other community employs auditory (non-speech) representations of data. While the two communities have a lot in common, they developed mostly in parallel over the course of the last few decades. With this STAR, we discuss a collection of work that bridges the borders of the two communities, hence a collection of work that aims to integrate the two techniques into one form of audiovisual display, which we argue to be “more than the sum of the two.” We introduce and motivate a classification system applicable to such audiovisual displays and categorize a corpus of 57 academic publications that appeared between 2011 and 2023 in categories such as reading level, dataset type, or evaluation system, to mention a few. The corpus also enables a meta-analysis of the field, including regularly occurring design patterns such as type of visualization and sonification techniques, or the use of visual and auditory channels, showing an overall diverse field with different designs. An analysis of a co-author network of the field shows individual teams without many interconnections. The body of work covered in this STAR also relates to three adjacent topics: audiovisual monitoring, accessibility, and audiovisual data art. These three topics are discussed individually in addition to the systematically conducted part of this research. The findings of this report may be used by researchers from both fields to understand the potentials and challenges of such integrated designs while hopefully inspiring them to collaborate with experts from the respective other field.
  • No hay miniatura disponible
    Ítem
    Re(de)fining sonification: project classification strategies in the Data Sonification Archive
    (Audio Engineering Society, 2024-09) Lindborg, PerMagnus; Caiola, Valentina; Ciuccarelli, Paolo; Chen, Manni; Lenzi, Sara
    This study focuses on a corpus of 445 sonification projects currently available in the Data Sonification Archive (DSA). The DSA develops in a collaborative process that involves researchers and creative communities and has been online since early 2021. Projects are heuristically classified according to several aspects, in particular their intended purpose, targeted users, subject matter, sonification method, and combination of media. In the present study, the authors analyze six curatorial classification strategies, labelled Goal, Method, User, Macro Topic, Micro Topic, and MediaMix, and discuss their definitions and usefulness for the archive. They then introduce two computational classification strategies, respectively based on clustering of music information retrieval of sonification audio and topic modeling of the descriptive texts that accompany DSA projects. Correlation analysis between curatorial and computational classifications, correspondingly sized, showed that the text-based method was more powerful than the audio-based methods. The authors then explored predictive modeling, tentatively achieving results for Goal, Method, and Macro Topic. This points toward the potential for automatic classification to assist in the curatorial management of the archive, as well as for similar repositories. The discussion focuses on how analysis of classification strategies supports a broadening of the definition of sonification, both as theoretical construct and as practice, where the communicative intention of the author, the aesthetic quality of the listening experience, a more explicit focus on narrative patterns, and other emerging aspects within sonification design, are all contributing factors to transitioning the field toward a mass medium for data representation, communication, and meaning-making.