Showing 1–3 of 3 results for author: Fovino, L G N

Evaluating the efectiveness of sonifcation in science education using Edukoi

Authors: Lucrezia Guiotto Nai Fovino, Anita Zanella, Luca Di Mascolo, Michele Ginolfi, Nicolò Carpita, Francesco Trovato Manuncola, Massimo Grassi

Abstract: Science, Technology, Engineering, and Mathematics classes are mainly taught using visual supports. However, the advancement of technology and the increasing eforts to equip schools with digital instrumentation have opened up the possibility of exploring new teaching avenues, such as sonifcation. We explored the efcacy of sonifcation in education using a novel interactive tool, Edukoi, in the conte… ▽ More Science, Technology, Engineering, and Mathematics classes are mainly taught using visual supports. However, the advancement of technology and the increasing eforts to equip schools with digital instrumentation have opened up the possibility of exploring new teaching avenues, such as sonifcation. We explored the efcacy of sonifcation in education using a novel interactive tool, Edukoi, in the context of astronomy, which is predominantly disseminated through spectacular images, animations, and visuals. Edukoi is a motion-sensing sonifcation tool that converts images to sound in real-time for educational applications. Our study, conducted with nearly 150 middle-school students, included a preliminary questionnaire investigating the perception, engagement, and motivation of students towards science; two sessions dedicated to testing Edukoi and assessing the potentiality of the software for the recognition of the colour and the shape of real and sketchy images; and a fnal second administration of the questionnaire to capture a possible benefcial efect of the use of the tool in the engagement towards science. Results showed the efectiveness of Edukoi in colour recognition and reasonable efcacy in shape identifcation. Although the questionnaire did not reveal an increment in science engagement over the time of the study, oral feedback from the students was positive. Edukoi presents a possible alternative teaching aid, potentially benefting diverse learners, including the visually impaired. Further developments of the software are needed to enhance its efectiveness in conveying more complex features such as composite colours or shapes. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Journal ref: Personal and Ubiquitous Computing (2024)

Evaluation of the effectiveness of sonification for time series data exploration

Authors: Lucrezia Guiotto Nai Fovino, Anita Zanella, Massimo Grassi

Abstract: Astronomy is a discipline primarily reliant on visual data. However, alternative data representation techniques are being explored, in particular ''sonification'', namely, the representation of data into sound. While there is increasing interest in the astronomical community in using sonification in research and educational contexts, its full potential is still to be explored. This study measured… ▽ More Astronomy is a discipline primarily reliant on visual data. However, alternative data representation techniques are being explored, in particular ''sonification'', namely, the representation of data into sound. While there is increasing interest in the astronomical community in using sonification in research and educational contexts, its full potential is still to be explored. This study measured the performance of astronomers and non-astronomers to detect a transit-like feature in time series data (i.e., light curves), that were represented visually or auditorily, adopting different data-to-sound mappings. We also assessed the bias that participants exhibited in the different conditions. We simulated the data of 160 light curves with different signal-to-noise ratios (SNR). We represented them as visual plots or auditory streams with different sound parameters to represent brightness: pitch, duration, or the redundant duration & pitch. We asked the participants to identify the presence of transit-like features in these four conditions in a session that included an equal number of stimuli with and without transit-like features. With auditory stimuli, participants detected transits with performances above the chance level. However, visual stimuli led to overall better performances compared to auditory stimuli and astronomers outperformed non-astronomers. Visualisations led to a conservative response bias (reluctance to answer ''yes, there is a transit''), whereas sonifications led to more liberal responses (proneness to respond ''yes, there is a transit''). Overall, this study contributes to understanding how different representations (visual or auditory) and sound mappings (pitch, duration, duration & pitch) of time series data affect detection accuracy and biases. △ Less

Submitted 15 February, 2024; originally announced February 2024.

Comments: Accepted for publication in AAJ. 10 pages, 4 figures

Edukoi: developing an interactive sonification tool for astronomy between entertainment and education

Authors: Lucrezia Guiotto Nai Fovino, Massimo Grassi, Anita Zanella, Luca Di Mascolo, Michele Ginolfi

Abstract: Edukoi is a software that aims to make interactive sonification suitable to convey and extract information. The program design is a modification of the software Herakoi, which sonifies images in real time mapping pitch to colour using a motion-aware approach for allowing users to interact with images through sound. The pitch-colour association of Hearkoi, albeit pleasing from the entertainment sid… ▽ More Edukoi is a software that aims to make interactive sonification suitable to convey and extract information. The program design is a modification of the software Herakoi, which sonifies images in real time mapping pitch to colour using a motion-aware approach for allowing users to interact with images through sound. The pitch-colour association of Hearkoi, albeit pleasing from the entertainment side, is not efficient for communicating specific information regarding colours and hues to listeners. Hence we modified it to create an instrument to be used by visually impaired and sighted children to explore images through sound and extract accurate information. We aim at building a flexible software that can be used in middle-schools for both art and science teaching. We tested its effectiveness using astronomical images, given the great fascination that astronomy always has on kids of all ages and backgrounds. Astronomy is also considered a very visual science, a characteristic that prevents students from learning this subject and having a related career. With this project we aim to challenge this belief and give to students the possibility to explore astronomical data through sound. Here we discuss our experiment, the choices we made regarding sound mappings, and what psychophysiological aspects we aim to evaluate to validate and improve Edukoi. △ Less

Submitted 5 September, 2023; originally announced September 2023.

Comments: 4 pages, 3 figures, to be published in the proceedings of "The 28th International Conference on Auditory Display (ICAD 2023) - Special Session on Astronomical Data Sonification"