Does embodied training improve the recognition of mid-level expressive movement qualities sonification?

Niewiadomski, Radoslaw; Mancini, Maurizio; Cera, Andrea; Piana, Stefano; Canepa, Corrado; Camurri, Antonio

Does embodied training improve the recognition of mid-level expressive movement qualities sonification?

dc.contributor.author	Niewiadomski, Radoslaw
dc.contributor.author	Mancini, Maurizio
dc.contributor.author	Cera, Andrea
dc.contributor.author	Piana, Stefano
dc.contributor.author	Canepa, Corrado
dc.contributor.author	Camurri, Antonio
dc.contributor.funder	Horizon 2020	en
dc.date.accessioned	2019-09-30T15:32:04Z
dc.date.available	2019-09-30T15:32:04Z
dc.date.issued	2018-12-04
dc.description.abstract	This research is a part of a broader project exploring how movement qualities can be recognized by means of the auditory channel: can we perceive an expressive full-body movement quality by means of its interactive sonification? The paper presents a sonification framework and an experiment to evaluate if embodied sonic training (i.e., experiencing interactive sonification of your own body movements) increases the recognition of such qualities through the auditory channel only, compared to a non-embodied sonic training condition. We focus on the sonification of two mid-level movement qualities: fragility and lightness. We base our sonification models, described in the first part, on the assumption that specific compounds of spectral features of a sound can contribute to the cross-modal perception of a specific movement quality. The experiment, described in the second part, involved 40 participants divided into two groups (embodied sonic training vs. no training). Participants were asked to report the level of lightness and fragility they perceived in 20 audio stimuli generated using the proposed sonification models. Results show that (1) both expressive qualities were correctly recognized from the audio stimuli, (2) a positive effect of embodied sonic training was observed for fragility but not for lightness. The paper is concluded by the description of the artistic performance that took place in 2017 in Genoa (Italy), in which the outcomes of the presented experiment were exploited.	en
dc.description.status	Peer reviewed	en
dc.description.version	Published Version	en
dc.format.mimetype	application/pdf	en
dc.identifier.citation	Niewiadomski, R., Mancini, M., Cera, A., Piana, S., Canepa, C. and Camurri, A. (2019) 'Does embodied training improve the recognition of mid-level expressive movement qualities sonification?', Journal on Multimodal User Interfaces, 13(3), pp. 191-203. DOI: 10.1007/s12193-018-0284-0	en
dc.identifier.doi	10.1007/s12193-018-0284-0	en
dc.identifier.eissn	1783-8738
dc.identifier.endpage	203	en
dc.identifier.issn	1783-7677
dc.identifier.issued	3	en
dc.identifier.journaltitle	Journal on Multimodal User Interfaces	en
dc.identifier.startpage	191	en
dc.identifier.uri	https://hdl.handle.net/10468/8633
dc.identifier.volume	13	en
dc.language.iso	en	en
dc.publisher	Springer Verlag	en
dc.relation.project	info:eu-repo/grantAgreement/EC/H2020::RIA/645553/EU/Dancing in the Dark/DANCE	en
dc.relation.uri	https://link.springer.com/article/10.1007%2Fs12193-018-0284-0
dc.rights	© The Author(s) 2018. This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.	en
dc.rights.uri	http://creativecommons.org/licenses/by/4.0/	en
dc.subject	Sonification	en
dc.subject	Expressive qualities	en
dc.subject	Lightness	en
dc.subject	Fragility	en
dc.subject	Movement qualities	en
dc.subject	Embodied training	en
dc.title	Does embodied training improve the recognition of mid-level expressive movement qualities sonification?	en
dc.type	Article (peer-reviewed)	en