Back to Search
Start Over
Gestural Embodiment Of Environmental Sounds : An Experimental Study
- Source :
- New Interfaces for Musical Expression (NIME), New Interfaces for Musical Expression (NIME), 2011, NA, France
- Publication Year :
- 2011
- Publisher :
- Zenodo, 2011.
-
Abstract
- cote interne IRCAM: Caramiaux11a; None / None; National audience; In this paper we present an experimental study concerning gestural embodiment of environmental sounds in a listening context. The presented work is part of a project aiming at modeling movement-sound relationships, with the end goal of proposing novel approaches for designing musical instruments and sounding objects. The experiment is based on sound stimuli corresponding to ``causal'' and ``non-causal'' sounds. It is divided into a performance phase and an interview. The experiment is designed to investigate possible correlation between the perception of the ``causality'' of environmental sounds and different gesture strategies for the sound embodiment. In analogy with the perception of the sounds' causality, we propose to distinguish gestures that ``mimic'' a sound's cause and gestures that ``trace'' a sound's morphology following temporal sound characteristics. Results from the interviews show that, first, our causal sounds database lead to consistent descriptions of the action at the origin of the sound and participants mimic this action. Second, non-causal sounds lead to inconsistent metaphoric descriptions of the sound and participants make gestures following sound ``contours''. Quantitatively, the results show that gesture variability is higher for causal sounds that non-causal sounds.
- Subjects :
- [SHS.MUSIQ]Humanities and Social Sciences/Musicology and performing arts
[INFO.INFO-OH]Computer Science [cs]/Other [cs.OH]
[INFO.INFO-MM]Computer Science [cs]/Multimedia [cs.MM]
[INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]
[INFO.INFO-IA]Computer Science [cs]/Computer Aided Engineering
[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]
Gesture Sound Interaction
Embodiment
Listening
Environmental Sound Perception
[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing
[INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG]
TheoryofComputation_LOGICSANDMEANINGSOFPROGRAMS
[INFO.INFO-SD]Computer Science [cs]/Sound [cs.SD]
[INFO]Computer Science [cs]
[INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC]
[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing
Subjects
Details
- Database :
- OpenAIRE
- Journal :
- New Interfaces for Musical Expression (NIME), New Interfaces for Musical Expression (NIME), 2011, NA, France
- Accession number :
- edsair.doi.dedup.....21a56ea7c4ab05dae2f39e5a063ef298
- Full Text :
- https://doi.org/10.5281/zenodo.1177978