Catégorie de document |
Contribution à un colloque ou à un congrès |
Titre |
Analyzing Sound Tracings - A Multimodal Approach to Music Information Retrieval |
Auteur principal |
Kristian Nymoen |
Co-auteurs |
Baptiste Caramiaux, Mariusz Kozak, Jim Torresen |
Colloque / congrès |
ACM Multimedia, Workshop MIRUM. 2011 |
Comité de lecture |
Oui |
Année |
2011 |
Statut éditorial |
Publié |
Résumé |
This paper investigates differences in the gestures people relate to pitched and non-pitched sounds respectively. An experiment has been carried out where participants were asked to move a rod in the air, pretending that moving it would create the sound they heard. By applying and interpreting the results from Canonical Correlation Analysis we are able to determine both simple and more complex correspondences between features of motion and features of sound in our data set. Particularly, the presence of a distinct pitch seems to influence how people relate gesture to sound. This identification of salient relationships between sounds and gestures contributes as a multi-modal approach to music information retrieval. |
Mots-clés |
Sound Tracing / Cross-Modal Analysis / Canonical Correlation Analysis |
Equipe |
Interactions musicales temps-réel |
Cote |
Nymoen11a |
Adresse de la version en ligne |
http://articles.ircam.fr/textes/Nymoen11a/index.pdf |
|