Chromaesthetica: a virtual reality app for learning musical theory using sound-colour cross-modal associations
Loading...
Files
Published Version
Date
2024-12-02
Authors
O'Toole, Patrick
Mancini, Maurizio
Pitt, Ian
Maye, Laura
Journal Title
Journal ISSN
Volume Title
Publisher
Association for Computing Machinery (ACM)
Published Version
Abstract
In this pilot study, we used a balanced A/B testing method to evaluate how an environment—a Virtual Reality (VR) head-mounted display (HMD) versus a traditional desktop—affects the performance of 20 participants on a musical pitch-colour association test. We aimed to discern the influence of testing environments on musical pitch-colour associations. Our findings revealed no significant difference in performance between the VR HMD and the traditional desktop conditions. Previous studies highlight VR’s potential, but the results of our investigation—focusing on limited immersive and presence qualities—suggest that working in VR as opposed to a standard desktop environment has no significant influence on musical pitch-colour association test results. This outcome prompts a further investigation into other inherent VR characteristics, such as spatial audio, natural environment simulations, and interactive object manipulation, which could potentially enhance the effectiveness of auditory-visual association tests. This study is the first in a series of studies to explore how VR technologies can be exploited to augment multi-modal testing, with a fully immersive musical pitch-colour association test envisioned.
Description
Keywords
Virtual reality , Audio , Visuals , Colour , Synaesthesia , Cross-modal associations
Citation
O’Toole, P., Mancini, M., Pitt, I. and Maye, L. (2024) 'Chromaesthetica: a virtual reality app for learning musical theory using sound-colour cross-modal associations', Proceedings of the International Conference on Mobile and Ubiquitous Multimedia, Stockholm Sweden, 1 - 4 December, pp. 513–515. https://doi.org/10.1145/3701571.3703369