Chromaesthetica: a virtual reality app for learning musical theory using sound-colour cross-modal associations

Simple item page
dc.contributor.authorO'Toole, Patricken
dc.contributor.authorMancini, Maurizioen
dc.contributor.authorPitt, Ianen
dc.contributor.authorMaye, Lauraen
dc.contributor.funderScience Foundation Irelanden
dc.date.accessioned2025-11-27T15:28:52Z
dc.date.available2025-11-27T15:28:52Z
dc.date.issued2024-12-02en
dc.description.abstractIn this pilot study, we used a balanced A/B testing method to evaluate how an environment—a Virtual Reality (VR) head-mounted display (HMD) versus a traditional desktop—affects the performance of 20 participants on a musical pitch-colour association test. We aimed to discern the influence of testing environments on musical pitch-colour associations. Our findings revealed no significant difference in performance between the VR HMD and the traditional desktop conditions. Previous studies highlight VR’s potential, but the results of our investigation—focusing on limited immersive and presence qualities—suggest that working in VR as opposed to a standard desktop environment has no significant influence on musical pitch-colour association test results. This outcome prompts a further investigation into other inherent VR characteristics, such as spatial audio, natural environment simulations, and interactive object manipulation, which could potentially enhance the effectiveness of auditory-visual association tests. This study is the first in a series of studies to explore how VR technologies can be exploited to augment multi-modal testing, with a fully immersive musical pitch-colour association test envisioned.en
dc.description.sponsorshipScience Foundation Ireland (Grant no. 18/CRT/6222)en
dc.description.statusPeer revieweden
dc.description.versionPublished Versionen
dc.format.mimetypeapplication/pdfen
dc.identifier.citationO'Toole, P., Mancini, M., Pitt, I. and Maye, L. (2024) 'Chromaesthetica: a virtual reality app for learning musical theory using sound-colour cross-modal associations', Proceedings of the International Conference on Mobile and Ubiquitous Multimedia, Stockholm Sweden, 1 - 4 December, pp. 513–515. https://doi.org/10.1145/3701571.3703369en
dc.identifier.doi10.1145/3701571.3703369en
dc.identifier.endpage515en
dc.identifier.isbn979-8-4007-1283-8en
dc.identifier.startpage513en
dc.identifier.urihttps://hdl.handle.net/10468/18315
dc.language.isoenen
dc.publisherAssociation for Computing Machinery (ACM)en
dc.relation.ispartofMUM '24: Proceedings of the International Conference on Mobile and Ubiquitous Multimediaen
dc.relation.urihttps://dl.acm.org/doi/proceedings/10.1145/3701571en
dc.rights© 2024, the Authors. This work is licensed under a Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/)en
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/en
dc.subjectVirtual realityen
dc.subjectAudioen
dc.subjectVisualsen
dc.subjectColouren
dc.subjectSynaesthesiaen
dc.subjectCross-modal associationsen
dc.titleChromaesthetica: a virtual reality app for learning musical theory using sound-colour cross-modal associationsen
dc.typeConference itemen
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
3701571.3703369.pdf
Size:
2.19 MB
Format:
Adobe Portable Document Format
Description:
Published Version
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
2.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Computer Science - Conference Items
ADVANCE CRT - Conference Items