Can VR help understand auditory-visual associations and synaesthesia through immersive battery tests?

Simple item page
dc.contributor.authorO'Toole, Patricken
dc.date.accessioned2025-11-24T16:43:04Z
dc.date.available2025-11-24T16:43:04Z
dc.date.issued2023-04-05en
dc.description.abstractThis paper gives an overview of my PhD research in the area of auditory-visual associations in Human-Computer Interaction (HCI). My project explores the condition called synaesthesia, and auditory-visual cross-modal associations, in order to gain a better understanding of how our auditory and visual senses combine to inform our perceptive and decision-makings skills. I seek to understand how technology can be used to help strengthen our auditory-visual associations. Previous work suggests that creating effective and immersive environments using Virtual Reality (VR) can help in gaining new insights into auditory-visual perception. Firstly, I will create a VR version of standard auditory-visual and synaesthesia tests, and conduct user studies using both traditional and the VR based tests, with a comparison of the results being investigated to see what impact using a more immersive environment, like VR, has on auditory-visual associations. Secondly, armed with new knowledge concerning auditory-visual associations using VR, I will create a framework that uses auditory-visual associations to help designers create interfaces that are personalised, adaptive and accessible to everyone.en
dc.description.statusPeer revieweden
dc.description.versionAccepted Versionen
dc.format.mimetypeapplication/pdfen
dc.identifier.citationO’Toole, P. (2022) 'Can VR help understand auditory-visual associations and synaesthesia through immersive battery tests?', 10th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW). Nara, Japan: IEEE, pp. 1–5. https://doi.org/10.1109/ACIIW57231.2022.10086003en
dc.identifier.doi10.1109/ACIIW57231.2022.10086003en
dc.identifier.endpage5en
dc.identifier.isbn978-1-6654-5490-2en
dc.identifier.journaltitleCan VR help understand auditory-visual associations and synaesthesia through immersive battery tests?en
dc.identifier.startpage1en
dc.identifier.urihttps://hdl.handle.net/10468/18265
dc.language.isoenen
dc.publisherInstitute of Electrical and Electronics Engineers (IEEE)en
dc.relation.urihttps://ieeexplore.ieee.org/xpl/conhome/10085961/proceedingen
dc.rights© 2022, IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.en
dc.subjectAuditory-visual associationsen
dc.subjectSynaesthesiaen
dc.subjectVirtual realityen
dc.subjectMusicen
dc.titleCan VR help understand auditory-visual associations and synaesthesia through immersive battery tests?en
dc.typeConference itemen
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Doctoral_Consortium_ACII_2022 - Patrick Rory O'Toole (1).pdf
Size:
151.76 KB
Format:
Adobe Portable Document Format
Description:
Accepted Version
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
2.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Computer Science - Conference Items
ADVANCE CRT - Conference Items