Access to this article is restricted until after the conference has taken place. Restriction lift date: 2024-09-14
Autofusion: Fusing multi-modalities with interactions
| dc.check.date | 2024-09-14 | en |
| dc.check.info | Access to this article is restricted until after the conference has taken place | en |
| dc.contributor.author | Nguyen, Thuy-Trinh | en |
| dc.contributor.author | Deligianni, Fani | en |
| dc.contributor.author | Nguyen, Hoang D. | en |
| dc.contributor.funder | Science Foundation Ireland | en |
| dc.date.accessioned | 2024-05-29T13:16:00Z | |
| dc.date.available | 2024-05-29T13:16:00Z | |
| dc.date.issued | 2024 | en |
| dc.description.abstract | In the context of escalating data flows through diverse channels, multimodal machine learning holds the potential to simultaneously process varied data formats from multiple sources, offering robust solutions for uncertainty in various applications. The study highlights the often under-explored correlation information among data modalities and emphasizes the importance of disentangling enriched interactions for more informed decision-making. This paper navigates the burgeoning field of multimodal artificial intelligence (AI) by proposing Autofusion, a pioneering framework addressing representation learning and fusion challenges. Our proposed approach integrates autoencoder structures to address overfitting issues in unimodal machine learning, simultaneously tackling information balancing challenges. The framework’s application in Alzheimer’s disease detection, using DementiaBank’s Pitt corpus, demonstrates promising results, outperforming unimodal methods and showcasing a substantial advantage over traditional fusion techniques. This research significantly contributes by introducing Autofusion as a comprehensive multimodal machine learning solution, demonstrating its efficacy through DementiaBank’s Pitt corpus to detect Alzheimer’s disease, and shedding light on the influential role of cross-modality interaction for enhanced performance in complex applications. | en |
| dc.description.sponsorship | Science Foundation Ireland (Grant 12/RC/2289-P2) | en |
| dc.description.status | Peer reviewed | en |
| dc.description.version | Published Version | en |
| dc.format.mimetype | application/pdf | en |
| dc.identifier.citation | Nguyen, T.-T., Deligianni, F. and Nguyen, H. D. (2024) ‘Autofusion: Fusing multi-modalities with interactions’, 28th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES 2024), Seville, Spain, 11-13 September. Procedia Computer Science. | en |
| dc.identifier.eissn | 1877-0509 | en |
| dc.identifier.journaltitle | Procedia Computer Science | en |
| dc.identifier.uri | https://hdl.handle.net/10468/15950 | |
| dc.language.iso | en | en |
| dc.publisher | Elsevier | en |
| dc.relation.ispartof | 28th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES 2024), Seville, Spain, 11-13 September | en |
| dc.rights | © 2024, the Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). | en |
| dc.rights.uri | https://creativecommons.org/licenses/by-nc-nd/4.0/ | en |
| dc.subject | Multimodal interactions | en |
| dc.subject | Multimodal fusion | en |
| dc.subject | Multimodal machine learning | en |
| dc.subject | Autofusion | en |
| dc.title | Autofusion: Fusing multi-modalities with interactions | en |
| dc.type | Conference item | en |
