Express yourself simply: Mobile AI for bridging communication gaps

Simple item page
dc.contributor.authorKramar, Annaen
dc.contributor.authorSalim, Kinzaen
dc.contributor.authorNguyen, Hoang D.en
dc.contributor.funderScience Foundation Irelanden
dc.date.accessioned2024-08-15T13:57:21Z
dc.date.available2024-08-15T13:57:21Z
dc.date.issued2024en
dc.description.abstractDoodle Me is an AI mobile application designed to bridge communication gaps and barriers. This tool is beneficial for individuals with articulation and phonological speech disorders. By using advanced machine learning algorithms, particularly a Convolutional Neural Network (CNN), the application interprets user-created drawings in real-time. This app provides a universal mode of expression that transcends traditional language barriers. The CNN model is trained on the QuickDraw dataset which achieves an accuracy of 92.6%. The application is accessible and practical, functioning seamlessly across all smartphones. Doodle Me enhances communication by recognizing and categorizing doodles, and provides visual and auditory feedback to users. This tool provides a holistic approach by aiding at rehabilitation of numerous medical conditions. It deals with multilinguistics of different age groups and is also eco-friendly. The application serves as an assistive tool in the healthcare system. It can support a wide range of medical conditions, including post-ischemic stroke aphasia, facial paralysis, stuttering/stammering, Autism Spectrum Disorder (ASD), post-operative laryngectomy or vocal cord paralysis, Alzheimer’s disease, and rehabilitation for post-cochlear implant patients (where children are taught about speech recognition by giving visual cues) and elderly with presbycusis (hearing loss at high frequencies). Doodle Me addresses communication barriers and promotes biosustainability by reducing the need for unnecessary stationary items. It is a practical application aimed at making a positive societal impact by facilitating seamless integration.en
dc.description.sponsorshipScience Foundation Ireland (18/CRT/6223; 12/RC/2289-P2)en
dc.description.statusPeer revieweden
dc.description.versionAccepted Versionen
dc.format.mimetypeapplication/pdfen
dc.identifier.citationKramar, A., Salim, K. and Nguyen, H. D. (2024) 'Express yourself simply: Mobile AI for bridging communication gaps', MOBILEHCI Adjunct ’24, 30 September - 3 October, Melbourne, VIC, Australia. https://doi.org/10.1145/3640471.3680456en
dc.identifier.doi10.1145/3640471.3680456en
dc.identifier.endpage6en
dc.identifier.isbn979-8-4007-0506-9/24/09en
dc.identifier.startpage1en
dc.identifier.urihttps://hdl.handle.net/10468/16193
dc.language.isoenen
dc.publisherAssociation for Computing Machinery (ACM)en
dc.rights© 2024, the Authors. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).en
dc.subjectConvolutional Neural Networken
dc.subjectMobile AIen
dc.subjectDoodle recognitionen
dc.subjectHuman-Computer Interactionen
dc.subjectMobile applicationen
dc.subjectMachine learningen
dc.titleExpress yourself simply: Mobile AI for bridging communication gapsen
dc.typeConference itemen
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Express Yourself Simply - Mobile AI for Bridging Communication Gaps.pdf
Size:
11.87 MB
Format:
Adobe Portable Document Format
Description:
Accepted Version
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
2.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Computer Science - Conference Items