Access to this article is restricted until after the conference has taken place. Restriction lift date: 2024-06-11
LLM-powered multimodal AI conversations for diabetes prevention
Loading...
Files
Date
2024
Authors
Dao, Dung
Teo, Jun Yi Claire
Wang, Wenru
Nguyen, Hoang D.
Journal Title
Journal ISSN
Volume Title
Publisher
Association for Computing Machinery (ACM)
Published Version
Abstract
The global prevalence of diabetes remains high despite rising life expectancy with improved quality and access to healthcare services. The significant burden that diabetes imposes warrants efforts to improve existing interventions in diabetes care. Present research on diabetes management has shown that artificial intelligence (AI) and Large Language Models (LLM) play an important role in various aspects of the diabetes continuum but a distinct lack of studies in diabetes prevention is observed. Our research introduces a comprehensive digital solution, leveraging the capabilities of GPT- 3.5 models maintained by OpenAI, focused specifically on the active prevention of diabetes. The system encompasses a user-friendly interface accessible via mobile and web applications, an AI-powered chatbot for instant Q&A and advice, personalized reminder systems, a data analysis module for tailored guidance, resource aggregators for health-related information, and an emotional support module to ensure a holistic approach to prevention. Furthermore, our experiments involved testing the quality of responses generated by a fine-tuned GPT-3.5 model, utilizing the Assistants API or a retrieval-augmented generation (RAG) system powered by FAISS for enhanced context awareness and personalized advice. The testing focused on a structured dataset of questions and answers related to diabetes prevention, with results highlighting the superiority of the GPT-3.5 model combined with the Assistants API in providing relevant, detailed, and personalized responses, thus demonstrating its potential as an invaluable tool in the proactive prevention of diabetes.
Description
Keywords
Design , Multimodal , Conversational , GPT-3.5 , Diabetes , Diabetes prevention , Dialogue , Fine-tuning
Citation
Dao, D., Teo, J. Y. C., Wang, W. and Nguyen, H. D. (2024) 'LLM-powered multimodal AI conversations for diabetes prevention', 1st ACM Workshop on AI-Powered Q&A Systems for Multimedia (AIQAM ’24), Phuket, Thailand, 10 June 2024. New York, NY, USA: ACM, 6pp. https://doi.org/10.1145/3643479.3662049