LLM-powered multimodal AI conversations for diabetes prevention

Thumbnail Image
Dao, Dung
Teo, Jun Yi Claire
Wang, Wenru
Nguyen, Hoang D.
Journal Title
Journal ISSN
Volume Title
Association for Computing Machinery (ACM)
Research Projects
Organizational Units
Journal Issue
The global prevalence of diabetes remains high despite rising life expectancy with improved quality and access to healthcare services. The significant burden that diabetes imposes warrants efforts to improve existing interventions in diabetes care. Present research on diabetes management has shown that artificial intelligence (AI) and Large Language Models (LLM) play an important role in various aspects of the diabetes continuum but a distinct lack of studies in diabetes prevention is observed. Our research introduces a comprehensive digital solution, leveraging the capabilities of GPT- 3.5 models maintained by OpenAI, focused specifically on the active prevention of diabetes. The system encompasses a user-friendly interface accessible via mobile and web applications, an AI-powered chatbot for instant Q&A and advice, personalized reminder systems, a data analysis module for tailored guidance, resource aggregators for health-related information, and an emotional support module to ensure a holistic approach to prevention. Furthermore, our experiments involved testing the quality of responses generated by a fine-tuned GPT-3.5 model, utilizing the Assistants API or a retrieval-augmented generation (RAG) system powered by FAISS for enhanced context awareness and personalized advice. The testing focused on a structured dataset of questions and answers related to diabetes prevention, with results highlighting the superiority of the GPT-3.5 model combined with the Assistants API in providing relevant, detailed, and personalized responses, thus demonstrating its potential as an invaluable tool in the proactive prevention of diabetes.
Design , Multimodal , Conversational , GPT-3.5 , Diabetes , Diabetes prevention , Dialogue , Fine-tuning
Dao, D., Teo, J. Y. C., Wang, W. and Nguyen, H. D. (2024) 'LLM-powered multimodal AI conversations for diabetes prevention', 1st ACM Workshop on AI-Powered Q&A Systems for Multimedia (AIQAM ’24), Phuket, Thailand, 10 June 2024. New York, NY, USA: ACM, 6pp. https://doi.org/10.1145/3643479.3662049
Link to publisher’s version