An artificial intelligence-based interactive learning platform to assist visually impaired children in learning mathematics

Thumbnail Image
Files
Date
2023-07-09
Authors
Shoaib, Muhammad
Jiang, Shiyu
Jin, Luo
Fitzpatrick, Donal
Pitt, Ian
Journal Title
Journal ISSN
Volume Title
Publisher
Springer Nature Ltd.
Published Version
https://doi.org/10.1007/978-3-031-35992-7_51
Research Projects
Organizational Units
Journal Issue
Abstract
Visually impaired children mainly depend upon hearing and touch in the absence of vision. Smartphones are now relatively cheap and are in widespread use in almost all parts of the world, including by many people who do not have access to laptops or desktop machines. Smartphone-based applications provide a learning environment in which visually impaired children can enhance their educational skills in a similar way to other students. This paper introduces an artificial intelligence-based interactive learning platform that can enhance the mathematical skills of visually impaired children. This platform can assist teachers in the classroom to provide accessible and interactive materials to their visually impaired students. The proposed platform uses text-to-speech along with vibrotactile and auditory feedback to help visually impaired students arrive at a better understanding of mathematical material. Four participants were recruited to evaluate the prototype of this interactive learning platform. The results showed that understanding of mathematical content in visually impaired children was significantly improved. Furthermore, problem-solving skills and action awareness were enhanced with the help of a multimodal feedback approach. Participants also reported high levels of satisfaction with the proposed design. The paper concludes with a discussion of possible directions for future research aimed at overcoming barriers to learning faced by visually impaired children.
Description
Keywords
Learning , Interactive , Mathematics , Visually impaired , Smartphone
Citation
Shoaib, M., Jiang, S., Jin, L., Fitzpatrick, D. and Pitt, I. (2023) 'An artificial intelligence-based interactive learning platform to assist visually impaired children in learning mathematics', in Stephanidis, C., Antona, M., Ntoa, S. and Salvendy, G. (eds.) HCI International 2023 Posters. HCII 2023. Communications in Computer and Information Science, vol 1833, pp. 366-373. Springer, Cham. https://doi.org/10.1007/978-3-031-35992-7_51
Link to publisher’s version
URI
https://hdl.handle.net/10468/15660
Collections
Computer Science - Book Chapters
Copyright
© 2023, the Author(s), under exclusive license to Springer Nature Switzerland AG 2023. This is a pre-print of the following paper: Shoaib, M., Jiang, S., Jin, L., Fitzpatrick, D. and Pitt, I. (2023) 'An artificial intelligence-based interactive learning platform to assist visually impaired children in learning mathematics', in Stephanidis, C., Antona, M., Ntoa, S. and Salvendy, G. (eds.) HCI International 2023 Posters. HCII 2023. Communications in Computer and Information Science, vol 1833, pp. 366-373. Springer, Cham. Reproduced with permission of the publisher. The final authenticated version is available online at: https://doi.org/10.1007/978-3-031-35992-7_51