Empowering multimodal learning analytics using agentic AI: A comprehensive platform for simulation-based clinical training with Intelligent Assessment
Loading...
Date
2026-04-26
Authors
Nguyen, Duc Hai
Salim, Kinza
Power, David
Connolly, Murray
Hamdy, Ahmed
Contreras, Maya
Mai, Tai Tan
Shorten, George
O’Sullivan, Barry
Nanjappan, Vijayakumar
Journal Title
Journal ISSN
Volume Title
Publisher
Association for Computing Machinery, Inc
Published Version
Abstract
Simulation-based clinical training generates rich multimodal data that remains underused due to fragmented modalities, annotation bottlenecks, weak provenance, and tools misaligned with educator workflows. We introduce ClinVision, an educator-in-the-loop platform that operationalizes end-to-end multimodal learning analytics: synchronized multi-camera review, ISBAR-aligned scoring (a validated clinical communication framework), and templated reports with jump-to-evidence provenance. Agentic AI - systems that act on behalf of users while preserving human authority - assists with phrasing under explicit control (accept/edit/reject) and visible provenance, supporting accountable use rather than prescriptive automation. An in-learning deployment with five educators revealed full ISBAR coverage and time-efficient workflows, though AI suggestions were used selectively. We surface three transferable design tensions (assistance vs. authority, structure vs. flexibility, evidence vs. overload) and demonstrate that workflow integration, temporal primitives, and background AI assistance may better support high-stakes assessment than analytics or automation alone.
Description
© 2026, the owner/author(s).
Keywords
Agentic AI , Clinical education , Human-AI collaboration , Human-centered design , ISBAR assessment , Multimodal learning analytics , Simulation-based training , Trustworthy AI , Video analytics , [ComputerScience] , Information Systems , Information Systems and Management , Education , Computer Graphics and Computer-Aided Design , Computer Networks and Communications , Computer Science Applications
Citation
Nguyen, D H, Salim, K, Power, D, Connolly, M, Hamdy, A, Contreras, M, Mai, T T, Shorten, G, O’Sullivan, B, Nanjappan, V & Nguyen, H D 2026, Empowering multimodal learning analytics using agentic AI: A comprehensive platform for simulation-based clinical training with Intelligent Assessment. in 16th International Learning Analytics and Knowledge Conference, Bergen, Norway, 27 April - 1 May 2026. 16th International Learning Analytics and Knowledge Conference, LAK 2026, Association for Computing Machinery, Inc, pp. 674-684, 16th International Conference on Learning Analytics and Knowledge, LAK 2026, Bergen, Norway, 27/04/26. https://doi.org/10.1145/3785022.3785129
conference
conference
Link to publisher’s version
Copyright
cc_by