Empowering multimodal learning analytics using agentic AI: A comprehensive platform for simulation-based clinical training with Intelligent Assessment

dc.contributor.authorNguyen, Duc Hai
dc.contributor.authorSalim, Kinza
dc.contributor.authorPower, David
dc.contributor.authorConnolly, Murray
dc.contributor.authorHamdy, Ahmed
dc.contributor.authorContreras, Maya
dc.contributor.authorMai, Tai Tan
dc.contributor.authorShorten, George
dc.contributor.authorO’Sullivan, Barry
dc.contributor.authorNanjappan, Vijayakumar
dc.contributor.authorNguyen, Hoang D.
dc.contributor.funderTaighde Éireann - Research Ireland
dc.contributor.funderEuropean Regional Development Fund, european regional
dc.date.accessioned2026-07-09T12:50:05Z
dc.date.available2026-07-09T12:50:05Z
dc.date.issued2026-04-26
dc.description© 2026, the owner/author(s).
dc.description.abstractSimulation-based clinical training generates rich multimodal data that remains underused due to fragmented modalities, annotation bottlenecks, weak provenance, and tools misaligned with educator workflows. We introduce ClinVision, an educator-in-the-loop platform that operationalizes end-to-end multimodal learning analytics: synchronized multi-camera review, ISBAR-aligned scoring (a validated clinical communication framework), and templated reports with jump-to-evidence provenance. Agentic AI - systems that act on behalf of users while preserving human authority - assists with phrasing under explicit control (accept/edit/reject) and visible provenance, supporting accountable use rather than prescriptive automation. An in-learning deployment with five educators revealed full ISBAR coverage and time-efficient workflows, though AI suggestions were used selectively. We surface three transferable design tensions (assistance vs. authority, structure vs. flexibility, evidence vs. overload) and demonstrate that workflow integration, temporal primitives, and background AI assistance may better support high-stakes assessment than analytics or automation alone.en
dc.description.sponsorshipResearch Ireland|12-RC-2289-P Research Ireland|18/CRT/6223
dc.format.extent11
dc.format.extent2936744
dc.identifier.authororcidNguyen, Duc Hai
dc.identifier.authororcidSalim, Kinza
dc.identifier.authororcidPower, David
dc.identifier.authororcidConnolly, Murray
dc.identifier.authororcidHamdy, Ahmed
dc.identifier.authororcidContreras, Maya
dc.identifier.authororcidMai, Tai Tan
dc.identifier.authororcidShorten, George
dc.identifier.authororcidO’Sullivan, Barry§0000-0002-0090-2085
dc.identifier.authororcidNanjappan, Vijayakumar
dc.identifier.authororcidNguyen, Hoang D.§0000-0003-2541-3269
dc.identifier.citationNguyen, D H, Salim, K, Power, D, Connolly, M, Hamdy, A, Contreras, M, Mai, T T, Shorten, G, O’Sullivan, B, Nanjappan, V & Nguyen, H D 2026, Empowering multimodal learning analytics using agentic AI: A comprehensive platform for simulation-based clinical training with Intelligent Assessment. in 16th International Learning Analytics and Knowledge Conference, Bergen, Norway, 27 April - 1 May 2026. 16th International Learning Analytics and Knowledge Conference, LAK 2026, Association for Computing Machinery, Inc, pp. 674-684, 16th International Conference on Learning Analytics and Knowledge, LAK 2026, Bergen, Norway, 27/04/26. https://doi.org/10.1145/3785022.3785129
dc.identifier.citationconference
dc.identifier.doi10.1145/3785022.3785129
dc.identifier.endpage684
dc.identifier.isbn9798400720666
dc.identifier.journaltitle16th International Learning Analytics and Knowledge Conference, Bergen, Norway, 27 April - 1 May 2026
dc.identifier.journaltitle16th International Conference on Learning Analytics and Knowledge, LAK 2026
dc.identifier.otherORCID: /0000-0003-2541-3269/work/220226991
dc.identifier.startpage674
dc.identifier.urihttps://hdl.handle.net/10468/19039
dc.language.isoeng
dc.publisherAssociation for Computing Machinery, Inc
dc.relation.ispartofseries16th International Learning Analytics and Knowledge Conference, LAK 2026
dc.rightscc_by
dc.subjectAgentic AI
dc.subjectClinical education
dc.subjectHuman-AI collaboration
dc.subjectHuman-centered design
dc.subjectISBAR assessment
dc.subjectMultimodal learning analytics
dc.subjectSimulation-based training
dc.subjectTrustworthy AI
dc.subjectVideo analytics
dc.subject[ComputerScience]
dc.subjectInformation Systems
dc.subjectInformation Systems and Management
dc.subjectEducation
dc.subjectComputer Graphics and Computer-Aided Design
dc.subjectComputer Networks and Communications
dc.subjectComputer Science Applications
dc.titleEmpowering multimodal learning analytics using agentic AI: A comprehensive platform for simulation-based clinical training with Intelligent Assessmenten
dc.typeConference contribution (Peer reviewed)
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
3785022.3785129.pdf
Size:
2.8 MB
Format:
Adobe Portable Document Format