Automated assessment of simulated laparoscopic surgical skill performance using deep learning
dc.contributor.author | Power, David | en |
dc.contributor.author | Burke, Cathy | en |
dc.contributor.author | Madden, Michael G. | en |
dc.contributor.author | Ullah, Ihsan | en |
dc.contributor.funder | Research Ireland | en |
dc.date.accessioned | 2025-05-13T08:54:24Z | |
dc.date.available | 2025-05-13T08:54:24Z | |
dc.date.issued | 2025 | en |
dc.description.abstract | Artificial intelligence (AI) has the potential to improve healthcare and patient safety and is currently being adopted across various fields of medicine and healthcare. AI and in particular computer vision (CV) are well suited to the analysis of minimally invasive surgical simulation videos for training and performance improvement. CV techniques have rapidly improved in recent years from accurately recognizing objects, instruments, and gestures to phases of surgery and more recently to remembering past surgical steps. Lack of labeled data is a particular problem in surgery considering its complexity, as human annotation and manual assessment are both expensive in time and cost, and in most cases rely on direct intervention of clinical expertise. In this study, we introduce a newly collected simulated Laparoscopic Surgical Performance Dataset (LSPD) specifically designed to address these challenges. Unlike existing datasets that focus on instrument tracking or anatomical structure recognition, the LSPD is tailored for evaluating simulated laparoscopic surgical skill performance at various expertise levels. We provide detailed statistical analyses to identify and compare poorly performed and well-executed operations across different skill levels (novice, trainee, expert) for three specific skills: stack, bands, and tower. We employ a 3-dimensional convolutional neural network (3DCNN) with a weakly-supervised approach to classify the experience levels of surgeons. Our results show that the 3DCNN effectively distinguishes between novices, trainees, and experts, achieving an F1 score of 0.91 and an AUC of 0.92. This study highlights the value of the LSPD dataset and demonstrates the potential of leveraging 3DCNN-based and weakly-supervised approaches to automate the evaluation of surgical performance, reducing reliance on manual expert annotation and assessments. These advancements contribute to improving surgical training and performance analysis. | en |
dc.description.sponsorship | Research Ireland (Grant number SFI/12/RC/2289_P2) | en |
dc.description.status | Peer reviewed | en |
dc.description.version | Published Version | en |
dc.format.mimetype | application/pdf | en |
dc.identifier.articleid | 13591 | en |
dc.identifier.citation | Power, D., Burke, C., Madden, M. G. and Ullah, I. (2025) 'Automated assessment of simulated laparoscopic surgical skill performance using deep learning', Scientific Reports, 15(1), 13591 (16pp). https://doi.org/10.1038/s41598-025-96336-5 | en |
dc.identifier.doi | 10.1038/s41598-025-96336-5 | en |
dc.identifier.issn | 20452322 | en |
dc.identifier.issued | 1 | |
dc.identifier.journaltitle | Scientific Reports | en |
dc.identifier.uri | https://hdl.handle.net/10468/17450 | |
dc.identifier.volume | 15 | |
dc.language.iso | en | en |
dc.publisher | Nature Research | en |
dc.relation.project | SFI/12/RC/2289_P2 | en |
dc.rights | © 2025, the Author(s). This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. | en |
dc.rights.uri | https://creativecommons.org/licenses/by/4.0/ | |
dc.subject | 3DCNN | en |
dc.subject | Automated assessment | en |
dc.subject | Deep learning | en |
dc.subject | Laparoscopic surgery | en |
dc.title | Automated assessment of simulated laparoscopic surgical skill performance using deep learning | en |
dc.type | Article (peer reviewed) | en |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- s41598-025-96336-5.pdf
- Size:
- 4.79 MB
- Format:
- Adobe Portable Document Format
- Description:
- Published Version