Virtual Reality and Simulation-Based Training in Surgical Education

Virtual reality (VR) and simulation-based training have emerged as pivotal components in modern surgical education, offering immersive, risk-free environments for skill acquisition and assessment. By replicating complex operative scenarios, these technologies enable trainees to practise psychomotor tasks, decision-making and procedural workflows under controlled conditions. The integration of advanced haptic feedback, three-dimensional anatomy and real-time performance metrics promotes deliberate practice and objective skill evaluation. Furthermore, simulation platforms facilitate standardised curricula, enabling proficiency-based progression and repeated exposure to rare or high-risk interventions. As healthcare systems worldwide strive to improve patient safety and optimise training efficiency, VR and simulation tools are reshaping the educational landscape by bridging the gap between theoretical learning and hands-on surgical experience.

Research from Nature Portfolio

Recent studies have harnessed deep learning and computer vision to decode intraoperative activity and support cognitive assistance. A vision transformer framework combined with supervised contrastive learning has been developed to identify and classify surgeon gestures, surgical steps and action quality from robotic surgery videos across multiple institutions. This approach generalises across diverse procedures and highlights the potential for automated feedback on operative performance. In parallel, an intelligent workflow recognition system for endoscopic submucosal dissection has been trained on extensive annotated video data, achieving human-level accuracy in phase detection and skill assessment. When integrated with commercial endoscopy platforms and validated in live animal models, this system provides real-time cognitive assistance and structured reports for trainee evaluation. These advancements demonstrate the feasibility of AI-driven, simulation-embedded tools for enhancing both training and intraoperative guidance.

Virtual Reality and Simulation-Based Training in Surgical Education publication trend

The graph below shows the total number of articles in virtual reality and simulation-based training in surgical education across all publications each year (not limited to Nature Index journals).

Technical terms

Virtual reality simulation: An interactive computer-generated environment that replicates surgical settings and instruments, allowing users to practise procedures with sensory feedback.

Vision transformer: A neural network architecture that applies self-attention mechanisms to image data, enabling detailed recognition of visual patterns such as surgical gestures.

Supervised contrastive learning: A training approach where models learn to distinguish between similar and dissimilar data points by maximising agreement of representations for the same class.

Surgical workflow recognition: The automated identification of phases and steps within an operative procedure, often using video analysis and machine learning.

Transfer effectiveness ratio (TER): A metric quantifying the efficiency of training transfer by comparing time saved in clinical practice per unit of training time invested.

References

1. A vision transformer for decoding surgeon activity from surgical videos. Nature Biomedical Engineering (2023).
2. Human visual explanations mitigate bias in AI-based assessment of surgeon skills. npj Digital Medicine (2023).
3. Intelligent surgical workflow recognition for endoscopic submucosal dissection with real-time animal study. Nature Communications (2023).
4. Effectiveness of Immersive Virtual Reality on Orthopedic Surgical Skills and Knowledge Acquisition Among Senior Surgical Residents. JAMA Network Open (2020).
5. The Virtual Operative Assistant: An explainable artificial intelligence tool for simulation-based training in surgery and medicine. PLOS ONE (2020).