Thesis Project · 2023

Virtual Reality Surgical Simulation Model to Train Microsurgical Digit Revascularization and Replantation

An interactive VR surgical simulator for reconstructive hand surgery training — simulating critical stages in digit replantation to build surgeons’ anatomical knowledge, cognizance, and motor cognition.

Medium 3D Modeling & Virtual Reality Programming

Year 2023

The Application

VR welcome screen for the Digit Revascularization Training Tool — 01Welcome screen and navigation menu

VR anatomy view showing a class II ring avulsion injury with isolated bone, artery, and tendon layers — 02Isolated bone, artery, and tendon layers for a ring avulsion injury

3D Model Library

Row of 3D digit models depicting a range of injury and healing states used in the training tool

Injury & Healing State Variations

Process

Hand-drawn storyboard and initial concept notes for the training tool — 01Storyboard and initial concept

Reference photography of a raised hand used for modeling proportions — 02Reference photography for hand proportions

Photoshop layer stack used to build the skin texture material — 03Building the skin texture material

Anatomical bone segmentation naming list — 04Anatomical bone segmentation

Digit model progression from vascular layer to finished skin surface — 05Model progression, vascular layer to finished surface

Unity C# script controlling layer opacity — 06Scripting layer opacity control in Unity

Unity C# script cycling through finger injury models — 07Scripting model selection and cycling

The aim of this project is to investigate the potential of interactive virtual reality surgical simulators for reconstructive hand surgery training and education. This application, which can be accessed via a VR compatible computer and headset, will simulate critical stages in digit replantation procedures to train surgeons on anatomical knowledge, cognizance, and motor cognition. The app provides an immersive 3D digital surgical environment where users can manipulate objects using their own hands. By offering an efficient tool to visualize injuries at a macro and micro scale, the app aims to enhance surgeons’ familiarity with and exposure to complicated and infrequently seen procedures, such as digit revascularization. The app builds on existing microsurgical training tools and explores the viability of a VR-based training tool compared to current training methods.

Acknowledgments

Special thanks to Dr. Matthieu Poyade, Dr. Jenny Clancy, and Matt Burke from Medtronic, as well as Dr. Scott Loewenstein from HealthPartners and the University of Minnesota Surgery Department.