Published online Feb 18, 2023. doi: 10.5500/wjt.v13.i2.36
Peer-review started: September 5, 2022
First decision: October 31, 2022
Revised: November 14, 2022
Accepted: January 3, 2023
Article in press: January 3, 2023
Published online: February 18, 2023
Virtual reality (VR) technologies have rapidly developed in the past few years. The most common application of the technology, apart from gaming, is for educational purposes. In the field of healthcare, VR technologies have been applied in several areas. Among them is surgical education. With the use of VR, surgical pathways along with the training of surgical skills can be explored safely, in a cost-effective manner. The aim of this mini-review was to explore the use of VR in surgical education and in the 3D reconstruction of internal organs and viable surgical pathways. Finally, based on the outcomes of the included studies, an ecosystem for the implementation of surgical training was proposed.
Core Tip: This mini-review aims to explore the use of virtual reality in surgical education and in the 3D reconstruction of internal organs and viable surgical pathways. For this purpose, a non-systematic literature review was conducted and three highly influential scientific papers were selected and discussed. The main topics addressed are the use of technologies in surgical education, the methodologies for the implementation of the training systems, the evaluation approaches and the strengths and limitations of the studies. Finally, the review concluded with a comparative synthesis of the main findings and a discussion on the proposal of a system for implementing these findings on surgical education in the field of organ transplantation.
- Citation: Ntakakis G, Plomariti C, Frantzidis C, Antoniou PE, Bamidis PD, Tsoulfas G. Exploring the use of virtual reality in surgical education. World J Transplant 2023; 13(2): 36-43
- URL: https://www.wjgnet.com/2220-3230/full/v13/i2/36.htm
- DOI: https://dx.doi.org/10.5500/wjt.v13.i2.36
During the past few years, the use of virtual reality (VR) has increased rapidly in a number of sectors, like education[1,2] transportation[3,4] and healthcare. In the case of education, the main advantage of using VR, is the immersion it provides, by using personalized experiences, promoting engagement, and providing hints that it may enhance learning, through the motivation aligned with the active participation of students.
As the immersion of the system increases, the effectiveness of the training module increases [7,8]. Additionally, the level of immersion of VR has been found to be proportional to the number of mo
VR has also found numerous applications in medical education[10-12]. More specifically, in the case of surgical education, the use of VR has been favored, due to many reasons, such as lack of mentors, reduction in training hours and various issues concerning operative procedures. In order to exploit all these advantages, many solutions have been implemented, like the da Vinci Skills Simulator and the LAP Mentor VR laparoscopic surgical simulator.
The aim of the present mini-review was to explore the use of VR simulators either alone or in combination with head-mounted displays (HMDs) in surgical education and in the construction of 3D models of internal organs. For this purpose, three highly influential scientific papers were selected and discussed. The main topics addressed were the use of technologies in surgical education, the methodologies for the implementation of the training systems, the evaluation approaches and the strengths and limitations of the studies. Finally, the review concluded with a comparative synthesis of the main findings and a discussion on the proposal of a system for implementing these findings on surgical education in the field of organ transplantation.
In April 2022, we performed a non-systematic literature search on the Google Scholar database using the terms “Virtual Reality”, “surgical education”, “surgery”, “medical education” to identify peer-reviewed articles, written in the English language, published after 2016, that seemingly explored the area of interest. The selected articles adhered to the following inclusion criteria: (1) Implement training in surgical skills with the use of VR technology; (2) Perform skill or full procedure training in abdominal surgeries; and (3) Include participants who were either surgical trainees or experienced surgeons.
All the information of interest was extracted from the selected articles. The information was used for the authors to identify main opportunities and limitations in the use of VR systems in surgical education and finally propose an infrastructure for extended reality (XR) technologies in order to implement a surgical training ecosystem.
The devices used for promoting surgical education with the use of VR are mostly expensive[17,18] simulators (LapSim and Lap Mentor), often combined with some additional HMDs[18,19], like HTC Vive 360 or Google VR, to create an immersive and engaging user experience. Most simulation technologies include special controllers (some with haptic feedback) that accurately simulate the use of surgical instruments. The LapSim emulator includes Simball 4D Joystick hardware and the Lap Mentor includes a syringe allowing realistic fluid delivery and BAL performance, while a wide variety of bronchoscopy instruments, such as biopsy forceps, cytology brush, suction and more can also be simulated. Both simulators offer a high-resolution display of the virtual environment (VE). The combination of VR HMDs and the VR simulators promotes immersiveness and enhances the interaction between the participants and the VE (Table 1).
|Beyer-Berjot et al, 2016–Lap Mentor VR||Huber et al, 2017-LapSim||Sampogna et al, 2017-Oculus Rift and Leap motion|
|Technology used for training||Virtual reality|
|Equipment used for training||Custom hardware and software-Lap Mentor VR||Custom hardware and software-LapSim||Windows 10-Oculus Quest Rift S|
|Additional technology used for training||Haptic|
|Additional equipment used for training||Lap Mentor realistic tactile surgical tools||LapSim realistic tactile surgical tools||Oculus gestures + Leap Motion|
|Operating system||Lap Mentor software||LapSim software||Windows 10|
While the aforementioned devices offer a unique interactive experience, their cost can be extremely high. During the past years, there has been a rapid shift in the exploration of low-cost devices, offering the possibility of a larger market to the creators of any application. Such devices are the Oculus Rift, Meta Quest, HTC Vive, Pico[18,19]. The cost of these devices does not exceed $500, making surgical training more accessible to any hospital setting and open to more participants. Sampogna et al used the Oculus Rift device combined with the Leap Motion sensor. The Oculus Rift requires a wired computer connection as well as the installation of the Oculus software on the computer and then through screencast displays the 3D VE on the glasses of the Rift device. The device includes two controllers, but in this study, they used the Leap Motion in order to keep the participants’ hands free. Leap Motion is a motion sensor that recognizes users’ actions and translates them into commands on a VR device or computer.
When implementing surgical training in VR, the simulation can include either some basic tasks that are performed during specific surgeries[17,18], or full surgical procedures. Simulators that specialize in specific surgeries, like the LAP simulator, have already integrated most of the corresponding tasks and require no further configurations in order to be ready for use. Huber et al combined such a VR laparoscopic simulator with a 360o video depicting an operating room, thus creating a highly immersive scenario, and offering, for the first time, a structured surrounding environment for the simulation to be accumulated in.
All the images and 3D models contained in the aforementioned simulators, are based on magnetic resonance imaging (MRI) and recordings of in vivo procedures. In order to create realistic 3D models of internal organs, a collection of computed tomography scans and MRIs are required. Sampogna et al described in detail the procedure of recreating 3D reconstructions based on medical imaging.
When implementing an evaluation of the efficacy of new training methodologies, usually the learning impact of the new method needs to be compared to traditional methods. In the selected studies there was heterogeneity in the outcome measures, which did not follow a common evaluation protocol (Table 2).
|Beyer-Berjot et al, 2016–Lap Mentor VR||Huber et al, 2017-LapSim|
|Tasks||Outcome measures||Tasks||Outcome measures|
|Initial assessment||Time (s)||Peg transfer||Time (s)|
|Clipping and grasping||No. of movements||Fine dissection||Left time (s)|
|2-Handed maneuvers||Path length (cm)||Cholecystectomy||Right time (s)|
|Full laparoscopic sigmoid colectomy||Time (z-score)|
|Median dissection||Left path length (m)|
|Lateral dissection||Left angular path (degree)|
|Anastomosis||Left grasps (n)|
|Full LSC||Right path length (m)|
|Right angular path (degree)|
|Right grasps (n)|
|Maximum drops (n)|
There are some common measurements between the study of Beyer-Berjot et al and Huber et al such as the completion time of each task and the number of errors, but other than that, the focus of the evaluation was shifted in opposite directions.
The outcome measures used in the study of Beyer-Berjot et al were: (1) Time taken to complete the task; (2) Time spent per hand; (3) Accuracy of the surgical procedure; (4) Depth of incisions; (5) Number of errors; (6) Number of ripped and burned vessels; and (7) Overall score of the LapSim system based on the calculation of all the components. Questionnaires were also administered, evaluating the degree of interaction, concentration and realism.
In the study of Huber et al, different outcome measures were considered, focusing on the degree of interaction of clipping and grasping, 2-handed maneuvers (time, number of movements, and path length) in 4 tasks, medial dissection, lateral dissection, anastomosis and full large single copy. The fidelity and content validity were measured on a Likert scale.
Sampogna et al developed questionnaires to measure simplicity, precision and fidelity, guidance, satisfaction, 3D reconstruction quality, VR immersiveness.
As mentioned before, the main advantage of using VR in surgical education is the immersiveness the technology provides. This advantage was exploited in full when VR was implemented with the use of HMD, as described by Huber et al, Sampogna et al. Furthermore, Huber et al introduced noise cancelling headphones for increasing immersion. Haptic feedback is a modality often used in VR environments in order to engage the sense of touch. Beyer-Berjot et al used a simulator that integrated with haptic feedback.
The enrolment of participants of different gaming and surgical skills can prove beneficial when evaluating a VR surgical education application. Huber et al used participants of 3 different laparoscopic experience levels, while about half of them had never played video games or had any exposure to VR. Beyer-Berjot et al implemented a similar design for the selection of the participants, but additionally they recruited a small number of video game players. The fact that the participants of these two studies had varying gaming skills, can offer a more subjective view on the usability and acceptability of the system, while the different surgical levels can assess the effectiveness of the system in terms of education.
Despite the great advantages of using VR technology in surgical education, there are also a couple of limitations that need to be considered. The use of VR simulators implemented without the use of HMDs, as described by Beyer-Berjot et al, did not exploit the full potential of the technology, lacking in immersion and users’ engagement. Furthermore, the limited number of participants when performing a feasibility study along with the non-comparison of a new teaching method versus the traditional one[17-19] can lead to barriers in evaluating the impact on learning and skill development. Also, limitations of the use of VR may appear in older adults due to lack of acquittance with the technology. Finally, as Sampogna et al pointed out, if the first operators have rich experience on the skills the new systems aspire to train, the effect of the developed applications on speeding-up the learning curve cannot be evaluated properly. The aforementioned limitations should be considered in terms of the publishing date and in the context of the technological advances of the time. Since then, VR technology has made major progress and the scope of its capabilities has improved vastly.
Among the selected studies, two used high-end VR simulation equipment and performed their study with precision sensors[17,18]. In the two studies, during each simulated task, a variety of data were collected, and they were displayed after the completion of the simulation. Some of them were time-on-task, and number of errors as well as some other indicators were designed during the implementation of the systems. The main difference between the simulators used the surgical task they focus on. LipSim can perform fine dissection, peg transfer, and cholecystectomy while LapMentor offers the option of training in sigmoid colectomy. In the study of Sampogna et al, MRIs were collected from different patients and then reconstruction of the internal organs was performed. The 3D models were imported in the Unity3D environment, and an application was created for Oculus Rift.
In all selected studies, the participants were either surgeons or surgical residents. Beyer-Berjot et al and Huber et al divided their participants into experimental groups based on the number of operations they had carried out in their careers and on their expertise, while Sampogna et al did not categorize their participants. In all three studies, before the beginning of the studies, participants had the opportunity to perform some warm-up tasks in order to get acquainted with the VR technology. The main aim of this exercise was to minimize the errors caused due to difficulties in operating the simulators and the HDMs.
In the past few years, expensive devices and applications have been used in the field of surgical education and surgical procedure, which imposes significant limitations to their extensive use. So, it is important to explore the use of less expensive XR technologies (augmented reality, VR, mixed reality). It is also important to explore the difficulties in co-surgery and in team surgery, due to cooperation problems that may arise. There is also a lack of intra-operative applications that focus on surgeon interactions. In addition, although some studies have been conducted on VR applications in the field of transplantation in general, there is a lack of studies on abdominal transplantations. Also, it will be useful to explore XR not only in surgical training but also during the surgical procedure.
Based on the findings of the comparative synthesis of the already existing approaches, we proposed a roadmap and its application could foster the training of surgeries (Figure 1). A 5-layered system could be constructed according to the following paradigm.
The first layer includes low-cost devices XR. More specifically, future studies should investigate VR devices such as Meta Quest 2, Pico and AR devices such as NReal Light, Toshiba DynaEdge, which cost no more than $500 each and are affordable for not only surgeons but also mass purchases by hospitals and universities. Also, within the same layer we propose the inclusion of IoT devices such as bands and smartwatches as well as Arduino and Raspberry devices that allow sensorial, real-world, big data acquisition, like speech and motion capture analysis. The second layer focuses on co-designing and co-creating virtual and augmented surgeons’ training, based on participatory activities that will take place among healthcare and technology-oriented professionals. In the third layer, a big data acquisition system is designed during the training activities. Data are gathered from heterogeneous sources such as training metrics, biomarkers, and sensory recordings that could help assess the quality of the surgical procedure. In the fourth layer, biosensors are programmed to collect periodic data from the surgeons, which are uploaded on a cloud-based infrastructure where they are stored in a suitable database for analysis. Additional factors could be studied, such as the noise in the virtual surgery as well as the fatigue of the surgeon during the sessions. The analysis of these data is likely to create new approaches to deal with medical errors in operating rooms. In the fifth layer a platform is constructed that graphically presents the training analytics and the course of the surgeries for each surgeon.
VR technologies are becoming more accessible and are a potential cognitive enhancer in the field of surgical education. The findings of this mini-review offer insight into the devices and systems used to train surgeons, as well as to low-cost devices that are rapidly being developed to offer a solution in surgical training. Interestingly, we found a lack of VR training in the field of organ transplantation. In order to tackle this, an ecosystem for promoting learning through XR systems is proposed to be im
We thank our colleagues from Laboratory Medical Physics and Digital Innovation lab, Faculty of Health Sciences, School of Medicine, Aristotle University of Thessaloniki who provided insight and expertise that greatly assisted the research.
Provenance and peer review: Invited article; Externally peer reviewed.
Peer-review model: Single blind
Specialty type: Transplantation
Country/Territory of origin: Greece
Peer-review report’s scientific quality classification
Grade A (Excellent): A
Grade B (Very good): 0
Grade C (Good): C
Grade D (Fair): 0
Grade E (Poor): 0
P-Reviewer: Frascio M, Italy; Ma Y, China S-Editor: Fan JR L-Editor: Ma JY P-Editor: Fan JR
|1.||Kavanagh S, Luxton-Reilly A, Wuensche B, Plimmer B. A systematic review of virtual reality in education. Themes Sci Tech Edu. 2017;10: 85-119. [Cited in This Article: ]|
|2.||Konstantinidis ST, Bamidis PD, Zary N. Introduction to digital innovation in healthcare education and training. InDigital Innovations in Healthcare Education and Training. 2021;3-15. [Cited in This Article: ]|
|3.||Jin M, Lam SH. A virtual-reality based integrated driving-traffic simulation system to study the impacts of intelligent transportation system (ITS). InProceedings. 2003 Interna Confer Cyberworlds. 2003;158-165. [DOI] [Cited in This Article: ]|
|4.||Kreimeier J, Ullmann D, Kipke H, Götzelmann T. Initial Evaluation of Different Types of Virtual Reality Locomotion Towards a Pedestrian Simulator for Urban and Transportation Planning. InExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 2020;1-6. [DOI] [Cited in This Article: ]|
|5.||Lányi CS. Virtual reality in healthcare. InIntelligent paradigms for assistive and preventive healthcare. Berlin, Heidelberg: Springer, 2006: 87-116. [Cited in This Article: ]|
|6.||Pantelidis VS. Reasons to use virtual reality in education and training courses and a model to determine when to use virtual reality. Themes Sci Tech Edu. 2010;2:59-70. [DOI] [Cited in This Article: ]|
|7.||Regenbrecht HT, Schubert TW, Friedmann F. Measuring the sense of presence and its relations to fear of heights in virtual environments. Int J Hum Comput Interact. 1998;10:233-249. [DOI] [Cited in This Article: ]|
|8.||Robillard G, Bouchard S, Fournier T, Renaud P. Anxiety and presence during VR immersion: a comparative study of the reactions of phobic and non-phobic participants in therapeutic virtual environments derived from computer games. Cyberpsychol Behav. 2003;6:467-476. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 152] [Cited by in F6Publishing: 155] [Article Influence: 8.2] [Reference Citation Analysis (0)]|
|9.||Andreano J, Liang K, Kong L, Hubbard D, Wiederhold BK, Wiederhold MD. Auditory cues increase the hippocampal response to unimodal virtual reality. Cyberpsychol Behav. 2009;12:309-313. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 12] [Cited by in F6Publishing: 12] [Article Influence: 0.9] [Reference Citation Analysis (0)]|
|10.||Pickering JD, Panagiotis A, Ntakakis G, Athanassiou A, Babatsikos E, Bamidis PD. Assessing the difference in learning gain between a mixed reality application and drawing screencasts in neuroanatomy. Anat Sci Educ. 2022;15:628-635. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 10] [Cited by in F6Publishing: 6] [Article Influence: 6.0] [Reference Citation Analysis (0)]|
|11.||Baniasadi T, Ayyoubzadeh SM, Mohammadzadeh N. Challenges and Practical Considerations in Applying Virtual Reality in Medical Education and Treatment. Oman Med J. 2020;35:e125. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 30] [Cited by in F6Publishing: 30] [Article Influence: 10.0] [Reference Citation Analysis (0)]|
|12.||Dyer E, Swartzlander BJ, Gugliucci MR. Using virtual reality in medical education to teach empathy. J Med Libr Assoc. 2018;106:498-500. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 81] [Cited by in F6Publishing: 91] [Article Influence: 18.2] [Reference Citation Analysis (0)]|
|13.||Bilimoria KY, Chung JW, Hedges LV, Dahlke AR, Love R, Cohen ME, Hoyt DB, Yang AD, Tarpley JL, Mellinger JD, Mahvi DM, Kelz RR, Ko CY, Odell DD, Stulberg JJ, Lewis FR. National Cluster-Randomized Trial of Duty-Hour Flexibility in Surgical Training. N Engl J Med. 2016;374:713-727. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 307] [Cited by in F6Publishing: 307] [Article Influence: 43.9] [Reference Citation Analysis (0)]|
Da Vinci Skills Simulator. [cited 10 August 2022]. Available from:
|15.||Ayodeji ID, Schijven M, Jakimowicz J, Greve JW. Face validation of the Simbionix LAP Mentor virtual reality training module and its applicability in the surgical curriculum. Surg Endosc. 2007;21:1641-1649. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 51] [Cited by in F6Publishing: 46] [Article Influence: 2.9] [Reference Citation Analysis (0)]|
|16.||Athanasiou A, Meling TR, Brotis A, Moiraghi A, Fountas K, Bamidis PD, Magras I. 3D printing in neurosurgery. Appli Med Sur. 2022;2:159-194. [DOI] [Cited in This Article: ]|
|17.||Beyer-Berjot L, Berdah S, Hashimoto DA, Darzi A, Aggarwal R. A Virtual Reality Training Curriculum for Laparoscopic Colorectal Surgery. J Surg Educ. 2016;73:932-941. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 29] [Cited by in F6Publishing: 21] [Article Influence: 3.0] [Reference Citation Analysis (0)]|
|18.||Huber T, Paschold M, Hansen C, Wunderling T, Lang H, Kneist W. New dimensions in surgical training: immersive virtual reality laparoscopic simulation exhilarates surgical staff. Surg Endosc. 2017;31:4472-4477. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 83] [Cited by in F6Publishing: 51] [Article Influence: 8.5] [Reference Citation Analysis (0)]|
|19.||Sampogna G, Pugliese R, Elli M, Vanzulli A, Forgione A. Routine clinical application of virtual reality in abdominal surgery. Minim Invasive Ther Allied Technol. 2017;26:135-143. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 19] [Cited by in F6Publishing: 15] [Article Influence: 2.5] [Reference Citation Analysis (0)]|
|20.||Antoniou P, Bamidou A, Tartanis I, Vrellis I, Bamidis P. Antoniou P, Bamidou A, Tartanis I, Vrellis I, Bamidis P. From Expert Consulting to Co-creation in Medical Education; Co-creating an Exploratory Educational Space for Orthopedic Medical Education. InInternational Conference on Technology and Innovation in Learning, Teaching and Education. 2018;622-631. [DOI] [Cited in This Article: ]|
|21.||Antoniou PE, Arfaras G, Pandria N, Athanasiou A, Ntakakis G, Babatsikos E, Nigdelis V, Bamidis P. Biosensor Real-Time Affective Analytics in Virtual and Mixed Reality Medical Education Serious Games: Cohort Study. JMIR Serious Games. 2020;8:e17823. [PubMed] [DOI] [Cited in This Article: ] [Cited by in Crossref: 13] [Cited by in F6Publishing: 13] [Article Influence: 4.3] [Reference Citation Analysis (0)]|
The Medical Futurist.
How Does Medical Virtual Reality Make Healthcare More Pleasant? [cited 24 April 2018]. Available from:
Sarah van Gelder.
To Regain People’s Trust, the Democratic Party Must Support Single-Payer. [cited 10 May 2017]. Available from:
Meta Quest 2 Review. [cited 19 September 2022]. Available from:
VR Headsets prove popular with consumer. [cited 3 July 2017]. Available from:
Xiaomi Mi Band 5 Review: Fixing all the quirks from the Mi Band 4, and then some. [cited 25 October 2020]. Available from:
How to Set Up a Raspberry Pi for the First Time. [cited 21 September 2022]. Available from: