Virtual reality training for cataract surgery operating performance in ophthalmology trainees
- PMID: 34931701
- PMCID: PMC8689714
- DOI: 10.1002/14651858.CD014953.pub2
Virtual reality training for cataract surgery operating performance in ophthalmology trainees
Abstract
Background: Cataract surgery is the most common incisional surgical procedure in ophthalmology and is important in ophthalmic graduate medical education. Although most ophthalmology training programs in the United States (US) include virtual reality (VR) training for cataract surgery, comprehensive reviews that detail the impact of VR training on ophthalmology trainee performance are lacking.
Objectives: To assess the impact of VR training for cataract surgery on the operating performance of postgraduate ophthalmology trainees, measured by operating time, intraoperative complications, postoperative complications, supervising physician ratings, and VR simulator task ratings.
Search methods: We searched CENTRAL (which contains the Cochrane Eyes and Vision Trials Register), Ovid MEDLINE, Embase.com, PubMed, LILACS, ClinicalTrials.gov, and the World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP). We did not use any date or language restrictions in the electronic search for trials. We last searched the electronic databases on 14 June 2021.
Selection criteria: We included randomized controlled trials (RCTs) comparing VR training to any other method of training, including non-VR simulation training (e.g., wet laboratory training), didactics training, or no supplementary training in postgraduate ophthalmology trainees.
Data collection and analysis: We used standard Cochrane methodology. Primary outcomes were operating times in the operating room and intraoperative complications. Secondary outcomes were operating times in simulated settings, simulator task ratings, and supervising physician ratings, either in the operating room or simulated settings.
Main results: We included six RCTs with a total of 151 postgraduate ophthalmology trainees ranging from 12 to 60 participants in each study. The included studies varied widely in terms of geography: two in the US, and one study each in China, Germany, India, and Morocco. Three studies compared VR training for phacoemulsification cataract surgery on the Eyesi simulator (VRmagic, Mannheim, Germany) with wet laboratory training and two studies compared VR training with no supplementary training. One study compared trainees who received VR training with those who received conventional training for manual small incision cataract surgery on the HelpMeSee simulator (HelpMeSee, New York, NY). Industry financially supported two studies. All studies had at least three domains judged at high or unclear risks of bias. We did not conduct a meta-analysis due to insufficient data (i.e., lack of precision measurements, or studies reported only P values). All evidence was very low-certainty, meaning that any estimates were unreliable. The evidence for the benefits of VR training for trainees was very uncertain for primary outcomes. VR-trained trainees relative to those without supplementary training had shorter operating times (mean difference [MD] -17 minutes, 95% confidence interval [CI] -21.62 to -12.38; 1 study, n = 12; very low-certainty evidence). Results for operating time were inconsistent when comparing VR and wet laboratory training: one study found that VR relative to wet laboratory training was associated with longer operating times (P = 0.038); the other reported that two training groups had similar operating times (P = 0.14). One study reported that VR-trained trainees relative to those without supplementary training had fewer intraoperative complications (P < 0.001); in another study, VR and conventionally trained trainees had similar intraoperative complication rates (MD -8.31, 95% CI -22.78 to 6.16; 1 study, n = 19; very low-certainty evidence). For secondary outcomes, VR training may have similar impact on trainee performance compared to wet laboratory and greater impact compared to no supplementary training, but the evidence was very uncertain. One study reported VR-trained trainees relative to those without supplementary training had significantly reduced operating time in simulated settings (P = 0.0013). Another study reported that VR-trained relative to wet laboratory-trained trainees had shorter operating times in VR settings (MD -1.40 minutes, 95% CI -1.96 to -0.84; 1 study, n = 60) and similar times in wet laboratory settings (MD 0.16 minutes, 95% CI -0.50 to 0.82; 1 study, n = 60). This study also found the VR-trained trainees had higher VR simulator ratings (MD 5.17, 95% CI 0.61 to 9.73; 1 study, n = 60). Results for supervising physician ratings in the operating room were inconsistent: one study reported that VR- and wet laboratory-trained trainees received similar supervising physician ratings for cataract surgery (P = 0.608); another study reported that VR-trained trainees relative to those without supplementary training were less likely to receive poor ratings by supervising physicians for capsulorhexis construction (RR 0.29, 95% CI 0.15 to 0.57). In wet laboratory settings, VR-trained trainees received similar supervising physician ratings compared with wet laboratory-trained trainees (MD -1.50, 95% CI -6.77 to 3.77; n = 60) and higher supervising physician ratings compared with trainees without supplementary training (P < 0.0001). However, the results for all secondary outcomes should be interpreted with caution because of very low-certainty evidence. AUTHORS' CONCLUSIONS: Current research suggests that VR training may be more effective than no supplementary training in improving trainee performance in the operating room and simulated settings for postgraduate ophthalmology trainees, but the evidence is uncertain. The evidence comparing VR with conventional or wet laboratory training was less consistent.
Copyright © 2021 The Cochrane Collaboration. Published by John Wiley & Sons, Ltd.
Conflict of interest statement
JCL: none.
ZY: none.
IUS: none.
PBG: none.
Figures
Update of
- doi: 10.1002/14651858.CD014953
Similar articles
-
Pharmacologic interventions for mydriasis in cataract surgery.Cochrane Database Syst Rev. 2021 May 27;5(5):CD012830. doi: 10.1002/14651858.CD012830.pub2. Cochrane Database Syst Rev. 2021. PMID: 34043237 Free PMC article.
-
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
-
Laser-assisted cataract surgery versus standard ultrasound phacoemulsification cataract surgery.Cochrane Database Syst Rev. 2016 Jul 8;7(7):CD010735. doi: 10.1002/14651858.CD010735.pub2. Cochrane Database Syst Rev. 2016. Update in: Cochrane Database Syst Rev. 2023 Jun 23;6:CD010735. doi: 10.1002/14651858.CD010735.pub3 PMID: 27387849 Free PMC article. Updated. Review.
-
Different-sized incisions for phacoemulsification in age-related cataract.Cochrane Database Syst Rev. 2017 Sep 20;9(9):CD010510. doi: 10.1002/14651858.CD010510.pub2. Cochrane Database Syst Rev. 2017. PMID: 28931202 Free PMC article. Review.
-
Virtual reality simulation training for health professions trainees in gastrointestinal endoscopy.Cochrane Database Syst Rev. 2018 Aug 17;8(8):CD008237. doi: 10.1002/14651858.CD008237.pub3. Cochrane Database Syst Rev. 2018. PMID: 30117156 Free PMC article.
Cited by
-
Comparison of effect and safety of phacoemulsification surgery performed by resident and attending physicians.Front Med (Lausanne). 2024 Aug 7;11:1401482. doi: 10.3389/fmed.2024.1401482. eCollection 2024. Front Med (Lausanne). 2024. PMID: 39175816 Free PMC article.
-
More than simulation: the HelpMeSee approach to cataract surgical training.Community Eye Health. 2023;36(120):20-21. Epub 2023 Dec 1. Community Eye Health. 2023. PMID: 38178826 Free PMC article. No abstract available.
-
Learning curves of novice residents on cataract surgery simulator: the E3CAPS pedagogic study.BMC Med Educ. 2024 Sep 30;24(1):1078. doi: 10.1186/s12909-024-06064-z. BMC Med Educ. 2024. PMID: 39350156 Free PMC article.
-
Outcomes of Non-Penetrating Deep Sclerectomy for Primary Congenital Glaucoma Performed by Experienced versus Trainee Surgeons: A Cohort Study.Clin Ophthalmol. 2023 Mar 16;17:897-906. doi: 10.2147/OPTH.S403016. eCollection 2023. Clin Ophthalmol. 2023. PMID: 36960324 Free PMC article.
-
Validation of collaborative cyberspace virtual reality oculometry enhanced with near real-time spatial audio.Sci Rep. 2023 Jun 21;13(1):10076. doi: 10.1038/s41598-023-37267-x. Sci Rep. 2023. PMID: 37344554 Free PMC article.
References
References to studies included in this review
Adnane 2020 {published data only}
Daly 2013 {published data only}
-
- Daly MK, Gonzalez E, Siracuse-Lee D, Legutko PA. Efficacy of surgical simulator training versus traditional wet-lab training on operating room performance of ophthalmology residents during the capsulorhexis in cataract surgery. Journal of Cataract and Refractive Surgery 2013;39(11):1734‐41. [DOI: 10.1016/j.jcrs.2013.05.044] - DOI - PubMed
Feudner 2009 {published data only}
-
- Feudner EM, Engel C, Neuhann IM, Petermeier K, Bartz-Schmidt KU, Szurman P. Virtual reality training improves wet-lab performance of capsulorhexis: results of a randomized, controlled study. Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie 2009;247(7):955‐63. [DOI: 10.1007/s00417-008-1029-7] - DOI - PubMed
Folgar 2007 {published data only}
-
- Folgar FA, Wong J, Helveston EM. Surgical outcomes in cataract surgeries performed by residents training with the EYESI simulator system. Investigative Ophthalmology & Visual Science 2007;48:ARVO E‐Abstract 1049.
Hu 2021 {published data only}
Nair 2021 {published data only}
-
- NCT04450420. Tunnel construction course pilot assessment of simulation-based training effectiveness. clinicaltrials.gov/show/NCT04450420 (first received 29 June 2020).
References to studies excluded from this review
Abellán 2013 {published data only}
Banerjee 2012 {published data only}
-
- Banerjee PP, Edward DP, Liang S, Bouchard CS, Bryar PJ, Ahuja R, et al. Concurrent and face validity of a capsulorhexis simulation with respect to human patients. Studies in Health Technology and Informatics 2012;173:35-41. - PubMed
Dean 2021 {published data only}
-
- Dean WH, Gichuhi S, Buchan JC, Makupa W, Mukome A, Otiti-Sengeri J, et al. Intense simulation-based surgical education for manual small-incision cataract surgery: the Ophthalmic Learning and Improvement Initiative in Cataract Surgery Randomized Clinical Trial in Kenya, Tanzania, Uganda, and Zimbabwe. JAMA Ophthalmology 2021;139(1):9‐15. [DOI: 10.1001/jamaophthalmol.2020.4718] - DOI - PMC - PubMed
-
- Mian SI. Redesigning surgical training curriculum with simulation: lessons from the OLIMPICS Trial. JAMA Ophthalmology 2021;139(1):16-7. [DOI: ] - PubMed
-
- PACTR201803002159198. The Simulated Ocular Surgery (SOS) trials [The Simulated Ocular Surgery (SOS) trials: randomised-controlled trials comparing intense simulation-based surgical education for cataract and glaucoma surgery to conventional training alone in East Africa]. researchonline.lshtm.ac.uk/id/eprint/4654987/1/Research-Protocol-SSA-SOS... (first received 30 March 2017).
Lo 2019 {published data only}
-
- Lo D, Main M, Patel P, Ahmad H. Impact of video coaching on ophthalmology resident capsulorhexis performance in cataract surgery. Investigative Ophthalmology & Visual Science 2019;60(9):489.
NCT03458442 {published data only}
-
- NCT03458442. China OLIMPICS: China Ophthalmic Learning and IMProvement Initiative in Cataract Surgery Trial. clinicaltrials.gov/show/NCT03458442 (first received 8 March 2018).
Santerre 2007 {published data only}
Singh 2014 {published data only}
-
- Singh P, Deuchler S, Schaefer H, Fassbender S, Kohnen T, Koch FH, et al. Indirect ophthalmoscopy: training with conventional hardware versus the Eyesi® indirect ophthalmoscopy simulator. Investigative Ophthalmology & Visual Science 2014;55(13):279.
Thomsen 2017 {published data only}
-
- Thomsen AS, Kiilgaard JF, la Cour MD, Konge L. Investigating inter-procedural transfer of surgical skills using virtual-reality simulation. Investigative Ophthalmology & Visual Science 2016;57(12):5827.
-
- Thomsen AS, Kiilgaard JF, la Cour M, Brydges R, Konge L. Is there inter-procedural transfer of skills in intraocular surgery? A randomized controlled trial. Acta Ophthalmologica 2017;95:845-51. - PubMed
References to ongoing studies
ISRCTN15327117 {published data only}
-
- ISRCTN15327117. The effect of virtual reality cataract extraction simulation surgery training on patient safety and outcomes. www.isrctn.com/ISRCTN15327117 (first received 15 December 2020).
NCT04908072 {published data only}
-
- NCT04908072. Global learning: an Orbis virtual-platform evaluation study [Validity and effectiveness of a virtual reality simulator for manual small incision cataract surgery: the Orbis-fundamental VR MSICS Simulator]. clinicaltrials.gov/ct2/show/NCT04908072 (first received 1 June 2021).
Additional references
Abell 2014
Altman 1996
Centers for Medicare & Medicaid Services 2016
-
- Centers for Medicare & Medicaid Services. Measure #388: cataract surgery with intra-operative complications (unplanned rupture of posterior capsule requiring unplanned vitrectomy) – national quality strategy domain: patient safety. www.aao.org/medicare/quality-reporting-measure/388-cataract-surgery-intr... (accessed prior to 21 June 2021). [URL: https://qpp.cms.gov/docs/QPP_quality_measure_specifications/Claims-Regis...]
Centers for Medicare & Medicaid Services 2018
-
- Centers for Medicare & Medicaid Services. Global surgery booklet. Medicare Learning Network Chicago (IL).
Covidence [Computer program]
-
- Covidence. Melbourne: Veritas Health Innovation, accessed 23 January 2020. Available at www.covidence.org.
Fahim 2016
-
- Fahim AT, Simunovic MP, Mammo Z, Mitry D, Pakzad-Vaezi K, Bradley P, et al. Comparison of ophthalmic training in 6 English-speaking countries. Canadian Journal of Ophthalmology 2016;51(3):212-8. - PubMed
Glanville 2006
Heemraz 2016
Higgins 2002
-
- Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine 2002;21(11):1539-58. - PubMed
Higgins 2011
-
- Higgins JP, Altman DG, Sterne JA. Chapter 8: Assessing risk of bias in included studies. In: Higgins JP, Green S, editor(s). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011. Available from training.cochrane.org/handbook/archive/v5.1/.
Higgins 2019
-
- Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al, editor(s). Cochrane Handbook for Systematic Reviews of Interventions Version 6.0 (updated August 2019). Cochrane, 2019. Available from training.cochrane.org/handbook/archive/v6. - PMC - PubMed
Higgins 2021
-
- Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M, et al, editor(s). Cochrane Handbook for Systematic Reviews of Interventions Version 6.2 (updated February 2021). Cochrane, 2021. Available from training.cochrane.org/handbook.
Hosler 2012
Lam 2013
-
- Lam CK, Sundaraj K, Sulaiman MN. A review of computer-generated simulation in the pedagogy of cataract surgery training and assessment. International Journal of Human–Computer Interaction 2013;29(10):661-9.
Lee 2020
Lotfipour 2017
Micieli 2011
Moore 2013
Nagendran 2013
Page 2020
-
- Page MJ, Higgins JP, Sterne JA. Chapter 13: Assessing risk of bias due to missing results in a synthesis. In: Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al, editor(s). Cochrane Handbook for Systematic Reviews of Interventions Version 6.1 (updated September 2020). The Cochrane Collaboration, 2020. Available from training.cochrane.org/handbook/archive/v6.1.
Paul 2018
Review Committee for Ophthalmology 2021
-
- Review Committee for Ophthalmology. Case log information: ophthalmology. Chicago (IL): Accreditation Council for Graduate Medical Education, 2021. [LINK: www.acgme.org/Portals/0/PFAssets/ProgramResources/OPH_CaseLogInfo.pdf?ve...]
Review Manager Web [Computer program]
-
- Review Manager Web (RevMan Web). Version 3.2.0. The Cochrane Collaboration, 2019. Available at: revman.cochrane.org.
Thomsen 2015
-
- Thomsen AS, Subhi Y, Kiilgaard JF, la Cour M, Konge L. Update on simulation-based surgical training and assessment in ophthalmology: a systematic review. Ophthalmology 2015;122(6):1111-30.e1. - PubMed
References to other published versions of this review
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical