Can Pediatric Endoscopists Accurately Assess Their Clinical Competency? A Comparison Across Skill Levels
- PMID: 30418413
- DOI: 10.1097/MPG.0000000000002191
Can Pediatric Endoscopists Accurately Assess Their Clinical Competency? A Comparison Across Skill Levels
Abstract
Background: Assessment is critical to support pediatric endoscopy training. Although trainee engagement in assessment is encouraged, the use of self-assessment and its accuracy among pediatric endoscopists is not well described. We aimed to determine the self-assessment accuracy of novice, intermediate, and experienced pediatric endoscopists.
Methods: Novice (performed <50 previous colonoscopies), intermediate (50-500), and experienced (>1000) pediatric endoscopists from 3 North American academic teaching hospitals each performed a clinical colonoscopy. Endoscopists were assessed in real-time by 2 experienced endoscopists using the Gastrointestinal Endoscopy Competency Assessment Tool for Pediatric Colonoscopy (GiECATKIDS). In addition, participants self-assessed their performance using the same instrument. Self-assessment accuracy between the externally assessed and self-assessed scores was evaluated using absolute difference scores, intraclass correlation coefficients, and Bland-Altman analyses.
Results: Forty-seven endoscopists participated (21 novices, 16 intermediates, and 10 experienced). Overall, there was moderate agreement of externally assessed and self-assessed GiECATKIDS total scores with an intraclass correlation coefficient of 0.72 (95% confidence interval, 0.55-0.83). The absolute difference scores among the 3 groups were significantly different (P = 0.005), with experienced endoscopists demonstrating a more accurate self-assessment compared to novices (P = 0.003). Bland-Altman plots revealed that novice endoscopists' self-assessed scores tended to be higher than their externally assessed scores, indicating they overestimated their performance.
Conclusions: We found that endoscopic experience was positively associated with self-assessment accuracy among pediatric endoscopists. Novices were inaccurate in assessing their endoscopic competence and were prone to overestimation of their performances. Our findings suggest novices may benefit from targeted interventions aimed at improving their insight and self-awareness.
Comment in
-
Training in Endoscopy: Coaching, Deliberate Practice, and Reflection.J Pediatr Gastroenterol Nutr. 2019 Mar;68(3):298-300. doi: 10.1097/MPG.0000000000002231. J Pediatr Gastroenterol Nutr. 2019. PMID: 30586015 No abstract available.
Similar articles
-
Impact of experience on self-assessment accuracy of clinical colonoscopy competence.Gastrointest Endosc. 2018 Mar;87(3):827-836.e2. doi: 10.1016/j.gie.2017.10.040. Epub 2017 Nov 6. Gastrointest Endosc. 2018. PMID: 29122599
-
The gastrointestinal endoscopy competency assessment tool for pediatric colonoscopy.J Pediatr Gastroenterol Nutr. 2015 Apr;60(4):474-80. doi: 10.1097/MPG.0000000000000686. J Pediatr Gastroenterol Nutr. 2015. PMID: 25564819
-
Gastrointestinal Endoscopy Competency Assessment Tool: reliability and validity evidence.Gastrointest Endosc. 2015;81(6):1417-1424.e2. doi: 10.1016/j.gie.2014.11.030. Epub 2015 Mar 7. Gastrointest Endosc. 2015. PMID: 25753836
-
Training and teaching innovations in colonoscopy.Gastroenterol Clin North Am. 2013 Sep;42(3):659-70. doi: 10.1016/j.gtc.2013.05.001. Gastroenterol Clin North Am. 2013. PMID: 23931865 Review.
-
Upskilling Pediatric Ileocolonoscopy.Gastrointest Endosc Clin N Am. 2023 Apr;33(2):253-265. doi: 10.1016/j.giec.2022.11.006. Gastrointest Endosc Clin N Am. 2023. PMID: 36948745 Review.
Cited by
-
Self-assessment of Competence in Endoscopy: Challenges and Insights.J Can Assoc Gastroenterol. 2020 Jun 23;4(4):151-157. doi: 10.1093/jcag/gwaa020. eCollection 2021 Aug. J Can Assoc Gastroenterol. 2020. PMID: 34337314 Free PMC article.
-
Pediatric Web-based Video Capsule Endoscopy Curriculum: A Pilot Study to Determine the Ability to Implement a Standardized Educational Curriculum.JPGN Rep. 2021 Nov 29;3(1):e130. doi: 10.1097/PG9.0000000000000130. eCollection 2022 Feb. JPGN Rep. 2021. PMID: 37168768 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical