Advertisement

Personalized video feedback improves suturing skills of incoming general surgery trainees

Published:December 27, 2017DOI:https://doi.org/10.1016/j.surg.2017.11.006

      Abstract

      Background

      The American Board of Surgery encourages graduating medical students to prepare for surgical residency before day 1. We sought to determine the impact of personalized video feedback on an advance preparation task.

      Methods

      We conducted a nonrandomized study comparing video feedback versus no feedback. We sent incoming surgical interns a preparatory package 2 months before starting residency. Trainees video-recorded themselves performing a subcuticular wound closure, 3 times at 3-week intervals, and submitted these for appraisal. A staff surgeon provided personalized feedback on each video as a narrated voiceover. The voiced-over videos were then returned to trainees. We compared performance (time and completion rate) on suturing in a multistation assessment against residents from the previous year (no-feedback group).

      Results

      The feedback group had a higher completion rate for the suturing assessment than the no-feedback group (23/28 [82%] vs. 8/27 [30%], P < .0001). The feedback group also completed the suturing station at a faster rate than those without feedback (hazard ratio 4.9 [95% confidence interval (CI): 2.2,11.2), P < .0001). Global rating scores were significantly higher for the feedback group (mean difference [5-point scale]  = 0.7 [95% CI: 0.3, 1.1]). However, Objective Structured Assessment of Technical Skills scores indicated no significant difference between groups (mean difference [5-point scale]  = 0.3 [95% CI: 0.0, 0.6]). Within the feedback group, we found significant improvement from baseline to final performances (mean difference = 109 seconds [95% CI: 79, 140]).

      Conclusion

      Personalized narrated feedback as part of a home-based advance preparation package for incoming residents is associated with higher performance on early objective assessments.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Surgery
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

      1. National Resident Matching Program, Results and Data: 2016 Main Residency Match. National Resident Matching Program, Washington, DC. 2016.

        • Minter R.M.
        • Amos K.D.
        • Bentz M.L.
        • et al.
        Transition to surgical residency: a multi-institutional study of perceived intern preparedness and the effect of a formal residency preparatory course in the fourth year of medical school.
        Acad Med. 2015; 90: 1116-1124
        • Esterl R.M.
        • Henzi D.L.
        • Cohn S.M.
        Senior medical student “boot camp”: can result in increased self-confidence before starting surgery internships.
        Curr Surg. 2006; 63: 264-268
        • Blackmore C.
        • Austin J.
        • Lopushinsky S.R.
        • Donnon T.
        Effects of postgraduate medical education “boot camps” on clinical skills, knowledge, and confidence: a meta-analysis.
        J Grad Med Educ. 2014; 6: 643-652
        • Frischknecht A.C.
        • Boehler M.L.
        • Schwind C.J.
        • et al.
        How prepared are your interns to take calls? Results of a multi-institutional study of simulated pages to prepare medical students for surgery internship.
        Am J Surg. 2014; 208: 307-315
        • American Board of Surgery
        • American College of Surgeons
        • Association of Program Directors in Surgery
        • Association for Surgical Education
        Statement on surgical preresidency preparatory courses.
        Am Surg. 2014; 80: 1085-1086
        • Association of Program Directors in Surgery
        • American Board of Surgery
        • American College of Surgeons
        • Association for Surgical Education
        Statement on surgical preresidency preparatory courses.
        Ann Surg. 2014; 260: 969-970
        • Pandian T.K.
        • Buckarma E.H.
        • Mohan M.
        • et al.
        At home pre-residency preparation for general surgery internship: a pilot study.
        J Surg Educ. 2017; (Epub ahead of print, June 27, 2017)
        • Ahmed N.
        • Devitt K.S.
        • Keshet I.
        • et al.
        A systematic review of the effects of resident duty hour restrictions in surgery: impact on resident wellness, training, and patient outcomes.
        Ann Surg. 2014; 259: 1041-1053
        • Hatala R.
        • Cook D.A.
        • Zendejas B.
        • Hamstra S.J.
        • Brydges R.
        Feedback for simulation-based procedural skills training: a meta-analysis and critical narrative synthesis.
        Adv Health Sci Educ Theory Pract. 2014; 19: 251-272
        • Ende J.
        Feedback in clinical medical education.
        JAMA. 1983; 250: 777-781
        • Farquharson A.L.
        • Cresswell A.C.
        • Beard J.D.
        • Chan P.
        Randomized trial of the effect of video feedback on the acquisition of surgical skills.
        Br J Surg. 2013; 100: 1448-1453
        • Backstein D.
        • Agnidis Z.
        • Regehr G.
        • Reznick R.
        The effectiveness of video feedback in the acquisition of orthopedic technical skills.
        Am J Surg. 2004; 187: 427-432
        • Backstein D.
        • Agnidis Z.
        • Sadhu R.
        • MacRae H.
        Effectiveness of repeated video feedback in the acquisition of a surgical technical skill.
        Can J Surg. 2005; 48: 195-200
        • Nesbitt C.I.
        • Phillips A.W.
        • Searle R.F.
        • Stansby G.
        Randomized trial to assess the effect of supervised and unsupervised video feedback on teaching practical skills.
        J Surg Educ. 2015; 72: 697-703
        • Abbott E.F.
        • Thompson W.
        • Pandian T.K.
        • et al.
        Personalized video feedback and repeated task practice improve laparoscopic knot-tying skills: two controlled trials.
        Acad Med. 2017; 92: S11-S32
        • Landis J.R.
        • Koch G.G.
        The measurement of observer agreement for categorical data.
        Biometrics. 1977; 33: 159-174
        • Martin J.A.
        • Regehr G.
        • Reznick R.
        • et al.
        Objective structured assessment of technical skill (OSATS) for surgical residents.
        Br J Surg. 1997; 84: 273-278
        • Cook D.A.
        • Beckman T.J.
        Current concepts in validity and reliability for psychometric instruments: theory and application.
        Am J Med. 2006; 119 (e7-e16): 166
        • Cook D.A.
        • Hatala R.
        • Brydges R.
        • et al.
        Technology-enhanced simulation for health professions education.
        JAMA. 2011; 306: 978-988
        • Supe A.
        • Prabhu R.
        • Harris I.
        • Downing S.
        • Tekian A.
        Structured training on box trainers for first year surgical residents: does it improve retention of laparoscopic skills? A randomized controlled study.
        J Surg Educ. 2012; 69: 624-632
        • McCambridge J.
        • Witton J.
        • Elbourne D.R.
        Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects.
        J Clin Epidemiol. 2014; 67: 267-277
        • Zendejas B.
        • Wang A.T.
        • Brydges R.
        • Hamstra S.J.
        • Cook D.A.
        Cost: The missing outcome in simulation-based medical education research: a systematic review.
        Surgery. 2013; 153: 160-176
        • Brydges R.
        • Hatala R.
        • Zendejas B.
        • Erwin P.J.
        • Cook D.A.
        Linking simulation-based educational assessments and patient-related outcomes.
        Acad Med. 2015; 90: 246-256
        • Brydges R.
        • Manzone J.
        • Shanks D.
        • et al.
        Self-regulated learning in simulation-based training: a systematic review and meta-analysis.
        Med Educ. 2015; 49: 368-378
        • McGaghie W.C.
        • Issenberg S.B.
        • Cohen E.R.
        • Barsuk J.H.
        • Wayne D.B.
        Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence.
        Acad Med. 2011; 86: 706-711
        • Cook D.A.
        • Brydges R.
        • Hamstra S.J.
        • et al.
        Comparative effectiveness of technology-enhanced simulation versus other instructional methods.
        Simul Healthc. 2012; 7: 308-320