Using epistemic network analysis to identify targets for educational interventions in trauma team communication

Published:February 03, 2018DOI:



      Epistemic Network Analysis (ENA) is a technique for modeling and comparing the structure of connections between elements in coded data. We hypothesized that connections among team discourse elements as modeled by ENA would predict the quality of team performance in trauma simulation.


      The Modified Non-technical Skills Scale for Trauma (T-NOTECHS) was used to score a simulation-based trauma team resuscitation. Sixteen teams of 5 trainees participated. Dialogue was coded using Verbal Response Modes (VRM), a speech classification system. ENA was used to model the connections between VRM codes. ENA models of teams with lesser T-NOTECHS scores (n = 9, mean = 16.98, standard deviation [SD] = 1.45) were compared with models of teams with greater T-NOTECHS scores (n = 7, mean = 21.02, SD = 1.09).


      Teams had different patterns of connections among VRM speech form codes with regard to connections among questions and edifications (meanHIGH = 0.115, meanLOW = −0.089; t = 2.21; P = .046, Cohen d = 1.021). Greater-scoring groups had stronger connections between stating information and providing acknowledgments, confirmation, or advising. Lesser-scoring groups had a stronger connection between asking questions and stating information. Discourse data suggest that this pattern reflected increased uncertainty. Lesser-scoring groups also had stronger connections from edifications to disclosures (revealing thoughts, feelings, and intentions) and interpretations (explaining, judging, and evaluating the behavior of others).


      ENA is a novel and valid method to assess communication among trauma teams. Differences in communication among higher- and lower-performing teams appear to result from the ways teams use questions. ENA allowed us to identify targets for improvement related to the use of questions and stating information by team members.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Surgery
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Ivatury R.R.
        • Guilford K.
        • Malhotra A.K.
        • Duane T.
        • Aboutanos M.
        • Martin N.
        Patient safety in trauma: maximal impact management errors at a level I trauma center.
        J Trauma. 2008; 64 (discussion 270-2): 265-270
        • Vioque S.M.
        • Kim P.K.
        • McMaster J.
        • et al.
        Classifying errors in preventable and potentially preventable trauma deaths: a 9-year review using the Joint Commission's standardized methodology.
        Am J Surg. 2014; 208: 187-194
        • Steinemann S.
        • Berg B.
        • Skinner A.
        • et al.
        In situ, multidisciplinary, simulation-based teamwork training improves early trauma care.
        J Surg Educ. 2011; 68: 472-477
        • Steinemann S.
        • Berg B.
        • DiTullio A.
        • et al.
        Assessing teamwork in the trauma bay: introduction of a modified “NOTECHS” scale for trauma.
        Am J Surg. 2012; 203: 69-75
        • Pea R.D.
        Practices of distributed intelligence and designs for education.
        in: Salomon G. Distributed Cognitions: Psychological and Educational Considerations. Cambridge University Press, Cambridge (UK)1997
        • Searle J.R.
        Speech Acts: An Essay in the Philosophy of Language.
        Cambridge University Press, Cambridge (UK)1969
        • Stiles W.B.
        Describing Talk: A Taxonomy of Verbal Response Modes.
        SAGE Publications, Thousand Oaks (CA)1992
        • Arastoopour G.
        • Shaffer D.W.
        • Swiecki Z.
        • Ruis A.R.
        • Chesler N.C.
        Teaching and Assessing Engineering Design Thinking with Virtual Internships and Epistemic Network Analysis.
        Harvey Mudd Design Workshop, Claremont, CA2015
        • Shaffer D.W.
        • Collier W.
        • Ruis A.R.
        A tutorial on epistemic network analysis: analyzing the structure of connections in cognitive, social, and interaction data.
        J Learn Analytics. 2016; 3: 37
        • Chesler N.C.
        • Ruis A.R.
        • Collier W.
        • Swiecki Z.
        • Arastoopour G.
        • Shaffer D.W.
        A novel paradigm for engineering education: virtual internships with individualized mentoring and assessment of engineering thinking.
        J Biomech Eng. 2015; 137: 24701-24708
        • Dorogovtsev S.N.
        • Mendes J.F.F.
        Evolution of Networks: From Biological Nets to the Internet and WWW (Physics).
        Oxford University Press, Oxford (UK)2003
        • Ferrer I.
        • Cancho R.
        • Solé R.V.
        The small world of human language.
        Proc Royal Soc B. 2001; 268: 2261-2265
        • Landauer T.K.
        Handbook of Latent Semantic Analysis.
        Lawrence Erlbaum Associates, Mahwah (NJ)2007
        • Lund K.
        • Burgess C.
        Producing high-dimensional semantic spaces from lexical co-occurrence.
        Behav Res Methods Instruments Comp. 1996; 28: 203-208
        • Newman M.E.J.
        Analysis of weighted networks.
        Phys Rev E. 2004; 70: 056131
        • Suthers D.D.
        • Desiato C.
        Exposing chat features through analysis of uptake between contributions.
        (Presented at: The 45th Hawaii International Conference on System Sciences; January 4–7)2012
        • Dyke G.
        • Kumar R.
        • Ai H.
        • Rosé C.P.
        Challenging assumptions: using sliding window visualizations to reveal time-based irregularities in CSCL processes.
        (Proceedings of the 10th International Conference of the Learning Sciences. International Society of the Learning Sciences)2012
        • Quardokus Fisher K.
        • Hirshfield L.
        • Siebert-Evenstone A.
        • Arastoopour G.
        • Koretsky M.
        Network analysis of interactions between students and an instructor during design meetings.
        (Presented at: American Society for Engineering Education Annual Conference & Exposition, New Orleans, LA; June 26–29)2016
        • Siebert-Evenstone A.L.
        • Arastoopour G.
        • Collier W.
        • Swiecki Z.
        • Ruis A.R.
        • Shaffer D.W.
        In search of conversational grain size: modeling semantic structure using moving stanza windows.
        (Presented at: 12th International Conference of the Learning Sciences. Singapore; June 20–24)2016
        • Westli H.K.
        • Johnsen B.H.
        • Eid J.
        • Rasten I.
        • Brattebø G.
        Teamwork skills, shared mental models, and performance in simulated trauma teams: an independent group design.
        Scand J Trauma Resusc Emerg Med. 2010; 18: 47
        • McComb S.
        • Simpson V.
        The concept of shared mental models in healthcare collaboration.
        J Adv Nurs. 2014; 70: 1479-1488
        • Alonso A.
        • Baker D.P.
        • Holtzman A.
        • et al.
        Reducing medical error in the military health system: how can team training help?.
        Human Resource Manage Rev. 2006; 16: 396-415
        • American College of Surgeons, Committee on Trauma
        Advanced Trauma Life Support (ATLS) Manual for Coordinators and Faculty.
        9th ed. 2013 (Chicago (IL))

      CHORUS Manuscript

      View Open Manuscript