Improving surgical outcomes through non-technical skills: the case for better training and national evaluation
DOI:
https://doi.org/10.18203/issn.2455-4510.IntJResOrthop20252652Keywords:
Non-technical skills, Surgeon training, Communication, Leadership, Decision-makingAbstract
Effective communication and teamwork are as crucial as technical proficiency for achieving positive surgical outcomes. Non-technical skills (NTS)-including communication, leadership, decision-making, and situational awareness—enhance surgical performance by fostering awareness and capability among both trainees and experienced surgeons. Despite growing recognition of its importance, NTS training is not uniformly implemented in surgical education, leaving a significant gap. This study examines opportunities to expand NTS training within surgical practice. A survey at a local hospital assessed the availability of NTS training and perceived needs among 38 surgical trainees and professionals. The majority acknowledged the value of NTS in improving clinical performance but reported limited focus on human factors in daily practice. Complementing the survey, a literature review was conducted across Medline, EMBASE, and PsycINFO databases, identifying 414 relevant articles, 114 of which focused on clinical or educational contexts. Of these, 61 studies emphasized psychomotor skill assessment via direct observation, patient outcomes, and peer feedback, underscoring the critical role of effective evaluation methods. Findings indicate that while NTS training is appreciated, its effectiveness depends heavily on feedback quality and team dynamics, particularly in addressing challenging behaviors. The study highlights the need for enhanced training design and robust feedback mechanisms. Although current evidence linking NTS training to improved patient outcomes is largely anecdotal, there is strong professional support for broader implementation. The authors advocate for a systematic, nationwide evaluation to determine the true impact of NTS training on surgical performance and outcomes.
Metrics
References
Kohn L, Corrigan J, Donaldson M. Committee on Quality of Healthcare in America, Institute of Medicine: To err is Human: Building a Safer Health System. Washington DC: National Academy Press. 2005.
Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R. Anaesthetists’ Non‐Technical Skills (ANTS): evaluation of a behavioural marker system. Br J Anaes. 2003;90(5):580-8. DOI: https://doi.org/10.1093/bja/aeg112
Leuschner S, Leuschner M, Kropf S, Niederbichler AD. Non-technical skills training in the operating theatre: a meta-analysis of patient outcomes. Surgeon. 2019;17(4):233-43. DOI: https://doi.org/10.1016/j.surge.2018.07.001
Bennett SA. The training and practice of crew resource management: recommendations from an inductive in vivo study of the flight deck. Ergonomics. 2019;62(2):219-32. DOI: https://doi.org/10.1080/00140139.2018.1506159
Rutherford JS, Flin R, Mitchell L. Non-technical skills of anaesthetic assistants in the perioperative period: a literature review. British J Anaesth. 2012;109(1):27-31. DOI: https://doi.org/10.1093/bja/aes125
Flowerdew L, Brown R, Vincent C, Woloshynowych M. Development and validation of a tool to assess emergency physicians' nontechnical skills. Ann Emerg Med. 2012;59(5):376-85. DOI: https://doi.org/10.1016/j.annemergmed.2011.11.022
Jones M, Howells N, Mitchell S, Burnand H, Mutimer J, Longman R. Human‐factors training for surgical trainees. Clin Teacher. 2014;11(3):165-9. DOI: https://doi.org/10.1111/tct.12147
Jelovsek JE, Kow N, Diwadkar GB. Tools for the direct observation and assessment of psychomotor skills in medical trainees: a systematic review. Med Edu. 2013;47(7):650-73. DOI: https://doi.org/10.1111/medu.12220
Weaver ML, Carter T, Yamazaki K, Hamstra SJ, Holmboe E, Chaer R, et al. The association of ACGME Milestones with performance on American Board of Surgery assessments: a national investigation of surgical trainees. Ann Surg. 2024;279(1):180-6. DOI: https://doi.org/10.1097/SLA.0000000000005998
Glasow PA. Fundamentals of survey research methodology. 2005.
Greaves JD, Grant J. Watching anaesthetists work: using the professional judgement of consultants to assess the developing clinical competence of trainees. Br J Anaesth. 2000;84(4):525-33. DOI: https://doi.org/10.1093/oxfordjournals.bja.a013485
Gaba DM. The future vision of simulation in health care. BMJ Quality Safety. 2004;13(1):2-10. DOI: https://doi.org/10.1136/qhc.13.suppl_1.i2
Hull L, Arora S, Symons NR, Jalil R, Darzi A, Vincent C, Sevdalis N. Training faculty in nontechnical skill assessment: national guidelines on program requirements. Ann Surg. 2013;258(2):370-5. DOI: https://doi.org/10.1097/SLA.0b013e318279560b
Sevdalis N, Davis R, Koutantji M, Undre S, Darzi A, Vincent CA. Reliability of a revised NOTECHS scale for use in surgical teams. American J Surg. 2008;196(2):184-90. DOI: https://doi.org/10.1016/j.amjsurg.2007.08.070
Jackson S, Brackley K, Landau A, Hayes K. Assessing non‐technical skills on the delivery suite: a pilot study. Clinical Teacher. 2014;11(5):375-80. DOI: https://doi.org/10.1111/tct.12231
Robertson ER, Hadi M, Morgan LJ, Pickering SP, Collins G, New S, et al. Oxford NOTECHS II: a modified theatre team non-technical skills scoring system. PloS one. 2014;9(3):90320. DOI: https://doi.org/10.1371/journal.pone.0090320
Grimshaw JM, Eccles MP, Walker AE, Thomas RE. Changing physicians' behavior: what works and thoughts on getting more things to work. J Contin Educ Health Prof. 2002;22(4):237-43. DOI: https://doi.org/10.1002/chp.1340220408
Lee M. On patient safety: being a jerk in the operating room is bad for the patient. Clin Orthop Relat Res. 2017;475:3283–30. DOI: https://doi.org/10.1007/s11999-016-5173-9
Crossley J, Marriott J, Purdie H, Beard JD. Prospective observational study to evaluate NOTSS (Non-Technical Skills for Surgeons) for assessing trainees' non-technical performance in the operating theatre. J British Surg. 2011;98(7):1010-20. DOI: https://doi.org/10.1002/bjs.7478
Kadzielski J, McCormick F, Herndon J. Surgeons’ attitudes are associated with reoperation and readmission rates. Clin Orthop Relat Res. 2015;473:1544–51. DOI: https://doi.org/10.1007/s11999-014-3687-6
Baines R, Regan de Bere S, Stevens S et al. The impact of patient feedback on the medical performance of qualified doctors: a systematic review. BMC Med Educ. 2018;18:173. DOI: https://doi.org/10.1186/s12909-018-1277-0
Santos R, Bakero L, Franco P, Alves C, Fragata I, Fragata J. Characterization of non-technical skills in paediatric cardiac surgery: communication patterns. European J Cardio-thor Surg. 2012;41(5):1005-12. DOI: https://doi.org/10.1093/ejcts/ezs068
Gibbs J, Smith P. A pathway to clinician-led culture change in the operating theatre. J Per Practice. 2016;26(6):134-7. DOI: https://doi.org/10.1177/175045891602600602
Haller G, Garnerin P, Morales MA, Pfister R, Berner M, Irion O, Clergue F, Kern C. Effect of crew resource management training in a multidisciplinary obstetrical setting. International J Qual Health Care. 2008;20(4):254-63. DOI: https://doi.org/10.1093/intqhc/mzn018
Hamilton N, Freeman BD, Woodhouse J, Ridley C, Murray D, Klingensmith ME. Team behavior during trauma resuscitation: a simulation-based performance assessment. J Grad Med Edu. 2009;1(2):253-9. DOI: https://doi.org/10.4300/JGME-D-09-00046.1
Yule S. and Paterson-Brown, S. Surgeons Non-technical skills. Surg Clin North Am. 2012;92:37-50. DOI: https://doi.org/10.1016/j.suc.2011.11.004
Neily J, Mills PD, Young-Xu Y, Carney BT, West P, Berger DH, et al. Association between implementation of a medical team training program and surgical mortality. JAMA. 2010;304(15):1693-700. DOI: https://doi.org/10.1001/jama.2010.1506
Andersen PO, Jensen MK, Lippert A, Østergaard D. Identifying non-technical skills and barriers for improvement of teamwork in cardiac arrest teams. Resuscitation. 2010;81(6):695-702. DOI: https://doi.org/10.1016/j.resuscitation.2010.01.024
Gjeraa K, Spanager L, Konge L, Petersen RH, Østergaard D. Non-technical skills in minimally invasive surgery teams: a systematic review. Surgical Endosc. 2016;30(12):5185-99. DOI: https://doi.org/10.1007/s00464-016-4890-1
Cooper SJ, Cant RP. Measuring non-technical skills of medical emergency teams: an update on the validity and reliability of the Team Emergency Assessment Measure (TEAM). Resuscitation. 2014;85(1):31-3. DOI: https://doi.org/10.1016/j.resuscitation.2013.08.276
Flin R, Maran N. Identifying and training non-technical skills for teams in acute medicine. BMJ Quality & Safety. 2004;13(1):80-4. DOI: https://doi.org/10.1136/qshc.2004.009993
Flin R, Patey R. Improving patient safety through training in non-technical skills. BMJ. 2009;23:339. DOI: https://doi.org/10.1136/bmj.b3595
O'Dea A, O'Connor P, Keogh I. A meta-analysis of the effectiveness of crew resource management training in acute care domains. Postgraduate medical journal. 2014;90(1070):699-708. DOI: https://doi.org/10.1136/postgradmedj-2014-132800
Frank JR. The CanMEDS 2005 physician competency framework: better standards, better physicians, better care. 2005.
Pugh D, Hamstra SJ, Wood TJ, Humphrey-Murto S, Touchie C, Yudkowsky R, et al. A procedural skills OSCE: assessing technical and non-technical skills of internal medicine residents. Advances in Health Sciences Education. 2015 Mar;20(1):85-100.Riem N, Boet S, Bould MD, Tavares W, Naik VN. Do technical skills correlate with non-technical skills in crisis resource management: a simulation study. British J Anaesth. 2012;109(5):723-8. DOI: https://doi.org/10.1007/s10459-014-9512-x
Salas E, Diaz Granados D, Weaver SJ, King H. Does team training work. Principles for health care. Acad Emerg Med. 2008;15:1002–9. DOI: https://doi.org/10.1111/j.1553-2712.2008.00254.x
Kemper PF, Noord I, de Bruijne M, Knol DL, Wagner C, van Dyck C. Development and reliability of the explicit professional oral communication observation tool to quantify the use of non-technical skills in healthcare. BMJ Qual Saf. 2013;22(7):586-95. DOI: https://doi.org/10.1136/bmjqs-2012-001451
Xiao Y, Hunter WA, Mackenzie CF. Task complexity in emergency medical care and its implications for team coordination. LOTAS group: level one trauma anesthesia simulation. Human Factors. 1996;38:636–45. DOI: https://doi.org/10.1518/001872096778827206
Charlesworth M, Pandit JJ. Rational performance metrics for operating theatres, principles of efficiency, and how to achieve it. J Brit Surg. 2020;107(2):63-9. DOI: https://doi.org/10.1002/bjs.11396
Yule S, Rowley D, Flin R, Maran N, Youngson G, Duncan J, Paterson‐Brown S. Experience matters: comparing novice and expert ratings of non‐technical skills using the NOTSS system. ANZ J Surg. 2009;79(3):154-60. DOI: https://doi.org/10.1111/j.1445-2197.2008.04833.x
Undre S, Sevdalis N, Healey AN, Darzi SA, Vincent CA. Teamwork in the operating theatre: cohesion or confusion. J Eval Clin Pract. 2006;12(2):182-9. DOI: https://doi.org/10.1111/j.1365-2753.2006.00614.x
Leong KBMSL, Hanskamp-Sebregts M, van der Wal RA, Wolff AP. Effects of perioperative briefing and debriefing on patient safety: a prospective intervention study. BMJ Open. 2017;7(12):18367. DOI: https://doi.org/10.1136/bmjopen-2017-018367
Walker CA, McGregor L, Taylor C, Robinson S. STOP5: a hot debrief model for resuscitation cases in the emergency department. Clin Exp Emerg Med. 2020;7(4):259-66. DOI: https://doi.org/10.15441/ceem.19.086
Overton A, Lowry A. Conflict management: difficult conversations with difficult people. Clin Colon Rectal Surg. 2013;26:259–64. DOI: https://doi.org/10.1055/s-0033-1356728
Flin R, O'Connor P. Safety at the sharp end: a guide to non-technical skills. CRC Press. 2017. DOI: https://doi.org/10.1201/9781315607467
Malec JF, Torsher LC, Dunn WF, Wiegmann DA, Arnold JJ, Brown DA, et al. The mayo high performance teamwork scale: reliability and validity for evaluating key crew resource management skills. Simulation Healthcare. 2007;2(1):4-10. DOI: https://doi.org/10.1097/SIH.0b013e31802b68ee
McCarney R, Warner J, Iliffe S, Van Haselen R, Griffin M, Fisher P. The Hawthorne Effect: a randomised, controlled trial. BMC Medical Res Methodol. 2007;7(1):30. DOI: https://doi.org/10.1186/1471-2288-7-30
Morey JC, Simon R, Jay GD, Wears RL, Salisbury M, Dukes KA, et al. Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project. Health Serv Res. 2002;37(6):1553-81. DOI: https://doi.org/10.1111/1475-6773.01104
Kathirgamanathan A, Woods L. Educational tools in the assessment of trainees in anaesthesia. Continuing Education in Anaesthesia, Critical Care Pain. 2011;11(4):138-42. DOI: https://doi.org/10.1093/bjaceaccp/mkr017
Mishra A, Catchpole K, McCulloch P. The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre. BMJ Quality Safety. 2009;18(2):104-8. DOI: https://doi.org/10.1136/qshc.2007.024760
Arora S, Miskovic D, Hull L, Moorthy K, Aggarwal R, Johannsson H, et al. Self vs expert assessment of technical and non-technical skills in high fidelity simulation. American J Surg. 2011;202(4):500-6. DOI: https://doi.org/10.1016/j.amjsurg.2011.01.024
Crossingham GV, Sice PJ, Roberts MJ, Lam WH, Gale TC. Development of workplace‐based assessments of non‐technical skills in anaesthesia. Anaesthesia. 2012;67(2):158-64. DOI: https://doi.org/10.1111/j.1365-2044.2011.06977.x
Rabøl LI, Østergaard D, Mogensen T. Outcomes of classroom-based team training interventions for multiprofessional hospital staff. A systematic review. Qual Safety Health Care. 2010;19(6):27. DOI: https://doi.org/10.1136/qshc.2009.037184
Kyrkjebø JM, Brattebø G, Smith-Strøm H. Improving patient safety by using interprofessional simulation training in health professional education. J Interprof Care. 2006;20(5):507-16. DOI: https://doi.org/10.1080/13561820600918200
Moorthy K, Munz Y, Adams S, Pandey V, Darzi A. A human factors analysis of technical and team skills among surgical trainees during procedural simulations in a simulated operating theatre. Ann Surg. 2005;242(5):631-9. DOI: https://doi.org/10.1097/01.sla.0000186298.79308.a8
Tibble H, Broughton N, Studdert D et al. Why do surgeons receive more complaints than their physician peers? ANZ J Surg. 2018;88:269–73. DOI: https://doi.org/10.1111/ans.14225
Abouleish, A.E. The struggling resident: avoiding Pygmalion and learned helplessness by using nontechnical performance assessment systems. Anesthesiology, 2010;112(5):1067-9. DOI: https://doi.org/10.1097/ALN.0b013e3181d403bf
Mazzocco K, Petitti DB, Fong KT, et al. Surgical team behaviors and patient outcomes. Am J Surg. 2009;197(5):678–85. DOI: https://doi.org/10.1016/j.amjsurg.2008.03.002