Non-technical skills for urological surgeons (NoTSUS): development and evaluation of curriculum and assessment scale.

OBJECTIVE: In the last decade non-technical skills (NTS) have emerged as a vital area for improvement within surgery. This study aims to develop and evaluate a Non-technical Skills for Urological Surgeons (NoTSUS) training curriculum and assessment scale. METHODS: This international, longitudinal and observational study began with a 3-round Delphi methodology to refine curriculum contents and rating scale. Sessions with up to four participants were delivered where each candidate undertook an independent scenario within the validated full immersion simulation environment. Candidates were assessed using both the NoTSS (Non-technical Skills for Surgeons) and NoTSUS rating scales by NTS-trained and non-trained experts. A post-training evaluation survey was distributed. RESULTS: 62 participants comprising trainees (n = 43) and specialists (n = 19) undertook the NoTSUS course. The NoTSS and NoTSUS scales correlated well, with a mean difference of 3.3 in the overall total (p = 0.10, r = 0.53). However, there was significant differences in scores between the NoTSS-trained and non-trained raters (n = 28, p = 0.03). A one-way ANOVA test revealed significant improvement throughout the four simulation scenarios in each session (p = 0.02). The NoTSUS curriculum received positive feedback from participants and demonstrated educational value and acceptability. CONCLUSIONS: The NoTSUS curriculum has demonstrated high educational value for NTS training aimed at urologists, with marked improvement throughout sessions. Correlation of NoTSUS and NoTSS scales proves its suitability for evaluating NTS in future training. Demonstration of inter-rater reliability indicates that the scale is reliable for use in assessment by expert faculty members. Furthermore, qualitative feedback from participants suggests gain of transferrable skills over the course.

Incidence of Wrong-Site Surgery List Errors for a 2-Year Period in a Single National Health Service Board.

INTRODUCTION: Wrong-site/side surgical "never events" continue to cause considerable harm to patients, healthcare professionals, and organizations within the United Kingdom. Incidence has remained static despite the mandatory introduction of surgical checklists. Operating theater list errors have been identified as a regular contributor to these never events. The aims of the study were to identify and to learn from the incidence of wrong-site/side list errors in a single National Health Service board. METHODS: The study was conducted in a single National Health Service board serving a population of approximately 300,000. All theater teams systematically recorded errors identified at the morning theater brief or checklist pause as part of a board-wide quality improvement project. Data were reviewed for a 2-year period from May 2013 to April 2015, and all episodes of wrong-site/side list errors were identified for analysis. RESULTS: No episodes of wrong-site/side surgery were recorded for the study period. A total of 86 wrong-site/side list errors were identified in 29,480 cases (0.29%). There was considerable variation in incidence between surgical specialties with ophthalmology recording the largest proportion of errors per number of surgical cases performed (1 in 87 cases) and gynecology recording the smallest proportion (1 in 2671 cases). The commonest errors to occur were "wrong-side" list errors (62/86, 72.1%). DISCUSSION: This is the first study to identify incidence of wrong-site/site list errors in the United Kingdom. Reducing list errors should form part of a wider risk reduction strategy to reduce wrong-site/side never events. Human factors barrier management analysis may help identify the most effective checks and controls to reduce list errors incidence, whereas resilience engineering approaches should help develop understanding of how to best capture and neutralize errors.

Simulation in urology to train non-technical skills in ward rounds.

OBJECTIVE: To report our experience of an exercise designed to train newly appointed urology trainees in non-technical skills on ward rounds as a part of a simulation 'boot camp', through a qualitative analysis of participant feedback on the utility of this method of training. PATIENTS AND METHODS: The simulations took place in a high-fidelity simulated ward bay. Forty-eight doctors with formal urology training ranging between 2 and 60 months (mean 19.1 ± 11.6 months) took part. Thirty-one participants were on a formal urology specialty training pathway. The remaining participants were core (pre-specialty) surgical trainees. The entry requirement was that participants must be junior-level urologists, ideally at the beginning of specialty training. Participants individually led a simulated ward round, which was devised using actors to play patients and a simulated 'switchboard' for telephone conversations. Distractions were introduced deliberately for participants to manage an emergent urology-related scenario. 'Freeze-frames' were used to 'pause' the ward round, whereby observing consultants provided feedback on performance. After the simulated exercises, a whole-group structured debriefing took place. Non-Technical Skills for Surgeons (NOTSS) scores were generated for participants by seven consultant urologists. Participants completed a two-part feedback form. Part one involved nine questions scored on a Likert scale, and part two required free-text responses. RESULTS: The mean (±sd) itemized NOTSS scores for situational awareness, decision-making, communication and teamwork, and leadership were 3.01 (±0.15), 2.95 (±0.16), 3.05 (±0.19), and 2.98 (±0.15), respectively. From the thematic analysis, participants commented positively on the number of scenarios per participant, the use of actors as patients and real staff, and the use of freeze-frames for immediate feedback. Residents also provided suggestions for distractions to be considered in the future. CONCLUSIONS: This simulated ward round was generally well received by participants, and the obtained feedback provides an insight into how this can be adapted to maximize the benefits for new specialty residents. The mean NOTSS scores indicated that non-technical skills performances could be improved. This supports our rationale to train non-technical skills in a safe environment to bolster career transition into positions of greater decision-making autonomy.

Cognitive training for technical and non-technical skills in robotic surgery: a randomised controlled trial.

OBJECTIVE: To investigate the effectiveness of motor imagery (MI) for technical skill and non-technical skill (NTS) training in minimally invasive surgery (MIS). SUBJECTS AND METHODS: A single-blind, parallel-group randomised controlled trial was conducted at the Vattikuti Institute of Robotic Surgery, King's College London. Novice surgeons were recruited by open invitation in 2015. After basic robotic skills training, participants underwent simple randomisation to either MI training or standard training. All participants completed a robotic urethrovesical anastomosis task within a simulated operating room. In addition to the technical task, participants were required to manage three scripted NTS scenarios. Assessment was performed by five blinded expert surgeons and a NTS expert using validated tools for evaluating technical skills [Global Evaluative Assessment of Robotic Skills (GEARS)] and NTS [Non-Technical Skills for Surgeons (NOTSS)]. Quality of MI was assessed using a revised Movement Imagery Questionnaire (MIQ). RESULTS: In all, 33 participants underwent MI training and 29 underwent standard training. Interrater reliability was high, Krippendorff's α = 0.85. After MI training, the mean (sd) GEARS score was significantly higher than after standard training, at 13.1 (3.25) vs 11.4 (2.97) (P = 0.03). There was no difference in mean NOTSS scores, at 25.8 vs 26.4 (P = 0.77). MI training was successful with significantly higher imagery scores than standard training (mean MIQ score 5.1 vs 4.5, P = 0.04). CONCLUSIONS: Motor imagery is an effective training tool for improving technical skill in MIS even in novice participants. No beneficial effect for NTS was found.

General surgery education across three continents.

Surgical education has seen tremendous changes in the US over the past decade. The Halstedian training model of see one, do one, teach one that governed surgical training for almost 100 years has been replaced by the achievement of the ACGME competencies, milestones, entrustable professional activities (EPAs), and acquisition of surgical skill outside the operating room on simulators. Several of these changes in American medical education have been influenced by educators and training paradigms abroad. In this paper, we review the training paradigms for surgeons in the UK, Japan, and Mexico to allow comparisons with the US training paradigm and promote the exchange of ideas.

Outcomes of Ureterorenoscopic Stone Treatment in 301 Patients with a Solitary Kidney.

Objectives: To determine the stone-free rates and intra- and postoperative complication rates and grades of ureterorenoscopic stone treatment in patients with a solitary kidney. Methods: This study is a subanalysis of the Clinical Research Office of the Endourological Society (CROES) ureterorenoscopy (URS) study, which is a prospective international multicenter observational study. Over a 1-year period, consecutive patients treated with ureterorenoscopy for urinary stones were included. Patients entered in this analysis were those with a solitary functioning kidney. Descriptive data on patient characteristics, stone-free rates, complication rates, and grades were evaluated for three separate groups: patients treated with ureteroscopy for ureteral stones, for renal stones, and a combination of renal and ureteral stones. Results: A total of 301 patients were treated for stones in a solitary kidney; 219 were treated for ureteral stones. In this group, the stone-free rate was 88.6%, with an intraoperative complication rate of 7.4% and postoperative complication rate of 4.1%. Totally, 57 patients were treated for renal stones. In this group, the stone-free rate was 56.4%, with an intraoperative complication rate of 7.0% and postoperative complication rate of 10.5%. There were 25 patients who were treated for renal stones in combination with ureter stones. In this group, the stone-free rate was 60.0%, with an intraoperative complication rate of 12.0% and postoperative complication rate of 10.5%. Within the three groups, 72% of the postoperative complications were classified as Clavien I and II. Conclusions: Ureteroscopy is an effective and safe treatment modality for the removal of ureteral and renal stones in patients with a solitary kidney. Stone location as well as total stone burden seems to be important factors influencing the ability to render patients stone free. Moreover, single session ureteroscopic stone removal was less effective for the treatment of larger renal stones or renal stones in combination with ureteral stones.

Development and validation of a tool for non-technical skills evaluation in robotic surgery-the ICARS system.

BACKGROUND: Non-technical skills (NTS) are being increasingly recognised as vital for safe surgical practice. Numerous NTS rating systems have been developed to support effective training and assessment. Yet despite the additional challenges posed by robotic surgery, no NTS rating systems have been developed for this unique surgical environment. This study reports the development and validation of the first NTS behavioural rating system for robotic surgery. METHODS: A comprehensive index of all relevant NTS behaviours in robotic surgery was developed through observation of robotic theatre and interviews with robotic surgeons. Using a Delphi methodology, a panel of 16 expert surgeons was consulted to identify behaviours important to NTS assessment. These behaviours were organised into an appropriate assessment template. Experts were consulted on the feasibility, applicability and educational impact of ICARS. An observational trial was used to validate ICARS. 73 novice, intermediate and expert robotic surgeons completed a urethrovesical anastomosis within a simulated operating room. NTS were tested using four scripted scenarios of increasing difficulty. Performances were video recorded. Robotic and NTS experts assessed the videos post hoc using ICARS and the standard behavioural rating system, NOn-Technical Skills for Surgeons (NOTSS). RESULTS: 28 key non-technical behaviours were identified by the expert panel. The finalised behavioural rating system was organised into four principle domains and seven categories. Expert opinion strongly supported its implementation. ICARS was found to be equivalent to NOTSS on Bland-Altman analysis and accurately differentiated between novice, intermediate and expert participants, p = 0.01. Moderate agreement was found between raters, Krippendorff's alpha = 0.4. The internal structure of ICARS was shown to be consistent and reliable (median Cronbach alpha = 0.92, range 0.85-0.94). CONCLUSION: ICARS is the first NTS behavioural rating system developed for robotic surgery. Initial validation has shown it to be an effective and reliable tool. Implementation of ICARS will supported structured training and assessment of NTS within the robotic surgical curriculum.

Training Tools for Nontechnical Skills for Surgeons-A Systematic Review.

OBJECTIVE: Development of nontechnical skills for surgeons has been recognized as an important factor in surgical care. Training tools for this specific domain are being created and validated to maximize the surgeon's nontechnical ability. This systematic review aims to outline, address, and recommend these training tools. DESIGN: A full and comprehensive literature search, using a systematic format, was performed on ScienceDirect and PubMed, with data extraction occurring in line with specified inclusion criteria. SETTING: Systematic review was performed fully at King's College London. RESULTS: A total of 84 heterogeneous articles were used in this review. Further, 23 training tools including scoring systems, training programs, and mixtures of the two for a range of specialities were identified in the literature. Most can be applied to surgery overall, although some tools target specific specialities (such as neurosurgery). Interrater reliability, construct, content, and face validation statuses were variable according to the specific tool in question. CONCLUSIONS: Study results pertaining to nontechnical skill training tools have thus far been universally positive, but further studies are required for those more recently developed and less extensively used tools. Recommendations can be made for individual training tools based on their level of validation and for their target audience. Based on the number of studies performed and their status of validity, NOTSS and Oxford NOTECHS II can be considered the gold standard for individual- and team-based nontechnical skills training, respectively, especially when used in conjunction with a training program.

Analysis of Factors' Association with Risk of Postoperative Urosepsis in Patients Undergoing Ureteroscopy for Treatment of Stone Disease.

INTRODUCTION: To investigate which patient, stone, infective, and surgical factors were most likely to increase the risk of postoperative urosepsis within 28 days of ureteroscopy (URS) and laser stone fragmentation for ureteral or renal stones. METHODS: Data were collected prospectively in a single National Health Service institution. A logistic regression model was used to assess the association of factors with postoperative urosepsis. Two matched-pair analyses were used to assess the risk of postoperative urosepsis in patients with (a) an emergency presentation to hospital with urosepsis in the 90 days preceding URS and (b) a positive midstream sample of urine (MSSU) identified, but who were asymptomatic at preoperative assessment, who then received an appropriate course of antibiotics. RESULTS: Four hundred sixty-two consecutive patients were included in the study. Thirty-four patients (7.4%) had an episode of urosepsis within 28 days of their operation. A positive preoperative MSSU was significantly associated with postoperative urosepsis on multivariable analysis, despite appropriate treatment with a preoperative course of antibiotics: odds ratio (OR) 4.88, 95% confidence interval (CI) 2.11, 11.31, p < 0.001. The presence of diabetes mellitus, presence of ischemic heart disease, patient American Society of Anesthesiologists score, same-session bilateral URS, and stone volume were the other variables significantly associated with postoperative infection on univariable analysis, but these ceased to be significantly associated on multivariable analysis. Subgroup analysis found that a positive MSSU in both patients with a preoperative ureteral stent and those without was significantly associated with postoperative urosepsis, however, the OR was much lower for the stented group (OR 3.23 vs OR 16.67). On matched-pair analysis, patients with a positive preoperative MSSU were significantly more likely to have postoperative urosepsis compared to controls (OR 17.46, 95% CI 2.18, 139.80, p = 0.007). There was no significant difference in the OR of postoperative urosepsis in patients who had a preceding urine infection requiring hospital admission in the 90 days preceding URS (OR 0.60, 95% CI 0.19, 1.92, p = 0.39). CONCLUSIONS: Positive preoperative MSSU was significantly associated with postoperative urosepsis by logistic regression and matched-pair analysis. These higher risk patients should be counseled appropriately before surgery, and should be the focus of vigilant postoperative monitoring. The study suggests particular caution in patients with a positive preoperative MSSU without a preoperative ureteral stent.

The Relationship Between Technical And Nontechnical Skills Within A Simulation-Based Ureteroscopy Training Environment.

OBJECTIVE: Little integration of technical and nontechnical skills (e.g., situational awareness, communication, decision making, teamwork, and leadership) teaching exists within surgery. We therefore aimed to (1) evaluate the relationship between these 2 skill sets within a simulation-based environment and (2) assess if certain nontechnical skill components are of particular relevance to technical performance. DESIGN: A prospective analysis of data acquired from a comparative study of simulation vs nonsimulation training was conducted. Half of the participants underwent training of technical and nontechnical skills within ureteroscopy, with the remaining half undergoing no training. All were assessed within a full immersion environment against both technical (time to completion, Objective Structured Assessment of Technical Skills, and task-specific checklist scores) and nontechnical parameters (Nontechnical Skills for Surgeons [NOTSS] rating scale). The data of whole and individual cohorts were analyzed using Pearson correlation coefficient. SETTING: The trial took place within the Simulation and Interactive Learning Centre at Guy's Hospital, London, UK. PARTICIPANTS: In total, 32 novice participants with no prior practical ureteroscopy experience were included within the data analysis. RESULTS: A correlation was found within all outcome measures analyzed. For the whole cohort, a strong negative correlation was found between time to completion and NOTSS scores (r = -0.75, p < 0.001), with strong positive correlations identified when NOTSS scores were compared with Objective Structured Assessment of Technical Skills (r = 0.89, p < 0.001) and task-specific checklist scores (r = 0.91, p < 0.001). Similar results were observed when each cohort was analyzed separately. Finally, all individual nontechnical skill components demonstrated a strong correlation with all technical skill parameters, regardless of training. CONCLUSIONS: A strong correlation between technical and nontechnical performance exists, which was demonstrated to be irrespective of training received. This may suggest an inherent link between skill sets. Furthermore, all nontechnical skill sets are important in technical performance. This supports the notion that both of these skills should be trained and assessed together within 1 curriculum.

Simulation-based ureteroscopy skills training curriculum with integration of technical and non-technical skills: a randomised controlled trial.

BACKGROUND: Current training modalities within ureteroscopy have been extensively validated and must now be integrated within a comprehensive curriculum. Additionally, non-technical skills often cause surgical error and little research has been conducted to combine this with technical skills teaching. This study therefore aimed to develop and validate a curriculum for semi-rigid ureteroscopy, integrating both technical and non-technical skills teaching within the programme. METHODS: Delphi methodology was utilised for curriculum development and content validation, with a randomised trial then conducted (n = 32) for curriculum evaluation. The developed curriculum consisted of four modules; initially developing basic technical skills and subsequently integrating non-technical skills teaching. Sixteen participants underwent the simulation-based curriculum and were subsequently assessed, together with the control cohort (n = 16) within a full immersion environment. Both technical (Time to completion, OSATS and a task specific checklist) and non-technical (NOTSS) outcome measures were recorded with parametric and non-parametric analyses used depending on the distribution of our data as evaluated by a Shapiro-Wilk test. RESULTS: Improvements within the intervention cohort demonstrated educational value across all technical and non-technical parameters recorded, including time to completion (p < 0.01), OSATS scores (p < 0.001), task specific checklist scores (p = 0.011) and NOTSS scores (p < 0.001). Content validity, feasibility and acceptability were all demonstrated through curriculum development and post-study questionnaire results. CONCLUSIONS: The current developed curriculum demonstrates that integrating both technical and non-technical skills teaching is both educationally valuable and feasible. Additionally, the curriculum offers a validated simulation-based training modality within ureteroscopy and a framework for the development of other simulation-based programmes.

Contralateral renal cell carcinoma ureteric metastases can arise on tyrosine kinase adjuvant therapy and be effectively treated by endoscopic laser excision and ablation.

Renal cell carcinoma (RCC) uncommonly metastasizes to the ureter and rarely to the contralateral ureter. We describe the presentation of 2 successive contralateral ureteric metastases from RCC in our institution. The first represents the only reported metachronous ureteric deposit on adjuvant sorafenib after laparoscopic radical nephrectomy for RCC. The other presented with a synchronous lesion after radiological work-up. Both lesions were treated with endoscopic excision and laser ablation with preservation of the renal unit and no local recurrence. We report these cases and discuss the literature.

Examining patient safety attitudes among urology trainees.

OBJECTIVES: To identify current attitudes to patient safety among urology trainees. To examine whether these have changed with the recent increase in emphasis on patient safety and the introduction of new working procedures in operating theatres. SUBJECTS AND METHODS: Subjects included 28 urology trainees, based in the West of Scotland, UK. Trainee attitudes were examined using the Operating Room Management Attitudes Questionnaire, a validated tool for examining attitudes towards patient safety. RESULTS: Attitudes to teamwork were highly positive, with 89-100% of trainees acknowledging the need to share information and conduct pre- and postoperative briefs, and 82-96% being accepting of multidisciplinary feedback on performance. Attitudes to preoperative briefing and multidisciplinary feedback were improved compared with a similar historical cohort. Trainees were reluctant to acknowledge the effect of stress and fatigue on personal performance; 50% felt they worked effectively in critical phases of operations even when tired, only 50% would tell team members their workload was becoming excessive and only 36% of trainees recognized that personal problems could affect their performance. There was no significant change in these attitudes from 2006 data. Regarding leadership and confidence assertion, 68% of trainees felt that leadership in the operating theatre should rest with the medical staff, 18% stated senior decisions or actions should not be questioned unless they threaten safety and 7% that they should not be questioned at all. This was similar to previous data. CONCLUSIONS: Attitudes to briefing and multidisciplinary feedback appear to have improved since the introduction of the World Health Organization surgical checklist and wider use of feedback tools; other safety attitudes remain largely unchanged. Urology trainees may benefit from further training to better understand the mechanisms of error development, to raise awareness of human performance limitation, particularly the effects of stress and fatigue, and to develop techniques to challenge decisions/respond to challenges.