Identifying the relationship between postoperative urinary continence and residual urethra stump measurements in robot assisted radical prostatectomy patients.

OBJECTIVE: To investigate the feasibility of urethral stump length and width measurements in recorded videos of robot assisted radical prostatectomy procedures using the Kinovea software and to assess if these measurements could be used as predictors of postoperative urinary continence. METHODS: Fifty-three patients were selected from an institutional database of 1400 cases and included in the study. All videos were analysed using the computer software 'Kinovea'. All measurements were performed using the inserted bladder catheter as a reference point. RESULTS: The reference point (bladder catheter) was available in 33 out of 53 patients. The median surgical urethral length (SUL) was significantly higher in the continent group (1050 vs. 1294 mm, p = 0.018). The urethral width measurements did not show a difference between the groups. In order to validate the Kinovea software as an accurate tool for the measurement of the urethral stump length and width results were correlated with the magnetic resonance imaging measurements of the urethra. CONCLUSIONS: The results of this study showed a significantly longer median SUL incontinent patients.

Analysis of the video motion tracking system "Kinovea" to assess surgical movements during robot-assisted radical prostatectomy.

BACKGROUNDS: Robot-assisted surgery facilitated the possibility to evaluate the surgeon's skills by recording and evaluating the robot surgical images. The aim of this study was to investigate the possibility of using a computer programme (Kinovea) for objective assessment of surgical movements in previously recorded in existing robot-assisted radical prostatectomy (RARP) videos. METHODS: Twelve entire RARP procedures were analysed by a trained researcher using the computer programme "Kinovea" to perform semi-automated assessment of surgical movements. RESULTS: Data analysis showed Kinovea was on average able to automatically assess only 22% of the total surgical duration per video of the robot-assisted surgery. On average, it lasted 4 hours of continued monitoring by the researcher to assess one RARP using Kinovea. CONCLUSION: Although we proved it is technically possible to use the Kinovea system in retrospective analysis of surgical movement in robot-assisted surgery, the acquired data do not give a comprehensive enough analysis of the video to be used in skills assessment.

A Prospective, Observational, Multicentre Study Concerning Nontechnical Skills in Robot-assisted Radical Cystectomy Versus Open Radical Cystectomy.

INTRODUCTION AND HYPOTHESES: valuation of surgical skills, both technical and nontechnical, is possible through observations and video analysis. Besides technical failures, adverse outcomes in surgery can also be related to hampered communication, moderate teamwork, lack of leadership, and loss of situational awareness. Even though some surgeons are convinced about nontechnical skills being an important part of their professionalisation, there is paucity of data about a possible relationship between nontechnical skills and surgical outcome. In robot-assisted surgery, the surgeon sits behind the console and is at a remote position from the surgical field and team, making communication more important than in open surgery and conventional laparoscopy. A lack of structured research makes it difficult to assess the value of the different analysis methods for nontechnical skills, particularly in robot-assisted surgery. Our hypothesis includes the following: (1) introduction of robot-assisted surgery leads to an initial decay in nontechnical skills behaviour during the learning curve of the team, (2) nontechnical skills behaviour is more explicitly expressed in experienced robot-assisted surgery teams than in experienced open surgery teams, and (3) introduction of robot-assisted surgery leads to the development of different forms of nontechnical skills behaviour compared with open surgery. DESIGN: This study is a prospective, observational, multicentre, nonrandomised, case-control study including bladder cancer patients undergoing either an open radical cystectomy or a robot-assisted radical cystectomy at the Catharina Hospital Eindhoven, the Netherlands, or at the Netherlands Cancer Institute, Antoni van Leeuwenhoek Hospital Amsterdam. All patients are eligible for inclusion; there are no exclusion criteria. The Catharina Hospital Eindhoven, the Netherlands, performs on average 35 radical cystectomies a year. The Netherlands Cancer Institute, Antoni van Leeuwenhoek Hospital Amsterdam, performs on average 100 radical cystectomies a year. PROTOCOL OVERVIEW: The choice of treatment is at the discretion of the patient and the surgeon. Patient results will be obtained prospectively. Pathology results as well as complications occurring within 90 d following surgery will be registered. Surgical complications will be registered according to the Clavien-Dindo system. MEASUREMENTS: Nontechnical skills will be observed using five different methods: (1) NOTSS: Nontechnical Skills for Surgeons; (2) Oxford NOTECHS II: a modified theatre team nontechnical skills scoring system; (3) OTAS: Observational Teamwork Assessment for Surgery; (4) Interpersonal and Cognitive Assessment for Robotic Surgery (ICARS): evaluation of nontechnical skills in robotic surgery; and (5) analysis of human factors. Technical skills in robot-assisted radical cystectomy will be analysed using two different methods: (1) GEARS: Global Evaluative Assessment of Robotic Skill and (2) GERT: Generic Error Rating Tool. SAFETY CRITERIA AND REPORTING: Formal ethical approval has been provided by Medical research Ethics Committees United (MEC-U), The Netherlands (reference number W19.048). We hope to present the results of this study to the scientific community at conferences and in peer-reviewed journals. STATISTICAL ANALYSIS: Frequency statistics will be calculated for patient demographical data, and a Shapiro-Wilk test with p > 0.05 will be used to define normal distribution. Univariate analysis will be conducted to test for statistically significant differences in observation scores between open radical cystectomy and robot-assisted radical cystectomy cohorts across all variables, using independent sample t tests and Mann-Whitney U testing, as appropriate. A variable-selection strategy will be used to create multivariate models. Binary logistic regression will be conducted to calculate odds ratios and 95% confidence intervals for significant predictors on univariate analysis and clinically relevant covariates. Statistical significance is set at p < 0.05 based on a two-tailed comparison. SUMMARY: This study uses a structured approach to the analysis of nontechnical skills using extracorporeal videos of both open radical cystectomy and robot-assisted radical cystectomy surgeries, in order to obtain detailed data on nontechnical skills during open and minimally invasive surgeries. The results of this study could possibly be used to develop team-training programmes, specifically for the introduction of the surgical robot in relation to changes in nontechnical skills. Additional analysis of technical skills using the intracorporeal footage of the surgical robot will be used to elucidate the role of surgical skills and surgical events in nontechnical skills.

Development and validation of the TOCO-TURBT tool: a summative assessment tool that measures surgical competency in transurethral resection of bladder tumour.

BACKGROUND: The current shift towards competency-based residency training has increased the need for objective assessment of skills. In this study, we developed and validated an assessment tool that measures technical and non-technical competency in transurethral resection of bladder tumour (TURBT). METHODS: The 'Test Objective Competency' (TOCO)-TURBT tool was designed by means of cognitive task analysis (CTA), which included expert consensus. The tool consists of 51 items, divided into 3 phases: preparatory (n = 15), procedural (n = 21), and completion (n = 15). For validation of the TOCO-TURBT tool, 2 TURBT procedures were performed and videotaped by 25 urologists and 51 residents in a simulated setting. The participants' degree of competence was assessed by a panel of eight independent expert urologists using the TOCO-TURBT tool. Each procedure was assessed by two raters. Feasibility, acceptability and content validity were evaluated by means of a quantitative cross-sectional survey. Regression analyses were performed to assess the strength of the relation between experience and test scores (construct validity). Reliability was analysed by generalizability theory. RESULTS: The majority of assessors and urologists indicated the TOCO-TURBT tool to be a valid assessment of competency and would support the implementation of the TOCO-TURBT assessment as a certification method for residents. Construct validity was clearly established for all outcome measures of the procedural phase (all r > 0.5, p < 0.01). Generalizability-theory analysis showed high reliability (coefficient Phi ≥ 0.8) when using the format of two assessors and two cases. CONCLUSIONS: This study provides first evidence that the TOCO-TURBT tool is a feasible, valid and reliable assessment tool for measuring competency in TURBT. The tool has the potential to be used for future certification of competencies for residents and urologists. The methodology of CTA might be valuable in the development of assessment tools in other areas of clinical practice.

The Simbla TURBT Simulator in Urological Residency Training: From Needs Analysis to Validation.

OBJECTIVE: To investigate the value of the physical Simbla Transurethral Resection of a Bladder Tumor (TURBT) simulator as an educational tool within urological residency training, by means of a training needs analysis (TNA) and assessment of its feasibility, acceptability, and face, content, and construct validity. METHODS: To analyze the training needs for TURBT, procedural steps and pitfalls were identified and the TNA was completed during an expert consensus meeting. Participants (n = 76) were divided into three groups based on their experience in TURBT: novices, intermediates, and experts. Participants performed two standardized TURBT procedures on the simulator. Face validity and content validity, as well as feasibility and acceptability, were assessed with a quantitative survey. Construct validity was assessed by comparing the performance of novices, intermediates, and experts on resection time, quality of tumor resection, and overall performance. RESULTS: Of the 21 procedural steps and 17 pitfalls defined in TNA, 13 steps and 8 pitfalls were covered by the Simbla. Participants rated the Simbla's overall realism (face validity) with a score of 8 of 10 (range 6-9). The simulator was judged to be most useful (content validity) for learning eye-hand coordination: score 8 (6-10). All aspects regarding realism and usefulness were rated above the acceptability threshold of 6/10. Intermediates (100%) and experts (96%) considered the Simbla to be a useful educational tool within the urological curriculum. Resection time was longer for novices than for experts (p < 0.05; construct validity). In addition, the overall performance of novices was rated lower compared with intermediates and experts, and novices showed more irradical resections and bladder perforations (all p < 0.05). CONCLUSIONS: The Simbla TURBT simulator is a valid, feasible, and acceptable educational tool for training procedural skills and may be implemented in the urological curriculum to complement learning in clinical practice. TNA is valuable in defining training objectives and evaluating the educational value of a simulator.

High acceptability of a newly developed urological practical skills training program.

BACKGROUND: Benefits of simulation training are widely recognized, but its structural implementation into urological curricula remains challenging. This study aims to gain insight into current and ideal urological practical skills training and presents the outline of a newly developed skills training program, including an assessment of the design characteristics that may increase its acceptability. METHODS: A questionnaire was sent to the urology residents (n = 87) and program directors (n = 45) of all Dutch teaching hospitals. Open- and close-ended questions were used to determine the views on current and ideal skills training and the newly developed skills training program. Eight semi-structured interviews were conducted with 39 residents and 15 program directors. All interviews were audiotaped, fully transcribed, and thereafter analyzed. RESULTS: Response was 87.4% for residents and 86.7% for program directors. Residents appeared to be still predominantly trained 'by doing'. Structured practical skills training in local hospitals takes place according to 12% of the residents versus 44% of the program directors (p < 0.001). Ideally, residents prefer to practice certain procedures on simulation models first, especially in endourology. The majority of residents (92%) and program directors (87%) approved of implementing the newly developed skills training program (p = 0.51). 'Structured scheduling', 'use of peer teaching' and 'high fidelity models' were indicated as design characteristics that increase its acceptability. CONCLUSIONS: Current urological residency training consists of patient-related 'learning by doing', although more practice on simulation models is desired. The acceptability of implementing the presented skills-training program is high. Design characteristics that increase its acceptability are structured scheduling, the use of peer teaching and high fidelity models.

Program for laparoscopic urological skills assessment: setting certification standards for residents.

AIM: There is growing pressure from the government and the public to define proficiency standards for surgical skills. Aim of this study was to estimate the reliability of the Program for Laparoscopic Urological Skills (PLUS) assessment and to set a certification standard for second-year urological residents. METHODS: Fifty participants were assessed on performance time and performance quality to investigate the reliability of the PLUS assessment. Generalisability coefficient of 0.8, on a scale of 0 to 1.0, was considered to indicate good reliability for assessment purposes. Pass/fail standards were based on laparoscopic experience: Novices, intermediates, and experts (>100 procedures). The pass/fail standards were investigated for the PLUS performances of 33 second-year urological residents. RESULTS: Fifteen novices, twenty-three intermediates and twelve experts were included. An inter-trial reliability of >0.80 was reached with two trials for each task. Inter-rater reliability of the quality measurements was 0.79 for two judges. Pass/fail scores were determined for the novice/intermediate boundary and the intermediate/expert boundary. Pass rates for second-year residents were 63.64% and 9.09%, respectively. CONCLUSION: The PLUS assessment is reliable for setting a certification standard for second-year urological residents that serves as a starting point for residents to proceed to the next level of laparoscopic competency.

Designing simulator-based training: an approach integrating cognitive task analysis and four-component instructional design.

Most studies of simulator-based surgical skills training have focused on the acquisition of psychomotor skills, but surgical procedures are complex tasks requiring both psychomotor and cognitive skills. As skills training is modelled on expert performance consisting partly of unconscious automatic processes that experts are not always able to explicate, simulator developers should collaborate with educational experts and physicians in developing efficient and effective training programmes. This article presents an approach to designing simulator-based skill training comprising cognitive task analysis integrated with instructional design according to the four-component/instructional design model. This theory-driven approach is illustrated by a description of how it was used in the development of simulator-based training for the nephrostomy procedure.

Program for laparoscopic urologic skills: a newly developed and validated educational program.

OBJECTIVE: To develop and evaluate a program for laparoscopic urologic skills (PLUS) to determine the face, content, and construct validation to achieve uniformity and standardization in training residents in urology. METHODS: The PLUS consists of 5 basic laparoscopic tasks. Three tasks were abstracted from the Fundamentals of Laparoscopic Surgery program, and 2 additional tasks were developed under continuous evaluation by expert urologists. Fifty participants were recruited from different hospitals and performed the final PLUS training. They all completed a questionnaire after performance. Three outcome parameters were measured: performance quality, time, and dropped objects. The relationship between laparoscopic experience and the outcome parameters was investigated. RESULTS: Of the 50 participants, 13 were students, 20 were residents, and 17 were urologists. Double-log linear regression analysis for all 5 tasks showed a significant effect (effect size range 0.53-0.82; P < .0005) for laparoscopic experience on performance time. Substantial correlations were found between experience and quality ratings (log-linear regression effect size 0.37; P = .012) and the number of dropped objects (Spearman correlation effect size 0.49; P < .01). The usefulness of the PLUS model as a training tool for basic laparoscopic skills was rated 4.55 on a scale from 1 (not useful) to 5 (useful) (standard deviation 0.58; range 3-5). CONCLUSION: The results of the present study indicated the face, content, and construct validity for the PLUS. The training is considered appropriate for use as a primary training tool for an entry test or as part of a step-wise training program in which basic and procedural laparoscopic skills are integrated.

Effect of distraction on the performance of endourological tasks: a randomized controlled trial.

OBJECTIVE: • To establish the effect of distraction on the performance of cystoscopy and basic endourological tasks by using a virtual reality (VR) simulator. SUBJECTS AND METHODS: • A total of 86 third-year medical students from Maastricht University, who had no previous experience in performing the tasks on a VR simulator, were randomly assigned to an intervention or control group. • All participants performed three endourological tasks on the VR simulator. Participants in the intervention group were distracted 1 min into the third task. The distraction consisted of being asked to answer questions about a medical case that had been presented to all the participants before the hands-on session. After two adequate verbal responses the conversation was terminated. • Number of traumata, number of missed lesions in the bladder and time to completion were measured by the VR simulator. RESULTS: • Number of traumata and missed lesions, as well as time to completion were significantly higher in the intervention than in the control group with effect sizes (using Cohen's categorization) of 0.48, 0.41 and 0.50 respectively. • Nevertheless, only 9.5% of the participants in the intervention group reported feeling burdened by the distraction. CONCLUSIONS: • Distraction during the performance of endourological skills results in significantly poorer performance by medical students on all the variables measured in a controlled learning environment. • Most students do not realize they are affected by distraction. • Further research is needed to determine the impact of distraction on more experienced participants and on patient safety.

The effect of distractions in the operating room during endourological procedures.

BACKGROUND: Professionals working in the operating room (OR) are subject to various distractions that can be detrimental to their task performance and the quality of their work. This study aimed to quantify the frequency, nature, and effect on performance of (potentially) distracting events occurring during endourological procedures and additionally explored urologists' and residents' perspectives on experienced ill effects due to distracting factors. METHODS: First, observational data were collected prospectively during endourological procedures in one OR of a teaching hospital. A seven-point ordinal scale was used to measure the level of observed interference with the main task of the surgical team. Second, semistructured interviews were conducted with eight urologists and seven urology residents in two hospitals to obtain their perspectives on the impact of distracting factors. RESULTS: Seventy-eight procedures were observed. A median of 20 distracting events occurred per procedure, which corresponds to an overall rate of one distracting event every 1.8 min. Equipment problems and procedure-related and medically irrelevant communication were the most frequently observed causes of interruptions and identified as the most distracting factors in the interviews. Occurrence of distracting factors in difficult situations requiring high levels of concentration was perceived by all interviewees as disturbing and negatively impacting performance. The majority of interviewees (13/15) thought distracting factors impacted more strongly on residents' compared to urologists' performance due to their different levels of experience. CONCLUSION: Distracting events occur frequently in the OR. Equipment problems and communication, the latter both procedure-related and medically irrelevant, have the largest impact on the sterile team and regularly interrupt procedures. Distracting stimuli can influence performance negatively and should therefore be minimized. Further research is required to determine the direct effect of distraction on patient safety.

Analysis of pitfalls encountered by residents in transurethral procedures in master-apprentice type of training.

BACKGROUND AND PURPOSE: Today's simulators are frequently limited in their possibilities to train all aspects of endourological procedures. It is therefore indicated to first make an inventory of training needs before (re)developing simulators. This study examined pitfalls encountered by residents in real-time transurethral procedures. MATERIALS AND METHODS: First, difficulties that residents encounter in transurethral procedures (transurethral resection of the bladder tumor [TURBT], transurethral resection of the prostate [TURP], ureterorenoscopy [URS]) were identified by asking urologists and residents to complete an open questionnaire. Based on their answers a list of pitfalls was designed and tested in 28 pilot observations. Then, two raters (interrater agreement 0.72, 0.70, and 0.75 for TURBT, TURP, and URS, respectively) categorized all observed procedure-related interactions between residents and supervisors in 80 procedures as (1) (type of ) pitfall or (2) no pitfall. RESULTS: Pitfalls most frequently encountered were as follows: (1) planning/anticipation on new situations (median 27.3%, 29.3%, and 31.8% of total pitfalls in TURBT, TURP, and URS, respectively); (2) handling of instruments (11.5%, 10.6%, and 20.0% for TURBT, TURP, and URS); (3) irrigation management for TURBT (7.7%), depth of resection for TURP (8.9%), and use of X-ray for URS (13.3%). CONCLUSION: Designers of endourological simulators should include possibilities to train planning/anticipation on new situations, handling of instruments in all transurethral procedures, and irrigation management in TURBT, depth of resection in TURP, and timing usage of X-ray in URS.

The effect of a low-fidelity model on cystoscopic skill training: a single-blinded randomized controlled trial.

INTRODUCTION: Models for training urological procedures without burdening patients are available at varying costs. We examined the value of training on a low-fidelity model in addition to training on a high-fidelity simulator in a cystoscopy training program. METHODS: Thirty-two medical students were randomized to an intervention and a control group. The former started by performing cystoscopy on a low-cost, low-fidelity, glass globe model before moving on to training on the URO Mentor (UM), a computerized simulator. The control group took part in the same UM training program but not in the low-fidelity training. Performance on UM was assessed by a global rating score, percentage of correctly inspected areas of the bladder (% inspected areas), time, and number of traumas caused. RESULTS: The intervention group had generally higher scores. Its global rating score on task 1 was significantly higher than that of the control group (Mann-Whitney U test, P = 0.046, effect size 0.6) and the group also scored higher, albeit not significantly, on time and % inspected areas. All students said they valued training with UM, but the appreciation of the intervention group was stronger (mean 8.9 vs. 8.1 on a scale from 1 to 10, P = 0.017, effect size 1.8). CONCLUSION: A low-fidelity glass globe model seemed to be an inexpensive educational tool to practice the first steps of cystoscopy. It may reduce training time on the UM simulator. The combined use of a low- and high-fidelity training model may provide an optimal learning effect.

A simulator for teaching transrectal ultrasound procedures: how useful and realistic is it?

INTRODUCTION: : We describe a new simulator for teaching transrectal ultrasound (TRUS) and present the results of a preliminary evaluation of the simulator's realism and usefulness for training. METHODS: : A simulator for abdominal ultrasound was adjusted by the developer to enable simulation of TRUS by providing an opening for inserting a dummy rectal probe. To enable TRUS simulation, data from ultrasound prostate imaging of eight real patients obtained with our regular ultrasound machine were transferred to the simulator by connecting the computer of the simulator to the ultrasound machine. These data were used to create images in the TRUS simulator. Residents and urologists used the simulator to perform TRUS in one of the eight patient cases and judged the simulator's realism and usefulness. RESULTS: : We were able to construct an initial urological module for the TRUS simulator. The images shown on the monitor of the simulator are quite realistic. The simulator can be used without difficulty to collect data, to create cases, and to perform TRUS. The absence of an option for prostate biopsy and the lack of tissue resistance were mentioned as two important shortcomings. Forty-seven participants rated the simulator's overall realism and usefulness for training purposes as 3.8 (standard deviation: 0.7) and 4.0 (standard deviation: 0.8) on a five-point Likert scale, respectively. CONCLUSIONS: : The simulator we describe can be used as a training tool for TRUS. It enables training with different patient cases and minimizes the burden to patients. Simulation of prostate biopsies should be added to increase the model's usefulness.

Acquisition of flexible cystoscopy skills on a virtual reality simulator by experts and novices.

OBJECTIVE: To assess the construct validity of the URO Mentor (Simbionix Corp., Cleveland, OH, USA) virtual reality training model for several variables of skills training in cysto-urethroscopy, addressing two research questions: (i) Does training on the URO Mentor significantly improve novices' performance in terms of time, trauma, areas inspected and Global Rating Scale (GRS) score?; (ii) is discrimination between different levels of expertise possible using the URO Mentor? METHODS: Thirty experts and 50 novices performed seven tasks on the URO Mentor during one training session. The first, fourth and seventh tasks were 'test tasks' to evaluate participants' performance. The simulator recorded procedure time and trauma; a supervisor scored which areas were inspected and gave scores on the GRS. A two-way analysis of variance with repeated-measures test was used to analyse experts' and novices' performances, with P < 0.05 considered to indicate statistical significance. Effect sizes (ES) were calculated to quantify the practical significance of the results; ES of 0.10, 0.30, and 0.50 were considered small, medium and large, respectively. RESULTS: Novices' performances showed a significant improvement with large ES in time (linear trend of learning curve P < 0.001, ES 0.66) and mean GRS score (linear trend P < 0.001, ES 0.84, quadratic trend P = 0.018, ES 0.24). There was a medium improvement for trauma (linear trend P < 0.001, ES 0.40) and a small improvement in areas inspected (linear trend P = 0.032, ES 0.21). That the 95% confidence intervals of the measures on the first task of experts and novices did not coincide indicates that differentiation between experts and novices on the four variables measured can be achieved using the URO Mentor. CONCLUSIONS: Training on the URO Mentor appears to result in a medium to large improvement of novices' performances for time, trauma, areas inspected and GRS scores. Moreover, discrimination between different levels of expertise is possible using this simulator.

Transfer of cysto-urethroscopy skills from a virtual-reality simulator to the operating room: a randomized controlled trial.

OBJECTIVE: To assess whether real-time cysto-urethroscopy (CUS) performance improves by simulator-based training (criterion or predictive validity), addressing the research question 'Does practical skills training on the URO Mentor (UM, Simbionix USA Corp., Cleveland, OH, USA) virtual-reality simulator improve the performance of flexible CUS in patients'. SUBJECTS AND METHODS: Participants (71 interns from Catharina Hospital Eindhoven, CHE, and 29 from University Medical Centre Groningen, UMCG) were randomized to carry out CUS in a patient after training on the UM (UM-trained, 50) or without training on UM (control, 50). The assessment of real-time performance consisted of scoring on a Global Rating Scale (GRS) by supervisors unaware of training status. Data were analysed using stepwise multiple linear regression. The effect size (ES) indication for correlations was used to interpret the magnitude of a standard regression coefficient (beta); an ES of 0.10, 0.30 and 0.50 were considered small, moderate and large, respectively. The study was approved by the Medical Review Ethics Committees of the participating hospitals. RESULTS: Overall, the group that received training performed significantly better than the controls (P < or = 0.003, beta range 0.30-0.47). There was no effect of training for participants with a specific preference for a surgical speciality in two of five GRS scores. Participants from CHE obtained higher GRS 3 scores than those from UMCG. Significantly more UMCG trainees indicated having had stress than those from CHE (P < 0.001). CONCLUSIONS: The results showed that interns who had trained on UM outperformed controls for a CUS procedure in a patient. Training for CUS on the UM is to be recommended for learning to respect tissue, procedural knowledge, flow of procedure and forward planning. Use of the UM to train interns with a specific interest in a surgical speciality in handling instruments, and time and motion, seems to be of limited value.

The virtual reality endourologic simulator is realistic and useful for educational purposes.

PURPOSE: To examine the educational value of URO Mentor, a virtual reality simulator for endourologic procedures, by establishing its face and content validity. MATERIALS AND METHODS: Eighty-nine urologists and residents in urology performed a urethrocystoscopy task (bladder inspection, biopsy, and coagulation) or a ureterorenoscopy task (manipulation of a distal ureter stone) using the URO Mentor. They completed an evaluation questionnaire about these tasks. Questionnaire bias related to task performance on URO Mentor was analyzed as well (Hawthorne effect). RESULTS: The overall rating of the URO Mentor was 7.3 on a 10-point scale (1 = poor, 10 = excellent). Regression analysis showed that ratings were not related to previous experience or task performance using the URO Mentor. Of all subjects, 25% rated the realism of URO Mentor as >or=3.5 on a five-point scale, and 82% rated its usefulness as an educational tool as >or=3.5 on a five-point scale. More than 73% of all participants said they would purchase a URO Mentor if financial means were available; participants who needed more time to complete the task were less positive in their answers to this question. CONCLUSIONS: URO Mentor appears to be a realistic and useful training model for endourologic procedures.

How useful and realistic is the uro trainer for training transurethral prostate and bladder tumor resection procedures?

PURPOSE: We evaluated the face and content validity (novice and expert opinions of realism and usefulness) of the Uro Trainer (Karl Storz GmbH, Tuttlingen, Germany), a simulator for transurethral resection procedures, to ascertain whether it is justifiable to continue the validation process by performing prospective experimental studies. MATERIALS AND METHODS: Between 2006 and 2008, 104 urologists and urology residents performed a transurethral bladder tumor resection and/or transurethral prostate resection procedure on the Uro Trainer, and rated simulator usefulness and realism on a 10-point scale (1-not at all useful/realistic/poor, 10-very useful/realistic/excellent). Participants were classified as experts (more than 50 procedures performed) or novices (50 or fewer procedures performed). Because the literature offered no guidelines for interpreting our data, we used criteria from other studies to interpret the results. RESULTS: A total of 161 questionnaires were analyzed from 97 (21% experts, 79% novices) and 64 (30% experts, 70% novices) participants who performed transurethral prostate resection and transurethral bladder tumor resection procedures, respectively. Mean usefulness, realism and overall scores varied from 5.6 to 8.2 (SD 1.4-2.5). Measured by validity criteria from other studies, Uro Trainer face and content validity was unsatisfactory, with ratings on only 3%, 5% and 8% of the parameters interpreted as positive, moderately acceptable and good, respectively. CONCLUSIONS: Measured against criteria from other validation studies, Uro Trainer face and content validity appears to be unsatisfactory. Modification of the simulator seems advisable before further experimental validation studies are initiated. The lack of general guidelines for establishing face and content validity suggests a need for consensus about appropriate methods for evaluating the validity of simulators.

A comparison of the physical properties of four new generation flexible ureteroscopes: (de)flection, flow properties, torsion stiffness, and optical characteristics.

BACKGROUND AND PURPOSE: Several kinds of flexible ureteroscopes are in use for the removal of kidney stones. This study evaluated and compared the characteristics of four new-generation flexible ureteroscopes. MATERIALS AND METHODS: The flexible ureteroscopes studied were: the ACMI Dur-8 Elite, the Storz Flex-X2 the Olympus XURF-P5, and the Wolf 7325.076. Measured properties included (de)flection, instrument insertion, flow properties, torsion stiffness, and optical characteristics. Active tip deflection and irrigation flow rates with and without various endoscopic tools were assessed. RESULTS: All ureteroscopes score better on (de)flection with an empty working channel, compared with a channel when tools are inserted (differences minimum 0.3 degrees--maximum 80.6 degrees). The Olympus XURF-P5 is the only ureteroscope with passive (de)flection capability, whereas the ACMI DUR-8 Elite is the only ureteroscope that has a secondary active (de)flection capability. The Storz Flex-X2 and the Wolf 7325.076 ureteroscopes show nearly identical best deflection capabilities with and without tools inserted in the working channel. The longest (Olympus XURF-P5, 70 cm) and shortest (ACMI DUR-8 Elite, 64 cm) ureteroscopes have, respectively, the lowest and highest flow rates. Best optical quality is offered by the Olympus XURF-P5 and Wolf 7325.076 ureteroscopes, which have low optical distortion (-9.7; -7.7%), high resolving power (17.95; 16.00 line pairs per millimeter), and a large field of view (62.9; 63.2 degrees). The Storz Flex-X2 and Wolf 7325.076 ureteroscopes have lowest torsion stiffness. CONCLUSIONS: The ex vivo evaluation of the deflection capabilities, passage of instruments, flow properties, torsion stiffness, and optical characteristics yielded quantitative measures of the in vivo performance capabilities of four new-generation flexible ureteroscopes. New ureteroscopes should be subjected to this or similar evaluation and comparison. Only in this way can the urologist make an informed and objective decision regarding appropriate instrument choice.