Assessment of Robotic Console Skills (ARCS): construct validity of a novel global rating scale for technical skills in robotically assisted surgery.

BACKGROUND: Skill assessment during robotically assisted surgery remains challenging. While the popularity of the Global Evaluative Assessment of Robotics Skills (GEARS) has grown, its lack of discrimination between independent console skills limits its usefulness. The purpose of this study was to evaluate construct validity and interrater reliability of a novel assessment designed to overcome this limitation. METHODS: We created the Assessment of Robotic Console Skills (ARCS), a global rating scale with six console skill domains. Fifteen volunteers who were console surgeons for 0 ("novice"), 1-100 ("intermediate"), or >100 ("experienced") robotically assisted procedures performed three standardized tasks. Three blinded raters scored the task videos using ARCS, with a 5-point Likert scale for each skill domain. Scores were analyzed for evidence of construct validity and interrater reliability. RESULTS: Group demographics were indistinguishable except for the number of robotically assisted procedures performed (p = 0.001). The mean scores of experienced subjects exceeded those of novices in dexterity (3.8 > 1.4, p < 0.001), field of view (4.1 > 1.8, p < 0.001), instrument visualization (3.9 > 2.2, p < 0.001), manipulator workspace (3.6 > 1.9, p = 0.001), and force sensitivity (4.3 > 2.6, p < 0.001). The mean scores of intermediate subjects exceeded those of novices in dexterity (2.8 > 1.4, p = 0.002), field of view (2.8 > 1.8, p = 0.021), instrument visualization (3.2 > 2.2, p = 0.045), manipulator workspace (3.1 > 1.9, p = 0.004), and force sensitivity (3.7 > 2.6, p = 0.033). The mean scores of experienced subjects exceeded those of intermediates in dexterity (3.8 > 2.8, p = 0.003), field of view (4.1 > 2.8, p < 0.001), and instrument visualization (3.9 > 3.2, p = 0.044). Rater agreement in each domain demonstrated statistically significant concordance (p < 0.05). CONCLUSIONS: We present strong evidence for construct validity and interrater reliability of ARCS. Our study shows that learning curves for some console skills plateau faster than others. Therefore, ARCS may be more useful than GEARS to evaluate distinct console skills. Future studies will examine why some domains did not adequately differentiate between subjects and applications for intraoperative use.

Viewpoint matters: objective performance metrics for surgeon endoscope control during robot-assisted surgery.

BACKGROUND: Effective visualization of the operative field is vital to surgical safety and education. However, additional metrics for visualization are needed to complement other common measures of surgeon proficiency, such as time or errors. Unlike other surgical modalities, robot-assisted minimally invasive surgery (RAMIS) enables data-driven feedback to trainees through measurement of camera adjustments. The purpose of this study was to validate and quantify the importance of novel camera metrics during RAMIS. METHODS: New (n = 18), intermediate (n = 8), and experienced (n = 13) surgeons completed 25 virtual reality simulation exercises on the da Vinci Surgical System. Three camera metrics were computed for all exercises and compared to conventional efficiency measures. RESULTS: Both camera metrics and efficiency metrics showed construct validity (p < 0.05) across most exercises (camera movement frequency 23/25, camera movement duration 22/25, camera movement interval 19/25, overall score 24/25, completion time 25/25). Camera metrics differentiated new and experienced surgeons across all tasks as well as efficiency metrics. Finally, camera metrics significantly (p < 0.05) correlated with completion time (camera movement frequency 21/25, camera movement duration 21/25, camera movement interval 20/25) and overall score (camera movement frequency 20/25, camera movement duration 19/25, camera movement interval 20/25) for most exercises. CONCLUSIONS: We demonstrate construct validity of novel camera metrics and correlation between camera metrics and efficiency metrics across many simulation exercises. We believe camera metrics could be used to improve RAMIS proficiency-based curricula.

A review of training research and virtual reality simulators for the da Vinci surgical system.

UNLABELLED: PHENOMENON: Virtual reality simulators are the subject of several recent studies of skills training for robot-assisted surgery. Yet no consensus exists regarding what a core skill set comprises or how to measure skill performance. Defining a core skill set and relevant metrics would help surgical educators evaluate different simulators. APPROACH: This review draws from published research to propose a core technical skill set for using the da Vinci surgeon console. Publications on three commercial simulators were used to evaluate the simulators' content addressing these skills and associated metrics. FINDINGS: An analysis of published research suggests that a core technical skill set for operating the surgeon console includes bimanual wristed manipulation, camera control, master clutching to manage hand position, use of third instrument arm, activating energy sources, appropriate depth perception, and awareness of forces applied by instruments. Validity studies of three commercial virtual reality simulators for robot-assisted surgery suggest that all three have comparable content and metrics. However, none have comprehensive content and metrics for all core skills. INSIGHTS: Virtual reality simulation remains a promising tool to support skill training for robot-assisted surgery, yet existing commercial simulator content is inadequate for performing and assessing a comprehensive basic skill set. The results of this evaluation help identify opportunities and challenges that exist for future developments in virtual reality simulation for robot-assisted surgery. Specifically, the inclusion of educational experts in the development cycle alongside clinical and technological experts is recommended.

Face, content, and construct validity of four, inanimate training exercises using the da Vinci ® Si surgical system configured with Single-Site ™ instrumentation.

BACKGROUND: Validated training exercises are essential tools for surgeons as they develop technical skills to use robot-assisted minimally invasive surgical systems. The purpose of this study was to show face, content, and construct validity of four, inanimate training exercises using the da Vinci (®) Si surgical system configured with Single-Site (™) instrumentation. METHODS: New (N = 21) and experienced (N = 6) surgeons participated in the study. New surgeons (11 Gynecology [GYN] and 10 General Surgery [GEN]) had not completed any da Vinci Single-Site cases but may have completed multiport cases using the da Vinci system. They participated in this study prior to attending a certification course focused on da Vinci Single-Site instrumentation. Experienced surgeons (5 GYN and 1 GEN) had completed at least 25 da Vinci Single-Site cases. The surgeons completed four inanimate training exercises and then rated them with a questionnaire. Raw metrics and overall normalized scores were computed using both video recordings and kinematic data collected from the surgical system. RESULTS: The experienced surgeons significantly outperformed new surgeons for many raw metrics and the overall normalized scores derived from video review (p < 0.05). Only one exercise did not achieve a significant difference between new and experienced surgeons (p = 0.08) when calculating an overall normalized score using both video and advanced metrics derived from kinematic data. Both new and experienced surgeons rated the training exercises as appearing, to train and measure technical skills used during da Vinci Single-Site surgery and actually testing the technical skills used during da Vinci Single-Site surgery. CONCLUSIONS: In summary, the four training exercises showed face, content, and construct validity. Improved overall scores could be developed using additional metrics not included in this study. The results suggest that the training exercises could be used in an overall training curriculum aimed at developing proficiency in technical skills for surgeons new to da Vinci Single-Site instrumentation.

Construct validity of nine new inanimate exercises for robotic surgeon training using a standardized setup.

BACKGROUND: As more surgeons choose to complete procedures robotically, validated training tools are needed so that they can acquire and maintain the technical skills required to proficiently use robotic systems. The purpose of this study was to show construct validity of nine new inanimate training exercises for robot-assisted surgery. The inanimate training exercises were designed to span several core technical skills required to use a robotic system. METHODS: New (n = 30) and experienced (n = 11) robotic surgeons participated in the study. New robotic surgeons had not yet completed their first robotic surgery case and participated in this study before attending their robotic certification course. Experienced robotic surgeons had completed more than 200 robotic surgery cases. The raw scores from the exercises were reported so that other research groups could easily define custom proficiency levels. Example normalized scores that could be used in proficiency-based curricula were computed. These normalized scores balanced efficiency (completion time) and accuracy (exercise-specific errors) to measure performance. Finally, the setup was standardized using a custom docking model, which enabled consistent and repeatable completion of the inanimate exercises across surgeons. RESULTS: For all nine exercises, experienced robotic surgeons completed the exercises significantly faster than new robotic surgeons (p < 0.01). Similarly, experienced robotic surgeons achieved higher normalized scores than new robotic surgeons for all nine exercises (p < 0.01). Finally, consistent robot setup was achieved using the custom docking model based on an analysis of the robot kinematic data. CONCLUSIONS: In summary, all nine inanimate exercises showed construct validity. The results suggest that the inanimate exercises along with the custom docking model can be used as part of proficiency-based curricula to improve robotic surgeon training.

The evolving application of single-port robotic surgery in general surgery.

Advances in the field of minimally invasive surgery have grown since the original advent of conventional multiport laparoscopic surgery. The recent development of single incision laparoscopic surgery remains a relatively novel technique, and has had mixed reviews as to whether it has been associated with lower pain scores, shorter hospital stays, and higher satisfaction levels among patients undergoing procedures through cosmetically-appeasing single incisions. However, due to technical difficulties that arise from the clustering of laparoscopic instruments through a confined working space, such as loss of instrument triangulation, poor surgical exposure, and instrument clashing, uptake by surgeons without a specific interest and expertise in cutting-edge minimally invasive approaches has been limited. The parallel use of robotic surgery with single-port platforms, however, appears to counteract technical issues associated with single incision laparoscopic surgery through significant ergonomic improvements, including enhanced instrument triangulation, organ retraction, and camera localization within the surgical field. By combining the use of the robot with the single incision platform, the recognized challenges of single incision laparoscopic surgery are simplified, while maintaining potential advantages of the single-incision minimally invasive approach. This review provides a comprehensive report of the evolving application single-port robotic surgery in the field of general surgery today.

Single-port robotic cholecystectomy: results from a first human use clinical study of the new da Vinci single-site surgical platform.

OBJECTIVES: To report our results from a first human use clinical study with the da Vinci Surgical single-site instrumentation in patients with gallbladder disease and to perform a retrospective comparison with traditional multiport laparoscopic cholecystectomy. DESIGN: Ten patients underwent robotic single-port cholecystectomy performed with the da Vinci Si robot and novel da Vinci single-site instrumentation. Outcomes and operative times were compared with patients undergoing traditional multiport laparoscopic cholecystectomy during the same period. SETTING: Tertiary care Veterans Administration hospital. PATIENTS: Outpatients older than 18 years with an American Society of Anesthesiologists class of 1 to 3, no prior upper abdominal surgery, and diagnosis of noninflammatory biliary disease. INTERVENTION: Single-site robotic cholecystectomy. MAIN OUTCOME MEASURES: Operative time, complications up to 30 days, pain scores, and overall satisfaction. RESULTS: Nine of 10 patients had completion of robotic single-site cholecystectomy. Average operating room time was 105.3 minutes compared with an average of 106.1 minutes in the standard laparoscopic group. There were no serious adverse events in the robotic surgery group, with an average follow-up of 3 or more months. CONCLUSION: Robotic single-port cholecystectomy is feasible and comparable with standard laparoscopic cholecystectomy in the Veterans Administration medical center setting.

Bariatric surgery.

Bariatric surgery is a growing segment of minimally invasive surgery. Laparoscopic bariatric procedures are considered some of the most technically challenging surgeries, requiring advanced surgical skills. Successful care of the morbidly obese patient requires a multidisciplinary team approach. These unique requirements are difficult to meet during residency and surgeons interested in bariatric surgery should pursue fellowship training in bariatric surgery.

Early, intermediate, and late effects of a surgical skills "boot camp" on an objective structured assessment of technical skills: a randomized controlled study.

BACKGROUND: Surgical interns enter residency with variable technical abilities and many feel unprepared to perform necessary procedures. We hypothesized that interns exposed to a preinternship intensive surgical skills curriculum would demonstrate improved competency over unexposed colleagues on a test of surgical skills and that this effect would persist throughout internship. STUDY DESIGN: We designed a 3-day intensive skills "boot camp" with simulation-based training on 10 topics. Interns were randomized to an intervention group (boot camp) or a control group (no boot camp). All interns completed a survey including demographic information, previous experience, and comfort with basic surgical skills. Both groups completed a clinical skills assessment focused on 4 topics: chest tube insertion, central line placement, wound closure, and the Fundamentals of Laparoscopic Surgery peg transfer task. We assessed both groups immediately (month 0), early postcurriculum (month 1), and late postcurriculum (month 6). RESULTS: Fifteen participants were in the intervention group and 13 were in the control group. Before boot camp, mean comfort levels were similar for the groups. All participants had minimal prior experience. Competency for chest tube insertion and central line placement were considerably higher for the boot camp group at months 0 and 1, although much of this difference disappeared by month 6. There was no substantial difference between the 2 groups in the Fundamentals of Laparoscopic Surgery peg transfer and wound closure skills. CONCLUSIONS: A surgical skills boot camp accelerates the learning curve for interns in basic surgical skills as measured by a technical skills examination for some skills, although these improvements diminished over time. This can augment traditional training and translate into fewer patient errors.

Minimally invasive surgery.

Minimally invasive surgery (MIS), or laparoscopic surgery, plays a vital role in residency training in a number of surgical disciplines including general surgery, surgical oncology, colorectal surgery, pediatric surgery, and thoracic surgery. The tremendous patient demand for MIS over the past 2 decades has resulted in surgeons rapidly embracing this technique. Many general surgery residencies cover basic laparoscopy within their residency program; however, the experience with more advanced cases is more variable. This career resource guides the interested medical student and physician to opportunities for fellowship training in MIS. It includes a discussion of the specialty, training requirements, grant funding, research fellowships, and pertinent societies.

Video self-assessment augments development of videoscopic suturing skill.

BACKGROUND: Development of surgical skills on inanimate models has been popularized by efforts to improve patient safety and efficiency of resident training. We evaluated whether surgical residents' acquisition of videoscopic suturing skill is accelerated by reviewing video of their own previous practice session. STUDY DESIGN: Fourteen residents from two general surgery training programs received didactic instruction on laparoscopy. Attempts at suturing and knotting were then timed and recorded for each subject, and half of them were provided a video of their attempts to review. After 7 to 10 days, repeat attempts were timed and recorded. Knots were mechanically tested, and videos were reviewed in blinded fashion. RESULTS: Baseline characteristics were similar between the two groups. Both groups demonstrated improvement of videoscopic suturing efficiency and quality. On a 27-point scale, suturing and knot quality scores improved by an average of 11.6 (SD 3.9) in the video review group and 2.3 (SD 6.0) in the control group (p = 0.007). Times to complete the tasks were reduced by 30.3% (SD 11%) in the video review group and 3.1% (SD 32%) in the control group (p = 0.075). Eighty-six percent of video review subjects found the videos useful, and 86% of control subjects believed that videos would have been useful. CONCLUSIONS: Development of videoscopic suturing skill is augmented by independent review of earlier attempts. Knot quality and technique are improved, with a trend toward increased speed. This minimal-cost method of enhancing skill training for junior residents parallels the effectiveness of video review in fields such as aviation and athletics.

Endoscopy is accurate, safe, and effective in the assessment and management of complications following gastric bypass surgery.

OBJECTIVES: Roux-en-Y gastric bypass (RYGB) is a common intervention for morbid obesity. Upper gastrointestinal (UGI) symptoms are frequent and difficult to interpret following RYGB. The aim of our study was to examine the role of endoscopy in evaluating UGI symptoms after RYGB and to assess the safety and efficacy of endoscopic therapy. METHODS: Between 1998 and 2005, a total of 1,079 patients underwent RYGB for clinically severe obesity and were followed prospectively. Patients with UGI symptoms after RYGB who were referred for endoscopy were studied. RESULTS: Of 1,079 patients, 76 (7%) who underwent RYGB were referred for endoscopy to evaluate UGI symptoms. Endoscopic findings included normal surgical anatomy (n=24, 31.6%), anastomotic stricture (n=40, 52.6%), marginal ulcer (n=12, 15.8%), unraveled nonabsorbable sutures causing functional obstruction (n=3, 4%) and gastrogastric fistula (n=2, 2.6%). Patients with abnormal findings on endoscopy presented with UGI symptoms at a mean of 110.7 days from their RYGB, which was significantly shorter than the time of 347.5 days for patients with normal endoscopy (P<0.001). A total of 40 patients with anastomotic strictures underwent 86 endoscopic balloon dilations before complete symptomatic relief. In one patient, a needle knife was used to open a completely obstructed anastomotic stricture. Unraveled, nonabsorbable suture material was successfully removed using endoscopic scissors in three patients. CONCLUSIONS: Patients presenting with UGI symptoms less than 3 months after surgery are more likely to have an abnormal finding on endoscopy. Endoscopic balloon dilation is safe and effective in managing anastomotic strictures. Endoscopic scissors are safe and effective in removing unraveled, nonabsorbable sutures contributing to obstruction.

Benefits to patients choosing preoperative weight loss in gastric bypass surgery: new results of a randomized trial.

BACKGROUND: Historically, preoperative weight loss has been encouraged for patients undergoing gastric bypass surgery to decrease liver mass, technically facilitating the procedure. In an earlier prospective randomized trial investigating effects of preoperative weight loss on patients' clinical outcomes, we reported no differences in postoperative complications or weight-loss profiles at 6-month followup. This article demonstrates results of the same study, with 1-year followup. STUDY DESIGN: One hundred consecutive patients in an 18-month period preparing to undergo gastric bypass surgery at Stanford University Medical Center were selected. Fifty patients were randomly assigned to lose 10% or more of their excess body weight preoperatively, and 50 patients were assigned to no preoperative weight-loss requirements. After 1 year, patient demographics and data on postoperative complications, cure or improvement of comorbidities, and differences in weight-loss profiles were collected. RESULTS: At 1 year, the 2 groups had similar preoperative demographics and body mass indexes (BMIs). Patients in the weight-loss group, on average, lost 8.2% of their excess body weight preoperatively compared with the nonweight-loss group, which gained 1.1% (p = 0.007). After a year, the patients in both arms of the study showed no difference in weight, BMI, excess weight-loss, and number of remaining comorbidites. But when patients were divided according to those who had lost at least 5% of their excess body weight preoperatively, the 1-year results for excess weight-loss, weight, and BMI were much lower for the weight-loss group. CONCLUSIONS: Preoperative weight loss in patients undergoing gastric bypass surgery is safe and feasible. It should be encouraged, because it will markedly improve longterm weight loss.

Comparison of hospital charges between robotic, laparoscopic stapled, and laparoscopic handsewn Roux-en-Y gastric bypass.

The feasibility and safety of laparoscopic and robotic Roux-en-Y gastric bypass (RRYGB) have been established. To evaluate the cost-effectiveness of robotic surgery we compared the hospital charges for robotic, laparoscopic stapled (SRYGB), and laparoscopic handsewn Roux-en-Y gastric bypass (HRYGB) at our institution. One hundred thirty-five consecutive patients undergoing Roux-en-Y gastric bypass at Stanford University Medical Center by handsewn, stapled or robotic techniques from 1 July 2005 to 31 December 2005 were evaluated. Medical records of these patients were retrospectively reviewed and the following variables were collected and analyzed: age, gender, body mass index (BMI), number of preoperative comorbidities, length of stay (LOS), operating and anesthesia times, postoperative complications, mortality, professional fees, and hospital and total charges. Twenty-one RRYGB, 78 SRYGB, and 36 HRYGB were performed during the study period. Comparison of the above three groups demonstrated no statistically significant differences in age, gender, BMI, number of preoperative comorbidities, LOS, operating and anesthesia times, postoperative complications, mortality or professional fees. Total charges were higher for RRYGB (US $77,820) when compared with SRYGB (US $66,153) but not when compared with HRYGB (US $68,814). RRYGB higher hospital charges resulted in higher total charges when compared with SRYGB and HRYGB. These differences do not reflect actual cost to the hospital.