RESUMO
Objective: To compare binary metrics and Global Evaluative Assessment of Robotic Skills (GEARS) evaluations of training outcome assessments for reliability, sensitivity, and specificity. Background: GEARS-Likert-scale skills assessment are a widely accepted tool for robotic surgical training outcome evaluations. Proficiency-based progression (PBP) training is another methodology but uses binary performance metrics for evaluations. Methods: In a prospective, randomized, and blinded study, we compared conventional with PBP training for a robotic suturing, knot-tying anastomosis task. Thirty-six surgical residents from 16 Belgium residency programs were randomized. In the skills laboratory, the PBP group trained until they demonstrated a quantitatively defined proficiency benchmark. The conventional group were yoked to the same training time but without the proficiency requirement. The final trial was video recorded and assessed with binary metrics and GEARS by robotic surgeons blinded to individual, group, and residency program. Sensitivity and specificity of the two assessment methods were evaluated with area under the curve (AUC) and receiver operating characteristics (ROC) curves. Results: The PBP group made 42% fewer objectively assessed performance errors than the conventional group (P < 0.001) and scored 15% better on the GEARS assessment (P = 0.033). The mean interrater reliability for binary metrics and GEARS was 0.87 and 0.38, respectively. Binary total error metrics AUC was 97% and for GEARS 85%. With a sensitivity threshold of 0.8, false positives rates were 3% and 25% for, respectively, the binary and GEARS assessments. Conclusions: Binary metrics for scoring a robotic VUA task demonstrated better psychometric properties than the GEARS assessment.
RESUMO
OBJECTIVES: To evaluate the technical and oncologic feasibility of laparoscopic nephroureterectomy for upper urinary tract transitional cell carcinoma. METHODS: A retrospective survey of 100 patients, treated with laparoscopic nephroureterectomy in 10 Belgian centres, was performed. Most procedures were performed transperitoneally. The distal ureter was managed by open surgery in 55 patients and laparoscopically in 45 patients. The mean follow-up was 20 mo. RESULTS: Mean operation time was 192 min and mean blood loss 234 ml. The conversion rate was 7%. Important postoperative complications were seen in 9%. Pathologic staging was pTa in 31 patients, pT1 in 23, pT2 in 12, pT3 in 33, and pT4 in 1, concomittant pTis in 3. Pathologic grade was G1 in 24 patients, G2 in 28, and G3 in 48. Negative surgical margins were obtained in all but one patient. Twenty-five patients developed progressive disease (24%) at a mean postoperative time of 9 mo (local recurrence in 8%, metastases in 11%, both in 5%). Progression was 0% for pTa, 17% for pT1, 17% for pT2, 51% for pT3, and 100% for pT4. Cancer-specific survival was 100% for pTa, 86% for pT1, 100% for pT2, 77% for pT3, and 0% for pT4. CONCLUSION: Laparoscopic nephroureterectomy appears to be a technically and oncologically feasible operation. To prevent tumour seeding, one should avoid opening the urinary tract and should extract the specimen with an intact organ bag. The high local recurrence rate in this study probably reflects the high percentage of high-grade and high-stage tumours in this study.
