Outcomes following surgery for perforating Crohn's disease.

BACKGROUND: The most common indications for surgery for patients with ileocolic Crohn's disease are fibrostenotic or perforating disease. The objective was to compare surgical outcomes of patients with perforating versus non-perforating disease following ileocolic resection. METHODS: This was a retrospective review of all patients who had their first ileocolic resection between 1990 and 2010, identified from a prospectively maintained inflammatory bowel disease database. Demographic information, preoperative medication, intraoperative findings and postoperative outcome data were collected. Outcomes in patients who had an abscess drained before surgery or were found to have a fistula or abscess at surgery or at pathology were compared with outcomes in all others. RESULTS: A total of 434 patients (56·2 per cent women) were included, 293 with perforating and 141 with non-perforating disease. Median age, tobacco use, and preoperative steroid and biological agent use were similar in the two groups. Forty patients (13·7 per cent) in the perforating group had abscesses drained before surgery and 251 patients had at least one fistula, most commonly to the sigmoid colon. Patients with perforating disease were more likely to require preoperative total parenteral nutrition, need another resection, have an ileostomy and a longer mean postoperative stay, and less likely to undergo a laparoscopic procedure. Patients in this group also developed more postoperative abscesses or leaks (4·8 versus 0 per cent; P = 0·006). The reoperation rate was similar (3·1 versus 0·7 per cent; P = 0·178). CONCLUSION: Patients with penetrating Crohn's disease are more likely to require a more complex procedure, and an ileostomy, and to a have longer postoperative stay.

Long-term outcome of colectomy and ileorectal anastomosis for Crohn's colitis.

BACKGROUND: Ileorectal anastomosis is an important surgical option for patients with Crohn's colitis with relative rectal sparing. OBJECTIVE: This study aimed to audit outcomes of ileorectal anastomosis for Crohn's and factors associated with proctectomy and reoperation. DESIGN: This retrospective study involved a chart review and contacting patients. SETTINGS: Patients with Crohn's colitis who had an ileorectal anastomosis were identified from the Mount Sinai Hospital Inflammatory Bowel Disease Database. PATIENTS: Demographics, operative and perioperative outcomes, and reoperative data were collected. MAIN OUTCOME MEASURES: Five- and 10-year Kaplan-Meier survival estimates and 95% confidence intervals were calculated for survival from proctectomy and Crohn's-related revisional surgery. Cox proportional hazards models were used to model the hazards of proctectomy and Crohn's-related revision on the clinical characteristics of patients. RESULTS: Eighty-one patients had an ileorectal anastomosis for Crohn's disease from 1982 to 2010. The most common indications for surgery were failed medical management (60/81, 74.1%) and a stricture causing obstruction (14/81, 17.3%). Seventy-seven percent (n = 62) had a 1-stage procedure, whereas 23% (n = 19) had a 2-stage procedure (colectomy followed by ileorectal anastomosis). The overall anastomotic leak rate was 7.4% (n = 6). Fifty-six patients had a functioning ileorectal anastomosis at the time of follow-up. At 5 and 10 years, 87% (95% CI: 75.5-93.3) and 72.2% (95% CI: 55.8-83.4) of individuals had a functioning ileorectal anastomosis. Eighteen patients required proctectomy for poor symptom control, whereas 11 patients required a small-bowel resection plus redo-ileorectal anastomosis. The mean time to proctectomy from the original ileorectal anastomosis was 88.3 months (SD = 62.1). Smoking was associated with both proctectomy (HR 3.93 (95% CI: 1.46-10.55)) and reoperative surgery (HR 2.12 (95% CI: 0.96-4.72)). LIMITATIONS: : This study was retrospective. CONCLUSIONS: Ileorectal anastomosis is an appropriate operation for selected patients with Crohn's colitis with sparing of the rectum. However, patients must be counseled that the reoperation rate and/or proctectomy rate is approximately 30%.

Transatlantic comparison of the competence of surgeons at the start of their professional career.

BACKGROUND: Although the objective in European Union and North American surgical residency programmes is similar-to train competent surgeons-residents' working hours are different. It was hypothesized that practice-ready surgeons with more working hours would perform significantly better than those being educated within shorter working week curricula. METHODS: At each test site, 21 practice-ready candidate surgeons were recruited. Twenty qualified Canadian and 19 qualified Dutch surgeons served as examiners. At both sites, three validated outcome instruments assessing multiple aspects of surgical competency were used. RESULTS: No significant differences were found in performance on the integrative and cognitive examination (Comprehensive Integrative Puzzle) or the technical skills test (Objective Structured Assessment of Technical Skill; OSATS). A significant difference in outcome was observed only on the Patient Assessment and Management Examination, which focuses on skills needed to manage patients with complex problems (P < 0.001). A significant interaction was observed between examiner and candidate origins for both task-specific OSATS checklist (P = 0.001) and OSATS global rating scale (P < 0.001) scores. CONCLUSION: Canadian residents, serving many more working hours, perform equivalently to Dutch residents when assessed on technical skills and cognitive knowledge, but outperformed Dutch residents in skills for patient management. Secondary analyses suggested that cultural differences influence the assessment process significantly.

Toward reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills.

BACKGROUND: Decision making on the competency of surgical trainees to perform laparoscopic procedures has been hampered by the lack of reliable methods to evaluate operative performance. The goal of this study was to develop a feasible and reliable method of evaluation. METHODS: Twenty-nine senior surgical residents were videotaped performing a low anterior resection and a Nissen fundoplication in a pig. Ten blinded laparoscopists rated the videos independently on two scales. Rating time was minimized by allowing raters to fast-forward through the tapes at their discretion. Interrater reliability and the time required to rate a procedure were assessed. RESULTS: Rating time per procedure was a median of 15 min (range, 6-40). The mean interrater reliability for the two scales was 0.74. CONCLUSIONS: The use of videotapes of operations enabled multiple raters to assess a performance reliably and shortened assessment times by 80%. This assessment technique shows potential as a means of evaluating the performance of advanced laparoscopic procedures by surgical trainees.

Pregnancy, delivery, and pouch function after ileal pouch-anal anastomosis for ulcerative colitis.

PURPOSE: This study was designed to evaluate the pregnancies, method of delivery, and functional results of females with chronic ulcerative colitis who have an ileal pouch-anal anastomosis. METHODS: A mailed questionnaire was sent to all females with an ileal pouch-anal anastomosis for chronic ulcerative colitis. Information on the pregnancy, method of delivery, and outcome was collected. Those females who had a successful pregnancy and delivery were contacted by telephone to clarify results and determine pouch functional results. Other clinical information was obtained from the Mount Sinai Hospital Inflammatory Bowel Disease database. RESULTS: Thirty-eight subjects had 67 pregnancies. Of these, 29 subjects had 49 deliveries. There were 25 vaginal deliveries and 24 cesarean sections. There were two pouch-related complications during the pregnancies and four pouch-related complications postpartum. All were treated nonoperatively. Stool frequency and day and night incontinence were increased during pregnancy in most subjects, but after delivery, prepregnancy function was restored in 24 (83 percent) of them. Five subjects (17 percent) had some degree of permanent deterioration in pouch function. Of these, three had vaginal deliveries, and two had cesarean sections. Multiple births and birth weight were not found to adversely affect subsequent pouch function. CONCLUSION: Pregnancy is safe in females with ileal pouch-anal anastomosis. Functional results are altered almost exclusively during the third trimester, but pouch function promptly returns to prepregnancy status in most females. A small proportion of females have long-term disturbances in function, but these are not related to the method of delivery. Thus, the method of delivery should be dictated by obstetric considerations.

Structured assessment of minor surgical skills (SAMSS) for family medicine residents.

PURPOSE: To develop a valid and reliable examination to assess the technical proficiency of family medicine residents' performance of minor surgical office procedures. METHOD: A multi-station OSCE-style examination using bench-model simulations of minor surgical procedures was developed. Participants were a randomly selected group of 33 family medicine residents (PGY-1 = 16, PGY-2 = 17) and 14 senior surgical residents who functioned as a validation group. Examiners were qualified surgeons and family physicians who used both checklists and global rating scales to score the participants' performances. RESULTS: When family medicine residents were evaluated by family physicians, interstation reliabilities were .29 for checklists and .42 for global ratings. When family medicine residents were evaluated by surgeons, the reliabilities were .53 for checklists and .75 for global ratings. Interrater reliability, measured as a correlation for total examination scores, was .97. Mean scores on the examination were 60%, 64%, and 87% for PGY-1 family medicine, PGY-2 family medicine, and surgery residents, respectively. The difference in scores between family medicine and surgery residents was significant (p < .001), providing evidence of construct validity. CONCLUSION: A new examination developed for assessing family medicine residents' skills with minor surgical office procedures is reliable and has evidence for construct validity. The examination has low reliability when family physicians serve as examiners, but moderate reliability when surgeons are the evaluators.

Exporting a technical skills evaluation technology to other sites.

BACKGROUND: The Objective Structured Assessment of Technical Skill (OSATS) is a multistation performance-based examination that assesses the technical skills of surgery residents. This study explores the implementation issues involved in remote administration of the OSATS focusing on feasibility and the psychometric properties of the examination. METHODS: An eight-station OSATS was administered to surgical residents in Los Angeles and Chicago. The University of Toronto and the local institutions shared responsibility for organization and administration of the examination. RESULTS: There was good reliability for both the checklist (alpha = 0.68 for LA, 0.73 for Chicago) and global rating forms (alpha = 0.82 for both sites). Both iterations also showed evidence of construct validity, with a significant effect of training year for the checklist and global rating forms at both sites (analysis of variance: F = 8.66 to 19.93, P <0.01). Despite some challenges, the model of central organization and peripheral delivery was effective for the administration of the examinations. CONCLUSIONS: Two iterations of the OSATS at remote sites demonstrated psychometric properties that are highly consistent with previously reported data suggesting that the examination is portable. Both faculty and residents indicated satisfaction with the examination experience. A model of central administration with peripheral delivery was feasible and effective.

Using operative outcome to assess technical skill.

BACKGROUND: This study examined whether an operative product and time to completion could serve as measures of technical skill. METHODS: Nine final-year (PGY5) and 11 penultimate-year (PGY4) general surgery residents participated in a 6-station bench model examination. Time to completion was recorded. Twelve faculty surgeons (2 per station) evaluated the quality of the final product using a 5-point scale. RESULTS: The mean interrater reliability was 0. 59 for product quality. Interstation reliability was 0.59 for analysis of the final product and 0.72 for time to completion. There was 63% and 78% agreement between attendings' ratings and product quality and time scores respectively. PGY5s' mean product quality score was 4.14 +/- 0.26, compared with 3.82 +/- 0.33 for PGY4s (P < 0.05). PGY5s' mean time was 110 +/- 19 minutes compared with PGY4s' 132 +/- 15 (P < 0.05). CONCLUSIONS: Analysis of the operative end product and time to completion offer efficient alternatives to on-line examiner scoring for bench model examinations of technical competence.

Coping behavior and social support contribute independently to quality of life after surgery for inflammatory bowel disease.

PURPOSE: The purpose of this study was to examine the association between coping behavior at the time of surgery and inflammatory bowel disease-related quality of life after surgery. We also investigated the relationship between perceived social support and both coping style and postsurgical quality of life. Finally, the value of the Medical Outcomes Study Social Support Scale for preoperative screening was assessed. METHODS: Eighty-six subjects who had surgery during a 12-month period completed the Inflammatory Bowel Disease Questionnaire, the Ways of Coping, a measure of inflammatory bowel disease symptom severity, and the Medical Outcomes Study Social Support Scale. Analysis of variance was used to test an association between Ways of Coping score and membership in a high quality of life (Inflammatory Bowel Disease Questionnaire > mean) or low quality of life (Inflammatory Bowel Disease Questionnaire < mean) cohort. Comparison of group means between the high quality of life and low quality of life cohorts identified Ways of Coping behavior scales that differed between the high quality of life and low quality of life cohorts. Stepwise linear regression analysis was then used to determine the independent contribution of 1) current inflammatory bowel disease symptoms, 2) current perceived social support, and 3) identified coping behaviors (self-control, self-blame, and escape, summed as a single index named "maladaptive coping") to postsurgical quality of life. The sensitivity, specificity, and negative predictive value of the Medical Outcomes Study Social Support Scale were assessed. RESULTS: The lower quality of life group distinguished itself by more frequent use of maladaptive coping. Regression analysis revealed that current inflammatory bowel disease-related symptoms, current perceived social support, and maladaptive coping behaviors at the time of surgery each made a highly significant independent contribution to postsurgical quality of life. The sensitivity of the Medical Outcomes Study Social Support Scale in identifying patients with poor postsurgical quality of life was 81 percent, and the specificity was 77 percent. The negative predictive value was 93 percent. CONCLUSIONS: Three coping behaviors which seem to be maladaptive (self-control, self-blame, and escape) are associated with lower quality of life after surgery for inflammatory bowel disease. These coping behaviors make a contribution to postsurgical quality of life independent of the negative effect on quality of life of inflammatory bowel disease symptoms. Perceived social support is a third factor that makes an independent contribution to postsurgical quality of life. The Medical Outcomes Study Social Support Scale has properties associated with an effective screening tool and merits further investigation as an instrument to screen presurgically for individuals at higher risk of poor subjective outcome of inflammatory bowel disease surgery.

A comprehensive examination for senior surgical residents.

BACKGROUND: Two complimentary examinations designed to comprehensively assess competence for surgical practice have been developed. The Objective Structured Assessment of Technical Skill (OSATS) evaluates a resident's operative skill, and the Patient Assessment and Management Examination (PAME) evaluates clinical management skills. METHODS: Twenty-four postgraduate year (PGY)-4 and PGY-5 general surgery residents from four training programs were examined. Each examination had eight stations, with a total of 6 hours of testing time. RESULTS: Interstation reliability for the OSATS was 0.64, for the PAME was 0.71, and for the total test was 0. 74. Examination scores discriminated between PGY-4 and PGY-5 residents for the OSATS (t = 4.39, P <.01), the PAME (t = 1.86, P <. 05), and the total examination (t = 3.90, P <.01). Year of training accounted for 40%, of the variance of scores. CONCLUSIONS: This comprehensive examination is a reliable and valid method of assessing critical skills in senior surgical residents and may be useful for the formal assessment of readiness for practice.

Use of community resources before inflammatory bowel disease surgery is associated with postsurgical quality of life.

BACKGROUND: Research in chronic illness shows that community resources can have a lasting influence on the course of the illness; however, little research has been done to evaluate the community agencies that specifically address the needs of inflammatory bowel disease (IBD) patients. OBJECTIVES: To survey awareness of community agency resources among patients who have surgery for IBD, and to analyze the association between using these resources and qualitative postsurgical outcomes. SUBJECTS AND METHODS: Ninety-two subjects who had surgery over a 12-month period completed, in full, the Inflammatory Bowel Disease Questionnaire (IBDQ), and a self-report instrument used to probe awareness and use of local community resources. Community resources were divided into two groups: those involving primarily social and educational participation ('social/ educational') and those involving some individualized attention, usually from a professional or trained lay facilitator ('professional/individual'). The contribution of presurgical participation in each type of resource to postsurgical quality of life was tested using ANOVA, with IBDQ score as the dependent variable. The ANOVA was repeated with postsurgical disease activity as a covariable. IBDQ subscale scores were compared between groups that were found to differ in the ANOVA. RESULTS: Almost all subjects were aware of at least one available resource. Participation in resources before surgery was variable, but 50% of the sample participated in at least one social/educational resource, and 46.9% participated in at least one professional/individual support. For the 92 subjects who completed both the IBDQ and the survey of resources, ANOVA revealed a main effect of professional/individual resource use on postsurgical quality of life but no main effect of social/educational resources and no interaction. DISCUSSION: The association between presurgical participation in professional or individualized community resources and better subjective outcome of IBD surgery may be explained by a positive contribution of participation to coping with surgery for IBD. The data do not support the alternative explanation that subjects with less severe disease (and thus better outcome) have greater ability to participate, although further research is required.

Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination.

PURPOSE: To compare the psychometric properties of checklists, global rating scales preceded by a checklist, and global rating scales alone in assessing surgery residents' performances on an OSCE-like technical skills examination. METHOD: In 1996, 53 general surgery residents with one to six years of postgraduate training participated in a performance-based examination of technical skills consisting of eight 15-minute stations (bench-model simulations of operative procedures in general surgery). Two qualified surgeons marked at each station, one using a task-specific checklist (C) and a subsequent global rating scale (Gc), the other using a global rating scale only (G). RESULTS: Interstation reliabilities measured by Cronbach's alpha were .79 for C, .89 for Gc, and .85 for G. A series of multiple regressions predicting level of training from test scores revealed an R2 of .584 for C alone, which increased to .711 when Gc was entered after (p < .001), and increased to .704 when G was entered after C (p < .001). However, R2 for Gc alone was .711, and for G alone was .704, neither of which changed when C was entered into the prediction (p > .10). The R2 for Gc and G predicting level of training (.725) was not significantly greater than that of either Gc or G alone. A very similar pattern of results was seen when C, Gc, and G were used to predict independent evaluations of the operative outcomes. CONCLUSIONS: Global rating scales scored by experts showed higher inter-station reliability, better construct validity, and better concurrent validity than did checklists. Further, the presence of the checklists did not improve the reliability or validity of the global rating scale over that of the global rating scale alone. These results suggest that global rating scales administered by experts are a more appropriate summative measure when assessing candidates on performance-based examinations.

Handsewn vs. stapled anastomoses in colon and rectal surgery: a meta-analysis.

PURPOSE: Trials comparing handsewn with stapled anastomoses in colon and rectal surgery have not found statistical differences. Despite this, authors have differed in their conclusions as to which technique is superior. To help determine whether differences in patient outcomes are present, a meta-analysis of all trials was performed. METHOD: A meta-analysis of all randomized, controlled trials assessing handsewn and stapled colon and rectal anastomoses was done using a fixed-effects model. Outcome variables were mortality, technical problems, leak rates, wound infections, strictures, and cancer recurrence. Outcomes were assessed for all anastomoses involving the colon and for the subset of colorectal anastomoses. RESULTS: Thirteen distinct trials met the inclusion criteria. Intraoperative technical problems were more likely to occur with stapled than with handsewn anastomoses for all anastomoses (P < 0.0001) and for colorectal anastomoses (P < 0.001). Strictures were also more common following stapled anastomoses (P = 0.015 for all anastomoses; P = 0.028 for colorectal anastomoses). All other outcome measures, including mortality, clinical and radiologic leak rates, and local cancer recurrence rates showed no difference between groups. CONCLUSION: Although intraoperative technical problems and postoperative strictures were more common with stapled anastomoses, other outcome measures showed no difference between groups. Thus, both techniques are effective, and the choice may be based on personal preference.

Automated blood pressure measurement at rest and during exercise: evaluation of the motion tolerant CardioDyne NBP 2000.

PURPOSE: The purpose of this study was to validate the use of a motion tolerant blood pressure monitor (CardioDyne NBP 2000, Luxtec, Worcester, MA) ) against standard manual auscultation at rest and during exercise. METHODS: Nineteen subjects (men, N = 9; women, N = 10) participated in the study (mean: age 21+/-1.2 yr; height 172.5+/-8 cm; mass 69.4+/-14.5 kg). Standard Bruce protocol treadmill exercise tests with 12-lead ECG and metabolic measures were administered to the subjects, with blood pressure measures taken at rest before, during, and after the exercise tests. Blood pressure by manual auscultatory sphygmomanometry and the CardioDyne NBP 2000 was recorded simultaneously in the same arm. Manual auscultatory blood pressure measures obtained by one experimenter were used as the criterion measure, and the data of two NBP 2000 audio reviewers were averaged for each data point recorded. RESULTS: Systolic blood pressure (SBP) and diastolic blood pressure (DBP) via manual auscultation and the NBP 2000 "automatic" values were not significantly different and were highly correlated at rest and during exercise. Resting intraclass correlation SBP values were high (range 0.95 to 0.98), as were DBP intraclass correlation values (range 0.83 to 0.95). Exercise intraclass correlation SBP values ranged from 0.94 to 0.99, and DBP intraclass correlation values from 0.88 to 0.93. CONCLUSION: We conclude that the NBP 2000 is simple to use at rest and during exercise stress testing and provides accurate and verifiable information.

A new assessment tool: the patient assessment and management examination.

BACKGROUND: The major goal of certification is to assure the public that the candidate is competent in all facets required of the position. The patient assessment and management examination (PAME) was developed to enable a more comprehensive assessment of competence in the practice of surgery. METHODS: A six-station, 3-hour, standardized-patient-based evaluation was developed. Each station was scored using a set of five-point global rating scales. PAME results were compared to the last two in training evaluation reports (ITER), the clinical knowledge component of the ITER (ITER-CK), an in-house oral examination (OE), and the Canadian Association of General Surgeons' multiple-choice examination (CAGS). RESULTS: Eighteen senior general surgery residents were evaluated. Overall reliability was 0.70 (Cronbach's alpha). Fifth-year residents scored significantly better than fourth-year residents (t = 3.062; p = 0.0074), with 1 year of training accounting for 37% of the variance in scores. Correlations between the PAME and each of the other measures were ITER, 0.24; ITER-CK, 0.38; OE, -0.13; and CAGS, 0.061, with the PAME demonstrating better reliability and stronger evidence of validity than any other. CONCLUSIONS: The PAME had better psychometric properties than other measures and assessed areas often not evaluated. This type of evaluation may be useful for feedback, remediation, or certification decisions.

Risk factors for pelvic pouch failure.

PURPOSE: This study was designed to identify factors associated with pelvic pouch failure. METHOD: A retrospective review of patients undergoing the pelvic pouch procedure with a minimum of 30 months follow-up was conducted. RESULTS: A total of 551 patients had pelvic pouch procedures from 1981 to 1992. Forty-nine patients (8.8 percent) have undergone pouch excision, and 9 (1.6 percent) have been defunctioned, for 58 (10.5 percent) patients with pouch failure. Cause of failure was leakage from the ileoanal anastomosis (IAA) in 21 (39 percent) patients, poor functional results in 13 (23 percent), pouchitis in 7 (12 percent), pouch leakage in 7 (12 percent), perianal disease in 7 (12 percent), and miscellaneous in 3 (5.2 percent). Nine of 22 patients (41 percent) had pouch failure during the first two years, with 2 of 147 patients (1 percent) having failure during the last two years of the study. The 58 patients whose pouches failed (Group 1) were compared with the 493 patients whose pouches did not fail (Group 2). Handsewn IAA (P < 0.001), tension on the IAA (P < 0.001), use of a defunctioning ileostomy (P < 0.01), a diagnosis of Crohn's disease (P < 0.001), and a leak from the pouch (P < 0.001) or the IAA (P < 0.001) were associated with pouch failure. Pouchitis was not a risk factor. CONCLUSION: The majority of pouch failures were caused by leaks at the IAA. Although the leak rate remained stable, leaks following a stapled anastomosis seemed to have a better prognosis than leaks following a handsewn anastomosis. Experience with the pouch procedure and the management of complications likely plays an important role in decreasing the risk of pouch failure.

Testing technical skill via an innovative "bench station" examination.

BACKGROUND: A new approach to testing operative technical skills, the Objective Structured Assessment of Technical Skill (OSATS), formally assesses discrete segments of surgical tasks using bench model simulations. This study examines the interstation reliability and construct validity of a large-scale administration of the OSATS. METHODS: A 2-hour, eight-station OSATS was administered to 48 general surgery residents. Residents were assessed at each station by one of 48 surgeons who evaluated the resident using two methods of scoring: task-specific checklists and global rating scales. RESULTS: Interstation reliability was 0.78 for the checklist score, and 0.85 for the global score. Analysis of variance revealed a significant effect of training for both the checklist score, F(3,44) = 20.08, P <0.001, and the global score, F(3,44) = 24.63, P <0.001. CONCLUSIONS: The OSATS demonstrates high reliability and construct validity, suggesting that we can effectively measure residents' technical ability outside the operating room using bench model simulations.

Objective structured assessment of technical skill (OSATS) for surgical residents.

BACKGROUND: The technical skill of surgical trainees is not well assessed. This study aimed (1) to compare the reliability of three scoring systems, (2) to compare live and bench formats and (3) to assess construct validity of a test of operative skill. METHODS: Parallel examinations of operative skill, one using live animals and one using simulations, were developed. Performance was graded using operation-specific checklists, detailed global rating forms and pass/fail judgements. Twenty surgical residents each took both formats. RESULTS: Disattenuated correlations between live and bench scores were high (0.69-0.72). Mean interrater reliability across stations ranged from 0.64 to 0.72. Internal consistency was moderate to high (alpha: 0.61-0.74) for the live format using the checklist and for live and bench formats using global ratings. Global ratings discriminated between resident levels for both formats (bench: F(2,17) = 4.45, P < 0.05; live: F(2,17) = 3.55, P < 0.05), checklists did not. CONCLUSION: This preliminary study suggests that the Objective Structured Assessment of Technical Skill can reliably and validly assess surgical skills. Global ratings are a better method of assessment than task-specific checklists. Bench model simulation gives equivalent results to use of live animals for this test format.