A Video-Based Assessment Tool to Measure Intraoperative Laparoscopic Suturing Using a Modified Script Concordance Methodology.

OBJECTIVES: Laparoscopic suturing (LS) is a challenging laparoscopic skill to teach. Its complexity and nuances are not modeled or measured in current simulation and assessment platforms.The script concordance test (SCT) is used to assess clinical reasoning.The purpose of this study is to provide evidence for validity of this novel SCT based online assessment for LS skills. DESIGN: We designed a video-based online SCT for LS using a cognitive task analysis and expert panelists.The CTA yielded 4 LS domains: needle handling (NH), tissue handling (TH), knot tying techniques (KT) and operative ergonomics (OE). Five-point scales with anchoring descriptors from -2 to +2 were used. Scoring was based on a modified SCT methodology. SETTING AND PARTICIPANTS: The test was administrated to 37 subjects (18 experts and 19 novices). There was no time limit given. A different expert group from the minimal invasive surgery (MIS) panelist were recruited. Experts were defined as surgeons and fellows with LS experience of >25 cases annually. Validity was assessed by comparing SCT scores of experienced and inexperienced surgeons. Cronbach's alpha was used to assess the internal consistency of the test. RESULTS: The survey started off with 47 questions in each of the following domains: 13 NH, 4 TH, 20 KT and 10 OE. Thirty-seven surgeons (18 experts and 19 inexperienced surgeons). Questions that demonstrated a large discrepancy among experts and panelists with a weighted score difference more than 40 were discarded (n = 20). One question was discarded because it received a 100% score from all participants. This yielded 26 remaining questions in the following domains: 8 NH, 2 TH, 11 KT and 5 OE. The test reliability level (Cronbach a) was 0.80. The mean score was 72 ± 9% and 63 ± 15% (p = 0.02) for experts and inexperienced surgeons, respectively. The mean time to complete the test was 21 minutes. CONCLUSION: This study provides validity evidence for a novel intraoperative LS assessment. The variability of responses between experts and panelists suggests that SCT may capture the clinical differences/surgeon preferences in performing LS intraoperatively.

Outcome trends and safety measures after 30 years of laparoscopic cholecystectomy: a systematic review and pooled data analysis.

BACKGROUND: Laparoscopic cholecystectomy (LC), one of the most commonly performed surgical procedures, remains associated with significant major morbidity including bile leak and bile duct injury (BDI). The effect of changes in practice over time, and of interventions to improve patient safety, on morbidity rates is not well understood. The aim of this review was to describe current incidence rates and trends for BDI and other complications during and after LC, and to identify risk factors and preventative measures associated with morbidity and BDI. METHODS: PubMed, MEDLINE, and Web of Science database searches and data extraction were conducted for studies which reported individual complications and complication rates following laparoscopic cholecystectomy in a representative population. Outcomes data were pooled. Meta-regression analysis was performed to assess factors associated with conversion, morbidity, and BDI rates. RESULTS: One hundred and fifty-one studies reporting outcomes for 505,292 patients were included in the final quantitative synthesis. Overall morbidity, BDI, and mortality rates were 1.6-5.3%, 0.32-0.52%, and 0.08-0.14%, respectively. Reported BDI rates reduced over time (1994-1999: 0.69(0.52-0.84)% versus 2010-2015 0.22(0.02-0.40)%, p = 0.011). Meta-regression analysis suggested higher conversion rates in developed versus developing countries (4.7 vs. 3.4%), though a greater degree of reporting bias was present in these studies, with no other significant associations identified. CONCLUSIONS: Overall, trends suggest a reduction in BDI over time with unchanged morbidity and mortality rates. However, data and reporting are heterogenous. Establishment of international outcomes registries should be considered.

Establishing meaningful benchmarks: the development of a formative feedback tool for advanced laparoscopic suturing.

BACKGROUND: Time and accuracy are commonly used metrics to assess laparoscopic skills in a simulated environment. However, they do not provide trainees with meaningful information about how to improve their skills. The objective of this study was to provide preliminary validity evidence for the creation a formative feedback tool (FFT) for advanced laparoscopic suturing skills. METHODS: Videotapes of senior surgical residents (PGY3-5; SRs) and minimally invasive surgeons (MIS) performing 3 advanced laparoscopic suturing tasks were analyzed: needle handling (NH), suturing under tension (UT), and continuous suturing (CS). A FFT was created based on a grounded theory analysis of interviews with MIS surgeons about the key technical aspects of each task. The FFT was used to assess the videotaped performances of SRs and MIS surgeons by two blinded independent raters. RESULTS: The FFT is composed of three parts: NH contains 10 items, UT 18, and CS 20. Each item was classified according to seven key surgical principles: depth perception, safety, bimanual dexterity, exposure, tissue handling, instrument manipulation, and forward planning. The videotaped performance of SR and MIS surgeons was graded on a 3-point Likert scale ("does well," "needs some improvement," and "does poorly") and scores were calculated as a sum of the points. ICCs for all three tasks were high (NH 0.90, UT 0.87, and CS 0.90). FFT score correlated strongly with combined time and accuracy measurements for UT (0.82, p < 0.01) and CS (0.81, p < 0.01), and moderately for NH (0.65, p < 0.01). MIS surgeons performed significantly better than SRs on UT (p = 0.02) and CS (p = 0.05), while scores on NH were similar (p = 0.57). CONCLUSIONS: A comprehensive tool for providing feedback about advanced laparoscopic suturing skills was developed. The FFT demonstrates evidence for validity as a measure of suturing skills and experience, and provides meaningful information to trainees about how to improve their skills and engage in more deliberate and efficient practice.

Reliable assessment of operative performance.

BACKGROUND: There is no consensus regarding the number of intraoperative assessments required to reliably measure trainee performance. This study used generalizability theory (GT) to describe factors contributing to score variance and to estimate the number of assessments needed to achieve high standards of reliability. METHODS: While performing laparoscopic procedures, trainees were assessed by the attending surgeon using Global Operative Assessment of Laparoscopic Skills (GOALS). Data were collected prospectively (2-month intervals), assessing each trainee multiple times. Reliability coefficient was calculated using trainees, cases, and raters as factors. RESULTS: Eighteen trainees were included for a total of 65 assessments. Total variance in scores was accounted for as follows: 66.1% by trainees, 31.6% by the interaction between trainees and cases, and 2.3% by raters. At least 3 cases are required for reliable scores using GOALS. CONCLUSIONS: Trainees accounted for most of the variance in GOALS scores with a minimum of 3 cases required to improve the reliability of the scores obtained. These data may guide the implementation of performance assessments in surgical training programs.

New models for advanced laparoscopic suturing: taking it to the next level.

BACKGROUND: Current simulations for laparoscopic suturing do not reflect the complexity of the skills required in the operating room. The purpose of this study was to develop three novel advanced suturing tasks with assessment metrics and to collect validity evidence for their measures of suturing skill. METHODS: We developed three tasks based on training gaps identified through a previous needs assessment: needle handling (NH), suturing under tension (UT), and continuous suturing (CS). Minimally invasive surgeons (MIS) and senior surgical residents (SR) completed these tasks and a questionnaire regarding their educational value. Performance was assessed by two raters based on time and accuracy. Validity was assessed by comparing performance according to the level of training and self-reported experience. The inter-rater reliability and internal consistency of the tasks were calculated. RESULTS: Thirty-one subjects (13 MIS, 18 SR) were enrolled in the study (median age 32; 77% male). Compared to the SR group, the MIS group had significantly greater scores on all tasks. While all MIS surgeons completed the three tasks within the allotted time, six (33%) residents could not complete at least one out of the three tasks. Laparoscopic suturing experience correlated positively with the scores of all tasks (NH 0.51, UT 0.70, CS 0.65. p < 0.01). Inter-rater reliability for all tasks was 0.99, and internal consistency was 0.80. The majority of participants agreed that the tasks were relevant to practice, helped improve technical competence, and adequately measured suturing ability. CONCLUSIONS: This study provides validity evidence for three novel advanced laparoscopic suturing tasks. Performance on all tasks correlated significantly with training level and self-reported experience. Integrating these tasks into educational curricula may help improve residents' suturing skills and better prepare residents for the operating room.

Common bile duct adenoma: case report and brief review of literature.

Papillary adenomas of the common bile duct are a rare entity with few published case reports and limited knowledge on its natural progression. We report here a case of common bile duct papillary adenoma in a 69-year-old female who presented with symptoms of common bile duct obstruction. She was treated with local endoscopic excision of the mass that has benign features. A brief review of literature is discussed with a proposed treatment plan for follow-up with surveillance endoscopy and ultrasonography as opposed to the radical resection for benign findings on pathology.