Deliberate Practice as an Effective Method for Reducing Diagnostic Error in Identifying Burn and Bruise Injuries Suspicious for an Abusive Injury.

OBJECTIVES: To examine the effectiveness of an education intervention for reducing physician diagnostic error in identifying pediatric burn and bruise injuries suspicious for abuse, and to determine case-specific variables associated with an increased risk of diagnostic error. STUDY DESIGN: This was a multicenter, prospective, cross-sectional study. A convenience sample of pediatricians and other front-line physicians who treat acutely injured children in the United States and Canada were eligible for participation. Using a web-based education and assessment platform, physicians deliberately practiced with a spectrum of 300 pediatric burn and bruise injury image-based cases. Participants were asked if there was a suspicion for abuse present or absent, were given corrective feedback after every case, and received summative diagnostic performance overall (accuracy), suspicion for abuse present (sensitivity), and absent (specificity). RESULT: Of the 93/137 (67.9%) physicians who completed all 300 cases, there was a significant reduction in diagnostic error (initial 16.7%, final 1.6%; delta -15.1%; 95% CI 13.5, 16.7), sensitivity error (initial 11.9%, final 0.7%; delta -11.2%; 95% CI 9.8, 12.5), and specificity error (initial 23.3%, final 6.6%; delta -16.7%; 95% CI 14.8, 18.6). Based on 35,627 case interpretations, variables associated with diagnostic error included patient age, sex, skin color, mechanism of injury, and size and pattern of injury. CONCLUSION: The education intervention substantially reduced diagnostic error in differentiating the presence versus absence of a suspicion for abuse in children with burn and bruise injuries. Several case-based variables were associated with diagnostic error, and these data can be used to close specific skill gaps in this clinical domain.

Twelve Tips for using Learning Curves in Health Professions Education Research.

Learning curves can be used to design, implement, and evaluate educational interventions. Attention to key aspects of the method can improve the fidelity of this representation of learning as well as its suitability for education and research purposes. This paper addresses when to use a learning curve, which graphical properties to consider, how to use learning curves quantitatively, and how to use observed thresholds to communicate meaning. We also address the associated ethics and policy considerations. We conclude with a best practices checklist for both educators and researchers seeking to use learning curves in their work.

Interactive computer-assisted learning as an educational method for learning pediatric interproximal dental caries identification.

OBJECTIVE: We developed a web-based tool to measure the amount and rate of skill acquisition in pediatric interproximal caries diagnosis among pre- and postdoctoral dental students and identified variables predictive for greater image interpretation difficulty. STUDY DESIGN: In this multicenter prospective cohort study, a convenience sample of pre- and postdoctoral dental students participated in computer-assisted learning in the interpretation of bitewing radiographs of 193 children. Participants were asked to identify the presence or absence of interproximal caries and, where applicable, locate the lesions. After every case, participants received specific visual and text feedback on their diagnostic performance. They were requested to complete the 193-case set but could complete enough cases to achieve a competency performance standard of 75% accuracy, sensitivity, and specificity. RESULTS: Of 130 participants, 62 (47.7%) completed all cases. The mean change from initial to maximal diagnostic accuracy was +15.3% (95% CI, 13.0-17.7), sensitivity was +10.8% (95% CI, 9.0-12.7), and specificity was +15.5% (95% CI, 12.9-18.1). The median number of cases completed to achieve competency was 173 (interquartile range, 82-363). Of these 62 participants, 45 (72.6%) showed overall improvement in diagnostic accuracy. Greater numbers of interproximal lesions (P < .001) and the presence of noninterproximal caries (P < .001) predicted greater interpretation difficulty. CONCLUSIONS: Computer-assisted learning led to improved diagnosis of interproximal caries on bitewing radiographs among pre- and postdoctoral dental students.

Competency Standard Derivation for Point-of-Care Ultrasound Image Interpretation for Emergency Physicians.

STUDY OBJECTIVE: Because number-based standards are increasingly controversial, the objective of this study was to derive a performance-based competency standard for the image interpretation task of point-of-care ultrasound (POCUS). METHODS: This was a prospective study. Operating on a clinically-relevant sample of POCUS images, we adapted the Ebel standard-setting method to derive a performance benchmark in 4 diverse pediatric POCUS applications: soft tissue, lung, cardiac and focused assessment with sonography in trauma (FAST). In Phase I (difficulty calibration), cases were categorized into interpretation difficulty terciles (easy, intermediate, hard) using emergency physician-derived data. In Phase II (significance), a 4-person expert panel categorized cases as low, medium, or high clinical significance. In Phase III (standard setting), a 3x3 matrix was created, categorizing cases by difficulty and significance, and a 6-member panel determined acceptable accuracy for each of the 9 cells. An overall competency standard was derived from the weighted sum. RESULTS: We obtained data from 379 emergency physicians resulting in 67,093 interpretations and a median of 184 (interquartile range, 154, 190) interpretations per case. There were 78 (19.5%) easy, 272 (68.0%) medium, and 50 (12.5%) hard-to-interpret cases, and 237 (59.3%) low, 65 (16.3%) medium, and 98 (24.5%) cases of high clinical significance across the 4 POCUS applications. The panel determined an overall performance-based competency score of 85.0% for lung, 89.5% for cardiac, 90.5% for soft tissue, and 92.7% for FAST. CONCLUSION: This research provides a transparent chain of evidence that derived clinically relevant competency standards for POCUS image interpretation.

Association Between Early Return to School Following Acute Concussion and Symptom Burden at 2 Weeks Postinjury.

Importance: Determining how the timing of return to school is related to later symptom burden is important for early postinjury management recommendations. Objective: To examine the typical time to return to school after a concussion and evaluate whether an earlier return to school is associated with symptom burden 14 days postinjury. Design, Setting, and Participants: Planned secondary analysis of a prospective, multicenter observational cohort study from August 2013 to September 2014. Participants aged 5 to 18 years with an acute (<48 hours) concussion were recruited from 9 Canadian pediatric emergency departments in the Pediatric Emergency Research Canada Network. Exposure: The independent variable was the number of days of school missed. Missing fewer than 3 days after concussion was defined as an early return to school. Main Outcomes and Measures: The primary outcome was symptom burden at 14 days, measured with the Post-Concussion Symptom Inventory (PCSI). Symptom burden was defined as symptoms status at 14 days minus preinjury symptoms. Propensity score analyses applying inverse probability of treatment weighting were performed to estimate the relationship between the timing of return to school and symptom burden. Results: This cohort study examined data for 1630 children (mean age [SD] 11.8 [3.4]; 624 [38%] female). Of these children, 875 (53.7%) were classified as having an early return to school. The mean (SD) number of days missed increased across age groups (5-7 years, 2.61 [5.2]; 8-12 years, 3.26 [4.9]; 13-18 years, 4.71 [6.1]). An early return to school was associated with a lower symptom burden 14 days postinjury in the 8 to 12-year and 13 to 18-year age groups, but not in the 5 to 7-year age group. The association between early return and lower symptom burden was stronger in individuals with a higher symptom burden at the time of injury, except those aged 5 to 7 years. Conclusions and Relevance: In this cohort study of youth aged 5 to 18 years, these results supported the growing belief that prolonged absences from school and other life activities after a concussion may be detrimental to recovery. An early return to school may be associated with a lower symptom burden and, ultimately, faster recovery.

Early analgesic administration and headache presence 7 days post-concussion in children.

OBJECTIVE: This study investigates whether acute treatment with ibuprofen, acetaminophen, or both is associated with resolution of headache or reduction of headache pain at 7 days post-concussion in children and youth. METHODS: A secondary analysis of the Predicting and Preventing Post-concussive Problems in Pediatrics (5P) prospective cohort study was conducted. Individuals aged 5-18 years with acute concussion presenting to nine Canadian pediatric emergency departments (ED) were enrolled from August 2013 to June 2015. The primary outcome was the presence of headache at 7 days, measured using the Post-Concussion Symptom Inventory. The association between acute administration of ibuprofen, acetaminophen, or both and headache presence at 7 days was investigated with propensity scores and adjusted multivariate regression models. RESULTS: 2277 (74.3%) of 3063 participants had headache upon ED presentation. Of these participants, 1543 (67.8%) received an analgesic medication before or during their ED visit [ibuprofen 754 (33.1%), acetaminophen 445 (19.5%), both 344 (15.1%); or no medication 734 (32.2%)]. Multivariate analysis pertained to 1707 participants with propensity scores based on personal characteristics and symptoms; 877 (51.4%) reported headache at 7 days post-concussion. No association emerged between treatment and presence of headache at 7 days [ibuprofen vs. untreated: (relative risk (RR) = 1.12 (95% CI 0.99,1.26); acetaminophen vs untreated RR = 1.02 (95% CI 0.87,1.22); both vs untreated RR = 1.02 (95% CI 0.86,1.18)]. CONCLUSIONS: Exposure to ibuprofen, acetaminophen, or both in the acute phase does not decrease the risk of headache at 7 days post-concussion. Non-opioid analgesics like ibuprofen or acetaminophen may be prescribed for short-term headache relief but clinicians need to be cautious with long-term medication overuse in those whose headache symptoms persist.

RéSUMé: OBJECTIF: Cette étude vise à déterminer si un traitement aigu à l'ibuprofène, à l'acétaminophène ou aux deux est associé à la résolution des maux de tête ou à la réduction de la douleur des maux de tête 7 jours après la commotion cérébrale chez les enfants et les adolescents. MéTHODES: Une analyse secondaire de l'étude de cohorte prospective Predicting and Preventing Post-concussive Problems in Pediatrics (5P) a été réalisée. Des personnes âgées de 5 à 18 ans souffrant d'une commotion cérébrale aiguë se présentant dans neuf services d'urgence pédiatriques (SU) canadiens ont été inscrites d'août 2013 à juin 2015. Le résultat primaire était la présence de maux de tête à 7 jours, mesurée à l'aide du Post-Concussion Symptom Inventory. L'association entre l'administration aiguë d'ibuprofène, d'acétaminophène ou des deux et la présence de maux de tête à 7 jours a été étudiée à l'aide de scores de propension et de modèles de régression multivariés ajustés. RéSULTATS: 2277 (74,3%) des 3063 participants avaient des maux de tête lors de la présentation aux urgences. Parmi ces participants, 1 543 (67,8%) ont reçu un médicament analgésique avant ou pendant leur visite aux urgences [ibuprofène 754 (33,1%), acétaminophène 445 (19,5%), les deux 344 (15,1%); ou aucun médicament 734 (32,2%)]. L'analyse multivariée a porté sur 1707 participants avec des scores de propension basés sur les caractéristiques personnelles et les symptômes; 877 (51,4%) ont signalé des maux de tête 7 jours après la commotion cérébrale. Aucune association n'est apparue entre le traitement et la présence de céphalées à 7 jours [ibuprofène vs non traité: (risque relatif (RR) = 1,12 (95%CI:0,99,1,26); acétaminophène vs non traité RR = 1,02 (95% IC: 0,87,1,22); les deux vs non traité RR = 1,02 (95% IC: 0,86,1,18)]. CONCLUSIONS: L'exposition à l'ibuprofène, à l'acétaminophène ou aux deux dans la phase aiguë ne diminue pas le risque de céphalées 7 jours après la commotion. Les analgésiques non opioïdes comme l'ibuprofène ou l'acétaminophène peuvent être prescrits pour soulager les maux de tête à court terme, mais les cliniciens doivent faire attention à la surconsommation de médicaments à long terme chez les personnes dont les symptômes de maux de tête persistent.

How safe are paediatric emergency departments? A national prospective cohort study.

BACKGROUND: Despite the high number of children treated in emergency departments, patient safety risks in this setting are not well quantified. Our objective was to estimate the risk and type of adverse events, as well as their preventability and severity, for children treated in a paediatric emergency department. METHODS: Our prospective, multicentre cohort study enrolled children presenting for care during one of 168 8-hour study shifts across nine paediatric emergency departments. Our primary outcome was an adverse event within 21 days of enrolment which was related to care provided at the enrolment visit. We identified 'flagged outcomes' (such as hospital visits, worsening symptoms) through structured telephone interviews with patients and families over the 21 days following enrolment. We screened admitted patients' health records with a validated trigger tool. For patients with flags or triggers, three reviewers independently determined whether an adverse event occurred. RESULTS: We enrolled 6376 children; 6015 (94%) had follow-up data. Enrolled children had a median age of 4.3 years (IQR 1.6-9.8 years). One hundred and seventy-nine children (3.0%, 95% CI 2.6% to 3.5%) had at least one adverse event. There were 187 adverse events in total; 143 (76.5%, 95% CI 68.9% to 82.7%) were deemed preventable. Management (n=98, 52.4%) and diagnostic issues (n=36, 19.3%) were the most common types of adverse events. Seventy-nine (42.2%) events resulted in a return emergency department visit; 24 (12.8%) resulted in hospital admission; and 3 (1.6%) resulted in transfer to a critical care unit. CONCLUSION: In this large-scale study, 1 in 33 children treated in a paediatric emergency department experienced an adverse event related to the care they received there. The majority of events were preventable; most were related to management and diagnostic issues. Specific patient populations were at higher risk of adverse events. We identify opportunities for improvement in care.

Paediatric post-concussive symptoms: symptom clusters and clinical phenotypes.

OBJECTIVE: To assess the co-occurrence and clustering of post-concussive symptoms in children, and to identify distinct patient phenotypes based on symptom type and severity. METHODS: We performed a secondary analysis of the prospective, multicentre Predicting and Preventing Post-concussive Problems in Pediatrics (5P) cohort study, evaluating children 5-17 years of age presenting within 48 hours of an acute concussion. Our primary outcome was the simultaneous occurrence of two or more persistent post-concussive symptoms on the Post-Concussion Symptom Inventory at 28 days post-injury. Analyses of symptom and patient clusters were performed using hierarchical cluster analyses of symptom severity ratings. RESULTS: 3063 patients from the parent 5P study were included. Median age was 12.1 years (IQR: 9.2-14.6 years), and 1857 (60.6%) were male. Fatigue was the most common persistent symptom (21.7%), with headache the most commonly reported co-occurring symptom among patients with fatigue (55%; 363/662). Headache was common in children reporting any of the 12 other symptoms (range: 54%-72%). Physical symptoms occurred in two distinct clusters: vestibular-ocular and headache. Emotional and cognitive symptoms occurred together more frequently and with higher severity than physical symptoms. Fatigue was more strongly associated with cognitive and emotional symptoms than physical symptoms. We identified five patient groups (resolved/minimal, mild, moderate, severe and profound) based on symptom type and severity. CONCLUSION: Post-concussive symptoms in children occur in distinct clusters, facilitating the identification of distinct patient phenotypes based on symptom type and severity. Care of children post-concussion must be comprehensive, with systems designed to identify and treat distinct post-concussion phenotypes.

Pediatric Musculoskeletal Radiographs: Anatomy and Fractures Prone to Diagnostic Error Among Emergency Physicians.

BACKGROUND: Pediatric musculoskeletal (pMSK) radiograph interpretations are common, but the specific radiograph features at risk of incorrect diagnosis are relatively unknown. OBJECTIVE: We determined the radiograph factors that resulted in diagnostic interpretation challenges for emergency physicians (EPs) reviewing pMSK radiographs. METHODS: EPs interpreted 1850 pMSK radiographs via a web-based platform and we derived interpretation difficulty scores for each radiograph in 13 body regions using one-parameter item response theory. We compared the difficulty scores by presence or absence of a fracture and, where applicable, by fracture location and morphology; significance was adjusted for multiple comparisons. An expert panel reviewed the 65 most commonly misdiagnosed fracture-negative radiographs to identify imaging features mistaken for fractures. RESULTS: We included data from 244 EPs, which resulted in 185,653 unique interpretations. For elbow, forearm, wrist, femur, knee, and tibia-fibula radiographs, those without a fracture had higher interpretation difficulty scores relative to those with a fracture; the opposite was true for the hand, pelvis, foot, and ankle radiographs (p < 0.004 for all comparisons). The descriptive review demonstrated that specific normal anatomy, overlapping bones, and external artefact from muscle or skin folds were often mistaken for fractures. There was a significant difference in difficulty score by anatomic locations of the fracture in the elbow, pelvis, and ankle (p < 0.004 for all comparisons). Ankle and elbow growth plate, fibular avulsion, and humerus condylar fractures were more difficult to diagnose than other fracture patterns (p < 0.004 for all comparisons). CONCLUSIONS: We identified actionable learning opportunities in pMSK radiograph interpretation for EPs.

Learning Pediatric Point-of-Care Ultrasound: How Many Cases Does Mastery of Image Interpretation Take?

OBJECTIVES: Using an education and assessment tool, we examined the number of cases necessary to achieve a performance benchmark in image interpretation of pediatric soft tissue, cardiac, lung, and focused assessment with sonography for trauma (FAST) point-of-care ultrasound (POCUS) applications. We also determined interpretation difficulty scores to derive which cases provided the greatest diagnostic challenges. METHODS: Pediatric emergency physicians participated in web-based pediatric POCUS courses sponsored by their institution as a credentialing priority. Participants deliberately practiced cases until they achieved diagnostic interpretation scores of combined 90% accuracy, sensitivity, and specificity. RESULTS: Of the 463 who enrolled, 379 (81.9%) completed cases. The median (interquartile range) number of cases required to achieve the performance benchmark for soft tissue was 94 (68-128); cardiac, 128 (86-201); lung, 87 (25-118); and FAST, 93 (68-133) (P < 0001). Specifically, cases completed to achieve benchmark were higher for cardiac relative to other applications (P < 0.0001 for all comparisons). In soft tissue cases, a foreign body was more difficult to diagnose than cobblestoning and hypoechoic collections (P = 0.036). Poor cardiac function and abnormal ventricles were more difficult to interpret with accuracy than normal (P < 0.0001) or pericardial effusion cases (P = 0.01). The absence of lung sliding was significantly more difficult to interpret than normal lung cases (P = 0.028). The interpretation difficulty of various FAST imaging findings was not significantly different. CONCLUSIONS: There was a significant variation in number of cases required to reach a performance benchmark. We also identified the specific applications and imaging findings that demonstrated the greatest diagnostic challenges. These data may inform future credentialing guidelines and POCUS learning interventions.

Management of Toddler's Fracture: A Systematic Review With Meta-Analysis.

OBJECTIVES: In studies that included children diagnosed with toddler's fractures (TFs), we determined the fracture-related adverse outcomes in those treated with immobilization versus no immobilization. Furthermore, we compared health services utilization between these 2 immobilization strategies. METHODS: A search was done on Ovid MEDLINE(R), Embase Classic + Embase, and Cochrane Central Register of Controlled Trials along with reference lists as conference proceedings and abstracts. No language or publication status or location restrictions were used. All study steps, including the methodological quality assessment, were conducted independently and in duplicate by 2 authors. RESULTS: Of the 490 references identified, 4 retrospective studies of low quality met inclusion criteria and collectively included 355 study participants. With respect to fracture-related adverse outcomes, there was no risk difference [0; 95% confidence interval (CI), -0.09 to 0.09] between the immobilization and no immobilization treatment strategies. Furthermore, in the immobilization versus no immobilization groups, there was a higher mean difference in the number of radiographs (0.69; 95% CI, 0.15-1.23) and scheduled outpatient orthopedic visits (0.96; 95% CI, 0.24-1.68), but a decreased relative risk (0.41; 95% CI, 0.05-3.19) of repeat emergency department visits. No data were reported on patient pain or caregiver satisfaction. CONCLUSIONS: In children with TF, this study suggests that no immobilization may be a safe alternative to immobilization for this minor fracture; however, high-quality evidence is needed to optimally inform clinical decision making. Future work should include validated measures of patient recovery, pain, and caregiver perspectives when comparing treatment strategies for this injury.

A Target Population Derived Method for Developing a Competency Standard in Radiograph Interpretation.

CONSTRUCT: For assessing the skill of visual diagnosis such as radiograph interpretation, competency standards are often developed in an ad hoc method, with a poorly delineated connection to the target clinical population. BACKGROUND: Commonly used methods to assess for competency in radiograph interpretation are subjective and potentially biased due to a small sample size of cases, subjective evaluations, or include an expert-generated case-mix versus a representative sample from the clinical field. Further, while digital platforms are available to assess radiograph interpretation skill against an objective standard, they have not adopted a data-driven competency standard which informs educators and the public that a physician has achieved adequate mastery to enter practice where they will be making high-stakes clinical decisions. APPROACH: Operating on a purposeful sample of radiographs drawn from the clinical domain, we adapted the Ebel Method, an established standard setting method, to ascertain a defensible, clinically relevant mastery learning competency standard for the skill of radiograph interpretation as a model for deriving competency thresholds in visual diagnosis. Using a previously established digital platform, emergency physicians interpreted pediatric musculoskeletal extremity radiographs. Using one-parameter item response theory, these data were used to categorize radiographs by interpretation difficulty terciles (i.e. easy, intermediate, hard). A panel of emergency physicians, orthopedic surgeons, and plastic surgeons rated each radiograph with respect to clinical significance (low, medium, high). These data were then used to create a three-by-three matrix where radiographic diagnoses were categorized by interpretation difficulty and significance. Subsequently, a multidisciplinary panel that included medical and parent stakeholders determined acceptable accuracy for each of the nine cells. An overall competency standard was derived from the weighted sum. Finally, to examine consequences of implementing this standard, we reported on the types of diagnostic errors that may occur by adhering to the derived competency standard. FINDINGS: To determine radiograph interpretation difficulty scores, 244 emergency physicians interpreted 1,835 pediatric musculoskeletal extremity radiographs. Analyses of these data demonstrated that the median interpretation difficulty rating of the radiographs was -1.8 logits (IQR -4.1, 3.2), with a significant difference of difficulty across body regions (p < 0.0001). Physician review classified the radiographs as 1,055 (57.8%) as low, 424 (23.1%) medium or 356 (19.1%) high clinical significance. The multidisciplinary panel suggested a range of acceptable scores between cells in the three-by-three table of 76% to 95% and the sum of equal-weighted scores resulted in an overall performance-based competency score of 85.5% accuracy. Of the 14.5% diagnostic interpretation errors that may occur at the bedside if this competency standard were implemented, 9.8% would be in radiographs of low-clinical significance, while 2.5% and 2.3% would be in radiographs of medium or high clinical significance, respectively. CONCLUSION(S): This study's novel integration of radiograph selection and a standard setting method could be used to empirically drive evidence-based competency standard for radiograph interpretation and can serve as a model for deriving competency thresholds for clinical tasks emphasizing visual diagnosis.

A Performance-Based Competency Assessment of Pediatric Chest Radiograph Interpretation Among Practicing Physicians.

BACKGROUND: There is limited knowledge on pediatric chest radiograph (pCXR) interpretation skill among practicing physicians. OBJECTIVES: We systematically determined baseline interpretation skill, the number of pCXR cases physicians required complete to achieve a performance benchmark, and which diagnoses posed the greatest diagnostic challenge. METHODS: Physicians interpreted 434 pCXR cases via a web-based platform until they achieved a performance benchmark of 85% accuracy, sensitivity, and specificity. Interpretation difficulty scores for each case were derived by applying one-parameter item response theory to participant data. We compared interpretation difficulty scores across diagnostic categories and described the diagnoses of the 30% most difficult-to-interpret cases. RESULTS: 240 physicians who practice in one of three geographic areas interpreted cases, yielding 56,833 pCXR case interpretations. The initial diagnostic performance (first 50 cases) of our participants demonstrated an accuracy of 68.9%, sensitivity of 69.4%, and a specificity of 68.4%. The median number of cases completed to achieve the performance benchmark was 102 (interquartile range 69, 176; min, max, 54, 431). Among the 30% most difficult-to-interpret cases, 39.2% were normal pCXR and 32.3% were cases of lobar pneumonia. Cases with a single trauma-related imaging finding, cardiac, hilar, and diaphragmatic pathologies were also among the most challenging. CONCLUSIONS: At baseline, practicing physicians misdiagnosed about one-third of pCXR and there was up to an eight-fold difference between participants in number of cases completed to achieve the standardized performance benchmark. We also identified the diagnoses with the greatest potential for educational intervention.

Retention of Critical Procedural Skills After Simulation Training: A Systematic Review.

OBJECTIVE: While short-term gains in performance of critical emergency procedures are demonstrated after simulation, long-term retention is relatively uncertain. Our objective was to determine whether simulation of critical emergency procedures promotes long-term retention of skills in nonsurgical physicians. METHODS: We searched multiple electronic databases using a peer-reviewed strategy. Eligible studies 1) were observational cohorts, quasi-experimental or randomized controlled trials; 2) assessed intubation, cricothyrotomy, pericardiocentesis, tube thoracostomy, or central line placement performance by nonsurgical physicians; 3) utilized any form of simulation; and 4) assessed skill performance immediately after and at ≥ 3 months after simulation. The primary outcome was skill performance at or above a preset performance benchmark at ≥ 3 months after simulation. Secondary outcomes included procedural skill performance at 3, 6, and ≥ 12 months after simulation. RESULTS: We identified 1,712 citations, with 10 being eligible for inclusion. Methodologic quality was moderate with undefined primary outcomes; inadequate sample sizes; and use of nonstandardized, unvalidated tools. Three studies assessed performance to a specific performance benchmark. Two demonstrated maintenance of the minimum performance benchmark while two demonstrated significant skill decay. A significant decline in the mean performance scores from immediately after simulation to 3, 6, and ≥ 12 months after simulation was observed in four of four, three of four, and two of five studies, respectively. Scores remained significantly above baseline at 3, 6, and ≥ 12 months after simulation in three of four, three of four, and four of four studies, respectively. CONCLUSION: There were a limited number of studies examining the retention of critical skills after simulation training. While there was some evidence of skill retention after simulation, overall most studies demonstrated skill decline over time.

Image interpretation: Learning analytics-informed education opportunities.

OBJECTIVES: Using a sample of pediatric chest radiographs (pCXR) taken to rule out pneumonia, we obtained diagnostic interpretations from physicians and used learning analytics to determine the radiographic variables and participant review processes that predicted for an incorrect diagnostic interpretation. METHODS: This was a prospective cross-sectional study. A convenience sample of frontline physicians with a range of experience levels interpreted 200 pCXR presented using a customized online radiograph presentation platform. Participants were asked to determine absence or presence (with respective location) of pneumonia. The pCXR were categorized for specific image-based variables potentially associated with interpretation difficulty. We also generated heat maps displaying the locations of diagnostic error among normal pCXR. Finally, we compared image review processes in participants with higher versus lower levels of clinical experience. RESULTS: We enrolled 83 participants (20 medical students, 40 postgraduate trainees, and 23 faculty) and obtained 12,178 case interpretations. Variables that predicted for increased pCXR interpretation difficulty were pneumonia versus no pneumonia (ß = 8.7, 95% confidence interval [CI] = 7.4 to 10.0), low versus higher visibility of pneumonia (ß = -2.2, 95% CI = -2.7 to -1.7), nonspecific lung pathology (ß = 0.9, 95% CI = 0.40 to 1.5), localized versus multifocal pneumonia (ß = -0.5, 95% CI = -0.8 to -0.1), and one versus two views (ß = 0.9, 95% CI = 0.01 to 1.9). A review of diagnostic errors identified that bony structures, vessels in the perihilar region, peribronchial thickening, and thymus were often mistaken for pneumonia. Participants with lower experience were less accurate when they reviewed one of two available views (p < 0.0001), and accuracy of those with higher experience increased with increased confidence in their response (p < 0.0001). CONCLUSIONS: Using learning analytics, we identified actionable learning opportunities for pCXR interpretation, which can be used to allow for a customized weighting of which cases to practice. Furthermore, experienced-novice comparisons revealed image review processes that were associated with greater diagnostic accuracy, providing additional insight into skill development of image interpretation.

Home Management Versus Primary Care Physician Follow-up of Patients With Distal Radius Buckle Fractures: A Randomized Controlled Trial.

STUDY OBJECTIVE: In patients with a distal radius buckle fracture, we determine whether home removal of a splint and physician follow-up as needed (home management) is noninferior to primary care physician follow-up in 1 to 2 weeks with respect to functional recovery. We also compare groups with respect to health care and patient-level costs. METHODS: This was a noninferiority randomized controlled trial conducted at a tertiary care children's hospital. Eligible patients were randomized to home management versus primary care physician follow-up and received telephone contact at 3 and 6 weeks after the index ED visit. Functional recovery was measured with the Activities Scale for Kids-performance, and participants reported wrist-injury-related health care interventions and expenses. The primary outcome was a comparison of the performance score between groups at 3 weeks. RESULTS: We enrolled 149 patients with mean age 9.5 years (SD 2.7 years), and 81 (54.4%) were male patients. Of the 133 patients (89.3%) with completed 3-week follow-up, the mean Activities Scale for Kids-performance score was 95.4% in the home management group (n=66) and 95.9% in the primary care physician follow-up group (n=67) (mean difference -0.4%; lower bound of the 95% confidence interval -2.4%). There was a mean costs savings of -$100.10 (95% confidence interval -$130.0 to -$70.20) in health care and -$28.2 (95% confidence interval -$49.6 to -$7.0) in patient costs in the home management versus primary care physician follow-up group. CONCLUSION: In patients with distal radius buckle fractures, home management is at least as good as primary care physician follow-up with respect to functional recovery. Implementation of the home management strategy also demonstrated significant cost savings.

Prepubescent Female Genital Examination Images: Evidence-Informed Learning Opportunities.

OBJECTIVES: To determine diagnoses and image features that are associated with difficult prepubescent female genital image interpretations. DESIGN AND SETTING: This was a mixed-methods study conducted at a tertiary care pediatric center using images from a previously developed education platform. PARTICIPANTS: Participants comprised 107 medical students, residents, fellows, and attendings who interpreted 158 cases to derive case difficulty estimates. INTERVENTIONS: This was a planned secondary analysis of participant performance data obtained from a prospective multi-center cross-sectional study. An expert panel also performed a descriptive review of images with the highest frequency of diagnostic error. MAIN OUTCOME MEASURES: We derived the proportion of participants who interpreted an image correctly, and features that were common in images with the most frequent diagnostic errors. RESULTS: We obtained 16,906 image interpretations. The mean proportion correct scores for each diagnosis were as follows: normal/normal variants 0.84 (95% confidence interval [CI] 0.82, 0.87); infectious/dermatology pathology 0.59 (95% CI 0.45, 0.73); anatomic pathology 0.61 (95% CI 0.41, 0.81); and, traumatic pathology 0.64 (95% CI 0.49, 0.79). The mean proportion correct scores varied by diagnosis (P < .001). The descriptive review demonstrated that poor image quality, infant genitalia, normal variant anatomy, external material (eg, diaper cream) in the genital area, and nonspecific erythema were common features in images with lower accuracy scores. CONCLUSIONS: A quantitative and qualitative examination of prepubescent female genital examination image interpretations provided insight into diagnostic challenges for this complex examination. These data can be used to inform the design of teaching interventions to improve skill in this area.

Interleukin-8 Predicts Fatigue at 12 Months Post-Injury in Children with Traumatic Brain Injury.

Despite many children experiencing fatigue after childhood brain injury, little is known about the predictors of this complaint. To date, traditional indices of traumatic brain injury (TBI) severity have not predicted reliably persisting fatigue (up to three years post-injury). This study aimed to establish whether persisting fatigue is predicted by serum biomarker concentrations in child TBI. We examined whether acute serum biomarker expression would improve prediction models of 12-month fatigue based on injury severity. Blood samples were collected from 87 children (1-17 years at injury) sustaining mild to severe TBI (Glasgow Coma Scale [GCS] range 3-15; mean 12.43; classified as mild TBI [n = 50, 57%] vs. moderate/severe TBI [n = 37, 43%]), and presenting to the emergency departments (ED) and pediatric intensive care units (PICU) at one of three tertiary pediatric hospitals (Royal Children's Hospital (RCH); Hospital for Sick Children (HSC), Toronto; St Justine Children's Hospital (SJH), Montreal). Six serum biomarker concentrations were measured within 24 h of injury (interleukin-6, interleukin-8 [IL-8], soluble vascular cell adhesion molecule [SVCAM], S100 calcium binding protein B [S100B], neuron specific enolase [NSE], and soluble neural cell adhesion molecule [sNCAM]). Fatigue at 12 months post-injury was measured using the Pediatric Quality of Life Inventory Multidimensional Fatigue Scale (parent report), classified as present/absent using previously derived cut-points. At 12 months post-injury, 22% of participants experienced fatigue. A model including IL-8 was the best serum biomarker for estimating the probability of children experiencing fatigue at 12 months post-injury. The IL-8 also significantly improved predictive models of fatigue based on severity.

Symptom Burden, School Function, and Physical Activity One Year Following Pediatric Concussion.

OBJECTIVES: To characterize symptom burden, school function, and physical activity in youth 1 year following acute concussion and those with subsequent repeat concussion. STUDY DESIGN: Secondary analysis of Predicting Persistent Postconcussive Problems in Pediatrics prospective, multicenter cohort study conducted in 9 Canadian emergency departments. Participants were children between ages 5 and 18 years who presented consecutively ≤48 hours of concussion and agreed to participate in a post hoc electronic survey 1 year after injury. Outcomes were assessed using a standardized 25-question symptom scale derived from the Post-Concussion Symptom Inventory-Parent; school function and physical activity outcomes were queried. The primary outcome was total symptom score 1 year following concussion, defined as the number of symptoms experienced more than before injury. RESULTS: Of 3052 youth enrolled in the Predicting Persistent Postconcussive Problems in Pediatrics study, 432 (median [IQR] age, 11.5 [9,14] years; 266 [62%] male) completed the 1-year survey; 34 respondents reported a repeat concussion. Following acute concussion, youth were more likely to be symptom-free than following repeat concussion (75% vs 50%; difference = 25% [95% CI 8-41]; P = .002) and to have recovered fully (90% vs 74%; difference = 17% [95% CI 5-34]; P = .002) after 1 year. Although physical symptoms were less 1 year after initial emergency department presentation for both groups (P < .001), youth with a repeat concussion reported greater headache persistence (26% vs 13%; difference = 13% [95% CI 1,31]; P = .024). Both groups returned to their normal school routine (100% vs 95%; difference = 5% [95% CI -5 to 8; P = .618). Youth without repeat concussion more frequently returned to normal physical activities (98% vs 85%; difference = 13% [95% CI 4-28]; P < .0001) and sport (95% vs 82%; difference = 13% [95% CI 3-29]; P = .009). CONCLUSIONS: Most youth are symptom-free and fully recovered 1 year following concussion. Some children with repeat concussion have worse outcomes and have delays in returning to normal school routines and sport.