Inter-Rater Reliability and Agreement Among Mass-Casualty Incident Algorithms Using a Pediatric Trauma Dataset: A Pilot Study.

INTRODUCTION: Many triage algorithms exist for use in mass-casualty incidents (MCIs) involving pediatric patients. Most of these algorithms have not been validated for reliability across users. STUDY OBJECTIVE: Investigators sought to compare inter-rater reliability (IRR) and agreement among five MCI algorithms used in the pediatric population. METHODS: A dataset of 253 pediatric (<14 years of age) trauma activations from a Level I trauma center was used to obtain prehospital information and demographics. Three raters were trained on five MCI triage algorithms: Simple Triage and Rapid Treatment (START) and JumpSTART, as appropriate for age (combined as J-START); Sort Assess Life-Saving Intervention Treatment (SALT); Pediatric Triage Tape (PTT); CareFlight (CF); and Sacco Triage Method (STM). Patient outcomes were collected but not available to raters. Each rater triaged the full set of patients into Green, Yellow, Red, or Black categories with each of the five MCI algorithms. The IRR was reported as weighted kappa scores with 95% confidence intervals (CI). Descriptive statistics were used to describe inter-rater and inter-MCI algorithm agreement. RESULTS: Of the 253 patients, 247 had complete triage assignments among the five algorithms and were included in the study. The IRR was excellent for a majority of the algorithms; however, J-START and CF had the highest reliability with a kappa 0.94 or higher (0.9-1.0, 95% CI for overall weighted kappa). The greatest variability was in SALT among Green and Yellow patients. Overall, J-START and CF had the highest inter-rater and inter-MCI algorithm agreements. CONCLUSION: The IRR was excellent for a majority of the algorithms. The SALT algorithm, which contains subjective components, had the lowest IRR when applied to this dataset of pediatric trauma patients. Both J-START and CF demonstrated the best overall reliability and agreement.

Prehospital Pediatric Respiratory Distress and Airway Management Training and Education: An NAEMSP Position Statement and Resource Document.

Although pediatric airway and respiratory emergencies represent high-acuity situations, the ability of EMS clinicians to effectively manage these patients is hampered by infrequent clinical exposure and shortcomings in pediatric-specific education. Cognitive gaps in EMS clinicians' understanding of the differences between pediatric and adult airway anatomy and respiratory physiology and pathology, variability in the training provided to EMS clinicians, and decay of the psychomotor skills necessary to safely and effectively manage pediatric patients experiencing respiratory emergencies collectively pose significant threats to the quality and safety of care delivered to pediatric patients. NAEMSP recommends:Pediatric airway education should include discussion of the factors that make pediatric airway management challenging.EMS agencies should provide pediatric-specific education that addresses recognition and treatment of pediatric respiratory distress based upon pathophysiology affecting upper airways, lower airways, cardiovascular systems, or extrinsic causes of disordered breathing. Pediatric airway training should also differentiate between hypoxic and hypercapnic respiratory failure. Education should emphasize that the cognitive and psychomotor skills requisite in management of pediatric respiratory emergencies will differ across patient age groups.EMS clinicians should be provided education and training in technology-dependent children and children and youth with special health care needs.EMS clinicians should receive initial and ongoing education and training in pediatric airway and respiratory conditions that emphasizes the principle of using the least invasive most effective strategies to achieve oxygenation and ventilation.Initial and continuing pediatric-focused education should be structured to maintain EMS clinician competency in the assessment and management of pediatric airway and respiratory emergencies and should be provided on a recurring basis to mitigate the decay of EMS clinicians' knowledge and skills that occurs due to infrequent field-based clinical exposure.Integration of clinician education programs with quality management programs is essential for the development and delivery of initial and continuing education intended to help EMS clinicians attain and maintain proficiency in pediatric airway and respiratory management.

Prehospital Pediatric Respiratory Distress and Airway Management Interventions: An NAEMSP Position Statement and Resource Document.

Devices and techniques such as bag-valve-mask ventilation, endotracheal intubation, supraglottic airway devices, and noninvasive ventilation offer important tools for airway management in critically ill EMS patients. Over the past decade the tools, technology, and strategies used to assess and manage pediatric respiratory and airway emergencies have evolved, and evidence regarding their use continues to grow.NAEMSP recommends:Methods and tools used to properly size pediatric equipment for ages ranging from newborns to adolescents should be available to all EMS clinicians. All pediatric equipment should be routinely checked and clearly identifiable in EMS equipment supply bags and vehicles.EMS agencies should train and equip their clinicians with age-appropriate pulse oximetry and capnography equipment to aid in the assessment and management of pediatric respiratory distress and airway emergencies.EMS agencies should emphasize noninvasive positive pressure ventilation and effective bag-valve-mask ventilation strategies in children.Supraglottic airways can be used as primary or secondary airway management interventions for pediatric respiratory failure and cardiac arrest in the EMS setting.Pediatric endotracheal intubation has unclear benefit in the EMS setting. Advanced approaches to pediatric ETI including drug-assisted airway management, apneic oxygenation, and use of direct and video laryngoscopy require further research to more clearly define their risks and benefits prior to widespread implementation.If considering the use of pediatric endotracheal intubation, the EMS medical director must ensure the program provides pediatric-specific initial training and ongoing competency and quality management activities to ensure that EMS clinicians attain and maintain mastery of the intervention.Paramedic use of direct laryngoscopy paired with Magill forceps to facilitate foreign body removal in the pediatric patient should be maintained even when pediatric endotracheal intubation is not approved as a local clinical intervention.

Quality Management of Prehospital Pediatric Respiratory Distress and Airway Programs: An NAEMSP Position Statement and Resource Document.

The unique challenges of pediatric respiratory and airway emergencies require the development and maintenance of a prehospital quality management program that includes pediatric-focused medical oversight and clinical care expertise, data collection, operational considerations, focused education, and clinician competency evaluation.NAEMSP recommends:Medical director oversight must include a focus on pediatric airway and respiratory management and integrate pediatric-specific elements in guideline development, competency assessment, and skills maintenance efforts.EMS agencies are encouraged to collaborate with medical professionals who have expertise in pediatric emergency care to provide support for quality management initiatives in pediatric respiratory distress and airway management.EMS agencies should define quality indicators for pediatric-specific elements in respiratory distress and airway management and benchmark performance based on regional and national standards.EMS agencies should implement both quantitative (objective) and qualitative (subjective) measures of performance to assess competency in pediatric respiratory distress and airway management.EMS agencies choosing to incorporate pediatric endotracheal intubation or supraglottic airway insertion must use pediatric-specific quality management benchmarks and perform focused review of advanced airway management.

Comparison of prehospital professional accuracy, speed, and interrater reliability of six pediatric triage algorithms.

OBJECTIVES: We evaluated prehospital professionals' accuracy, speed, interrater reliability, and impression in a pediatric disaster scenario both without a tool ("No Algorithm"-NA) and with 1 of 5 algorithms: CareFlight (CF), Simple Triage and Rapid Treatment (START) and JumpSTART (J-START), Pediatric Triage Tape (PTT), Sort, Assess, Life-saving interventions, Treatment/Transport (SALT), and Sacco Triage Method (STM). METHODS: Prehospital professionals received disaster lectures, focusing on 1 triage algorithm. Then they completed a timed tabletop disaster exercise with 25 pediatric victims to measure speed. A predetermined criterion standard was used to assess accuracy of answers. Answers were compared to one another to determine the interrater reliability. RESULTS: One hundred and seven prehospital professionals participated, with 15-28 prehospital professionals in each group. The accuracy was highest for STM (89.3%; 95% confidence interval [CI] 85.7% to 92.2%) and lowest for PTT (67.8%; 95% CI 63.4% to 72.1%). Accuracy of NA and SALT tended toward undertriage (15.8% and 16.3%, respectively). The remaining algorithms tended to overtriage, with PTT having the highest overtriage percentage (25.8%). The 3 fastest algorithms were: CF, SALT, and NA, all taking 5 minutes or less. STM was the slowest. STM demonstrated the highest interrater reliability, whereas CF and SALT demonstrated the lowest interrater reliability. CONCLUSIONS: This study demonstrates the most common challenges inherent to mass casualty incident (MCI) triage systems: as accuracy and prehospital professional interrater reliability improve, speed slows. No triage algorithm in our study excelled in all these measures. Additional investigation of these algorithms in larger MCI drills requiring collection of vital signs in real time or during a real MCI event is needed.

A Four-Year-Old with History of Kawasaki Disease Presenting in Acute Shock.

We present a case in which emergency medical services (EMS) intervened on a critically ill child with known giant coronary aneurysms as sequela to her severe complicated Kawasaki disease. This patient's severe shock ultimately ended in cardiac arrest and death. We discuss the keys to recognition, and critical importance to early intervention of pediatric shock in prehospital care. We also detail the cardiac ramifications of Kawasaki disease, steps for prompt identification of high risk complaints in these patients, and opportunities for treatment.

Pediatric respiratory distress: California out-of-hospital protocols and evidence-based recommendations.

OBJECTIVES: Prehospital protocols vary across local emergency medical service (EMS) agencies in California. We sought to develop evidence-based recommendations for the out-of-hospital evaluation and treatment of pediatric respiratory distress, and we evaluated the protocols for pediatric respiratory distress used by the 33 California local EMS agencies. METHODS: Evidence-based recommendations were developed through an extensive literature review of the current evidence regarding out-of-hospital treatment of pediatric patients with respiratory distress. The authors compared the pediatric respiratory distress protocols of each of the 33 California local EMS agencies with the evidence-based recommendations. Our focus was on the treatment of 3 main pediatric respiratory complaints by presentation: stridor (croup), wheezing < 24 months (bronchiolitis), and wheezing > 24 months (asthma). RESULTS: Protocols across the 33 California local EMS agencies varied widely. Stridor (croup) had the highest protocol variability of the 3 presentations we evaluated, with no treatment having uniform use among all agencies. Only 3 (9.1%) of the local EMS agencies differentiated wheezing in children < 24 months of age, referencing this as possible bronchiolitis. All local EMS agencies included albuterol and epinephrine (intravenous/intramuscular) in their pediatric wheezing (asthma) treatment protocols. The least common treatments for wheezing (asthma) included nebulized epinephrine (3/33) and magnesium (2/33). No agencies included steroids in their treatment protocols (0/33). CONCLUSION: Protocols for pediatric respiratory distress vary widely across the state of California, especially among those for stridor (croup) and wheezing in < 24 months (bronchiolitis). The evidence-based recommendations that we present for the prehospital treatment of these conditions may be useful for EMS medical directors tasked with creating and revising these protocols.

Tabletop Application of SALT Triage to 10, 100, and 1000 Pediatric Victims.

INTRODUCTION: The Sort, Access, Life-saving interventions, Treatment and/or Triage (SALT) mass-casualty incident (MCI) algorithm is unique in that it includes two subjective questions during the triage process: "Is the victim likely to survive given the resources?" and "Is the injury minor?" HYPOTHESIS/PROBLEM: Given this subjectivity, it was hypothesized that as casualties increase, the inter-rater reliability (IRR) of the tool would decline, due to an increase in the number of patients triaged as Minor and Expectant. METHODS: A pre-collected dataset of pediatric trauma patients age <14 years from a single Level 1 trauma center was used to generate "patients." Three trained raters triaged each patient using SALT as if they were in each of the following scenarios: 10, 100, and 1,000 victim MCIs. Cohen's kappa test was used to evaluate IRR between the raters in each of the scenarios. RESULTS: A total of 247 patients were available for triage. The kappas were consistently "poor" to "fair:" 0.37 to 0.59 in the 10-victim scenario; 0.13 to 0.36 in the 100-victim scenario; and 0.05 to 0.36 in the 1,000-victim scenario. There was an increasing percentage of subjects triaged Minor as the number of estimated victims increased: 27.8% increase from 10- to 100-victim scenario and 7.0% increase from 100- to 1,000-victim scenario. Expectant triage categorization of patients remained stable as victim numbers increased. CONCLUSION: Overall, SALT demonstrated poor IRR in this study of increasing casualty counts while triaging pediatric patients. Increased casualty counts in the scenarios did lead to increased Minor but not Expectant categorizations.