ABSTRACT
OBJECTIVE: The study was done to evaluate levels of missing and invalid values in the Michigan (MI) National Emergency Medical Services Information System (NEMSIS) (MI-EMSIS) and explore possible causes to inform improvement in data reporting and prehospital care quality. METHODS: We used a mixed-methods approach to study trends in data reporting. The proportion of missing or invalid values for 18 key reported variables in the MI-EMSIS (2010-2015) dataset was assessed overall, then stratified by EMS agency, software platform, and Medical Control Authorities (MCA)-regional EMS oversight entities in MI. We also conducted 4 focus groups and 10 key-informant interviews with EMS participants to understand the root causes of data missingness in MI-EMSIS. RESULTS: Only five variables of the 18 studied exhibited less than 10% missingness, and there was apparent variation in the rate of missingness across all stratifying variables under study. No consistent trends over time regarding the levels of missing or invalid values from 2010 to 2015 were identified. Qualitative findings indicated possible causes for this missingness including data-mapping issues, unclear variable definitions, and lack of infrastructure or training for data collection. CONCLUSIONS: The adoption of electronic data collection in the prehospital setting can only support quality improvement if its entry is complete. The data suggest that there are many EMS agencies and MCAs with very high levels of missingness, and they do not appear to be improving over time, demonstrating a need for investment in efforts in improving data collection and reporting.
ABSTRACT
OBJECTIVE: To identify modifiers of emergency medical services (EMS) oversight quality, including facilitators and barriers, and inform best practices and policy related to EMS oversight and system performance. METHODS: We used a qualitative design, including 4 focus groups and 10 in-depth, 1-on-1 interviews. Primary data were collected from EMS stakeholders in Michigan from June to July 2016. Qualitative data were analyzed using the rapid assessment technique. RESULTS: Emergent themes included organizational structure, oversight and stakeholder leadership, interorganizational communication and relationships, competition or collaboration among MCA stakeholders, quality improvement practices, resources, and needs specific to rural communities. CONCLUSIONS: EMS is a critical component of disaster response. This study revealed salient themes and modifiers, including facilitators and barriers, of EMS oversight quality. These findings were evaluated in the context of current evidence and informed state policy to improve the quality of EMS oversight and prehospital care for both routine and disaster settings. Some were particular to geographic regions and communities, whereas others were generalizable.
Subject(s)
Disasters , Emergency Medical Services , Focus Groups , Humans , Quality Improvement , Rural PopulationABSTRACT
Introduction In a 2015 report, the Institute of Medicine (IOM; Washington, DC USA), now the National Academy of Medicine (NAM; Washington, DC USA), stated that the field of Emergency Medical Services (EMS) exhibits signs of fragmentation; an absence of system-wide coordination and planning; and a lack of federal, state, and local accountability. The NAM recommended clarifying what roles the federal government, state governments, and local communities play in the oversight and evaluation of EMS system performance, and how they may better work together to improve care. OBJECTIVE: This systematic literature review and environmental scan addresses NAM's recommendations by answering two research questions: (1) what aspects of EMS systems are most measured in the peer-reviewed and grey literatures, and (2) what do these measures and studies suggest for high-quality EMS oversight? METHODS: To answer these questions, a systematic literature review was conducted in the PubMed (National Center for Biotechnology Information, National Institutes of Health; Bethesda, Maryland USA), Web of Science (Thomson Reuters; New York, New York USA), SCOPUS (Elsevier; Amsterdam, Netherlands), and EMBASE (Elsevier; Amsterdam, Netherlands) databases for peer-reviewed literature and for grey literature; targeted web searches of 10 EMS-related government agencies and professional organizations were performed. Inclusion criteria required peer-reviewed literature to be published between 1966-2016 and grey literature to be published between 1996-2016. A total of 1,476 peer-reviewed titles were reviewed, 76 were retrieved for full-text review, and 58 were retained and coded in the qualitative software Dedoose (Manhattan Beach, California USA) using a codebook of themes. Categorizations of measure type and level of application were assigned to the extracted data. Targeted websites were systematically reviewed and 115 relevant grey literature documents were retrieved. RESULTS: A total of 58 peer-reviewed articles met inclusion criteria; 46 included process, 36 outcomes, and 18 structural measures. Most studies applied quality measures at the personnel level (40), followed by the agency (28) and system of care (28), and few at the oversight level (5). Numerous grey literature articles provided principles for high-quality EMS oversight. CONCLUSIONS: Limited quality measurement at the oversight level is an important gap in the peer-reviewed literature. The grey literature is ahead in this realm and can guide the policy and research agenda for EMS oversight quality measurement. Taymour RK , Abir M , Chamberlin M , Dunne RB , Lowell M , Wahl K , Scott J . Policy, practice, and research agenda for Emergency Medical Services oversight: a systematic review and environmental scan. Prehosp Disaster Med. 2018;33(1):89-97.
