Measuring Adverse Events in Hospitalized Patients: An Administrative Method for Measuring Harm.

CONTEXT: Current methods for tracking harm either require costly full manual chart review (FMCR) or rely on proxy methods that have questionable accuracy. We propose an administrative measure of harm detection that uses electronically captured data. OBJECTIVE: Determine the level of agreement on harm event occurrence when harm is detected based on an administrative harm measurement tool (AHMT) compared with FMCR. DESIGN: A retrospective chart review was used to measure the level of agreement in harm detection between an AHMT that uses electronically captured data and a FMCR. SETTING: The inpatient hospital setting was used. PATIENTS: Approximately 771 medical records from 5 hospitals were reviewed. MAIN OUTCOME MEASURES: Measures of positive predictive value, negative predictive value, weighted sensitivity, weighted specificity, and concordance were used to evaluate agreement between the 2 methods. RESULTS: Although there was agreement at the harm-event level, the results were not all as high as desired: adjusted sensitivity 65%, adjusted specificity 85%, positive predictive value (PPV) 59%, negative predictive value (NPV) 88%, and concordance 75%. The patient-level results show greater agreement: adjusted sensitivity 95%, adjusted specificity 86%, PPV 61%, NPV 99%, and concordance 81%. CONCLUSION: The AHMT is sufficiently accurate for use as a within hospital tool to reliably detect and track harm. Nevertheless, it is not recommended as a tool to make comparisons across institutions, which has policy and payment implications. Further research using administrative harm detection, including the use of a broader set of measures and electronic health records, is needed.

Patient Factors Predictive of Hospital Readmissions Within 30 Days.

BACKGROUND: Under the Affordable Care Act, the Congress has mandated that the Centers for Medicare and Medicaid Services reduce payments to hospitals subject to their Inpatient Prospective Payment System that exhibits excess readmissions. Using hospital-coded discharge abstracts, we constructed a readmission measure that accounts for cross-hospital variation that enables hospitals to monitor their entire inpatient populations and evaluate their readmission rates relative to national benchmarks. METHODS: Multivariate logistic regressions are applied to determine which patient factors increase the odds of a readmission within 30 days and by how much. This study uses deidentified discharge abstract data from a database of approximately 15 million inpatient discharges representing 611 acute care hospitals from Premier healthcare alliance over a 2-year period (2008q4-2010q3). The hospitals are geographically diverse and represent large urban academic centers and small rural community hospitals. RESULTS: This study demonstrates that meaningful risk-adjusted readmission rates can be tracked in a dynamic database. The clinical conditions responsible for the index admission were the strongest predictive factor of readmissions, but factors such as age and accompanying comorbid conditions were also important. Socioeconomic factors, such as race, income, and payer status, also showed strong statistical significance in predicting readmissions. CONCLUSIONS: Payment models that are based on stratified comparisons might result in a more equitable payment system while at the same time providing transparency regarding disparities based on these factors. No model, yet available, discriminates potentially modifiable readmissions from those not subject to intervention highlighting the fact that the optimum readmission rate for any given condition is yet to be identified.

The effectiveness of a multicenter quality improvement collaborative in reducing inpatient mortality.

MOTIVATION AND BACKGROUND: This study examines the evidence that a particular quality improvement collaborative that focused on Quality, Efficiency, Safety and Transparency (QUEST) was able to improve hospital performance. SETTING: The collaborative included a range of improvement vehicles, such as sharing customized comparative reports, conducting online best practices forums, using 90-day rapid-cycle initiatives to test specific interventions, and conducting face-to-face meetings and quarterly one-on-one coaching sessions to elucidate opportunities. METHODS: With these kinds of activities in mind, the objective was to test for the presence of an overall "QUEST effect" via statistical analysis of mortality results that spanned 6 years (2006-2011) for more than 600 acute care hospitals from the Premier alliance. RESULTS: The existence of a QUEST effect was confirmed from complementary approaches that include comparison of matched samples (collaborative participants against controls) and multivariate analysis. CONCLUSION: The study concludes with a discussion of those methods that were plausible reasons for the successes.

Measuring cardiac waste: the premier cardiac waste measures.

The authors developed 8 measures of waste associated with cardiac procedures to assist hospitals in comparing their performance with peer facilities. Measure selection was based on review of the research literature, clinical guidelines, and consultation with key stakeholders. Development and validation used the data from 261 hospitals in a split-sample design. Measures were risk adjusted using Premier's CareScience methodologies or mean peer value based on Medicare Severity Diagnosis-Related Group assignment. High variability was found in resource utilization across facilities. Validation of the measures using item-to-total correlations (range = 0.27-0.78), Cronbach α (.88), and Spearman rank correlation (0.92) showed high reliability and discriminatory power. Because of the level of variability observed among hospitals, this study suggests that there is opportunity for facilities to design successful waste reduction programs targeting cardiac-device procedures.

Identifying hospital-wide harm: a set of ICD-9-CM-coded conditions associated with increased cost, length of stay, and risk of mortality.

This study identifies an expanded set of hospital-acquired conditions (HACs), using the Present-On-Admission (POA) indicator and secondary diagnoses present on International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM)-coded discharge abstracts and evaluates their association with mortality, length of stay (LOS), and cost. A sample of 500 000 de-identified ICD-9-CM-coded discharge abstracts was randomly drawn from a data set of 11 million. A total of 138 secondary condition clusters were identified as potential inpatient complications (PICs). Regression modeling was used to determine marginal association of each PIC with mortality, LOS, and cost. In all, 16% of hospitalized patients developed 1 or more of these conditions while in the hospital compared with less than 1% of inpatients experiencing HACs defined by the Centers for Medicare and Medicaid Services. Also, 74 PICs were associated with seriously higher mortality rates (5 excess deaths per 1000), significantly LOS (0.4 extra days per discharge), and significantly higher costs (an extra $1000 per discharge).

Development of a method to measure and compare hospital waste: the Premier hospital waste index.

The authors developed 15 measures and a comparative index to assist acute care facilities in identifying and monitoring clinical and administrative functions for health care waste reduction. Primary clinical and administrative data were collected from 261 acute care facilities contained within a database maintained by Premier Inc, spanning October 1, 2010, to September 30, 2011. The measures and 4 index models were tested using the Cronbach α coefficient and item-to-total and Spearman rank correlations. The final index model was validated using 52 facilities that had complete data. Analysis of the waste measures showed good internal reliability (α = .85) with some overlap. Index modeling found that data transformation using the standard deviation and adjusting for the proportional contribution of each measure normalized the distribution and produced a Spearman rank correlation of 0.95. The waste measures and index methodology provide a simple and reliable means to identify and reduce waste and compare and monitor facility performance.

Developing a pathway for high-value, patient-centered total joint arthroplasty.

BACKGROUND: Total joint arthroplasty (TJA) is one of the most widely performed elective procedures; however, there are wide variations in cost and quality among facilities where the procedure is performed. QUESTIONS/PURPOSES: The purposes of this study were to (1) develop a generalizable clinical care pathway for primary TJA using inputs from clinical, academic, and patient stakeholders; and (2) identify system- and patient-level processes to provide safe, effective, efficient, and patient-centered care for patients undergoing TJA. METHODS: We used a combination of quantitative and qualitative methods to design a care pathway that spans 14 months beginning with the presurgical office visit and concluding 12 months after discharge. We derived care suggestions from interviews with 16 hospitals selected based on readmission rates, cost, and quality (n = 10) and author opinion (n = 6). A 32-member multistakeholder panel refined the pathway during a 1-day workshop. Participants were selected based on leadership in orthopaedic (n = 4) and anesthesia (n = 1) specialty societies; involvement in organizations specializing in safety and high reliability care (n = 3), lean production/consumption of care (n = 3), and patient experience of care (n = 3); membership in an interdisciplinary care team of a hospital selected for interviewing (n = 8); recent receipt of a TJA (n = 1); and participation in the pathway development team (n = 9). RESULTS: The care pathway includes 40 suggested processes to improve care, 37 techniques to reduce waste, and 55 techniques to improve communication. Central themes include standardization and process improvement, interdisciplinary communication and collaboration, and patient/family engagement and education. Selected recommendations include standardizing care protocols and staff roles; aligning information flow with patient and process flow; identifying a role accountable for care delivery and communication; managing patient expectations; and stratifying patients into the most appropriate care level. CONCLUSIONS: We developed a multidisciplinary clinical care pathway for patients undergoing TJA based on principles of high-value care. The pathway is ready for clinical testing and context-specific adaptation. LEVEL OF EVIDENCE: Level V, therapeutic study. See the Instructions for Authors for a complete description of levels of evidence.

Keys to engaging clinicians in clinical IT.

Suggestions for gaining active participation of clinicians in the design and implementation of a clinical IT system include: Selecting open and easy-to-use systems, Gaining organization-wide buy in, Successfully articulating the benefits of these technologies for both patients and the organization.

The relationship between evidence-based practices and survival in patients requiring prolonged mechanical ventilation in academic medical centers.

Studies suggest variable adoption of evidence-based practice guidelines. The authors hypothesized that compliance with guidelines for patients requiring mechanical ventilation would vary among academic medical centers and that this variation might be associated with survival. A total of 1463 intensive care unit cases receiving continuous mechanical ventilation for >96 hours were reviewed. The variation in mortality based on compliance with 6 evidence-based practices was determined, and the effect of each intervention was estimated using a logistic regression model. Compliance varied widely across the participating centers. A strong association with survival was seen for 2 of the 6 practices: sedation management and glycemic control (odds ratios for death of 0.30 and 0.46, respectively, each P < .01). Spontaneous breathing trials, deep venous thrombosis prophylaxis, semi-recumbent positioning, and stress ulcer prophylaxis were not associated with survival in the model. More consistent adoption of these practices represents an opportunity for academic medical centers and was associated with enhanced survival.