Clinical Analytics Prediction Engine (CAPE): Development, electronic health record integration and prospective validation of hospital mortality, 180-day mortality and 30-day readmission risk prediction models.

BACKGROUND: Numerous predictive models in the literature stratify patients by risk of mortality and readmission. Few prediction models have been developed to optimize impact while sustaining sufficient performance. OBJECTIVE: We aimed to derive models for hospital mortality, 180-day mortality and 30-day readmission, implement these models within our electronic health record and prospectively validate these models for use across an entire health system. MATERIALS & METHODS: We developed, integrated into our electronic health record and prospectively validated three predictive models using logistic regression from data collected from patients 18 to 99 years old who had an inpatient or observation admission at NorthShore University HealthSystem, a four-hospital integrated system in the United States, from January 2012 to September 2018. We analyzed the area under the receiver operating characteristic curve (AUC) for model performance. RESULTS: Models were derived and validated at three time points: retrospective, prospective at discharge, and prospective at 4 hours after presentation. AUCs of hospital mortality were 0.91, 0.89 and 0.77, respectively. AUCs for 30-day readmission were 0.71, 0.71 and 0.69, respectively. 180-day mortality models were only retrospectively validated with an AUC of 0.85. DISCUSSION: We were able to retain good model performance while optimizing potential model impact by also valuing model derivation efficiency, usability, sensitivity, generalizability and ability to prescribe timely interventions to reduce underlying risk. Measuring model impact by tying prediction models to interventions that are then rapidly tested will establish a path for meaningful clinical improvement and implementation.

Undergoing transformation to the patient centered medical home in safety net health centers: perspectives from the front lines.

OBJECTIVES: Safety net health centers (SNHCs), which include federally qualified health centers (FQHCs) provide primary care for underserved, minority and low income patients. SNHCs across the country are in the process of adopting the patient centered medical home (PCMH) model, based on promising early implementation data from demonstration projects. However, previous demonstration projects have not focused on the safety net and we know little about PCMH transformation in SNHCs. DESIGN: This qualitative study characterizes early PCMH adoption experiences at SNHCs. SETTING AND PARTICIPANTS: We interviewed 98 staff (administrators, providers, and clinical staff) at 20 of 65 SNHCs, from five states, who were participating in the first of a five-year PCMH collaborative, the Safety Net Medical Home Initiative. MAIN MEASURES: We conducted 30-45 minute, semi-structured telephone interviews. Interview questions addressed benefits anticipated, obstacles encountered, and lessons learned in transition to PCMH. RESULTS: Anticipated benefits for participating in the PCMH included improved staff satisfaction and patient care and outcomes. Obstacles included staff resistance and lack of financial support for PCMH functions. Lessons learned included involving a range of staff, anticipating resistance, and using data as frequent feedback. CONCLUSIONS: SNHCs encounter unique challenges to PCMH implementation, including staff turnover and providing care for patients with complex needs. Staff resistance and turnover may be ameliorated through improved health care delivery strategies associated with the PCMH. Creating predictable and continuous funding streams may be more fundamental challenges to PCMH transformation.

Association between patient-centered medical home rating and operating cost at federally funded health centers.

CONTEXT: Little is known about the cost associated with a health center's rating as a patient-centered medical home (PCMH). OBJECTIVE: To determine whether PCMH rating is associated with operating cost among health centers funded by the US Health Resources and Services Administration. DESIGN, SETTING, AND PARTICIPANTS: Cross-sectional study of PCMH rating and operating cost in 2009. PCMH rating was assessed through surveys of health center administrators conducted by Harris Interactive of all 1009 Health Resources and Services Administration­funded community health centers. The survey provided scores from 0 (worst) to 100 (best) for total PCMH score and 6 subscales: access/communication, care management, external coordination, patient tracking, test/referral tracking, and quality improvement. Costs were obtained from the Uniform Data System reports submitted to the Health Resources and Services Administration. We used generalized linear models to determine the relationship between PCMH rating and operating cost. MAIN OUTCOME MEASURES: Operating cost per physician full-time equivalent, operating cost per patient per month, and medical cost per visit. RESULTS: Six hundred sixty-nine health centers (66%) were included in the study sample, with 340 excluded because of nonresponse or incomplete data. Mean total PCMH score was 60 (SD, 12; range, 21-90). For the average health center, a 10-point higher total PCMH score was associated with a $2.26 (4.6%) higher operating cost per patient per month (95% CI, $0.86-$4.12). Among PCMH subscales, a 10-point higher score for patient tracking was associated with higher operating cost per physician full-time equivalent ($27,300; 95% CI, $3047-$57,804) and higher operating cost per patient per month ($1.06; 95% CI, $0.29-$1.98). A 10-point higher score for quality improvement was also associated with higher operating cost per physician full-time equivalent ($32,731; 95% CI, $1571-$73,670) and higher operating cost per patient per month ($1.86; 95% CI, $0.54-$3.61). A 10-point higher PCMH subscale score for access/communication was associated with lower operating cost per physician full-time equivalent ($39,809; 95% CI, $1893-$63,169). CONCLUSIONS: According to a survey of health center administrators, higher scores on a scale that assessed 6 aspects of the PCMH were associated with higher health center operating costs. Two subscales of the medical home were associated with higher cost and 1 with lower cost.

Patient-centered medical home characteristics and staff morale in safety net clinics.

BACKGROUND: We sought to determine whether perceived patient-centered medical home (PCMH) characteristics are associated with staff morale, job satisfaction, and burnout in safety net clinics. METHODS: Self-administered survey among 391 providers and 382 clinical staff across 65 safety net clinics in 5 states in 2010. The following 5 subscales measured respondents' perceptions of PCMH characteristics on a scale of 0 to 100 (0 indicates worst and 100 indicates best): access to care and communication with patients, communication with other providers, tracking data, care management, and quality improvement. The PCMH subscale scores were averaged to create a total PCMH score. RESULTS: Six hundred three persons (78.0%) responded. In multivariate generalized estimating equation models, a 10% increase in the quality improvement subscale score was associated with higher morale (provider odds ratio [OR], 2.64; 95% CI, 1.47-4.75; staff OR, 3.62; 95% CI, 1.84-7.09), greater job satisfaction (provider OR, 2.45; 95% CI, 1.42-4.23; staff OR, 2.55; 95% CI 1.42-4.57), and freedom from burnout (staff OR, 2.32; 95% CI, 1.31-4.12). The total PCMH score was associated with higher staff morale (OR, 2.63; 95% CI, 1.47-4.71) and with lower provider freedom from burnout (OR, 0.48; 95% CI, 0.30-0.77). A separate work environment covariate correlated highly with the quality improvement subscale score and the total PCMH score, and PCMH characteristics had attenuated associations with morale and job satisfaction when included in models. CONCLUSIONS: Providers and staff who perceived more PCMH characteristics in their clinics were more likely to have higher morale, but the providers had less freedom from burnout. Among the PCMH subscales, the quality improvement subscale score particularly correlated with higher morale, greater job satisfaction, and freedom from burnout.

Development of a safety net medical home scale for clinics.

BACKGROUND: Existing tools to measure patient-centered medical home (PCMH) adoption are not designed for research evaluation in safety-net clinics. OBJECTIVE: Develop a scale to measure PCMH adoption in safety-net clinics. RESEARCH DESIGN: Cross-sectional survey. SUBJECTS: Sixty-five clinics in five states. MAIN MEASURES: Fifty-two-item Safety Net Medical Home Scale (SNMHS). The total score ranges from 0 (worst) to 100 (best) and is an average of multiple subscales (0-100): Access and Communication, Patient Tracking and Registry, Care Management, Test and Referral Tracking, Quality Improvement, and External Coordination. The scale was tested for internal consistency reliability and tested for convergent validity using The Assessment of Chronic Illness Care (ACIC) and the Patient-Centered Medical Home Assessment (PCMH-A). The scale was applied to centers in the sample. In addition, linear regression models were used to measure the association between clinic characteristics and medical home adoption. RESULTS: The SNMHS had high internal consistency reliability (Cronbach's alpha = 0.84). The SNMHS score correlated moderately with the ACIC score (r = 0.64, p < 0.0001) and the PCMH-A (r = 0.56, p < 0.001). The mean SNMHS score was 61 ± SD 13. Among the subscales, External Coordination (66 ± 16) and Access and Communication (65 ± 14) had the highest mean scores, while Quality Improvement (55 ± 17) and Care Management (55 ± 16) had lower mean scores. Clinic characteristics positively associated with total SNMHS score were having more providers (ß 15.8 95% CI 8.1-23.4 >8 provider FTEs compared to <4 FTEs) and participation in financial incentive programs (ß 8.4 95% 1.6-15.3). CONCLUSION: The SNMHS demonstrated reliability and convergent validity for measuring PCMH adoption in safety-net clinics. Some clinics have significant PCMH adoption. However, room for improvement exists in most domains, especially for clinics with fewer providers.

Incoming resident interest in global health: occasional travel versus a future career abroad?

BACKGROUND: While there is growing interest among residents in participating in international health experiences, it is unclear whether this interest will translate into intentions to pursue a global health career. We aimed to describe overall interest in and career intentions toward global health among interns. METHODS: We administered an anonymous survey to incoming interns in all specializations during graduate medical education orientation at 3 teaching hospitals affiliated with 2 Midwestern US medical schools in June 2009. Survey domains included demographics, previous global health experiences, interest in and barriers to participating in global health experiences during residency, and plans to pursue a future global health career. RESULTS: Response rate was 87% (299 of 345 residents). The most commonly reported barriers to participating in global health experiences were scheduling (82%) and financial (80%) concerns. Two-thirds of interns (65%) reported they were likely to focus on global health in their future career. Of those envisioning a global health career, 77% of interns reported interest in participating in short, occasional trips in the future; and 23% of interns intended to pursue a part-time or full-time career abroad. Interns committed to a career abroad were more willing to use vacation time (73% vs. 40% of all others, respectively; P < .001) or to personally finance the trip (58% vs. 27% of all others, respectively; P  =  < .001), and were less concerned about personal safety than interns not committed (9% vs. 26% of all others, respectively; P  =  .01). CONCLUSIONS: Although a large proportion of incoming interns report interest in global health careers, few are committed to a global health career. Medical educators could acknowledge career plans in global health when developing global health curricula.

Characterization of symptoms of sleep disorders in children with headache.

To investigate the prevalence of sleep disorders and their symptoms in children with headaches, 64 patients in the outpatient clinics of the University of Chicago Department of Pediatric Neurology were interviewed. Investigated disorders included excessive daytime sleepiness, narcolepsy, insomnia, sleep apnea, restlessness, and parasomnias. Unlike previous studies, subjects were compared with matched control patients by age and sex. Both headache and nonheadache groups completed a 111-item questionnaire detailing sleep symptoms and behaviors. It was found that children with headaches have a significantly higher prevalence of excessive daytime sleepiness, narcolepsy, and insomnia than children without headaches (P < 0.005), which is consistent with prior literature. A similar result was obtained in examining only migraines. However, we did not find a significantly higher prevalence of symptoms of sleep apnea, restlessness, and parasomnias, which contradicts previous literature. Also, the effect of medications taken by headache patients as a confounding factor was insignificant. Overall, pediatricians may find it beneficial to ask about daytime sleepiness, narcolepsy, and insomnia when treating a headache patient.