Improving Quality and Safety for Patients After Hospital Discharge: Primary Care as the Lead Integrator in Postdischarge Care Transitions.

To understand current and idealized primary care-based care transition workflow processes for hospitalized patients, we conducted 133 interviews with staff at 9 primary care sites; community agency staff (n = 18); recently discharged patients (n = 33); and primary care thought leaders (n = 9). Current postdischarge workflows in primary care vary widely across settings, are often implemented inconsistently, and rarely involve communications with the patient or inpatient team during hospitalization. Based on these findings, we propose 5 principles for primary care practices to facilitate active involvement in postdischarge care, beginning during the hospital admission and extending until after the initial postdischarge primary care visit.

Assessing the Implementation and Effectiveness of the Electronic Patient-Reported Outcome Tool for Older Adults With Complex Care Needs: Mixed Methods Study.

BACKGROUND: Goal-oriented care is being adopted to deliver person-centered primary care to older adults with multimorbidity and complex care needs. Although this model holds promise, its implementation remains a challenge. Digital health solutions may enable processes to improve adoption; however, they require evaluation to determine feasibility and impact. OBJECTIVE: This study aims to evaluate the implementation and effectiveness of the electronic Patient-Reported Outcome (ePRO) mobile app and portal system, designed to enable goal-oriented care delivery in interprofessional primary care practices. The research questions driving this study are as follows: Does ePRO improve quality of life and self-management in older adults with complex needs? What mechanisms are likely driving observed outcomes? METHODS: A multimethod, pragmatic randomized controlled trial using a stepped-wedge design and ethnographic case studies was conducted over a 15-month period in 6 comprehensive primary care practices across Ontario with a target enrollment of 176 patients. The 6 practices were randomized into either early (3-month control period; 12-month intervention) or late (6-month control period; 9-month intervention) groups. The primary outcome measure of interest was the Assessment of Quality of Life-4D (AQoL-4D). Data were collected at baseline and at 3 monthly intervals for the duration of the trial. Ethnographic data included observations and interviews with patients and providers at the midpoint and end of the intervention. Outcome data were analyzed using linear models conducted at the individual level, accounting for cluster effects at the practice level, and ethnographic data were analyzed using qualitative description and framework analysis methods. RESULTS: Recruitment challenges resulted in fewer sites and participants than expected; of the 176 target, only 142 (80.6%) patients were identified as eligible to participate because of lower-than-expected provider participation and fewer-than-expected patients willing to participate or perceived as ready to engage in goal-setting. Of the 142 patients approached, 45 (32%) participated. Patients set a variety of goals related to self-management, mental health, social health, and overall well-being. Owing to underpowering, the impact of ePRO on quality of life could not be definitively assessed; however, the intervention group, ePRO plus usual care (mean 15.28, SD 18.60) demonstrated a nonsignificant decrease in quality of life (t24=-1.20; P=.24) when compared with usual care only (mean 21.76, SD 2.17). The ethnographic data reveal a complex implementation process in which the meaningfulness (or coherence) of the technology to individuals' lives and work acted as a key driver of adoption and tool appraisal. CONCLUSIONS: This trial experienced many unexpected and significant implementation challenges related to recruitment and engagement. Future studies could be improved through better alignment of the research methods and intervention to the complex and diverse clinical settings, dynamic goal-oriented care process, and readiness of provider and patient participants. TRIAL REGISTRATION: ClinicalTrials.gov NCT02917954; https://clinicaltrials.gov/ct2/show/NCT02917954.

Characteristics of Patients and Proxy Caregivers Using Patient Portals in the Setting of Serious Illness and End of Life.

Background: There are few studies examining the usage and utility of patient portals among seriously ill and end-of-life populations and their caregivers. Objective: The aim of this study was to describe portal user characteristics among patients and their caregivers (proxy login) at two time points: (1) the 12 months following an electronic medical record flag for serious illness and (2) during the last 12 months of life. Methods: A retrospective cohort analysis of Kaiser Permanente Colorado (KPCO) patients with serious illness, as defined by Kaiser Permanente's prognostic algorithm, and their proxy caregivers was performed for the two time periods. Use was characterized as (1) the discrete number of days the portal was used and (2) the number of days that portal features were accessed. Differences in use by user characteristics were assessed. Results: Patients flagged for serious illness (N = 6129) were 70.4 ± 14.2 years of age, and used the portal on average 50.4 days. Patients (N = 6517) in the last year of life were 76.7 ± 13.7 years of age and used the portal on average 43 days. Caregiver proxy use of the portal was low in both cohorts. Patients who were older, female, non-White, and healthier were less likely to use the portal. Conclusions: In comparison with overall KPCO portal use and recent patient portal studies examining use patterns, patient portal use was high among patients flagged with serious illness and nearing the end of life. However, because use was associated with age, gender, and race, addressing barriers to portal adoption among underserved populations and caregiver proxies is key to better leveraging patient portal systems for palliative and end-of-life care.

Clinical Quality Measure Exchange is Not Easy.

PURPOSE: The Trial of Aggregate Data Exchange for Maintenance of Certification and Raising Quality was a randomized controlled trial which first had to test whether quality reporting could be a by-product of clinical care. We report on the initial descriptive study of the capacity for and quality of exchange of whole-panel, standardized quality measures from health systems. METHODS: Family physicians were recruited from 4 health systems with mature quality measurement programs and agreed to submit standardized, physician-level quality measures for consenting physicians. Identified measure or transfer errors were captured and evaluated for root-cause problems. RESULTS: The health systems varied considerably by patient demographics and payer mix. From the 4 systems, 256 family physicians elected to participate. Of 19 measures negotiated for use, 5 were used by all systems. There were more than 15 types of identified errors including breaks in data delivery, changes in measures, and nonsensical measure results. Only 1 system had no identified errors. CONCLUSIONS: The secure transfer of standardized, physician-level quality measures from 4 health systems with mature measure processes proved difficult. There were many errors that required human intervention and manual repair, precluding full automation. This study reconfirms an important problem, namely, that despite widespread health information technology adoption and federal meaningful use policies, we remain far from goals to make clinical quality reporting a reliable by-product of care.

Randomized Clinical Trial of a Clinical Decision Support Tool for Improving the Appropriateness Scores for Ordering Imaging Studies in Primary and Specialty Care Ambulatory Clinics.

OBJECTIVE. The objective of our study was to evaluate whether the use of a clinical decision support (CDS) tool improved the appropriateness scores of orders for advanced imaging in clinical practice. MATERIALS AND METHODS. We used a stepped-wedge, cluster randomized clinical trial to evaluate the effectiveness of a CDS tool in an integrated health care system. Clinicians entered structured indications for each CT and MRI order, and the indications were electronically scored against appropriateness criteria to assign an appropriateness score. We compared the proportion of orders with adjusted appropriateness scores of 7 or greater (on a 1-9 scale) before and after activation of best practice alerts (BPAs) triggered for orders with low or marginal appropriateness scores. Secondary outcomes included the rate per month of orders for advanced imaging and the proportion of orders for which the radiology department requested changes. RESULTS. Between October 2015 and February 2016, 941 clinicians ordered 22,279 CT or MRI studies that met eligibility criteria. Before activation of the BPA, the mean proportion of appropriate orders (adjusted for time and clinic effect) was 77.0% (95% CI, 75.5-78.4%), which increased to 80.1% (95% CI, 78.7-81.5%) after activation (p = 0.001). There was no significant change in the rate of orders per month for advanced imaging. The proportion of order changes requested by the radiology department decreased from 5.7% (95% CI, 5.6-5.9%) before CDS implementation to 5.3% (95% CI, 5.1-5.5%) after CDS implementation (p < 0.001). CONCLUSION. Using an evidence-based CDS tool in clinical practice was associated with a modest but significant improvement in the appropriateness scores of advanced imaging orders.

Adjuvant gemcitabine-docetaxel chemotherapy for stage I uterine leiomyosarcoma: Trends and survival outcomes.

OBJECTIVE: To assess recent trends of administering adjuvant gemcitabine-docetaxel (GD) chemotherapy for Stage I uterine leiomyosarcoma, and to compare disease-free and overall survival between women who received and did not receive adjuvant GD chemotherapy. METHODS: All patients diagnosed with Stage I uterine leiomyosarcoma in a California-Colorado population-based health plan inclusive of 2006-2013 were included in a retrospective cohort. Adjuvant GD chemotherapy rates, clinico-pathologic characteristics and survival estimates were assessed. RESULTS: Of 111 women with Stage I uterine leiomyosarcoma, 33 received adjuvant GD (median 4cycles), 77 received no chemotherapy, and 1 patient excluded for non-GD chemotherapy. GD-chemotherapy and no-chemotherapy groups were similar with respect to age, stage (IA/IB), uterine weight, mitotic index, body mass index, and Charlson comorbidity score. Non-Hispanic white women were twice as likely to receive adjuvant chemotherapy as non-white or Hispanic women (37.7 vs. 17.1%, P=0.02). The proportion of women receiving adjuvant GD chemotherapy increased from 6.5% in 2006-2008 to 46.9% in 2009-2013 (P<0.001). There was no significance difference in unadjusted Kaplan-Meyer estimated disease-free (P=0.95) or overall survival (P=0.43) between GD-chemotherapy and no-chemotherapy cohorts. Corresponding adjusted Cox proportional hazard ratios for adjuvant GD chemotherapy compared to no chemotherapy were 1.01 (95% confidence interval [CI] 0.57-1.80, P=0.97) for recurrence and 1.28 (95% CI 0.69-2.36, P-0.48) for mortality. CONCLUSIONS: Use of adjuvant GD chemotherapy for Stage I uterine leiomyosarcoma has increased significantly in the last decade, despite unclear benefit. Compared to no chemotherapy, 4-6cycles of adjuvant GD chemotherapy does not appear to alter survival outcomes.

Supporting Goal-Oriented Primary Health Care for Seniors with Complex Care Needs Using Mobile Technology: Evaluation and Implementation of the Health System Performance Research Network, Bridgepoint Electronic Patient Reported Outcome Tool.

BACKGROUND: Older adults experiencing multiple chronic illnesses are at high risk of hospitalization and health decline if they are unable to manage the significant challenges posed by their health conditions. Goal-oriented care approaches can provide better care for these complex patients, but clinicians find the process of ascertaining goals "too complex and too-time consuming," and goals are often not agreed upon between complex patients and their providers. The electronic patient reported outcomes (ePRO) mobile app and portal offers an innovative approach to creating and monitoring goal-oriented patient-care plans to improve patient self-management and shared decision-making between patients and health care providers. The ePRO tool also supports proactive patient monitoring by the patient, caregiver(s), and health care provider. It was developed with and for older adults with complex care needs as a means to improve their quality of life. OBJECTIVE: Our proposed project will evaluate the use, effectiveness, and value for money of the ePRO tool in a 12-month multicenter, randomized controlled trial in Ontario; targeting individuals 65 or over with two or more chronic conditions that require frequent health care visits to manage their health conditions. METHODS: Intervention groups using the ePRO tool will be compared with control groups on measures of quality of life, patient experience, and cost-effectiveness. We will also evaluate the implementation of the tool. RESULTS: The proposed project presented in this paper will be funded through the Canadian Institute for Health Research (CIHR) eHealth Innovation Partnerships Program (eHIPP) program (CIHR-348362). The expected completion date of the study is November, 2019. CONCLUSIONS: We anticipate our program of work will support improved quality of life and patient self-management, improved patient-centered primary care delivery, and will encourage the adoption of goal-oriented care approaches across primary health care systems. We have partnered with family health teams and quality improvement organizations in Ontario to ensure that our research is practical and that findings are shared widely. We will work with our established international network to develop an implementation framework to support continued adaptation and adoption across Canada and internationally.

Correction of: Supporting Goal-Oriented Primary Health Care for Seniors with Complex Care Needs Using Mobile Technology: Evaluation and Implementation of the Health System Performance Research Network, Bridgepoint Electronic Patient Reported Outcome Tool.

[This corrects the article DOI: 10.2196/resprot.5756.].

Association between secure patient-clinician email and clinical services utilisation in a US integrated health system: a retrospective cohort study.

OBJECTIVE: To assess associations between secure patient-clinician email use and clinical services utilisation over time. DESIGN: Retrospective cohort study between July 2010 and December 2013. Controlling for a utilisation surge around first secure email use, we analysed difference of differences between propensity score-matched groups of secure patient-clinician email users and non-users for utilisation 1-12 months before and 7-18 months after first email (users) or a randomly assigned index date (non-users). SETTING: US integrated healthcare delivery system. PARTICIPANTS: 9345 adults with first secure email use between July 2011 and July 2012 and continuous enrolment for ≥30 months and 9345 adults without secure email use between July 2010 and July 2012 matched to users on demographics, health status, and baseline utilisation. PRIMARY OUTCOME MEASURES: Rates of office visits, patient-initiated phone calls, scheduled telephone visits, after-hours clinic visits, emergency department visits, and hospitalisations. RESULTS: After controlling for multiple factors, no statistically significant differences in utilisation between secure email users and non-users occurred. Utilisation transiently increased by 88-237% around first email use. Annual rates of patient-initiated phone calls decreased among secure email users, 0.2 fewer calls per person (95% CI -0.3 to -0.1), from a mean of 4.1 calls per person 1-12 months before first use to a mean of 3.8 calls per person 7-18 months after first use. Rates of patient-initiated phone calls also decreased among non-users, 0.1 fewer calls per person (95% CI -0.2 to 0.0), from a mean of 4.2 calls per person 1-12 months before the index date to mean of 4.1 calls per person 7-18 months after the index date. CONCLUSIONS: Compared with non-users, patient use of secure email with clinicians was not associated with statistically significant differences in clinical services utilisation 7-18 months after first use.

Secure e-mailing between physicians and patients: transformational change in ambulatory care.

Secure e-mailing between Kaiser Permanente physicians and patients is widespread; primary care providers receive an average of 5 e-mails from patients each workday. However, on average, secure e-mailing with patients has not substantially impacted primary care provider workloads. Secure e-mail has been associated with increased member retention and improved quality of care. Separate studies associated patient portal and secure e-mail use with both decreased and increased use of other health care services, such as office visits, telephone encounters, emergency department visits, and hospitalizations. Directions for future research include more granular analysis of associations between patient-physician secure e-mail and health care utilization.

Association of online patient access to clinicians and medical records with use of clinical services.

CONTEXT: Prior studies suggest that providing patients with online access to health records and e-mail communication with physicians may substitute for traditional health care services. OBJECTIVE: To assess health care utilization by both users and nonusers of online access to health records before and after initiation of MyHealthManager (MHM), a patient online access system. DESIGN, SETTING, AND PARTICIPANTS: Retrospective cohort study of the use of health care services by members (≥18 years old) who were continuously enrolled for at least 24 months during the study period March 2005 through June 2010 in Kaiser Permanente Colorado, a group model, integrated health care delivery system. Propensity scores (using age, sex, utilization frequencies, and chronic illnesses) were used for cohort matching. Unadjusted utilization rates were calculated for both MHM users and nonusers and were the basis for difference-of-differences analyses. We also used generalized estimating equations to compare the adjusted rates of utilization of health care services before and after online access. MAIN OUTCOME MEASURES: Rates of office visits, telephone encounters, after-hours clinic visits, emergency department encounters, and hospitalizations between members with and without online access. RESULTS: Comparing the unadjusted rates for use of clinical services before and after the index date between the matched cohorts, there was a significant increase in the per-member rates of office visits (0.7 per member per year; 95% CI, 0.6-0.7; P < .001) and telephone encounters (0.3 per member per year; 95% CI, 0.2-0.3; P < .001). There was also a significant increase in per-1000-member rates of after-hours clinic visits (18.7 per 1000 members per year; 95% CI, 12.8-24.3; P < .001), emergency department encounters (11.2 per 1000 members per year; 95% CI, 2.6-19.7; P = .01), and hospitalizations (19.9 per 1000 members per year; 95% CI, 14.6-25.3; P < .001) for MHM users vs nonusers. CONCLUSION: Having online access to medical records and clinicians was associated with increased use of clinical services compared with group members who did not have online access.

Comparing virtual consults to traditional consults using an electronic health record: an observational case-control study.

BACKGROUND: Patients have typically received health care through face-to-face encounters. However, expansion of electronic communication and electronic health records (EHRs) provide alternative means for patient and physicians to interact. Electronic consultations may complement regular healthcare by providing "better, faster, cheaper" processes for diagnosing, treating, and monitoring health conditions. Virtual consultation between physicians may provide a method of streamlining care, potentially saving patients the time and expense of added visits. The purpose of this study was to compare physician usage and patient satisfaction with virtual consultations (VCs) with traditional consultations (TCs) facilitated within an EHR. METHODS: We conducted an observational case-control survey study within Kaiser Permanente, Colorado. A sample of patients who had VCs requested by physicians (N = 270) were matched with patients who had TCs requested by physicians (N = 270), by patient age, gender, reason for the consult, and specialty department. These patients (VC and TC), were invited to participate in a satisfaction survey. In addition, 205 primary care physicians who submitted a VC or TC were surveyed. RESULTS: During the study period, 58,146 VC or TC were requested (TC = 96.3%). Patients who completed a satisfaction survey (267 out of 540 patients, 49.4% response rate) indicated they were satisfied with their care, irrespective of the kind of consult (mean 10-point Likert score of 8.5). 88 of 205 primary care physicians surveyed (42.9%) returned at least one survey; VC and TC survey response rates and consulted departments were comparable (p = 0.13). More TCs than VCs requested transfer of patient care (p = 0.03), assistance with diagnosis (p = 0.04) or initiating treatment (p =0.04). Within 3 weeks of the consultation request, 72.1% of respondents reported receiving information from VCs, compared with 33.9% of the TCs (p < 0.001). Utility of information provided by consultants and satisfaction with consultations did not differ between VCs and TCs. CONCLUSIONS: Referring physicians received information from consultants more quickly from VCs compared with TCs, but the value and application of information from both types of consultations were similar. VCs may decrease the need for face-to-face specialty encounters without a decrease in the patient's perception of care.

Computerized alert reduced D-dimer testing in the elderly.

OBJECTIVE: To assess the effect of a targeted age-specific computerized alert to reduce D-dimer testing in elderly patients. STUDY DESIGN: A single-crossover cluster randomized trial of computerized alerts during physician order entry involving 8 ambulatory care clinics in a group-model integrated care delivery system. METHODS: The rate of completed D-dimer tests per 1000 patient visits, ratio of completed venous ultrasonography to completed D-dimer tests, and rate of completed venous ultrasonography per 1000 patient visits. RESULTS: The rate of completed D-dimer tests per 1000 visits among patients 65 years and older in intervention clinics decreased from 5.02 to 1.52 (95% confidence interval [CI], -4.20 to -2.80; P <.001), which persisted throughout the study period. The rate of completed D-dimer tests per 1000 visits among patients 65 years and older in control clinics decreased from 3.14 to 2.11 (95% CI, -1.66 to -0.04; P <.001 for interaction). After activation of the alert in control clinics, the rate of completed D-dimer tests per 1000 visits among patients 65 years and older decreased from 2.11 to 0.81 (95% Cl, -1.79 to -0.80; P <.001). After activation of the alert in each clinic group, the ratios of completed venous ultrasonography to completed D-dimer tests increased from 1.17 to 4.05 (95% CI, 2.52-3.22) and from 2.25 to 7.29 (95% CI, 3.74-6.35) in intervention clinics and control clinics, respectively (P <.001 for both). CONCLUSION: An electronic age-specific alert targeted to a specific condition reduced D-dimer testing in this elderly population of outpatients and demonstrated a persistent effect.

Risk adjusting community-acquired pneumonia hospital outcomes using automated databases.

OBJECTIVE: To describe the development and assessment of the Abbreviated Fine Severity Score (AFSS), a simplified version of the Pneumonia Severity Index (PSI) suitable for providing risk-adjusted reports to clinicians caring for patients hospitalized with community-acquired pneumonia. STUDY DESIGN: Retrospective cohort study. METHODS: We defined the AFSS based on data available in administrative and laboratory databases. We downloaded and linked these hospitalization and laboratory data from 2 cohorts (11,030 patients and 6147 patients) hospitalized with community-acquired pneumonia in all Kaiser Permanente Medical Care Program hospitals in northern California. We then assessed the relationship between the AFSS and mortality, length of stay, intensive care unit admission, and the use of assisted ventilation. Using logistic regression analysis, we assessed the performance of the AFSS and determined the area under the receiver operating characteristic curve (c statistic). Using a combination of manual and electronic medical record review, we compared the AFSS with the full PSI in 2 subsets of patients in northern California and Denver, Colorado, whose medical records were manually reviewed. RESULTS: The AFSS compares favorably with the PSI with respect to predicting mortality. It has good discrimination with respect to inhospital (c = 0.74) and 30-day (c = 0.75) mortality. It also correlates strongly with the PSI (r = 0.87 and r = 0.93 in the 2 medical record review subsets). CONCLUSIONS: The AFSS can be used to provide clinically relevant risk-adjusted outcomes reports to clinicians in an integrated healthcare delivery system. It is possible to apply risk-adjustment methods from research settings to operational ones.

Evaluation of laboratory monitoring alerts within a computerized physician order entry system for medication orders.

BACKGROUND: Errors involving medication use are common. Computerized physician order entry (CPOE) can improve prescribing practices. Few studies have examined the effect of CPOE in combination with decision support tools on prescribing practices in the outpatient setting. Less is known about prescribers' adherence to laboratory monitoring recommendations. OBJECTIVE: To evaluate if reminders presented during CPOE for medications would increase physicians' compliance with guidelines for laboratory monitoring at initiation of therapy. STUDY DESIGN: Randomized prospective intervention study. METHODS: Two hundred seven primary care physicians in a group-model managed care organization were randomized to receive or not receive drug laboratory monitoring alerts within the CPOE system. Adherence to laboratory monitoring recommendations for patients prescribed selected medications was compared between physician groups. RESULTS: There was no significant difference between the control and intervention group physicians in the overall rate of compliance with ordering the recommended laboratory monitoring for patients prescribed study medications. Laboratory monitoring was performed as recommended 56.6% of the time in the intervention group compared with 57.1% of the time in the control group (P = .31). In cases in which a statistically significant difference was demonstrated, improved compliance favored the intervention group (eg, 71.2% vs 62.3% [P = .003] for gemfibrozil and 75.7% vs 73.9% [P = .05] for statins). CONCLUSIONS: As CPOE becomes more prevalent, additional research is needed to determine effective decision support tools. These findings then should be communicated to the developers and users of computerized medical record systems.

Natural language processing in the electronic medical record: assessing clinician adherence to tobacco treatment guidelines.

BACKGROUND: Comprehensively assessing care quality with electronic medical records (EMRs) is not currently possible because much data reside in clinicians' free-text notes. METHODS: We evaluated the accuracy of MediClass, an automated, rule-based classifier of the EMR that incorporates natural language processing, in assessing whether clinicians: (1) asked if the patient smoked; (2) advised them to stop; (3) assessed their readiness to quit; (4) assisted them in quitting by providing information or medications; and (5) arranged for appropriate follow-up care (i.e., the 5A's of smoking-cessation care). DESIGN: We analyzed 125 medical records of known smokers at each of four HMOs in 2003 and 2004. One trained abstractor at each HMO manually coded all 500 records according to whether or not each of the 5A's of smoking cessation care was addressed during routine outpatient visits. MEASUREMENTS: For each patient's record, we compared the presence or absence of each of the 5A's as assessed by each human coder and by MediClass. We measured the chance-corrected agreement between the human raters and MediClass using the kappa statistic. RESULTS: For "ask" and "assist," agreement among human coders was indistinguishable from agreement between humans and MediClass (p>0.05). For "assess" and "advise," the human coders agreed more with each other than they did with MediClass (p<0.01); however, MediClass performance was sufficient to assess quality in these areas. The frequency of "arrange" was too low to be analyzed. CONCLUSIONS: MediClass performance appears adequate to replace human coders of the 5A's of smoking-cessation care, allowing for automated assessment of clinician adherence to one of the most important, evidence-based guidelines in preventive health care.