Real-time Feedback in Pay-for-Performance: Does More Information Lead to Improvement?

BACKGROUND: Pay-for-performance (P4P) has been used expansively to improve quality of care delivered by physicians. However, to what extent P4P works through the provision of information versus financial incentives is poorly understood. OBJECTIVE: To determine whether an increase in information feedback without changes to financial incentives resulted in improved physician performance within an existing P4P program. INTERVENTION/EXPOSURE: Implementation of a new registry enabling real-time feedback to physicians on quality measure performance. DESIGN: Observational, predictive piecewise model at the physician-measure level to examine whether registry introduction associated with performance changes. We used detailed physician quality measure data 3 years prior to registry implementation (2010-2012) and 2 years after implementation (2014-2015). We also linked physician-level data including age, gender, and board certification; group-level data including registry click rates; and patient panel data including chronic conditions. PARTICIPANTS: Four hundred thirty-four physicians continuously affiliated with Advocate from 2010 to 2015. MAIN MEASURES: Physician performance on ten quality metrics. KEY RESULTS: We found no consistent pattern of improvement associated with the availability of real-time information across ten measures. Relative to predicted performance without the registry, average performance increased for two measures (childhood immunization status-rotavirus (p < 0.001) and diabetes care-medical attention for nephropathy (p = 0.024)) and decreased for three measures (childhood immunization status-influenza (p < 0.001) and diabetes care-HbA1c testing (p < 0.001) and poor HbA1c control (p < 0.001)). Results were consistent for subgroup analysis on those most able to improve, i.e., physicians in the bottom tertile of performance prior to registry introduction. Physicians who improved most were in groups that accessed the registry more than those who improved least (8.0 vs 10.0 times per week, p = 0.010). CONCLUSIONS: More frequent provision of information, provided in real-time, was insufficient to improve physician performance in an existing P4P program with high baseline performance. Results suggest that electronic registries may not themselves drive performance improvement. Future work should consider testing information feedback enhancements with financial incentives.

Effect of Financial Bonus Size, Loss Aversion, and Increased Social Pressure on Physician Pay-for-Performance: A Randomized Clinical Trial and Cohort Study.

Importance: Despite limited effectiveness of pay-for-performance (P4P), payers continue to expand P4P nationally. Objective: To test whether increasing bonus size or adding the behavioral economic principles of increased social pressure (ISP) or loss aversion (LA) improves the effectiveness of P4P. Design, Setting, and Participants: Parallel studies conducted from January 1 to December 31, 2016, consisted of a randomized clinical trial with patients cluster-randomized by practice site to an active control group (larger bonus size [LBS] only) or to groups with 1 of 2 behavioral economic interventions added and a cohort study comparing changes in outcomes among patients of physicians receiving an LBS with outcomes in propensity-matched physicians not receiving an LBS. A total of 8118 patients attributed to 66 physicians with 1 of 5 chronic conditions were treated at Advocate HealthCare, an integrated health system in Illinois. Data were analyzed using intention to treat and multiple imputation from February 1, 2017, through May 31, 2018. Interventions: Physician participants received an LBS increased by a mean of $3355 per physician (LBS-only group); prefunded incentives to elicit LA and an LBS; or increasing proportion of a P4P bonus determined by group performance from 30% to 50% (ISP) and an LBS. Main Outcomes and Measures: The proportion of 20 evidence-based quality measures achieved at the patient level. Results: A total of 86 physicians were eligible for the randomized trial. Of these, 32 were excluded because they did not have unique attributed patients. Fifty-four physicians were randomly assigned to 1 of 3 groups, and 33 physicians (54.5% male; mean [SD] age, 57 [10] years) and 3747 patients (63.6% female; mean [SD] age, 64 [18] years) were included in the final analysis. Nine physicians and 864 patients were randomized to the LBS-only group, 13 physicians and 1496 patients to the LBS plus ISP group, and 11 physicians and 1387 patients to the LBS plus LA group. Physician characteristics did not differ significantly by arm, such as mean (SD) physician age ranging from 56 (9) to 59 (9) years, and sex (6 [46.2%] to 6 [66.7%] male). No differences were found between the LBS-only and the intervention groups (adjusted odds ratio [aOR] for LBS plus LA vs LBS-only, 0.86 [95% CI, 0.65-1.15; P = .31]; aOR for LBS plus ISP vs LBS-only, 0.95 [95% CI, 0.64-1.42; P = .81]; and aOR for LBS plus ISP vs LBS plus LA, 1.10 [95% CI, 0.75-1.61; P = .62]). Increased bonus size was associated with a greater increase in evidence-based care relative to the comparison group (risk-standardized absolute difference-in-differences, 3.2 percentage points; 95% CI, 1.9-4.5 percentage points; P < .001). Conclusions and Relevance: Increased bonus size was associated with significantly improved quality of care relative to a comparison group. Adding ISP and opportunities for LA did not improve quality. Trial Registration: ClinicalTrials.gov Identifier: NCT02634879.

Measuring unmet needs and services among persons with traumatic brain injury.

OBJECTIVES: (1) To develop a comprehensive list of needs and services appropriate for persons with traumatic brain injury (TBI); (2) to determine whether these needs and services formed unidimensional hierarchies from least common to most common; (3) to describe the relationship between unmet needs and services received; and (4) to estimate the extent to which a variety of demographic, injury, and service characteristics predict unmet needs. DESIGN: Statewide mailed survey. SETTING: Illinois communities. PARTICIPANTS: A total of 895 persons who had had a TBI recruited from Brain Injury Association members and rehabilitation service recipients. The median time post-TBI was 7 years; the median age was 37 years. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: A 27-item instrument assessing service needs and utilization of services, and equal-interval measures of needs and services derived with Rasch analysis. RESULTS: The most prevalent unmet needs were improving memory or problem-solving skills (51.9%), increasing income (50.5%), and improving job skills (46.3%). The instrument defined unidimensional and reliable constructs of needs and services. Persons with greater unmet needs tended to receive fewer services; to report lower life satisfaction and worse medical health and psychologic well-being since injury; to be younger, single, black, dependent in 1 or more daily activities; and to have more recent injuries. CONCLUSIONS: The results show the common pattern of unmet needs and services and emphasize the importance of comprehensive, statewide assessment of services and needs in developing policies.