Behavioral public policy in practice: Misconceptions and opportunities.

I greatly respect the authors of the target article. However, in contrast to the target article's assertion, practitioners of behavioral public policy are indeed involved in developing and promoting systemic solutions. Its "i-frame"/"s-frame" distinction is incoherent, unhelpful, and obscures promising future directions for behavioral public policy. Its content and presentation undermine its stated goals and encourage sweeping dismissals of the field.

A manifesto for applying behavioural science.

Recent years have seen a rapid increase in the use of behavioural science to address the priorities of public and private sector actors. There is now a vibrant ecosystem of practitioners, teams and academics building on each other's findings across the globe. Their focus on robust evaluation means we know that this work has had an impact on important issues such as antimicrobial resistance, educational attainment and climate change. However, several critiques have also emerged; taken together, they suggest that applied behavioural science needs to evolve further over its next decade. This manifesto for the future of applied behavioural science looks at the challenges facing the field and sets out ten proposals to address them. Meeting these challenges will mean that behavioural science is better equipped to help to build policies, products and services on stronger empirical foundations-and thereby address the world's crucial challenges.

Evaluating the impact of a very low-cost intervention to increase practices' engagement with data and change prescribing behaviour: a randomized trial in English primary care.

BACKGROUND: Unsolicited feedback can solicit changes in prescribing. OBJECTIVES: Determine whether a low-cost intervention increases clinicians' engagement with data, and changes prescribing; with or without behavioural science techniques. METHODS: Randomized trial (ISRCTN86418238). The highest prescribing practices in England for broad-spectrum antibiotics were allocated to: feedback with behavioural impact optimization; plain feedback; or no intervention. Feedback was sent monthly for 3 months by letter, fax and email. Each included a link to a prescribing dashboard. The primary outcomes were dashboard usage and change in prescribing. RESULTS: A total of 1401 practices were randomized: 356 behavioural optimization, 347 plain feedback, and 698 control. For the primary engagement outcome, more intervention practices had their dashboards viewed compared with controls [65.7% versus 55.9%; RD 9.8%, 95% confidence intervals (CIs): 4.76% to 14.9%, P < 0.001]. More plain feedback practices had their dashboard viewed than behavioural feedback practices (69.1% versus 62.4%); but not meeting the P < 0.05 threshold (6.8%, 95% CI: -0.19% to 13.8%, P = 0.069). For the primary prescribing outcome, intervention practices possibly reduced broad-spectrum prescribing to a greater extent than controls (1.42% versus 1.12%); but again not meeting the P < 0.05 threshold (coefficient -0.31%, CI: -0.7% to 0.1%, P = 0.104). The behavioural impact group reduced broad-spectrum prescribing to a greater extent than plain feedback practices (1.63% versus 1.20%; coefficient 0.41%, CI: 0.007% to 0.8%, P = 0.046). No harms were detected. CONCLUSIONS: Unsolicited feedback increased practices' engagement with data, with possible slightly reduced antibiotic prescribing (P = 0.104). Behavioural science techniques gave greater prescribing effects. The modest effects on prescribing may reflect saturation from similar initiatives on antibiotic prescribing. CLINICAL TRIAL REGISTRATION: ISRCTN86418238.

Provision of social norm feedback to high prescribers of antibiotics in general practice: a pragmatic national randomised controlled trial.

BACKGROUND: Unnecessary antibiotic prescribing contributes to antimicrobial resistance. In this trial, we aimed to reduce unnecessary prescriptions of antibiotics by general practitioners (GPs) in England. METHODS: In this randomised, 2 × 2 factorial trial, publicly available databases were used to identify GP practices whose prescribing rate for antibiotics was in the top 20% for their National Health Service (NHS) Local Area Team. Eligible practices were randomly assigned (1:1) into two groups by computer-generated allocation sequence, stratified by NHS Local Area Team. Participants, but not investigators, were blinded to group assignment. On Sept 29, 2014, every GP in the feedback intervention group was sent a letter from England's Chief Medical Officer and a leaflet on antibiotics for use with patients. The letter stated that the practice was prescribing antibiotics at a higher rate than 80% of practices in its NHS Local Area Team. GPs in the control group received no communication. The sample was re-randomised into two groups, and in December, 2014, GP practices were either sent patient-focused information that promoted reduced use of antibiotics or received no communication. The primary outcome measure was the rate of antibiotic items dispensed per 1000 weighted population, controlling for past prescribing. Analysis was by intention to treat. This trial is registered with the ISRCTN registry, number ISRCTN32349954, and has been completed. FINDINGS: Between Sept 8 and Sept 26, 2014, we recruited and assigned 1581 GP practices to feedback intervention (n=791) or control (n=790) groups. Letters were sent to 3227 GPs in the intervention group. Between October, 2014, and March, 2015, the rate of antibiotic items dispensed per 1000 population was 126.98 (95% CI 125.68-128.27) in the feedback intervention group and 131.25 (130.33-132.16) in the control group, a difference of 4.27 (3.3%; incidence rate ratio [IRR] 0.967 [95% CI 0.957-0.977]; p<0.0001), representing an estimated 73,406 fewer antibiotic items dispensed. In December, 2014, GP practices were re-assigned to patient-focused intervention (n=777) or control (n=804) groups. The patient-focused intervention did not significantly affect the primary outcome measure between December, 2014, and March, 2015 (antibiotic items dispensed per 1000 population: 135.00 [95% CI 133.77-136.22] in the patient-focused intervention group and 133.98 [133.06-134.90] in the control group; IRR for difference between groups 1.01, 95% CI 1.00-1.02; p=0.105). INTERPRETATION: Social norm feedback from a high-profile messenger can substantially reduce antibiotic prescribing at low cost and at national scale; this outcome makes it a worthwhile addition to antimicrobial stewardship programmes. FUNDING: Public Health England.

Stating Appointment Costs in SMS Reminders Reduces Missed Hospital Appointments: Findings from Two Randomised Controlled Trials.

BACKGROUND: Missed hospital appointments are a major cause of inefficiency worldwide. Healthcare providers are increasingly using Short Message Service reminders to reduce 'Did Not Attend' (DNA) rates. Systematic reviews show that sending such reminders is effective, but there is no evidence on whether their impact is affected by their content. Accordingly, we undertook two randomised controlled trials that tested the impact of rephrasing appointment reminders on DNA rates in the United Kingdom. TRIAL METHODS: Participants were outpatients with a valid mobile telephone number and an outpatient appointment between November 2013 and January 2014 (Trial One, 10,111 participants) or March and May 2014 (Trial Two, 9,848 participants). Appointments were randomly allocated to one of four reminder messages, which were issued five days in advance. Message assignment was then compared against appointment outcomes (appointment attendance, DNA, cancellation by patient). RESULTS: In Trial One, a message including the cost of a missed appointment to the health system produced a DNA rate of 8.4%, compared to 11.1% for the existing message (OR 0.74, 95% CI 0.61-0.89, P<0.01). Trial Two replicated this effect (DNA rate 8.2%), but also found that expressing the same concept in general terms was significantly less effective (DNA rate 9.9%, OR 1.22, 95% CI 1.00-1.48, P<0.05). Moving from the existing reminder to the more effective costs message would result in 5,800 fewer missed appointments per year in the National Health Service Trust in question, at no additional cost. The study's main limitations are that it took place in a single location in England, and that it required accurate phone records, which were only obtained for 20% of eligible patients. We conclude that missed appointments can be reduced, for no additional cost, by introducing persuasive messages to appointment reminders. Future studies could examine the impact of varying reminder messages in other health systems. TRIAL REGISTRATION: Controlled-Trials.com 49432571.

A novel performance monitoring framework for health research systems: experiences of the National Institute for Health Research in England.

BACKGROUND: The National Institute for Health Research (NIHR) was established in 2006 with the aim of creating an applied health research system embedded within the English National Health Service (NHS). NIHR sought to implement an approach for monitoring its performance that effectively linked early indicators of performance with longer-term research impacts. We attempted to develop and apply a conceptual framework for defining appropriate key performance indicators for NIHR. METHOD: Following a review of relevant literature, a conceptual framework for defining performance indicators for NIHR was developed, based on a hybridisation of the logic model and balanced scorecard approaches. This framework was validated through interviews with key NIHR stakeholders and a pilot in one division of NIHR, before being refined and applied more widely. Indicators were then selected and aggregated to create a basket of indicators aligned to NIHR's strategic goals, which could be reported to NIHR's leadership team on a quarterly basis via an oversight dashboard. RESULTS: Senior health research system managers and practitioners endorsed the conceptual framework developed and reported satisfaction with the breadth and balance of indicators selected for reporting. CONCLUSIONS: The use of the hybrid conceptual framework provides a pragmatic approach to defining performance indicators that are aligned to the strategic aims of a health research system. The particular strength of this framework is its capacity to provide an empirical link, over time, between upstream activities of a health research system and its long-term strategic objectives.