Evaluating change in a pressured healthcare system: a cross-sectional study of implementation outcomes using routine data indicators and proxies.

BACKGROUND: Implementation evaluation should focus on implementation success, guided by theories and frameworks. With high staff vacancies in the health services, it is important to consider pragmatic methods of data collection for implementation evaluation. This paper presents a cross-sectional rapid evaluation of a handheld medical device designed for remote examinations, piloted in Northern England. By using downloaded device data and administrative records mapped to domains from the implementation outcomes framework, this evaluation offers a pragmatic example of assessing implementation success. METHODS: The pilot design was pragmatic: sites volunteered, decided which services to use the device in, and launched when ready. The pilot and evaluation together lasted 1 year. Data was downloaded from the devices, and administrative records for the pilot accessed. Variables were mapped to five of the implementation outcomes, after reviewing with the device manufacturer and pilot team to assess robustness. RESULTS: N=352 care episodes were recorded using the device with 223 patients. Out of 19 sites 'signed up' to the pilot, 5 launched and delivered 10 of 35 proposed projects: a site and project adoption rate of 26 and 29%, respectively. Six sites signed up to an extension period; three had launched and three had not during the original timelines, indicating some sustainability. Feasibility was high, with only one in seven care episodes needing to be repeated due to poor device quality or error (sound/audio/internet). Fidelity of device usage was low for two of the eight available device examinations. Device and staffing costs were high but potential cost savings were attributable to fewer in-person appointments. CONCLUSIONS: Through using device and administrative data, this evaluation minimised burden on busy healthcare staff yet was still guided by an evaluation framework. Five out of the eight implementation outcomes were measured, including sustainability and costs. The findings give insight into implementation challenges, particularly around adoption. For future research, it is recommended to engage with staff to prioritise outcome measurements and to focus on meaningful interpretation of indicators.

A Discrete Choice Experiment to Derive Health Utilities for Aromatic L-Amino Acid Decarboxylase (AADC) Deficiency in France.

PURPOSE: Cost-effectiveness evaluations of interventions require health utility data. However, in medical conditions, such as aromatic L-amino acid decarboxylase (AADC) deficiency, this presents problems due to the rarity of the disease. The study aim therefore was to employ a discrete choice experiment (DCE) to generate health utilities for AADC deficiency. METHODS: A previous literature review, clinician and parent interviews had identified six key AADC deficiency attributes: mobility, muscle weakness, oculogyric crises (OCG), feeding ability, cognitive impairment and screaming. A representative sample of the French general population was recruited. Participants rated 5 health state vignettes describing AADC deficiency using time-trade-off (TTO) and standard gamble (SG). Additionally, participants rated the worst health state using the Health Utility Index version 3 (HUI3). Subsequently, participants completed DCE 11 choice sets. Indirect DCE part-worth utilities were converted to health utilities using the anchors from the TTO, SG and HUI3. RESULTS: The DCE was completed online by 1001 participants (50.9% female; mean age 45.7 years). Most participants (596, 59.5%) provided consistent responses to the repeated choice task. Five models were evaluated, and one preference reversal ("head control"/"sitting unaided") was identified in all models. The rescaled utilities ranged from 0.3891 to 0.5577 (difference of 0.17 utilities) for TTO anchors corresponding to the worst (633233) and best (111111) health states. Health utilities ranged from 0.5534 to 0.7093 for the SG anchors. The disutility associated with a transition from "no problems walking" to "bedridden" was -0.0533, whereas disutility of moving from "constant screaming" relative to "no screaming" was -0.0248. The disutility associated with daily OCG was -0.0167. Disutilities for the other attributes were small although there were exceptions. CONCLUSION: A DCE was used to derive health utilities for AADC deficiency. These health utilities will subsequently be used in an economic model evaluating an AADC deficiency intervention.

Eliciting health state utilities for Aromatic L-amino Acid Decarboxylase (AADC) deficiency: a UK vignette study.

PURPOSE: The aim of this study was to generate health state utilities for aromatic L-amino acid decarboxylase (AADC) deficiency, a rare genetic, lifelong neurogenerative condition predominantly manifesting in young infants. METHODS: Participants were presented with health state vignettes. These had been previously developed based on published literature, clinician input, interviews with parents of AADC deficiency patients and expert opinion. A total of 5 health state vignettes were presented: bedridden, head control, sitting unsupported, standing with assistance and walking with assistance. Health state utilities (HSU) were elicited using time-trade off (TTO; 10-year time horizon) and the standard gamble (SG). The vignettes were completed online by panel participants drawn from a representative sample of the United Kingdom residential population. RESULTS: A total of 1598 participants completed the vignettes. Around 21% had incongruent responses (higher utilities for the bedridden compared to walking health states). Incongruent responses were associated with shorter task completion times, gender and parental status. These responses were removed from the analysis. Health state utilities (HSU) increased correspondingly as health states improved for both the TTO and SG. The mean HSU (standard deviation) for the TTO task were: bedridden state 0.49 (0.34); head control 0.54 (0.33), sitting unsupported 0.63 (0.31); standing with assistance 0.68 (0.31); and walking with assistance 0.73 (0.31). For the SG, mean health state utilities were: 0.56 (0.28), 0.57 (0.27), 0.67 (0.24), 0.70 (0.24), and 0.75 (0.25), respectively. CONCLUSION: Health state utilities were derived for AADC deficiency through a vignette study. These will be used for a cost-effectiveness model of an AADC deficiency treatment.

Eliciting Health State Utilities for Aromatic L-Amino Acid Decarboxylase (AADC) Deficiency: A Vignette Study in France.

PURPOSE: Health-related quality of life (HRQoL) is difficult to measure in rare diseases, especially in paediatric populations, yet capturing HRQoL is critical to evaluating treatment, including the cost-effectiveness of treatments. Given the ultra-rare nature of AADC deficiency indirect elicitation of HRQoL data through proxy caregiver/parent ratings is not feasible. In these circumstances, HRQoL data may be derived through vignette studies using the general population. The aim of the study was to generate health utility values specific for France for AADC deficiency using vignettes. METHODS: The study was completed online by panel participants from a French representative sample. Five health state vignettes, reflecting key milestones in the eladocagene exuparvovec clinical trials and economic model, were presented to the participants: "bedridden", "head control", "sitting unsupported", "standing with assistance" and "walking with assistance". The vignettes had been previously developed with input from parents of patients with AADC deficiency, patients and expert opinion. Participants also completed the Health Utilities Index-3 for the "bedridden" health state. RESULTS: A total of 1001 participants (51% females; mean age 46 years) completed the vignettes. Utilities increased linearly as the health state improved for both the time trade-off (TTO): 0.47 (standard deviation, SD 0.36) to 0.54 (SD 0.36) and standard gamble (SG): 0.61 (SD 0.29) to 0.67 (SD 0.27). A significant minority had incongruent responses (high utilities for the bedridden compared to walking health states) for the vignette (27%). When these were removed, the TTO health utilities (N=729) ranged from 0.39 (SD 0.36) to 0.56 (SD 0.38) and 0.61 (SD 0.30) to 0.69 (SD 0.27) for the SG. CONCLUSION: Health utilities were derived for AADC deficiency which will be used for a cost-effectiveness model of an AADC deficiency treatment.

A Discrete Choice Experiment to Derive Health Utilities for Aromatic L-Amino Acid Decarboxylase (AADC) Deficiency.

PURPOSE: Deriving health utilities for rare medical conditions such as aromatic L-amino acid decarboxylase (AADC) deficiency poses challenges. The rarity of AADC deficiency and the fact that this genetic condition often presents in very young children means that robust utility values cannot be derived from the child or their parent/caregiver. Alternative approaches, eg, discrete choice experiments (DCE), are required in order to provide health utilities. The aim of the study was to generate health utilities for AADC deficiency using a DCE. METHODS: The DCE was completed online by panel participants from a UK representative sample. The DCE comprised 6 AADC deficiency attributes (2-6 levels): mobility, muscle weakness, oculogyric crises, feeding ability, cognitive impairment and screaming. These were identified from published literature, clinician input, parent interviews and expert opinion. Participants were presented with 10 choice sets specified using an orthogonal design, including a repeat task to evaluate choice consistency. Participants were presented with 5 health state vignettes prior to the DCE. These were used to elicit time trade-off (TTO) utilities. Multinomial logit models were estimated for the DCE data. The TTO utilities for the worst/best health states were used as anchors to convert indirect DCE part-worth utilities to health utilities. RESULTS: A total of 1596 participants completed the DCE. The majority (70.7%) gave consistent responses to the repeated choice task; only 1.7% (27) always chose the same alternative for every choice set. Five models were evaluated. There was one preference reversal ("sitting unaided"/"standing with assistance") occurring in all models; these two mobility level coefficients were set to be equal in the final model. Rescaled utilities ranged from 0.494 to 0.7279, corresponding to the worst (633233) and best (111111) health states. CONCLUSION: Health utilities were derived for AADC deficiency through a DCE. These will be used for a cost-effectiveness model of an AADC deficiency treatment.

Deriving Vignettes for the Rare Disease AADC Deficiency Using Parent, Caregiver and Clinician Interviews to Evaluate the Impact on Health-Related Quality of Life.

PURPOSE: Aromatic l-amino acid decarboxylase (AADC) deficiency is a rare genetic condition, characterised by movement disorder, and speech and cognitive functioning impairment. To enable economic evaluation of treatments, health-related quality of life or utilities need to be derived. These are currently lacking in the literature. This is challenging, where patient numbers are small, particularly in paediatric populations. This study outlines the 5-stage development of vignettes describing AADC, for use in a subsequent health-state utility elicitation study, with an emphasis on caregiver and clinician engagement. METHODS: To align with the economic model, 5 vignettes describing 5 AADC deficiency motor milestones were developed, ranging from "bedridden" to "walking with assistance". Stage 1 comprised identification of symptoms/impairments from the literature and AADC deficiency charity websites. Stage 2 comprised group discussion with 3 caregivers. A symptoms matrix was developed, followed by draft vignettes (Stage 3). Eight clinicians reviewed these, alongside the same 3 caregivers via a survey (Stage 4). The vignettes were revised at stage 5. RESULTS: There was high consensus regarding symptoms at Stages 1 and 2, although the literature highlighted behavioural and autonomic symptoms, which caregivers did not. The symptoms were grouped into neuromuscular, autonomic, cognitive, behavioural and functional impairments. Clinician and caregiver vignette feedback highlighted the idiopathic nature of AADC. Despite this, clinicians suggested only 2 additional symptoms. Similarly, caregivers suggested 4 symptoms and a change to the wording used for the cognitive symptoms. Not all changes were included. CONCLUSION: The differing focus of caregivers, clinicians and the literature reinforces the importance of patient/caregiver engagement. The vignettes need to comprehensively capture what it is like to live with AADC deficiency, in order for the subsequent utilities to be robust. A focus on evidence triangulation, especially for idiopathic conditions, and how engagement is sought from caregivers are important future avenues of research.

Retrospective coding of health care professional cancer screening behaviours and of real-world interventions designed to support them: Identifying recommendations to optimize intervention design.

OBJECTIVES: Screening can detect cancer earlier. Uptake of breast, cervical, and bowel cancer screening in England is below 75%. This study identifies the barriers and facilitators underpinning HCP screening behaviours which can support screening uptake, and reviews the design of real-world interventions targeting these, assessing for congruence between the two. The aim was to provide recommendations to improve the design of interventions. DESIGN AND METHODS: Barriers/facilitators were identified by a literature review and qualitatively coded using the theoretical domains framework (TDF). Interventions were identified by stakeholders and coded using the behaviour change wheel and the taxonomy of behaviour change techniques. Congruence was assessed through comparing the intervention designs with behavioural science experts' recommendations which link the TDF domains to intervention design. Recommendations targeted missed opportunities. RESULTS: Barriers/facilitators were extracted from 60 papers and most frequently coded to the TDF domains: environmental context and resources, knowledge and beliefs about consequences. Thirty-one interventions were identified, most frequently education, training or enablement functions, delivered via communication/marketing or service provision, and using BCTs designed to shape knowledge or highlight the consequences of or antecedents to screening. Intervention design was largely congruent with recommendations. However, there was less use of persuasion and modelling intervention functions and a reliance on BCTs such as providing instruction when other BCTs could be considered. CONCLUSIONS: Recommendations include to consider a broader range of intervention functions and BCTs, particularly for training interventions which should make use of recommended BCTs such as 'graded tasks'.

Item banking and computer-adaptive testing in clinical trials: Standing in sight of the PROMISed land.

The use of patient-reported outcome instruments (PRO) in clinical trials in order to capture the impacts of treatment on patients is widespread. However, regulatory agencies have over the past decade highlighted the need for PROs that are fit for purpose and target relevant aspects of the patient's condition. Many legacy PROs were developed with little patient input, are lengthy, and may lack relevance having not been modified or adapted as medical treatments have advanced. Computer-adaptive test (CAT) systems provide the possibility of targeted approaches to capturing patient-centric data, while minimising patient burden. Coupled with greater patient input in the development of PROs, CAT offers the opportunity of overcoming the shortcomings of the previous generation of PROs. This paper describes the some of the issues facing legacy PROs, current regulatory guidance, and initiatives, such as the Patient-Reported Outcome Measurement Information System (PROMIS), as well as the early signs of use of CAT to capture PRO data in clinical trials.

Assessment of fidelity in an educational workshop designed to increase the uptake of a primary care alcohol screening recommendation.

RATIONALE, AIMS AND OBJECTIVES: Educational workshops are a commonly used quality improvement intervention. Often delivered by credible local health professionals who do not necessarily have skills in pedagogy, it can be challenging to achieve high intervention fidelity. This paper summarizes the fidelity assessment of a workshop designed to increase the uptake of a primary care alcohol screening recommendation. METHOD: Delivered in a single health region, the workshop comprised separate sessions delivered by three local health professionals, plus two role plays delivered by a commercial company. Sessions were tailored to local barriers. Meetings were held with presenters and an outline of the barriers was provided. Two researchers attended the workshop, rating the number of specified barriers targeted by presenters and their quality of delivery. Participant responsiveness was measured through attendees' feedback and intervention dose was calculated as the proportion of health professionals who attended and proportion of general practices represented. RESULTS: Exposure was low, with 62 of 545 health professionals from 30 of a possible 80 practices attending. Sixty-five per cent of the specified barriers were targeted. There was variability in quality of delivery and participant responsiveness; challenges included potential mixed messages, overreliance on didactic methods and certain barriers appearing easier to target than others. CONCLUSIONS: The framework provided a rounded assessment of intervention fidelity: intervention coverage was low, adherence was moderate and there was variability in the quality of delivery across presenters. Future studies testing the effectiveness of interventions delivered by local experts with and without brief training in pedagogy/behaviour change would be beneficial.

Cost and feasibility: an exploratory case study comparing use of a literature review method with questionnaires, interviews and focus groups to identify barriers for a behaviour-change intervention.

BACKGROUND: It is often recommended that behaviour-change interventions be tailored to barriers. There is a scarcity of research into the best method of barrier identification, although combining methods has been suggested to be beneficial. This paper compares the feasibility and costs of three different methods of barrier identification used in three implementation projects conducted in primary care. METHODS: Underpinned by a theory-base, project one used a questionnaire and interviews; project two used a single focus group and questionnaire, and project three used a literature review of published barriers. The feasibility of each project, as experienced by the research team, and labour costs are summarised. RESULTS: The literature review of published barriers was the least costly and most feasible method, being quick to conduct and avoiding the challenges of recruitment experienced when using interviews or a questionnaire. The feasibility of using questionnaires was further reduced by the time taken to develop the instruments. Conducting a single focus group was also found to be a more feasible method, taking less time than interviews to collect and analyse the barriers. CONCLUSIONS: Considering the ease of recruitment, time required and cost of the different methods to collect barriers is crucial at the start of implementation studies. The literature review method is the least costly and most feasible method. Use of a single focus group was found to be more feasible than conducting individual interviews or administering a questionnaire, with less recruitment challenges experienced, and quicker data collection. Future research would benefit from comparing the robustness of the methods in terms of the comprehensiveness of barriers identified.

Gathering opinion leader data for a tailored implementation intervention in secondary healthcare: a randomised trial.

BACKGROUND: Health professionals' behaviour is a key component in compliance with evidence-based recommendations. Opinion leaders are an oft-used method of influencing such behaviours in implementation studies, but reliably and cost effectively identifying them is not straightforward. Survey and questionnaire based data collection methods have potential and carefully chosen items can - in theory - both aid identification of opinion leaders and help in the design of an implementation strategy itself. This study compares two methods of identifying opinion leaders for behaviour-change interventions. METHODS: Healthcare professionals working in a single UK mental health NHS Foundation Trust were randomly allocated to one of two questionnaires. The first, slightly longer questionnaire, asked for multiple nominations of opinion leaders, with specific information about the nature of the relationship with each nominee. The second, shorter version, asked simply for a list of named "champions" but no more additional information. We compared, using Chi Square statistics, both the questionnaire response rates and the number of health professionals likely to be influenced by the opinion leaders (i.e. the "coverage" rates) for both questionnaire conditions. RESULTS: Both questionnaire versions had low response rates: only 15% of health professionals named colleagues in the longer questionnaire and 13% in the shorter version. The opinion leaders identified by both methods had a low number of contacts (range of coverage, 2-6 each). There were no significant differences in response rates or coverage between the two identification methods. CONCLUSIONS: The low response and population coverage rates for both questionnaire versions suggest that alternative methods of identifying opinion leaders for implementation studies may be more effective. Future research should seek to identify and evaluate alternative, non-questionnaire based, methods of identifying opinion leaders in order to maximise their potential in organisational behaviour change interventions.

Immediate versus sustained effects: interrupted time series analysis of a tailored intervention.

BACKGROUND: Detailed intervention descriptions and robust evaluations that test intervention impact--and explore reasons for impact--are an essential part of progressing implementation science. Time series designs enable the impact and sustainability of intervention effects to be tested. When combined with time series designs, qualitative methods can provide insight into intervention effectiveness and help identify areas for improvement for future interventions. This paper describes the development, delivery, and evaluation of a tailored intervention designed to increase primary health care professionals' adoption of a national recommendation that women with mild to moderate postnatal depression (PND) are referred for psychological therapy as a first stage treatment. METHODS: Three factors influencing referral for psychological treatment were targeted using three related intervention components: a tailored educational meeting, a tailored educational leaflet, and changes to an electronic system data template used by health professionals during consultations for PND. Evaluation comprised time series analysis of monthly audit data on percentage referral rates and monthly first prescription rates for anti-depressants. Interviews were conducted with a sample of health professionals to explore their perceptions of the intervention components and to identify possible factors influencing intervention effectiveness. RESULTS: The intervention was associated with a significant, immediate, positive effect upon percentage referral rates for psychological treatments. This effect was not sustained over the ten month follow-on period. Monthly rates of anti-depressant prescriptions remained consistently high after the intervention. Qualitative interview findings suggest key messages received from the intervention concerned what appropriate antidepressant prescribing is, suggesting this to underlie the lack of impact upon prescribing rates. However, an understanding that psychological treatment can have long-term benefits was also cited. Barriers to referral identified before intervention were cited again after the intervention, suggesting the intervention had not successfully tackled the barriers targeted. CONCLUSION: A time series design allowed the initial and sustained impact of our intervention to be tested. Combined with qualitative interviews, this provided insight into intervention effectiveness. Future research should test factors influencing intervention sustainability, and promote adoption of the targeted behavior and dis-adoption of competing behaviors where appropriate.

Exploring the feasibility of Conjoint Analysis as a tool for prioritizing innovations for implementation.

BACKGROUND: In an era of scarce and competing priorities for implementation, choosing what to implement is a key decision point for many behavioural change projects. The values and attitudes of the professionals and managers involved inevitably impact the priority attached to decision options. Reliably capturing such values is challenging. METHODS: This paper presents an approach for capturing and incorporating professional values into the prioritization of healthcare innovations being considered for adoption. Conjoint Analysis (CA) was used in a single UK Primary Care Trust to measure the priorities of healthcare professionals working with women with postnatal depression. Rating-based CA data was gathered using a questionnaire and then mapped onto 12 interventions being considered as a means of improving the management of postnatal depression. RESULTS: The 'impact on patient care' and the 'quality of supporting evidence' associated with the potential innovations were the most influential in shaping priorities. Professionals were least influenced by whether an innovation was an existing national or local priority, or whether current practice in the Trust was meeting minimum standards. Ranking the 12 innovations by the preferences of potential adopters revealed 'guided self help' was the top priority for implementation and 'screening questions for post natal depression' the least. When other factors were considered (such as the presence of routine data or planned implementation activity elsewhere in the Trust), the project team chose to combine the eight related treatments and implement these as a single innovation referred to as 'psychological therapies'. CONCLUSIONS: Using Conjoint Analysis to prioritise potential innovation implementation options is a feasible means of capturing the utility of stakeholders and thus increasing the chances of an innovation being adopted. There are some practical barriers to overcome such as increasing response rates to conjoint surveys before routine and unevaluated use of this technique should be considered.

Challenges in identifying barriers to adoption in a theory-based implementation study: lessons for future implementation studies.

BACKGROUND: Exploring barriers to the uptake of research based recommendations into practice is an important part of the development of implementation programmes. Techniques to identify barriers can include use of theory-informed questionnaires and qualitative interviews. Conceptualising and measuring theory-informed factors, and engaging health professionals' to uncover all potential barriers, can be a difficult task. This paper presents a case study of the process of trying to identify, systematically, the key factors influencing health professionals' referrals for women diagnosed with mild to moderate postnatal depression for psychological treatment. The paper illustrates how the factors were conceptualised and measured and explores the real world challenges experienced, with implications for future implementation studies. METHODS: Theory-informed factors were conceptualised and measured using a questionnaire and interviews. The questionnaire was piloted, before being administered to general practitioners, practice nurses and health visitors working in general practices in one area of the UK NHS. The interviews were conducted with a small sample of general practitioners who had not completed the questionnaire, further exploring factors influencing their referral decisions in the local context. RESULTS: The response rate to the questionnaire was low (19%), despite selecting the recommendation to target through engagement with local stakeholders and surveying local health professionals, and despite using two reminders, an incentive prize, and phone calls to practice managers to bolster response rates. CONCLUSIONS: Two significant challenges to achieving higher response rates and successfully exploring local context were identified: the difficulties of developing a robust- but feasible- questionnaire to explore theory-informed factors, and targeting recommendations that are important to policy makers, but which health professionals view as unimportant. This case study highlights the "trade-off" between scientifically rigorous collection of data against the pragmatism and flexibility requirements of "real world" implementation. Future implementation studies should explore different ways of identifying factors influencing the adoption of recommendations to bridge this gulf.

Statistical synthesis of contextual knowledge to increase the effectiveness of theory-based behaviour change interventions.

Tailored implementation strategies targeting health professionals' adoption of evidence-based recommendations are currently being developed. Research has focused on how to select an appropriate theoretical base, how to use that theoretical base to explore the local context, and how to translate theoretical constructs associated with the key factors found to influence innovation adoption into feasible and tailored implementation strategies. The reasons why an intervention is thought not to have worked are often cited as being: inappropriate choice of theoretical base; unsystematic development of the implementation strategies; and a poor evidence base to guide the process. One area of implementation research that is commonly overlooked is how to synthesize the data collected in a local context in order to identify what factors to target with the implementation strategies. This is suggested to be a critical process in the development of a theory-based intervention. The potential of multilevel modelling techniques to synthesize data collected at different hierarchical levels, for example, individual attitudes and team level variables, is discussed. Future research is needed to explore further the potential of multilevel modelling for synthesizing contextual data in implementation studies, as well as techniques for synthesizing qualitative and quantitative data.

Maximizing the impact of systematic reviews in health care decision making: a systematic scoping review of knowledge-translation resources.

CONTEXT: Barriers to the use of systematic reviews by policymakers may be overcome by resources that adapt and present the findings in formats more directly tailored to their needs. We performed a systematic scoping review to identify such knowledge-translation resources and evaluations of them. METHODS: Resources were eligible for inclusion in this study if they were based exclusively or primarily on systematic reviews and were aimed at health care policymakers at the national or local level. Resources were identified by screening the websites of health technology assessment agencies and systematic review producers, supplemented by an email survey. Electronic databases and proceedings of the Cochrane Colloquium and HTA International were searched as well for published and unpublished evaluations of knowledge-translation resources. Resources were classified as summaries, overviews, or policy briefs using a previously published classification. FINDINGS: Twenty knowledge-translation resources were identified, of which eleven were classified as summaries, six as overviews, and three as policy briefs. Resources added value to systematic reviews by, for example, evaluating their methodological quality or assessing the reliability of their conclusions or their generalizability to particular settings. The literature search found four published evaluation studies of knowledge-translation resources, and the screening of abstracts and contact with authors found three more unpublished studies. The majority of studies reported on the perceived usefulness of the service, although there were some examples of review-based resources being used to assist actual decision making. CONCLUSIONS: Systematic review producers provide a variety of resources to help policymakers, of which focused summaries are the most common. More evaluations of these resources are required to ensure users' needs are being met, to demonstrate their impact, and to justify their funding.

Translating research into practice in Leeds and Bradford (TRiPLaB): a protocol for a programme of research.

BACKGROUND: The National Institute for Health Research (NIHR) has funded nine Collaborations for Leadership in Applied Health Research and Care (CLAHRCs). Each CLAHRC is a partnership between higher education institutions (HEIs) and the NHS in nine UK regional health economies. The CLAHRC for Leeds, York, and Bradford comprises two 'research themes' and three 'implementation themes.' One of these implementation themes is Translating Research into Practice in Leeds and Bradford (TRiPLaB). TRiPLaB aims to develop, implement, and evaluate methods for inducing and sustaining the uptake of research knowledge into practice in order to improve the quality of health services for the people of Leeds and Bradford. METHODS: TRiPLaB is built around a three-stage, sequential, approach using separate, longitudinal case studies conducted with collaborating NHS organisations, TRiPLaB will select robust innovations to implement, conduct a theory-informed exploration of the local context using a variety of data collection and analytic methods, and synthesise the information collected to identify the key factors influencing the uptake and adoption of targeted innovations. This synthesis will inform the development of tailored, multifaceted, interventions designed to increase the translation of research findings into practice. Mixed research methods, including time series analysis, quasi-experimental comparison, and qualitative process evaluation, will be used to evaluate the impact of the implementation strategies deployed. CONCLUSION: TRiPLaB is a theory-informed, systematic, mixed methods approach to developing and evaluating tailored implementation strategies aimed at increasing the translation of research-based findings into practice in one UK health economy. Through active collaboration with its local NHS, TRiPLaB aims to improve the quality of health services for the people of Leeds and Bradford and to contribute to research knowledge regarding the interaction between context and adoption behaviour in health services.

A simple methodology for piloting and evaluating mass media interventions: an exploratory study.

To develop effective mass media health campaigns it is important to explore the behaviour-change techniques that make campaigns more or less effective. This exploratory study observed the behaviour-change techniques employed in two current healthy eating television programmes, and mapped these techniques onto key theoretical frameworks. Interviews were then conducted with six participants who watched the programmes, to identify which techniques were perceived to be more and less effective and to identify any disjunctures between the behaviour-change techniques used in the programmes and factors perceived by the participants to be particularly influential upon their healthy eating. The two programmes were found to use similar behaviour-change techniques, with a heavy reliance on providing general health motivation. Interviews revealed that participants perceived several specific barriers to eating healthily, felt the need for more specific guidance and emphasised the importance of identifying with the role models used in the programmes. Recommendations for future mass media health campaigns include the need to educate individuals about how to overcome specific barriers that they might face when trying to eat a healthy diet and to include a wider range of role models to encourage the audience to identify with the programme participants.

Use of a time series design to test effectiveness of a theory-based intervention targeting adherence of health professionals to a clinical guideline.

OBJECTIVES: The aim of this study was to test the effectiveness of a theory of planned behaviour intervention to increase adherence of community mental health professionals to a national suicide prevention guideline. DESIGN: Routinely collected audit adherence data from an intervention and control site were collected and analysed using time series analysis to test whether the intervention significantly increased adherence. The effects of a local and national event on adherence were also examined. METHOD: A Theory of Planned Behaviour (TPB) questionnaire, developed from interview findings, was administered to the health professionals. Subjective norms were found to be the most significant predictor of intention to adhere to the guideline, and were targeted with an interactive educational intervention. Time series analysis applied to routinely collected audit adherence data was used to test intervention effectiveness. RESULTS: The TPB accounted for 58% of the variance in intention to adhere, with subjective norms the only significant predictor. The intervention did not significantly increase adherence; however, the national and local events were found to have significantly increased adherence. CONCLUSIONS: The TPB was a useful framework for exploring barriers to adherence; however, this did not translate into an effective intervention. Future research should seek collaboration with local experts, and use this information in combination with the TPB, to develop interventions. Collaborative research with experts in pedagogy may also help to develop more effective interventions, particularly education-based interventions that require adult learning.