Psychometric properties of two implementation measures: Normalization MeAsure Development questionnaire (NoMAD) and organizational readiness for implementing change (ORIC).

Background: Effective interventions need to be implemented successfully to achieve impact. Two theory-based measures exist for measuring the effectiveness of implementation strategies and monitor implementation progress. The Normalization MeAsure Development questionnaire (NoMAD) explores the four core concepts (Coherence, Cognitive Participation, Collective Action, Reflexive Monitoring) of the Normalization Process Theory. The Organizational Readiness for Implementing Change (ORIC) is based on the theory of Organizational Readiness for Change, measuring organization members' psychological and behavioral preparedness for implementing a change. We examined the measurement properties of the NoMAD and ORIC in a multi-national implementation effectiveness study. Method: Twelve mental health organizations in nine countries implemented Internet-based cognitive behavioral therapy (iCBT) for common mental disorders. Staff involved in iCBT service delivery (n = 318) participated in the study. Both measures were translated into eight languages using a standardized forward-backward translation procedure. Correlations between measures and subscales were estimated to examine convergent validity. The theoretical factor structures of the scales were tested using confirmatory factor analysis (CFA). Test-retest reliability was based on the correlation between scores at two time points 3 months apart. Internal consistency was assessed using Cronbach's alpha. Floor and ceiling effects were quantified using the proportion of zero and maximum scores. Results: NoMAD and ORIC measure related but distinct latent constructs. The CFA showed that the use of a total score for each measure is appropriate. The theoretical subscales of the NoMAD had adequate internal consistency. The total scale had high internal consistency. The total ORIC scale and subscales demonstrated high internal consistency. Test-retest reliability was suboptimal for both measures and floor and ceiling effects were absent. Conclusions: This study confirmed the psychometric properties of the NoMAD and ORIC in multi-national mental health care settings. While measuring on different but related aspects of implementation processes, the NoMAD and ORIC prove to be valid and reliable across different language settings.

Why was the study done?: Effective interventions need to be implemented successfully to achieve impact. Reliable measurement instruments are needed to determine if an implementation was successful or not. Two theory-based instruments exist for measuring the effectiveness of implementation strategies and monitor progress. The NoMAD measures aspects of normalization related to sense-making, willingness to implement, the work people do, and reflection. The Organizational Readiness for Implementing Change (ORIC) measures organization members' preparedness for implementing a change. What did we do?: This study examined whether the NoMAD and ORIC measure what they are supposed to measure. We translated the instruments from English to eight languages (Albanian, Danish, Dutch, French, German, Italian, and Spanish/Catalan) We applied various statistical methods to confirm the measurement properties, including correlations of scales, factor structures, test­retest reliability, consistency and floor and ceiling effects. 318 mental health professionals from nine countries participated in the study. What did we find?: For both instruments, total scores can be used as well as the subscale scores. Internal consistency for ORIC was high and for NoMAD adequate. Test­retest reliability was demonstrated, and floor and ceiling effects were rare. What does this mean?: NoMAD and ORIC are reliable instruments for measuring implementation processes and outcomes across mental health care settings in different countries and languages. They measure related but different aspects of implementation processes and outcomes. The measures are brief, and theory supported. However, more work is to be done on interpreting scores in relation to implementation success and regarding changes over time.

How well do services for young people with long term conditions deliver features proposed to improve transition?

BACKGROUND: For young people with long-term conditions, transition from child to adult-oriented health services is a critical period which, if not managed well, may lead to poor outcomes. There are features of transition services which guidance and research suggest improve outcomes. We studied nine such features, calling them 'proposed beneficial features': age-banded clinic; meet adult team before transfer; promotion of health self-efficacy; written transition plan; appropriate parent involvement; key worker; coordinated team; holistic life-skills training; transition manager for clinical team. We aimed to describe the extent to which service providers offer these nine features, and to compare this with young people's reported experience of them. METHODS: A longitudinal, mixed methods study followed 374 young people as their care moved from child to adult health services. Participants had type 1 diabetes, cerebral palsy or autism spectrum disorder with additional mental health difficulties. Data are reported from the first two visits, one year apart. RESULTS: Three hundred four (81.3%) of the young people took part in the second visit (128 with diabetes, 91 with autism, 85 with cerebral palsy). Overall, the nine proposed beneficial features of transition services were poorly provided. Fewer than half of services stated they provided an age-banded clinic, written transition plan, transition manager for clinical team, a protocol for promotion of health self-efficacy, or holistic life-skills training. To varying degrees, young people reported that they had not experienced the features which services said they provided. For instance, the agreement for written transition plan, holistic life-skills training and key worker, was 30, 43 and 49% respectively. Agreement was better for appropriate parent involvement, age-banded clinic, promotion of health self-efficacy and coordinated team at 77, 77, 80 and 69% respectively. Variation in the meaning of the features as experienced by young people and families was evident from qualitative interviews and observations. CONCLUSIONS: UK services provide only some of the nine proposed beneficial features for supporting healthcare transition of young people with long term conditions. Observational studies or trials which examine the influence of features of transition services on outcomes should ensure that the experiences of young people and families are captured, and not rely on service specifications.

Head and neck cancer and dysphagia; caring for carers.

OBJECTIVES: A diagnosis of head and neck cancer (HNC) is a profound event for patients and family members who play a crucial role in their care. Eating and drinking difficulties affect patients' quality of life (QOL), but the impact on the carers' QOL has not been explored. This preliminary mixed method study reports on carer QOL over time and investigates the relationship with dysphagia. METHODS: Two hundred and eight HNC patients referred for (chemo)radiotherapy were asked to identify a carer and complete a health-related QOL and a swallowing QOL questionnaire at pre-treatment, 3 and 12 months post-treatment. Carers were given the Caregiver QOL-Cancer (CQOL-C) questionnaire at the same time points. A purposive sample of patient and carer dyads was observed over mealtimes and interviewed. RESULTS: Seventy per cent of carers returned a questionnaire at least once. There was no change in CQOL-C scores between pre-treatment and 3 months, but a significant improvement was found between 3 and 12 months post-treatment (p = 0.012). Patient-reported outcomes accounted for 52% of variance in carer QOL measurements (R(2) = 0.52, p < 0.001). Four themes emerged from the qualitative data food provision, monitoring, motivation and changes to lifestyle. CONCLUSIONS: Findings suggest a relationship between carer and patient QOL. Elsewhere, these two characteristics have been associated such that the greater the patients' physical care needs, the poorer the carers' and patients' QOL. Living with someone with dysphagia not only involves managing the physical swallowing difficulties but is also likely to impact on social activities such as participation in shared meals, leading to permanent lifestyle changes.

Qualitative methods in a randomised controlled trial: the role of an integrated qualitative process evaluation in providing evidence to discontinue the intervention in one arm of a trial of a decision support tool.

OBJECTIVE: To understand participants' experiences and understandings of the interventions in the trial of a computerised decision support tool in patients with atrial fibrillation being considered for anti-coagulation treatment. DESIGN: Qualitative process evaluation carried out alongside the trial: non-participant observation and semistructured interviews. PARTICIPANTS: 30 participants aged >60 years taking part in the trial of a computerised decision support tool. RESULTS: Qualitative evidence provided the rationale to undertake a decision to discontinue one arm of the trial on the basis that the intervention in that arm, a standard gamble values elicitation exercise was causing confusion and was unlikely to produce valid data on participant values. CONCLUSIONS: Qualitative methods used alongside a trial allow an understanding of the process and progress of a trial, and provide evidence to intervene in the trial if necessary, including evidence for the rationale to discontinue an intervention arm of the trial.