Telephone delivery of psychological interventions: Balancing protocol with patient-centred care.

Common mental health problems of anxiety and depression affect significant proportions of the global population. Within the UK, and increasingly across western countries, a key policy response has been the introduction of high volume, low intensity psychological assessment and treatment services, such as the NHS's Improving Access to Psychological Therapies (IAPT) service, the largest service delivery model yet to be implemented at a national level (England). IAPT may be delivered in face-to-face meetings or over the telephone, as well as through other media. In order to increase access and achieve wide reach with efficient use of resources, IAPT's service models utilise relatively structured and standardised protocols, whilst aiming simultaneously to deliver a tailored and personalised experience for patients. Previous research has revealed that this can be a challenging balance for front-line practitioners to strike. Here we report research into the telephone delivery of guided self-help, low intensity interventions within IAPT, examining the challenges faced in remote delivery when combining structure with personalisation during assessment and treatment sessions. We show the ways in which the lack of flexibility in adhering to a system-driven structure can displace, defer or disrupt the emergence of the patient's story, thereby compromising the personalisation and responsiveness of the service. Our study contributes new insights to our understanding of the association between personalisation, engagement and patient experience within high volume, low-intensity psychological treatment services. Our research on the telephone delivery of IAPT is particularly timely in view of the current global Covid-19 health crisis, as a result of which face-to-face delivery of IAPT has had to be (temporarily) suspended.

Developing and testing methods for deriving preference-based measures of health from condition-specific measures (and other patient-based measures of outcome).

OBJECTIVES: Generic preference-based measures such as EQ-5D are widely used to estimate quality-adjusted life-years but may not be available or, more importantly, appropriate in some medical conditions. Condition-specific preference-based measures (CSPBMs) provide an alternative to generic measures that may be more relevant in some conditions. This project conducted five studies to examine issues in the development and use of CSPBMS: (1) literature review of measures; (2) deriving health states values for classifications with highly correlated dimensions; (3) impact of condition labelling; (4) impact of add-on dimensions; and (5) comparative performance of measures. DESIGN: (1) Systematic search and literature review; (2) and (5) psychometric analyses on existing data; (2), (3) and (4) valuation surveys and survey analyses. SETTING: Valuation surveys conducted using face-to-face interviews in the respondents' homes. PARTICIPANTS: Valuation surveys conducted using representative samples of the UK general population. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: The project developed a CSPBM CORE-6D and analyses AQL-5D, CORE-6D, EORTC-8D, EQ-5D, OAB-5D and SF-6D data. RESULTS: (1) There was substantial variability in methods used to develop CSPBMs. (2) A new method for generating states using Rasch analysis was undertaken, which successfully dealt with the problem of highly correlated domains. (3) Condition labels affected utility values but this was dependent on the condition and severity of the health state. (4) Adding on an extra dimension affected health-state values and preference weights for other dimensions. (5) The performance of CSPBMs was comparable with that of their parent instrument and of generic preference-based measures with better performance for discrimination between severity groups. CONCLUSIONS: CSPBMs have an important role for economic evaluation, for which generic measures are inappropriate. However, their use in economic evaluation may be compromised by naming the condition; the exclusion of side effects and comorbidities; and focusing effects. Whether a reduction in comparability should be accepted depends on the extent of any gain in validity and responsiveness. This will depend on the condition and measure in question. Research agenda: (1) The appropriateness of generic preference-based measures should be examined in more conditions (and compared with CSPBMs). (2) Further quantitative and qualitative work is requested into the impact of, and reasons for labelling effects. (3) Use of add-ons for condition-specific measures (for side effects and comorbidities) and as a solution to the limitation of generic measures should be explored. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Methods to identify postnatal depression in primary care: an integrated evidence synthesis and value of information analysis.

OBJECTIVES: To provide an overview of methods to identify postnatal depression (PND) in primary care and to assess their validity, acceptability, clinical effectiveness and cost-effectiveness, to model estimates of cost, to assess whether any method meets UK National Screening Committee (NSC) criteria and to identify areas for future research. DATA SOURCES: Searches of 20 electronic databases (including MEDLINE, CINAHL, PsycINFO, EMBASE, CENTRAL, DARE and CDSR), forward citation searching, personal communication with authors and searching of reference lists. REVIEW METHODS: A generalised linear mixed model approach to the bivariate meta-analysis was undertaken for the validation review with quality assessment using QUADAS. Within the acceptability review, a textual narrative approach was employed to synthesise qualitative and quantitative research evidence. For the clinical and cost-effectiveness reviews methods outlined by the Centre for Reviews and Dissemination and the Cochrane Collaboration were followed. Probabilistic models were developed to estimate the costs associated with different identification strategies. RESULTS: The Edinburgh Postnatal Depression Scale (EPDS) was the most frequently explored instrument across all of the reviews. In terms of test performance, postnatally the EPDS performed reasonably well: sensitivity ranged from 0.60 (specificity 0.97) to 0.96 (specificity 0.45) for major depression only; from 0.31 (specificity 0.99) to 0.91 (specificity 0.67) for major or minor depression; and from 0.38 (specificity 0.99) to 0.86 (specificity 0.87) for any psychiatric disorder. Evidence from the acceptability review indicated that, in the majority of studies, the EPDS was acceptable to women and health-care professionals when women were forewarned of the process, when the EPDS was administered in the home, with due attention to training, with empathetic skills of the health visitor and due consideration to positive responses to question 10 about self-harm. Suggestive evidence from the clinical effectiveness review indicated that use of the EPDS, compared with usual care, may lead to reductions in the number of women with depression scores above a threshold. In the absence of existing cost-effectiveness studies of PND identification strategies, a decision-analytic model was developed. The results of the base-case analysis suggested that use of formal identification strategies did not appear to represent value for money, based on conventional thresholds of cost-effectiveness used in the NHS. However, the scenarios considered demonstrated that this conclusion was primarily driven by the costs of false positives assumed in the base-case model. CONCLUSIONS: In light of the results of our evidence synthesis and decision modelling we revisited the examination of PND screening against five of the NSC criteria. We found that the accepted criteria for a PND screening programme were not currently met. The evidence suggested that there is a simple, safe, precise and validated screening test, in principle a suitable cut-off level could be defined and that the test is acceptable to the population. Evidence surrounding clinical and cost-effectiveness of methods to identify PND is lacking. Further research should aim to identify the optimal identification strategy, in terms of key psychometric properties for postnatal populations. In particular, research comparing the performance of the Whooley and help questions, the EPDS and a generic depression measure would be informative. It would also be informative to identify the natural history of PND over time and to identify the clinical effectiveness of the most valid and acceptable method to identify postnatal depression. Further research within a randomised controlled trial would provide robust estimates of the clinical effectiveness.

A review and critical appraisal of measures of therapist-patient interactions in mental health settings.

OBJECTIVES: To assemble and to appraise critically the current literature on tests and measures of therapist-patient interactions in order to make recommendations for practice, training and research, and to establish benchmarks for standardisation, acceptability and routine use of such measures. DATA SOURCES: Major electronic databases (including PsycINFO) were searched from inception to 2002. REVIEW METHODS: A comprehensive conceptual map of the subject area of therapist-patient interactions was developed through data extraction from, and analysis of, studies selected from the literature searches. The results of these searches were assessed and appraised to produce a set of possible therapist-patient measures. These measures were then evaluated. RESULTS: The contextual map included the various concepts and domains that had been used in the context of the literature on therapist-patient interactions, and was used to guide the successive stages of the review. Three developmental processes were identified as necessary for the provision of an effective therapeutic relationship: 'establishing a relationship', 'developing a relationship' and 'maintaining a relationship'. Eighty-three therapist-patient measures having basic information on reliability and validity were identified for critical appraisal. The areas of the conceptual map that received most coverage (i.e. over 50% measures associated with them) were framework, therapist and patient engagement, roles, therapeutic techniques and threats to the relationship. These areas relate to the three key developmental processes outlined above. Of the 83 measures matching the content domain, 43 met the minimum standard. A total of 30 measures displayed adequate responsiveness or precision. None of the 43 measures that met the minimum standard was fully addressed in terms of acceptability and feasibility evidence. The majority of these measures had three or fewer components described. Therefore, out of a total of 83 measures matching the content domain, no measure could be said to have met an industry standard. CONCLUSIONS: The findings indicate that the therapist-patient interaction can be measured using a wide range of instruments of varying value. However, due care should be taken in ensuring that the measure is suitable for the context in which it is to be used. Following on from this work, it is suggested that specific research networks for the development of therapist-patient measures should be established, that research activity should prioritise investment in increasing the evidence base of existing measures rather than attempting to develop new ones, and that research activity should focus on improving these existing measures in terms of acceptability and feasibility issues.

Collaborative care for depression in UK primary care: a randomized controlled trial.

BACKGROUND: Collaborative care is an effective intervention for depression which includes both organizational and patient-level intervention components. The effect in the UK is unknown, as is whether cluster- or patient-randomization would be the most appropriate design for a Phase III clinical trial. METHOD: We undertook a Phase II patient-level randomized controlled trial in primary care, nested within a cluster-randomized trial. Depressed participants were randomized to 'collaborative care' - case manager-coordinated medication support and brief psychological treatment, enhanced specialist and GP communication - or a usual care control. The primary outcome was symptoms of depression (PHQ-9). RESULTS: We recruited 114 participants, 41 to the intervention group, 38 to the patient randomized control group and 35 to the cluster-randomized control group. For the intervention compared to the cluster control the PHQ-9 effect size was 0.63 (95% CI 0.18-1.07). There was evidence of substantial contamination between intervention and patient-randomized control participants with less difference between the intervention group and patient-randomized control group (-2.99, 95% CI -7.56 to 1.58, p=0.186) than between the intervention and cluster-randomized control group (-4.64, 95% CI -7.93 to -1.35, p=0.008). The intra-class correlation coefficient for our primary outcome was 0.06 (95% CI 0.00-0.32). CONCLUSIONS: Collaborative care is a potentially powerful organizational intervention for improving depression treatment in UK primary care, the effect of which is probably partly mediated through the organizational aspects of the intervention. A large Phase III cluster-randomized trial is required to provide the most methodologically accurate test of these initial encouraging findings.

A preliminary study of a measure of role-play competence in psychodynamic interpersonal therapy.

We report a 15-item role-play competence measure. Ratings by three judges of 34 role plays from psychodynamic interpersonal therapy training showed good inter-rater (.73-.79) and internal reliability (.84-.96). Validity was supported as scores were statistically significantly associated with psychotherapy experience. Most participants achieved satisfactory ratings supporting the training.

The effectiveness of computerized cognitive behavioural therapy in routine care.

OBJECTIVES AND DESIGN: The efficacy of a Computerized Cognitive Behavioural Therapy (CCBT) package, Beating the Blues, has been demonstrated in a large randomized controlled trial. The current study tests the generalizability of this finding in a naturalistic non-randomized trial. METHOD: 219 patients with anxiety and/or depression were recruited to receive CCBT in routine care. The Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) and Work and Social Adjustment scale (WSA) were administered pre-treatment, immediately on completing treatment and at 6 months post-treatment. Single-item self-report measures of anxiety and depression were also collected during each treatment session. RESULTS: Completer and intention-to-treat analysis demonstrated statistically and clinically significant improvements on the CORE-OM, WSA and in self-reported anxiety and depression. Intention-to-treat analysis indicated an average 0.29-point drop on the CORE-OM, equating to an uncontrolled pre-post effect size of 0.50. Research completers achieved an average 0.61-point drop equating to an uncontrolled pre-post size of 1.00 on the same measure. Where data was available (18%), these benefits were maintained at week 32 (6 months follow-up). CONCLUSION: CCBT can be an effective first line tool within a stepped care framework for the management of common mental health problems.

The CORE-OM in an older adult population: psychometric status, acceptability, and feasibility.

There is a need to extend and test the feasibility and acceptability of mental health outcome measures in the older population (i.e., aged 65-100). We present data on the CORE-OM (Clinical Outcomes in Routine Evaluation-Outcome Measure) on a sample of 118 people aged 65-97 presenting for mental health treatment and 214 people aged 65-94 drawn from a non-clinical population. Results show the CORE-OM to be a reliable measure in both samples when the overall mean item is used but the reliability is not as high for the specific domains as psychometrically stable structures. The CORE-OM showed large overall differences between the non-clinical and clinical samples indicating that it is equally as sensitive to these differing populations across this older age band as with working-age adults. However, the norms for the clinical sample were consistently lower than the equivalent clinical norms for a working-age sample. These findings suggest that the collection and compilation of age-specific norms is crucial in ensuring that appropriately referenced norms are used rather than assuming that norms are generalizable across the whole adult life-span.

Counselling and interpersonal therapies for depression: towards securing an evidence-base.

Both generic counselling (delivered by BACP level counsellors in primary care settings) and the interpersonal therapies place a central value on the role and function of relationships--both within and outside the practice setting - as a vehicle for understanding and treating people presenting with depression. Recent studies have compared generic counselling with antidepressant medication, usual GP care, cognitive-behaviour therapy (CBT), and as an adjunct to GP care (i.e. in combination with GP care). Findings suggest either that there is no difference between generic counselling and other treatment conditions, or that there are small advantages to counselling over usual GP care but only in the short-term with such differences disappearing at 1-year. Studies investigating the interpersonal therapies (IPT) have established that the content of such therapies differ in their content from behavioural and cognitive therapies despite the outcomes being broadly similar. Considerable research effort has focused on the process of change in IP therapies. Important factors include the level of prior commitment by the patient to psychological therapy and their confidence in the therapist. Patients with well assimilated problems tend to do better in CBT than psychodynamic-interpersonal therapy. Therapists need to be flexible and responsive to patient needs particularly concerning interpersonal and attachment issues. Future research in counselling needs to identify the effective components of generic counselling and relate these to a theoretical base. In the IP therapies, there needs to be a greater focus on the change outside the therapy session and on the effectiveness of such therapies in non-research settings.

Client interpersonal and cognitive styles as predictors of response to time-limited cognitive therapy for depression.

This study examined the relationship between cognitive and interpersonal styles and outcome among 24 clients who received time-limited cognitive therapy for depression. The authors hypothesized that this relationship would be mediated by therapeutic alliance. They found that clients' interpersonal style, particularly an underinvolved style, was predictive of treatment outcome. As predicted, the impact of this style on outcome was mediated through the therapeutic alliance.

Value of HoNOS in assessing patient change in NHS psychotherapy and psychological treatment services.

BACKGROUND: Little research on the value of Health of the Nation Outcome Scales (HoNOS) has occurred in out-patient settings, particularly psychotherapy services. AIMS: To determine whether HoNOS provides an adequate assessment for psychotherapy services which is sensitive to change. METHODS: HoNOS ratings from 1688 patients from eight out-patient psychotherapy services were collected. Of these, 362 also had ratings post-treatment. Mean scores, pre-to post-treatment differences, and reliable and clinically significant change criteria were calculated for HoNOS items and for total scores. RESULTS: The mean total HoNOS rating was 8.93, which is comparable to psychiatric out-patients. Only three items showed sufficient variability to use in assessing pre- to post-treatment change. CONCLUSIONS: Significant limitations were found in rating items that commonly present to psychotherapists. The lack of variability in most items limits HoNOS's usefulness in this population.

Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. Clinical Outcomes in Routine Evaluation-Outcome Measures.

To complement the evidence-based practice paradigm, the authors argued for a core outcome measure to provide practice-based evidence for the psychological therapies. Utility requires instruments that are acceptable scientifically, as well as to service users, and a coordinated implementation of the measure at a national level. The development of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) is summarized. Data are presented across 39 secondary-care services (n = 2,710) and within an intensively evaluated single service (n = 1,455). Results suggest that the CORE-OM is a valid and reliable measure for multiple settings and is acceptable to users and clinicians as well as policy makers. Baseline data levels of patient presenting problem severity, including risk, are reported in addition to outcome benchmarks that use the concept of reliable and clinically significant change. Basic quality improvement in outcomes for a single service is considered.

Measurement and psychotherapy. Evidence-based practice and practice-based evidence.

BACKGROUND: Measurement is the foundation of evidence-based practice. Advances in measurement procedures should extend to psychotherapy practice. AIMS: To review the developments in measurement relevant to psychotherapy. METHOD: Domains reviewed are: (a) interventions; (b) case formulation; (c) treatment integrity; (d) performance (including adherence, competence and skillfulness); (e) treatment definitions; (f) therapeutic alliance; and (g) routine outcome measurement. RESULTS: Modern methods of measurement can support 'evidence-based practice' for psychological treatments. They also support 'practice-based evidence', a complementary paradigm to improve clinical effectiveness in routine practice via the infrastructure of Practice Research Networks (PRNs). CONCLUSIONS: Advances in measurement derived from psychotherapy research support a model of professional self-management (practice-based evidence) which is widely applicable in psychiatry and medicine.

Psychotherapy in two-plus-one sessions: outcomes of a randomized controlled trial of cognitive-behavioral and psychodynamic-interpersonal therapy for subsyndromal depression.

A total of 116 clients with a range of subsyndromal depression received 3 therapy sessions: 2 sessions 1 week apart followed by a 3rd session 3 months later (the 2 + 1 model). Clients were stratified for severity on the Beck Depression Inventory (BDI) as stressed, subclinical, or low-level clinically depressed. In a 2 x 2 design, they received either cognitive-behavioral (CB) or psychodynamic-interpersonal (PI) therapy, either immediately or after a 4-week delay. An initial advantage for the immediate condition disappeared once the delayed-condition clients received treatment. Improvement rates at the end of treatment were 67% (stressed), 72% (subclinical), and 65% (low-level clinically depressed). There were no significant differences between CB and PI treatment methods, with the exception at 1-year follow-up, when the BDI showed a significant advantage for CB. Implications for designing very brief planned interventions are discussed.

Relations of the alliance with psychotherapy outcome: findings in the Second Sheffield Psychotherapy Project.

Clients (n = 79) and therapists (n = 5) rated their alliance using parallel forms of the Agnew Relationship Measure (ARM) after every session of their time-limited psychodynamic-interpersonal or cognitive-behavioral treatments for depression. The ARM assesses 5 dimensions of the alliance: Bond, Partnership, Confidence, Openness, and Client Initiative. Treatment outcome was assessed as residual gain from pretreatment assessment to end of treatment, 3-month follow-up, and 1-year follow-up on 6 standard measures. Some aspects of the alliance as measured by the ARM were correlated with clients' gains in treatment. The strength of the association varied across assessment measures, occasions of outcome assessment, ARM scales, and the session number when the alliance was measured.

Alliance structure assessed by the Agnew Relationship Measure (ARM).

OBJECTIVES: We used a new instrument, the Agnew Relationship Measure (ARM), to examine the alliance's dimensionality and to construct scales for use in future studies. DESIGN: We studied the alliance as reported on the ARM by both clients and therapists in the Second Sheffield Psychotherapy Project, a randomized comparison of two contrasting time-limited psychotherapies for depression. METHODS: Clients (N = 95) and therapists (N = 5) completed parallel forms of the (ARM) after every session (N = 1120). RESULTS: Five scales were constructed, based on results of simultaneous components analyses and considerations of conceptual coherence and comparability across client and therapist perspectives. CONCLUSIONS: Bond, partnership, and confidence overlapped statistically (consistent with previous studies), but there are conceptual and empirical reasons for retaining the distinctions. Openness represented a relatively independent dimension. The client initiative scale had low internal consistency but the items may have value for future investigations.