RESUMO
Background: Homelessness is a traumatic experience, and can have a devastating effect on those experiencing it. People who are homeless often face significant barriers when accessing public services, and have often experienced adverse childhood events, extreme social disadvantage, physical, emotional and sexual abuse, neglect, low self-esteem, poor physical and mental health, and much lower life expectancy compared to the general population. Rates of problematic substance use are disproportionately high, with many using drugs and alcohol to deal with the stress of living on the street, to keep warm, or to block out memories of previous abuse or trauma. Substance dependency can also create barriers to successful transition to stable housing. Objectives: To understand the effectiveness of different substance use interventions for adults experiencing homelessness. Search Methods: The primary source of studies for was the 4th edition of the Homelessness Effectiveness Studies Evidence and Gaps Maps (EGM). Searches for the EGM were completed in September 2021. Other potential studies were identified through a call for grey evidence, hand-searching key journals, and unpacking relevant systematic reviews. Selection Criteria: Eligible studies were impact evaluations that involved some comparison group. We included studies that tested the effectiveness of substance use interventions, and measured substance use outcomes, for adults experiencing homelessness in high income countries. Data Collection and Analysis: Descriptive characteristics and statistical information in included studies were coded and checked by at least two members of the review team. Studies selected for the review were assessed for confidence in the findings. Standardised effect sizes were calculated and, if a study did not provide sufficient raw data for the calculation of an effect size, author(s) were contacted to obtain these data. We used random-effects meta-analysis and robust-variance estimation procedures to synthesise effect sizes. If a study included multiple effects, we carried out a critical assessment to determine (even if only theoretically) whether the effects are likely to be dependent. Where dependent effects were identified, we used robust variance estimation to determine whether we can account for these. Where effect sizes were converted from a binary to continuous measure (or vice versa), we undertook a sensitivity analysis by running an additional analysis with these studies omitted. We also assessed the sensitivity of results to inclusion of non-randomised studies and studies classified as low confidence in findings. All included an assessment of statistical heterogeneity. Finally, we undertook analysis to assess whether publication bias was likely to be a factor in our findings. For those studies that we were unable to include in meta-analysis, we have provided a narrative synthesis of the study and its findings. Main Results: We included 48 individual papers covering 34 unique studies. The studies covered 15, 255 participants, with all but one of the studies being from the United States and Canada. Most papers were rated as low confidence (n = 25, or 52%). By far the most common reason for studies being rated as low confidence was high rates of attrition and/or differential attrition of study participants, that fell below the What Works Clearinghouse liberal attrition standard. Eleven of the included studies were rated as medium confidence and 12 studies as high confidence. The interventions included in our analysis were more effective in reducing substance use than treatment as usual, with an overall effect size of -0.11 SD (95% confidence interval [CI], -0.27, 0.05). There was substantial heterogeneity across studies, and the results were sensitive to the removal of low confidence studies (-0.21 SD, 95% CI [-0.59, 0.17] - 6 studies, 17 effect sizes), the removal of quasi-experimental studies (-0.14 SD, 95% CI [-0.30, 0.02] - 14 studies, 41 effect sizes) and the removal of studies where an effect size had been converted from a binary to a continuous outcome (-0.08 SD, 95% CI [-0.31, 0.15] - 10 studies, 31 effect sizes). This suggests that the findings are sensitive to the inclusion of lower quality studies, although unusually the average effect increases when we removed low confidence studies. The average effect for abstinence-based interventions compared to treatment-as-usual (TAU) service provision was -0.28 SD (95% CI, -0.65, 0.09) (6 studies, 15 effect sizes), and for harm reduction interventions compared to a TAU service provision is close to 0 at 0.03 SD (95% CI, -0.08, 0.14) (9 studies, 30 effect sizes). The confidence intervals for both estimates are wide and crossing zero. For both, the comparison groups are primarily abstinence-based, with the exception of two studies where the comparison group condition was unclear. We found that both Assertative Community Treatment and Intensive Case Management were no better than treatment as usual, with average effect on substance use of 0.03 SD, 95% CI [-0.07, 0.13] and -0.47 SD, 95% CI [-0.72, -0.21] 0.05 SD, 95% CI [-0.28, 0.39] respectively. These findings are consistent with wider research, and it is important to note that we only examined the effect on substance use outcomes (these interventions can be effective in terms of other outcomes). We found that CM interventions can be effective in reducing substance use compared to treatment as usual, with an average effect of -0.47 SD, 95% CI (-0.72, -0.21). All of these results need to be considered in light of the quality of the underlying evidence. There were six further interventions where we undertook narrative synthesis. These syntheses suggest that Group Work, Harm Reduction Psychotherapy, and Therapeutic Communities are effective in reducing substance use, with mixed results found for Motivational Interviewing and Talking Therapies (including Cognitive Behavioural Therapy). The narrative synthesis suggested that Residential Rehabilitation was no better than treatment as usual in terms of reducing substance use for our population of interest. Authors' Conclusions: Although our analysis of harm reduction versus treatment as usual, abstinence versus treatment as usual, and harm reduction versus abstinence suggests that these different approaches make little real difference to the outcomes achieved in comparison to treatment as usual. The findings suggest that some individual interventions are more effective than others. The overall low quality of the primary studies suggests that further primary impact research could be beneficial.
RESUMO
This systematic review is part of a broader evidence synthesis which aims to produce two systematic reviews to address a significant gap in the evidence base identified by Luchenski et al. (2018) and by (White, 2018). The first review (which is the subject of this protocol) will use meta-analysis to examine the effectiveness of different psychosocial interventions in (1) reducing problematic substance use; (2) improving mental health; and (3) improving housing stability for adults experiencing homelessness. The second review (which is covered by a separate title registration and protocol) will be of the experiences of adults experiencing homelessness when accessing or using psychosocial interventions, and will be a qualitative evidence synthesis using thematic synthesis (Thomas & Harden, 2008).
RESUMO
The systematic review set out in this protocol is part of a broader evidence synthesis which intends to produce two systematic reviews to address a significant gap in the evidence base identified by Luchenski et al. (2018) and by White and Narayanan (2021). This review (the focus of this protocol) will be of the experiences of adults experiencing homelessness when accessing and using psychosocial interventions. This review of qualitative data will use thematic synthesis to analyse these experiences as faced by this population when accessing and using psychosocial interventions.
RESUMO
Background: Homelessness is a major social and public health concern. It is a traumatic experience, and can have a devastating effect on those experiencing it. People who are homeless often face significant barriers when accessing public services, and those experiencing more visible and extreme forms of homelessness have often faced adverse childhood events, extreme social disadvantage, physical, emotional and sexual abuse, neglect, low self-esteem, poor physical and mental health, and much lower life expectancy compared to the general population. Problematic substance use is disproportionately high amongst people experiencing homelessness, with many using drugs and alcohol to deal with the stress of living on the street, to keep warm, or to block out memories of previous abuse or trauma. Drug overdose is a major cause of death for people experiencing street homelessness. Substance dependency can also create barriers to successful transition to stable housing. There is ongoing policy interest in the effectiveness of different interventions that aim to stop, reduce or prevent problematic substance use, and there is specific interest in the relative effectiveness of interventions that adopt harm reduction or abstinence-based approaches. Objectives: The objective of this review is to understand the effectiveness of different substance use interventions. The review will consider the effectiveness of harm reduction-based interventions, and abstinence-based interventions, for adults experiencing homelessness. The focus of the review is on high-income countries. Search Methods: The primary source of studies for potential inclusion in this review is the Homelessness Effectiveness Studies Evidence and Gaps Maps (EGM). The first of these was published in 2018, with updates published in 2019 and 2020. A further update is due to be published in the summer of 2022. It is this update that provides the final list of studies from which this review will draw. The search for this update (EGM 4th edition) was completed in September 2021. Other potential studies will be identified through a call for grey evidence and hand-searching key journals. Selection Criteria: Eligible studies will be impact evaluations with designs at levels, 3, 4 and 5 of the Maryland Scientific Methods scale. This therefore includes all studies categorised as either 'Randomised Controlled Trials' or 'nonexperimental designs with a comparison group' from the studies which form the basis of the Homelessness Effectiveness Studies Evidence and Gap Maps (EGM) created by CHI and the Campbell Collaboration. We are interested in studies that examine the effect of interventions on substance use outcomes. Studies to be excluded are those with designs at levels 1 and 2 of the Maryland Scientific Methods scale, for example, studies without a control or comparison group, 'before vs. after' designs (without an untreated comparison group), and cross-sectional regressions. Data Collection and Analysis: Descriptive characteristics and statistical information in included studies will be coded and checked by at least two members of the review team. Studies selected for the review will be assessed for confidence in the findings using a critical appraisal tool for determining confidence in primary studies. Standardised effect sizes will be calculated and, if a study does not provide sufficient raw data for the calculation of an effect size, we will attempt to contact the author(s) to obtain this data. We will aim to use random-effects meta-analysis and robust-variance estimation procedures to synthesise effect sizes. If a study includes multiple effects, we will carry out a critical assessment to determine (even if only theoretically) whether the effects are likely to be dependent. Where we suspect dependent effects, we will determine whether we can account for these by robust variance estimation. We will explore the moderating influence of participant and study characteristics, such as gender, race, substances targeted and length of follow-up. Where effect sizes are converted from a binary to continuous measure (or vice versa), we will undertake a sensitivity analysis to investigate the effect of the inclusion of studies with a converted effect size in the meta-analysis by running an additional analysis with these studies omitted. We will also assess the sensitivity of results to inclusion of non-randomised studies and studies classified as low confidence in findings. All analyses will include an assessment of statistical heterogeneity. Finally, we will undertake analysis to assess whether publication bias is likely to be a factor in our findings.
