Lived experience perspectives guiding improvements to the Systematic Tailored Assessment for Responding to Suicidality protocol.

Background and aims: Suicide risk assessment protocols have traditionally been developed by clinical or research experts in suicidology, with little formal involvement of those with a lived experience of suicide. This study broadly aimed to seek lived experience perspectives of the Systematic Tailored Assessment for Responding to Suicidality (STARS) protocol A further aim was to elicit lived experience suggestions for wording and language used in the existing items within sections of the STARS protocol (STARS-p). Method: Participants were 33 adults (Female = 64%) with a lived experience of suicide, who attended a virtual research workshop at the National Lived Experience of Suicide Summit (2021). After being educated about STARS-p, participants provided their overall perceptions of STARS-p as well as suggestions for rewording and language use across the sections of STARS-p. Their responses were gathered using a virtual online platform for live electronic data collection. A three-phase process of qualitative content analysis was used, engaging both inductive and deductive approaches to explore study aims one and two, respectively. The Consolidated Criteria for Reporting Qualitative Research was followed to enhance quality of reporting. Results: Qualitative content analysis of participants' views of the STARS-p reflected three main categories, namely, STARS philosophy; What STARS aspires to; and Continuity of care and meeting needs. Responses characterized participants' perceptions of the core purpose of STARS-p and ways for refining or adapting it to suit diverse needs and settings. Based on deductive content analysis, suggested modifications to wording of items and additional items to extend sections were identified. Conclusion: The study yielded novel perspectives from those with a lived experience of suicide, which will inform improvements to the next edition of STARS-p. The STARS training (required for licensed use of the protocol) will be updated accordingly, in line with these results.

Active involvement of people with lived experience of suicide in suicide research: a Delphi consensus study.

BACKGROUND: The importance and value of involvement of people with lived experience of suicide has been recognized in suicide research and prevention. Nonetheless, clear guidance on research collaboration and co-production is lacking. This study aimed to address this gap by developing a set of guidelines on active involvement of people with lived experience of suicide in suicide studies., i.e., conducting research with or by people with lived experience, rather than to, about or for them. METHODS: The Delphi method was used to determine statements on best practice for the active involvement of people with lived experience of suicide in suicide research. Statements were compiled through a systematic search of the scientific and grey literature, and reviewing qualitative data from a recent related study conducted by the authors. Two expert panels: people with lived experience of suicide (n = 44) and suicide researchers (n = 29) rated statements over three rounds of an online survey. Statements endorsed by at least 80% of panellists of each panel were included in the guidelines. RESULTS: Panellists endorsed 96 out of 126 statements in 17 sections covering the full research cycle from deciding on the research question and securing funding, to conducting research and disseminating and implementing outcomes. Overall, there was a substantial level of agreement between the two panels regarding support from research institutions, collaboration and co-production, communication and shared decision making, conducting research, self-care, acknowledgment, and dissemination and implementation. However, panels also disagreed on specific statements regarding representativeness and diversity, managing expectations, time and budgeting, training, and self-disclosure. CONCLUSIONS: This study identified consensus recommendations on active involvement of people with lived experience of suicide in suicide research, including co-production. Support from research institutions and funders, and training on co-production for researchers and people with lived experience, are needed for successful implementation and uptake of the guidelines.

The Role of Impulsivity and Self-Control in Suicidal Ideation and Suicide Attempt.

Two studies are reported examining the relation of self-control, as measured by self-report inventories, to indices of suicidal ideation and suicide attempts. In the first study (n = 113), self-control related significantly (p < 0.05) and negatively to both indices (r = -0.37 and r = -0.26), and, in a hierarchical regression analysis, added significantly to the variance in the suicidal ideation index accounted for by a measure of impulsivity. The second study (n = 223) replicated the findings of the bivariate correlations (r = -0.55 and r = -0.59) with the suicidality indices in the first study, both with the earlier measures and with alternative measures of self-control and impulsivity. Results indicated self-control added to the prediction of both indices and not just the ideation index. The second study also demonstrated that self-control acts as a moderator for perceived stress, a known risk factor for suicidality, such that, at low levels of perceived stress, there is little difference between those high and low in measured self-control, but that at high stress levels, those with high self-control had lower scores on suicidal ideation. The results are interpreted as showing that self-control is a protective factor for suicidality.

The Personal Suicide Stigma Questionnaire (PSSQ): Relation to Self-Esteem, Well-Being, and Help-Seeking.

Two studies are reported that extend the evidence base for use of the Personal Stigma of Suicide Questionnaire (PSSQ). In the first study (N = 117), the Rosenberg Self-Esteem Scale, the WHO-5 measure of well-being, as well as measures of suicidality were examined in relation to the PSSQ. A self-selected sub-sample (N = 30) completed the PSSQ after an interval of two months. In line with the stigma internalization model, when demographic variables and suicidality were accounted for, the PSSQ self-blame subscale was the most significant predictor of self-esteem. As for well-being, the rejection subscale was involved as well as self-blame. The retest stability of the PSSQ for the sub-sample was 0.85 and coefficient alpha for the total sample was 0.95, indicating both good stability and internal consistency for the scale. In the second study (N = 140), PSSQ was studied in relation to intention to seek help from four sources in the case of suicidal ideation. The strongest relationship with PSSQ was with intention not to seek help from anyone (r = 0.35). When other variables were included in the prediction of help-seeking from a general medical practitioner, family or friends, or from nobody, the only significant PSSQ correlate was minimization. For help-seeking from a psychologist or psychiatrist, the most significant predictor was judged helpfulness of prior contact with them. The results from these studies strengthen previous findings of the construct validity of the PSSQ and point to its utility in understanding barriers to help-seeking among those experiencing suicidality.

Informing and Sustaining Participation of Lived Experience in the Suicide Prevention Workforce.

BACKGROUND: Currently, there is no comprehensive study focused on identifying what is needed to support ongoing participation within the suicide prevention lived experience workforce (LEW). It is unclear what specific factors may impede or support ongoing participation in the LEW. The aim of this study was to explore the experiences of suicide prevention LEW in terms of its sustainability. METHOD: A qualitative interview method was utilised, with a purposive sample of participants who had engaged in the LEW for at least 12 months. The sample comprised 13 individuals (nine females, four males) who engaged in multiple LEW roles, with over half (54%) working in the LEW for more than 5 years. Data were analysed using thematic analysis. RESULTS: Five main themes were identified: support, passion, personal impact, training, and work diversity. Each theme offers perspectives about the challenges participants face within the suicide prevention LEW. CONCLUSION: Challenges faced are both similar to those found in the broader MH sector and unique to suicide prevention. Findings suggest that managing expectations of the LEW is important and can inform the creation of guidelines for a supported and sustainable suicide prevention LEW.

Long-Term Use and Application of Systematic Tailored Assessment for Responding to Suicidality (STARS) Protocol Following Original Training.

BACKGROUND: Understanding the use of Systematic Tailored Assessment for Responding to Suicidality protocol (STARS-p) in practice by trained mental health practitioners over the longer- term is critical to informing further developments. The study aim was to examine practitioners' experiences of STARS-p and factors associated with its use in practice over a 12-24-month period after training. METHOD: Practitioners who undertook the STARS-p training completed an online survey 12-24 months post training. The survey focused on the frequency of use of STARS-p (in full and each section) as well as perceptions about STARS-p applied in practice. Analyses included correlations, logistic regression and content analysis. RESULTS: 67 participants (81% female, Mage = 43.2, SD = 10.3) were included in the analyses. A total of 80.6% of participants had used the entire STARS-p at some time-point in their practice and less than half (44.7%) frequently used the entire STARS-p (all components in one administration). Parts A, B and C were used frequently in suicide risk assessment (SRA) by 84%, 71% and 82% of participants, respectively. Use of the entire protocol and different sections was most related to male gender, perceived ease of administration and confidence in the use of the protocol. Qualitative results revealed three main themes. CONCLUSIONS: STARS-p as a whole or its parts, is frequently used. Advantages of, and barriers to, using STARS-p in practice can inform further developments of STARS-p and STARS training.

Optimal Care Pathways for People in Suicidal Crisis Who Interact with First Responders: A Scoping Review.

BACKGROUND: First responders play a vital role in attending to people in suicidal crisis and influencing their care. AIMS: To examine existing care pathways and models of care that could be used for people in a suicidal crisis who have come to the attention of first responders. METHODS: A scoping review of academic and grey literature published between 2009 and 2019 was conducted, supplemented by consultation with experts, service providers and people with lived experience. RESULTS: The search identified 703 studies. Twenty-three peer reviewed and grey literature articles, as well as one personal communication, were considered eligible for inclusion. Six models, covering 22 programs, were identified. No studies were identified that described care pathways, per se. Co-responder and safe haven models were associated with reduced hospital use and police detentions. Aftercare models were associated with improved well-being and reduction in symptoms. Co-responder, safe haven, and aftercare models were all rated positively by service users. No studies measured the impact on longer term suicidality. LIMITATIONS: Inclusion criteria were broad resulting in heterogeneity of studies and designs, limiting comparisons. Few studies employed standardised measurement protocols, reducing the ability to draw sound conclusions. CONCLUSION: Several novel programs have the potential to support individuals in crisis who encounter first responders.

Suicide risk assessment fears, attitudes and behaviours of lifeline crisis supporters.

Lifeline Australia operates crisis support services through Lifeline Crisis Supporters. An integral part of their role is to conduct online suicide risk assessments with help-seekers. However, there is limited literature regarding suicide risk assessment practices for this population. This study aimed to examine how suicide prevention training, vicarious trauma and fears impacted suicide risk assessment behaviours of Lifeline Crisis Supporters. A cross-sectional survey design was used to recruit a volunteer convenience sample of 125 Lifeline Australia Crisis Supporters (75.2% females; Mage  = 54.9) in 2018 to participate in an online survey. Findings revealed that those with more suicide-specific training had less risk assessment-related fears, and that fears were not related to attitudes towards suicide prevention. There was no significant relationship between vicarious trauma and amount of training or years of experience in the role. Further, participants with higher levels of vicarious trauma demonstrated significantly more negative attitudes towards suicide prevention. Overall, training appears to be a significant factor in suicide risk assessment practice behaviours of Lifeline Crisis Supporters, highlighting a need for ongoing training and support for them. This research also suggests that whilst fears exist, they do not significantly impair Lifeline Crisis Supporters' ability to undertake suicide risk assessment.

The Role of Unemployment, Financial Hardship, and Economic Recession on Suicidal Behaviors and Interventions to Mitigate Their Impact: A Review.

Understanding the social determinants and risk factors for suicidal behaviors underlies the development of effective suicide prevention interventions. This review focused on recently published literature (2010 onwards), with the aim to determine the role of economic factors (at the individual and population level) on suicidal behaviors and ideation as well as the effectiveness of interventions addressing these factors in reducing suicidal behaviors and ideation. Where available, literature examining the economic impact of COVID-19 was highlighted. Economic recession and unemployment are associated with increased risk of suicidal behavior at the population and individual level. Additionally, personal financial problems such as debt and financial strain are associated with increased risk of suicidal behavior and ideation at the individual level. Regarding interventions, unemployment benefits, employment protection legislation, higher minimum wage and active labor market programs may reduce suicide at the population level. However, it is not clear what impact they have at the individual level, nor in relation to suicide attempts, self-harm, or suicidal ideation. There was a lack of evidence as to the effectiveness of financially focused suicide prevention interventions at either level. Current findings were contextualized within, and advance, prominent social theoretical models. Recommendations focused on future areas of research, including the unfolding economic impact of COVID-19, as well as the co-design and evaluation of tailored interventions and/or gatekeeper training for those in the financial and welfare sector, and enhanced early education aimed at increasing financial literacy in young people before onset or exacerbation of financial hardship.

Developing a post-discharge suicide prevention intervention for children and young people: a qualitative study of integrating the lived-experience of young people, their carers, and mental health clinicians.

BACKGROUND: Suicide in young people is a leading cause of death. Interventions that are reflexive, tailored, and developed in concert with this at-risk population are needed. This study aimed to integrate lived-experience into the design of a suicide prevention intervention delivered by phone to young people post-discharge from an emergency department (ED) for suicide risk or self-harm. METHODS: Qualitative study was conducted at the Queensland Children's Hospital, Brisbane Australia. Four focus groups with young people with lived-experience, parents or carers and ED mental health clinicals were conducted. In total 5 young people with lived-experience of suicidality (17-21 years, Mage = 19.20), 3 parents and carers with a lived-experience of caring for a young person with mental illness, and 10 ED mental health clinicians participated in focus groups. The first phase of qualitative analysis involved a phenomenological analysis and second phase included a deductive content analysis. The paper is following the Consolidated Criteria for Reporting Qualitative Research. RESULTS: First phase, a phenomenological analysis identified three foundational themes to structure future follow-up phone interventions: a person-centred focus, the phone-call dynamic, and the phone-call purpose. Second phase, a deductive content analysis found that participants preferred an intervention that was structured, consistent, and finite. Moreover, an intervention that was authentic, able to facilitate and empower growing independence, and achievable of young people after an ED presentation was desired. CONCLUSIONS: Participants expressed their desire for a responsive, structured, and clearly focused phone call that would recognise the young person and parent/carer's needs while providing tailored support to ease transition from the ED to available community and family led care.

Developing an Intervention for Suicide Prevention: A Rapid Review of Lived Experience Involvement.

OBJECTIVE: While suicide prevention interventions should be informed by lived experience, there are no reviews examining involvement of lived experience (LE) thus far. This rapid review aimed to synthesize available studies using LE of suicidality to guide the development of suicide prevention interventions. METHOD: A rapid review following PRISMA guidelines was conducted. Key electronic databases were searched for the literature for the last 10 years (2010 until June 2019) to identify studies that have incorporated the lived experience of people of suicide to develop a suicide prevention intervention. Key features of the LE intervention development process were synthesized and discussed. RESULTS: A final 11 studies from 13 papers were selected for synthesis. Most studies employed focus groups (73%). Research questions focused on participant preferences, experiences, and recommendations for suicide prevention interventions. Considering the qualitative nature, majority of studies used thematic analyses to study participant responses and generate intervention components based on identified themes. Translation from research findings into a physical intervention was described in limited detail across all studies. The rapid review was limited to the literature about development of interventions using LE of suicide published in English in last 10 years. CONCLUSIONS: With an increased focus on person-centered care and LE in suicide prevention, such valuable expertise should be integrated into intervention development. This review provides insight into the process to ensure responses to suicidal persons are well aligned with the needs of those they serve. HighlightsLimited studies have involved lived experience in the development of interventionsFocus groups and thematic analysis are common methods to develop interventionsLimited description of translating themes into intervention components is described.

Reasons for living among those with lived experience entering the suicide prevention workforce.

This study explored reasons for living among those with lived experience of suicide entering the suicide prevention workforce. The study recruited 110 participants from two Roses in the Ocean training programs (79% female, mean age 46.5). Responses to open-ended survey questions about reasons for living were analyzed using qualitative content analysis method. Connection to others and service were the most commonly stated reasons for living. Other categories included orientation toward future, life, self, pleasure, and spiritual reasons and values. These findings can be used in further research and design of support programs for peer specialists.

Preliminary Evaluation of Lived Experience of Suicide Training: Short-, Medium- and Longer-Term Impacts of Our Voices in Action Training.

Despite increased participation and multiple workforce roles of those with lived experience in suicide prevention, there are no evaluated training programs to support this population. This study evaluated a training program aimed to prepare people for these important roles. Survey data at pre-, post- and at three- and 12-month follow-up were used measuring knowledge, attitudes, and self-efficacy, as well as psychological distress as a safety measure. Participants experienced significant gains in knowledge after training, although not all aspects of knowledge were maintained at follow-up. Self-efficacy was examined through confidence and empowerment. Confidence gains were significant at immediate and longer-term follow-up but gains in empowerment were not maintained over time. Participants' positive attitudes improved but this was not significant. There was no indication of increases in psychological distress in participants throughout the training and follow-up periods. Implications of these outcomes are discussed.

A Pilot Study of Clinicians' Perceptions of Feasibility, Client-Centeredness, and Usability of the Systematic Tailored Assessment for Responding to Suicidality Protocol.

Background: The Systematic Tailored Assessment for Responding to Suicidality (STARS) is a client-centered, psychosocial needs-based assessment protocol. This semistructured interview obtains client prioritized indicators that contribute to suicidality and informs commensurate care responses for preventing suicide. Aim: To pilot the feasibility, client-centeredness, and usability of the STARS protocol, including clinicians' perceptions of ease of use; content validity; and administration within the community setting. Method: A convenience sample of clinicians who undertook assessment and/or intervention with suicidal persons and had used STARS between mid-2016 and early 2017 completed an online survey assessing feasibility, client-centeredness, and usability of STARS. Results: Of the 51 clinicians who entered the survey, 42 (82.3%; aged 25-74; 69% female) completed it. Overall, perceptions of feasibility and usability of STARS were positive, particularly regarding client-centeredness of the protocol and confidence in information obtained for screening suicidality and informing needs-based priority responses. Limitations: The pilot findings are limited by the use of a small convenience sample and the low completion rate of clinicians with STARS training. Conclusion: STARS was perceived as a feasible and useful psychosocial needs-based assessment protocol. Suggestions for improving STARS, training requirements, and application to diverse populations are outlined.

Gatekeeper Training and Minimum Standards of Competency.

Gatekeeper training (GKT) is one of the most widely used suicide prevention strategies. It involves training people who are not necessarily clinicians to be able to identify people experiencing suicidality and refer them to appropriate services. While there is a dearth of research that supports the causal link between GKT and reduced suicide rates, this is likely the result of a variety of factors including training design, definitions of "gatekeepers," differing populations in which the gatekeeper (GK) operates, and other variables that may influence suicide rates. Despite this, research suggests that GKT improves people's knowledge, skills, and confidence in helping individuals who experience suicidal ideation and enhances positive beliefs about the efficacy of suicide prevention. However, there is no consensus on GK competencies to allow differences in effectiveness between various training programs to be measured, that is, knowledge, skills and abilities, attitudes, and self-efficacy attributes expected of a person resulting from the training. This paper discusses challenges in developing GK competencies. It uses developments in suicide prevention competencies for clinicians, vocational education, and training sector competencies, as well as empirical work in GKT, to propose minimum GK competencies that may be examined for further research and evaluation of programs.

Attitudes and Arguments in the Voluntary Assisted Dying Debate in Australia: What Are They and How Have They Evolved Over Time?

This paper provides a broad discussion about voluntary assisted dying (VAD) in Australia. The discussion examines the history of the VAD debate in Australia and whether public support for VAD and the arguments that have provided the framework for the VAD debate have evolved over time. This seems a prudent time to have such a discussion, given the very recent rush by all Australian states to bring about or attempt to bring about VAD legislation. This rush, inexplicably perhaps, comes after decades of attempted but failed progress in the legalisation of VAD in Australia. The authors attempted to undertake a systematic literature review for this paper, but the paucity of academic research and the lack of consistent terminology in this area made such a search untenable. Instead, the authors examined parliamentary documentation and then widened the search via the sources found within this documentation. The examination of available data showed that VAD has enjoyed significant public support from Australians over time and that the arguments in the VAD debate in Australia have been consistent over time.

Consumer and Carer Perspectives of a Zero Suicide Prevention Program: A Qualitative Study.

This study explored the experiences of healthcare consumers who had recently attempted suicide, and their carers, following placement on a Suicide Prevention Pathway based on the Zero Suicide framework. Qualitative interviews were conducted with 10 consumers and 5 carers using a semi-structured interview schedule. Interviews were transcribed and thematic analysis was applied to identify prominent themes and sub-themes. Three interrelated themes were identified. The first theme was 'Feeling safe and valued' with the associated sub-theme pertaining to perceived stigmatizing treatment and self-stigma. The second was 'Intersection of consumer and staff/organizational needs' with a related sub-theme of time pressure and reduced self-disclosure. The final theme was 'Importance of the 'whole picture', highlighting the relevance of assessing and addressing psychosocial factors when planning for consumer recovery. Overall, consumers and their carers reported a favorable experience of the Suicide Prevention Pathway; however, there were several areas identified for improvement. These included reconciling the time-pressures of a busy health service system, ensuring consumers and carers feel their psychosocial concerns are addressed, and ensuring that adequate rapport is developed. Key to this is ensuring consumers feel cared for and reducing perceptions of stigma.

Suicidology Post Graduate Curriculum: Priority Topics and Delivery Mechanisms for Suicide Prevention Education.

BACKGROUND: There has been limited attention to the development and delivery of tertiary suicide prevention curricula. The aim of this work was to describe the status of postgraduate suicide prevention education, with specific attention on examining the needs of the suicide prevention sector in Australia. METHOD: An online survey was completed by 76 stakeholders in Australia. Current curriculum learning outcomes from Griffith University's postgraduate suicidology programs guided the development of the survey. RESULTS: Four key learning domains were rated highest in importance by stakeholders. According to most stakeholders, skills-based qualifications were the most relevant type of qualification, and online modulized education was the most preferred delivery mode. Half of stakeholders supported suicide prevention professional development through a combination of financial support and study leave. CONCLUSIONS: The survey provided invaluable feedback regarding the priorities of Australia's suicide prevention sector for content domains and delivery mechanisms for tertiary suicidology education. The findings showed the preferred type of organizational (employer) support that may be provided for employees to undertake such education. These findings will inform the future developments of Griffith University's suicidology programs and may motivate other universities to consider offering same or a similar type of education to support the suicide prevention sector toward saving lives.

Impact of Systematic Tailored Assessment for Responding to Suicidality (STARS) Protocol Training on Mental Health Professionals' Attitudes, Perceived Capabilities, Knowledge, and Reluctance to Intervene.

BACKGROUND AND AIMS: Systematic Tailored Assessment for Responding to Suicidality (STARS) protocol and associated training were developed with the key objectives of supporting clinicians to conduct a suicide enquiry, obtaining a comprehensive account of psycho-social factors contributing to suicidality, and collaboratively developing a safety plan with clients. STARS training aims to address knowledge, attitudes and capabilities that influence intervention behavior/skills. This study aimed to examine associations between clinician characteristics and pre-training competencies in suicide risk assessment (SRA), as well as the impact of STARS training workshop on clinician competencies; and to determine the predictors of SRA training outcomes. METHOD: Australian mental health professionals working with suicidal persons who undertook the STARS 2-day face-to-face workshop between 2018 and 2020 completed an online survey at pre- and post-training. Of the 222 participants who completed the pre-training questionnaire, 144 (64.9%) also completed the post-training questionnaire. Participants were mostly female (75.7%), had completed a university degree (86.4%), had <10 years of experience in suicide prevention (71.7%), and were allied and mental health professionals (78.1%). We used linear mixed-effects regression for statistical analyses. RESULTS: STARS participants who reported higher perceived capability at baseline had significantly greater formal and informal training, more years of experience in suicide prevention, and were more likely to have experienced client suicide and/or suicide attempt and to report fewer SRA related fears. We found overall significant positive impacts of STARS training on clinician competencies (attitudes, perceived capability, declarative knowledge) from pre- to post-training. The most distinct changes following STARS training were for perceived capability and declarative knowledge. Participants who had more positive attitudes after training were significantly more likely to have had less prior supervision/mentoring. Reluctance to intervene was not found to significantly change after training. CONCLUSIONS: We found evidence that attitudes, perceived capability and declarative knowledge changed positively from pre- to post-STARS training among mental health professionals. Underpinned by the minimum standardized SRA competencies, STARS training may be critical for informing evidence-based knowledge and skills in SRA and safety planning.

Wesley LifeForce Suicide Prevention Gatekeeper Training in Australia: 6 Month Follow-Up Evaluation of Full and Half Day Community Programs.

Background and Objective: Wesley Mission LifeForce training is an Australian suicide prevention gatekeeper program which has not been formally evaluated. The aims of this evaluation were to (1) determine the short- and medium- term impacts of the training on worker capabilities (perceived and declarative knowledge), attitudes, and reluctance to intervene measures; and (2) compare the impact of the half and full day workshops on these measures. Method: 1,079 Australian community workers of diverse professional backgrounds completed a pre-workshop questionnaire as part of registration for the Wesley LifeForce suicide prevention training between 2017 and 2019. Of these, 299 participants also completed the post workshop questionnaires (matched sample). They attended either half day (n = 97) or full day workshops (n = 202) and completed also a 3- and 6- month follow-up questionnaire. We used linear mixed-effect modeling for repeated measures to analyze data. Results: LifeForce training participants experienced an increase in perceived capability, declarative knowledge, more positive attitudes and reduced reluctance to intervene, at least in the short term. The program is particularly well targeted for community gatekeepers with no prior training, albeit those with prior training in this study also experienced positive and significant gains on most measured constructs. Conclusions: We found evidence of effectiveness of the Wesley LifeForce training over time, without difference between the short (half day) and longer (full day) formats of delivery. Nevertheless, the latter format offers skills-based and skills rehearsal opportunities, the impacts of which we were unable to measure in this evaluation and should be estimated in the future.