Enhancing the quality of cognitive behavioral therapy in community mental health through artificial intelligence generated fidelity feedback (Project AFFECT): a study protocol.

BACKGROUND: Each year, millions of Americans receive evidence-based psychotherapies (EBPs) like cognitive behavioral therapy (CBT) for the treatment of mental and behavioral health problems. Yet, at present, there is no scalable method for evaluating the quality of psychotherapy services, leaving EBP quality and effectiveness largely unmeasured and unknown. Project AFFECT will develop and evaluate an AI-based software system to automatically estimate CBT fidelity from a recording of a CBT session. Project AFFECT is an NIMH-funded research partnership between the Penn Collaborative for CBT and Implementation Science and Lyssn.io, Inc. ("Lyssn") a start-up developing AI-based technologies that are objective, scalable, and cost efficient, to support training, supervision, and quality assurance of EBPs. Lyssn provides HIPAA-compliant, cloud-based software for secure recording, sharing, and reviewing of therapy sessions, which includes AI-generated metrics for CBT. The proposed tool will build from and be integrated into this core platform. METHODS: Phase I will work from an existing software prototype to develop a LyssnCBT user interface geared to the needs of community mental health (CMH) agencies. Core activities include a user-centered design focus group and interviews with community mental health therapists, supervisors, and administrators to inform the design and development of LyssnCBT. LyssnCBT will be evaluated for usability and implementation readiness in a final stage of Phase I. Phase II will conduct a stepped-wedge, hybrid implementation-effectiveness randomized trial (N = 1,875 clients) to evaluate the effectiveness of LyssnCBT to improve therapist CBT skills and client outcomes and reduce client drop-out. Analyses will also examine the hypothesized mechanism of action underlying LyssnCBT. DISCUSSION: Successful execution will provide automated, scalable CBT fidelity feedback for the first time ever, supporting high-quality training, supervision, and quality assurance, and providing a core technology foundation that could support the quality delivery of a range of EBPs in the future. TRIAL REGISTRATION: ClinicalTrials.gov; NCT05340738 ; approved 4/21/2022.

The Impact of the COVID-19 Pandemic on Mental Health, Occupational Functioning, and Professional Retention Among Health Care Workers and First Responders.

BACKGROUND: The COVID-19 pandemic has greatly affected front-line health care workers (HCW) and first responders (FR). The specific components of COVID-19 related occupational stressors (CROS) associated with psychiatric symptoms and reduced occupational functioning or retention remain poorly understood. OBJECTIVES: Examine the relationships between total and factored CROS, psychiatric symptoms, and occupational outcomes. DESIGN: Observational, self-report, single time-point online assessment. PARTICIPANTS: A total of 510 US HCW (N = 301) and FR (N = 200) with occupational duties affected by the COVID-19 pandemic. MAIN OUTCOMES AND MEASURES: CROS were assessed using a custom 17-item questionnaire. Post-traumatic stress disorder (PTSD), depression, insomnia, and generalized anxiety symptoms were assessed using the PTSD Checklist-5 (PCL5), Patient Health Questionnaire-9 (PHQ9), Insomnia Severity Index (ISI), and General Anxiety Disorder-7 (GAD7). Respondents' likelihood of leaving current field and occupational functioning were assessed with 2-item PROMIS subscales. Relationships were modeled using multivariable regression. Open-ended responses were coded using rapid template analysis. RESULTS: CROS total scores correlated significantly with all four psychiatric symptom domains (R's = .42-.53), likelihood of leaving one's current occupation (R = .18), and trouble doing usual work (R = .28), all p's < .001. Half of HCW indicated a decreased likelihood of staying in their current occupation as a result of the pandemic. CROS were fit to a 3-factor model consisting of risk, demoralization, and volume factors. All CROS factors were associated with psychiatric symptom burden, but demoralization was most prominently associated with psychiatric symptoms and negative occupational outcomes. Among psychiatric symptoms, PTSD symptoms were most strongly associated with negative occupational outcomes. Open-ended statements emphasized lack of protection and support, increased occupational demands, and emotional impact of work duties. CONCLUSIONS AND RELEVANCE: These results demonstrate potentially treatable psychiatric symptoms in HCW and FR experiencing CROS, impacting both wellbeing and the health care system. Mitigating CROS, particularly by addressing factors driving demoralization, may improve HCW and FR mental health, occupational functioning, and retention.