Social Media Data Mining of Antitobacco Campaign Messages: Machine Learning Analysis of Facebook Posts.

BACKGROUND: Social media platforms provide a valuable source of public health information, as one-third of US adults seek specific health information online. Many antitobacco campaigns have recognized such trends among youth and have shifted their advertising time and effort toward digital platforms. Timely evidence is needed to inform the adaptation of antitobacco campaigns to changing social media platforms. OBJECTIVE: In this study, we conducted a content analysis of major antitobacco campaigns on Facebook using machine learning and natural language processing (NLP) methods, as well as a traditional approach, to investigate the factors that may influence effective antismoking information dissemination and user engagement. METHODS: We collected 3515 posts and 28,125 associated comments from 7 large national and local antitobacco campaigns on Facebook between 2018 and 2021, including the Real Cost, Truth, CDC Tobacco Free (formally known as Tips from Former Smokers, where "CDC" refers to the Centers for Disease Control and Prevention), the Tobacco Prevention Toolkit, Behind the Haze VA, the Campaign for Tobacco-Free Kids, and Smoke Free US campaigns. NLP methods were used for content analysis, including parsimonious rule-based models for sentiment analysis and topic modeling. Logistic regression models were fitted to examine the relationship of antismoking message-framing strategies and viewer responses and engagement. RESULTS: We found that large campaigns from government and nonprofit organizations had more user engagements compared to local and smaller campaigns. Facebook users were more likely to engage in negatively framed campaign posts. Negative posts tended to receive more negative comments (odds ratio [OR] 1.40, 95% CI 1.20-1.65). Positively framed posts generated more negative comments (OR 1.41, 95% CI 1.19-1.66) as well as positive comments (OR 1.29, 95% CI 1.13-1.48). Our content analysis and topic modeling uncovered that the most popular campaign posts tended to be informational (ie, providing new information), where the key phrases included talking about harmful chemicals (n=43, 43%) as well as the risk to pets (n=17, 17%). CONCLUSIONS: Facebook users tend to engage more in antitobacco educational campaigns that are framed negatively. The most popular campaign posts are those providing new information, with key phrases and topics discussing harmful chemicals and risks of secondhand smoke for pets. Educational campaign designers can use such insights to increase the reach of antismoking campaigns and promote behavioral changes.

The Association Between Tobacco Retailer Outlet Density and Prevalence of Cigarette Smoking in Virginia.

OBJECTIVE: We examine the association between tobacco retail outlet density and adult smoking prevalence at the county level in Virginia, controlling for spatial autocorrelations. AIMS AND METHODS: Pooling data from 2020 County Health Rankings (compiled data from various sources including, but not limited to, the National Center for Health Statistics-Mortality Files, the Behavioral Risk Factor Surveillance System (BRFSS), and the American Community Survey) and Counter Tools, we conducted regression analyses that accounted for spatial autocorrelation (spatial lag models, LMlag) and adjusted for county-level access to healthcare, demographics, SES, environmental factors, risk conditions or behaviors, and population health measures. RESULTS: Our estimates provide evidence that every increase of one tobacco retail outlet per 1000 persons was associated with 1.16 percentage points (95% CI: 0.80-1.52) higher smoking prevalence at the county level in Virginia after controlling for spatial autocorrelation. The effect of outlet density was largely explained by social determinants of health such as SES, risky conditions or behaviors, and environmental factors. We further noticed that the impact of social determinants of health were closely related and can be explained by indicators of population health (rates of mental distress (ß = 1.49, 95% CI: 1.31-1.67) and physical inactivity (ß = 0.07, 95% CI: 0.04-0.10). CONCLUSIONS: Although higher tobacco outlet density was associated with an increase in county-level smoking prevalence, the impact of outlet density was largely explained by social determinants of health and mental illness. Improving well-being at the community level could be a promising strategy in future tobacco control policies. IMPLICATION: The influence of tobacco outlet density seems to be explained by other social determinants of health and population level of mental or physical health. Thus, efforts to reduce tobacco use and consequent negative health effects should explore the impact of improving regional living standards. However, a sole focus on economic growth may not be sufficient, whereas a focus on such things as promoting work-life balance and improving overall well-being at the community level may be more.

Factors associated with patient-reported experiences and outcomes of substance use disorder treatment in Cape Town, South Africa.

BACKGROUND: Interventions are needed to improve the quality of South Africa's substance use disorder (SUD) treatment system. This study aimed to identify factors associated with patient-reported suboptimal access, quality, and outcomes of SUD treatment to guide the design of targeted quality improvement initiatives. METHOD: We analysed clinical record and patient survey data routinely collected by SUD services in the Western Cape Province, South Africa. The sample included 1097 treatment episodes, representing 32% of all episodes in 2019. Using multivariate logistic regression, we modelled socio-demographic, substance use and treatment correlates of patient-reported suboptimal access to, quality and outcomes of SUD treatment. RESULTS: Overall, 37.9% of patients reported substantial difficulties in accessing treatment, 28.8% reported suboptimal quality treatment, and 31.1% reported suboptimal SUD outcomes. The odds of reporting poor access were elevated for patients identifying as Black/African, in residential treatment, with comorbid mental health problems, and longer histories of substance use. Length of substance use, comorbid mental health problems, and prior SUD treatment were associated with greater likelihood of reporting suboptimal quality treatment. Patients with comorbid mental health problems, polysubstance use, who did not complete treatment, and who perceived treatment to be of poor quality were more likely to report suboptimal outcomes. CONCLUSION: This study is among the first to use patient-reported experiences and outcome measures to identify targets for SUD treatment improvement. Findings suggest substantial room to improve South African SUD treatment services, with targeted efforts needed to reduce disparities in outcomes for patients of Black/African descent, for those with comorbid mental health problems, and for patients who have chronic substance use difficulties. Interventions to enhance the relevance, appropriateness, and acceptability of SUD services for these patient sub-groups are needed to improve system performance.

South African service users' perceptions of patient-reported outcome and experience measures for adolescent substance use treatment: A qualitative study.

INTRODUCTION AND AIMS: Patient-reported outcome measures (PROM) and experience measures (PREM) for substance use disorder (SUD) treatment exist for adults but have unknown relevance for adolescents. This study aimed to explore adolescents' perceptions of effective SUD treatment and possible barriers to completing PROMs and PREMs to guide efforts to adapt the South African Addiction Treatment Services Assessment (SAATSA) for adolescents. DESIGN AND METHODS: Five focus groups were conducted with 38 adolescent service users recruited from residential and outpatient SUD treatment facilities in South Africa. Group discussions explored perceptions of treatment components necessary for desired SUD treatment outcomes, treatment experiences that support engagement in care, and perceptions of PROM and PREM completion. RESULTS: Participants viewed treatment elements that enhance motivation for change, coping and emotional regulation; provide recreational alternatives to substance use; and improve family relationships and home environments as critical to positive treatment outcomes. They reflected that provider characteristics and developmentally and culturally appropriate services facilitated engagement in treatment. PROM and PREM completion seemed acceptable, with participants suggesting ways to enhance their appeal. DISCUSSION AND CONCLUSION: Findings confirm that adult-oriented PROMs and PREMs require adaptation for adolescents. Service user inputs identified ways to expand the content of the SAATSA to better reflect adolescents' treatment priorities. These inputs have also guided changes to item formulation and administration procedures to enhance the SAATSA's acceptability for adolescents. Ensuring the SAATSA addresses treatment outcomes and experiences that matter to adolescents is vital for generating information to guide improvements to adolescent SUD services.

Answering questions about electronic cigarettes using a multidisciplinary model.

Electronic cigarettes (ECIGs) are a relatively new class of tobacco products and a subject of much debate for scientists and policymakers worldwide. Objective data that address the ECIG risk-benefit ratio for individual and public health are needed, and addressing this need requires a multidisciplinary approach that spans several areas of psychology as well as chemistry, toxicant inhalation, and physiology. This multidisciplinary approach would benefit from methods that are reliable, valid, and swift. For this reason, we formed a multidisciplinary team to develop methods that could answer questions about ECIGs and other potential modified risk tobacco products. Our team includes scientists with expertise in psychology (clinical, community, and experimental) and other disciplines, including aerosol research, analytical chemistry, biostatistics, engineering, internal medicine, and public health. The psychologists on our team keep other members focused on factors that influence individual behavior, and other team members keep the psychologists aware of other issues, such as product design. Critically, all team members are willing to extend their interests beyond the boundaries of their discipline to collaborate effectively with the shared goal of producing the rigorous science needed to inform empirically based tobacco policy. In addition, our trainees gain valuable knowledge from these collaborations and learn that other disciplines are accessible, exciting, and can enhance their own research. Multidisciplinary work presents challenges: learning other scientists' languages and staying focused on our core mission. Overall, our multidisciplinary team has led to several major findings that inform the scientific, regulatory, and public health communities about ECIGs and their effects. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services.

OBJECTIVE: Minimal knowledge exists on the factors that affect implementation of performance measurement systems, particularly in low- and middle-income countries (LMICs). To address this, we describe the implementation of a performance measurement system for South Africa's substance abuse treatment services known as the Service Quality Measures (SQM) initiative. METHOD: We conducted a mixed-methods evaluation of system implementation. We surveyed 81 providers about the extent of system implementation within their agencies and the factors that facilitated implementation. We conducted 26 in-depth interviews of providers' perceived barriers and facilitators to implementation. RESULTS: The overall penetration of this system was high. Almost all providers viewed the system as feasible to implement, acceptable, appropriate for use in their context, and useful for guiding service improvements. However, the extent of implementation varied significantly across sites (p < .05). Leadership support (p < .05) was associated with increased implementation in multivariable analyses. Providers reflected that high rates of patient attrition, variability in willingness to implement the system, and limited capacity for interpreting performance feedback affected the extent of system implementation. CONCLUSIONS: It is feasible to implement a performance measurement system in LMICs if the system is acceptable, appropriate, and useful to providers. To ensure the utility of this system for treatment service strengthening, system implementation must be optimized. Efforts to enhance target population coverage, strengthen leadership support for performance measurement, and build capacity for performance feedback utilization may enhance the implementation of this performance measurement system.

Substance abuse treatment engagement, completion and short-term outcomes in the Western Cape province, South Africa: Findings from the Service Quality Measures Initiative.

BACKGROUND: Optimizing the effectiveness of substance use disorder (SUD) treatment is critical in low-and middle-income countries (LMICs) with limited opportunities for SUD treatment. This is the first study to identify targets for interventions to improve the quality of SUD treatment in a LMIC. METHOD: We explored correlates of three indicators of treatment quality (treatment engagement, completion and abstinence at treatment exit) using data from a SUD performance measurement system implemented in the Western Cape Province of South Africa. The sample included data from 1094 adult treatment episodes representing 53% of the treatment episodes in 2016. Using multivariate logistic regression analyses, we modeled socio-demographic, substance use and program correlates of treatment engagement, completion, and abstinence at treatment exit. RESULTS: Overall, 59% of patients completed treatment (48% of patients from outpatient services). Treatment completion was associated with greater likelihood of abstinence at treatment exit. Patients were more likely to complete treatment if they engaged in treatment, were older, and had more severe drug problems (characterized by daily drug use and heroin problems) and attended programs of shorter duration. Residential treatment was associated with greater likelihood of treatment engagement, completion, and abstinence at treatment exit. CONCLUSION: Improving rates of outpatient treatment completion will enhance the effectiveness of South Africa's SUD treatment system. Interventions that promote engagement in treatment, particularly among younger patients; reduce program length through referral to step-down continuing care; and ensure better matching of drug problem to treatment level and type could improve rates of treatment completion.

Openness to adopting evidence-based practice in public substance use treatment in South Africa using task shifting: Caseload size matters.

BACKGROUND: In response to the lack of coverage for substance use treatment in the Western Cape province of South Africa, the local government expanded funding for evidence-based practices (EBPs) for treating substance use. Yet, little is known about provider and staff attitudes towards adopting EBPs in this setting, which is particularly relevant in this context where task shifting clinical care increases demands on paraprofessional providers. This study aimed to (1) assess attitudes towards adopting EBPs among a range of staff working in substance use treatment in Cape Town using a task shifting model; and (2) evaluate factors associated with openness towards adopting EBPs in this setting. METHODS: Staff (n = 87) were recruited from 11 substance use treatment clinics. Demographics and job-related characteristics were assessed. Staff perceptions of organizational factors were assessed using the TCU Organizational Readiness for Change (ORC) scale. The dependent variable, attitudes towards adopting EBPs, was assessed using the Evidence-Based Practice Attitude Scale (EBPAS). RESULTS: This study is one of the first to administer the EBPAS in South Africa and found good internal consistency (total score: α = .82). In a multivariable model adjusting for site and factors associated with EBPAS total score at the bivariate level, only smaller caseload size was associated with greater openness to adopting EBPs (B = 1.61, SE = .73; t = 2.21; p<.05). CONCLUSIONS: As pressure to scale up implementation of EBPs in South African substance use treatment services intensifies, additional efforts are needed to understand barriers to adopt EBPs in this setting. Supporting staff adoption of EBPs in resource-limited settings may require additional resources to limit staff caseloads in the context of task shifting.

Behavioral Healthcare Staff Attitudes and Practices Regarding Consumer Tobacco Cessation Services.

Given the high prevalence of tobacco use among persons with behavioral health disorders, there has been much discussion about if and when tobacco cessation services should be provided to consumers. Approximately 1700 staff (who served adults and youth) from 38 public behavioral healthcare agencies in Virginia completed a survey on their attitudes and practices regarding tobacco cessation services for consumers. Results showed that most staff (88%) think tobacco cessation services should be offered and do not interfere with treatment. Most staff (57%) always/usually screened consumers for tobacco use, but few (14%) always/usually provided tobacco cessation counseling. Reported barriers included consumers not wanting to quit and a lack of staff training. Most staff reported that their organizations do not have policies regarding tobacco cessation services. Use of tobacco cessation practices was related to staff confidence using the practices, preparedness, and years of experience. Steps to improving the use of tobacco cessation practices in this setting are discussed.

Energy drink use is associated with alcohol and substance use in eighth, tenth, and twelfth graders.

The increasing prevalence of energy drink (ED) use and its link with negative behaviors and adverse health outcomes has garnered much attention. Use of EDs combined with alcohol among college students has been of particular interest. It is unclear if these relationships develop in the context of college, or if similar associations exist in younger individuals. The present study examined associations between ED consumption patterns and other substance use in an adolescent, school-based sample. Participants were N = 3743 students attending 8th, 10th or 12th grade in a suburban central Virginia public school system who completed a prevention needs assessment survey in 2012. Chi-square analyses and logistic regressions were used to compare rates of alcohol, tobacco and other drug use across three ED use groups: moderate/heavy (12.6%), light (30.5%), and non-users (57%). Over 40% of the sample reported recent (past month) ED use, with males more likely to report moderate/heavy ED use than females (14.0% and 11.1%, respectively; p = 0.02). After adjusting for gender and grade, ED use group predicted lifetime alcohol, tobacco and other drug use (all p < 0.001). Moderate/heavy ED users were most likely and ED non-users were least likely to report using each of the 13 substances in the survey, with light ED users intermediate to the other two groups. Moderate/heavy ED users were consistently most likely to report licit and illicit substance use. Additional research is needed to better understand which adolescents are at greatest risk for adverse health behaviors associated with ED use.

Providers' perceptions of the implementation of a performance measurement system for substance abuse treatment: A process evaluation of the Service Quality Measures initiative.

BACKGROUND: In South Africa, concerns exist about the quality of substance abuse treatment. We developed a performance measurement system, known as the Service Quality Measures (SQM) initiative, to monitor the quality of treatment and assess efforts to improve quality of care. In 2014, the SQM system was implemented at six treatment sites to evaluate how implementation protocols could be improved in preparation for wider roll-out. OBJECTIVE: To describe providers' perceptions of the feasibility and acceptability of implementing the SQM system, including barriers to and facilitators of implementation. METHODS: We conducted 15 in-depth interviews (IDIs) with treatment providers from six treatment sites (two sites in KwaZulu-Natal and four in the Western Cape). Providers were asked about their experiences in implementing the system, the perceived feasibility of the system, and barriers to implementation. All IDIs were audio-recorded and transcribed verbatim. A framework approach was used to analyse the data. RESULTS: Providers reported that the SQM system was feasible to implement and acceptable to patients and providers. Issues identified through the IDIs included a perceived lack of clarity about sequencing of key elements in the implementation of the SQM system, questions on integration of the system into clinical care pathways, difficulties in tracking patients through the system, and concerns about maximising patient participation in the process. CONCLUSION: Findings suggest that the SQM system is feasible to implement and acceptable to providers, but that some refinements to the implementation protocols are needed to maximise patient participation and the likelihood of sustained implementation.

Development and psychometric validation of a novel patient survey to assess perceived quality of substance abuse treatment in South Africa.

BACKGROUND: A hybrid performance measurement system that combines patient-reported outcome data with administrative data has been developed for South African substance abuse treatment services. This paper describes the development and psychometric validation of one component of this system, the South African Addiction Treatment Services Assessment (SAATSA). METHODS: First, a national steering committee identified five domains and corresponding indicators on which treatment quality should be assessed. A decision was made to develop a patient survey to assess several of these indicators. A stakeholder work group sourced survey items and generated additional items where appropriate. The feasibility and face validity of these items were examined during cognitive response testing with 16 patients. This led to the elimination of several items. Next, we conducted an initial psychometric validation of the SAATSA with 364 patients from residential and outpatient services. Exploratory (EFA) and confirmatory factor analyses (CFA) were conducted to assess the latent structure of the SAATSA. Findings highlighted areas where the SAATSA required revision. Following revision, we conducted another psychometric validation with an additional sample of 285 patients. We used EFA and CFA to assess construct validity and we assessed reliability using Cronbach's measure of internal consistency. RESULTS: The final version of the SAATSA comprised 31 items (rated on a four-point response scale) that correspond to six scales. Four of these scales are patient-reported outcome measures (substance use, quality of life, social connectedness and HIV risk outcomes) that together assess the perceived effectiveness of treatment. The remaining two scales assess patients' perceptions of access to and quality of care. The models for the final revised scales had good fit and the internal reliability of these scales was good to excellent, with Cronbach's α ranging from 0.72 to 0.89. CONCLUSION: A lack of adequate measurement tools hampers efforts to improve the quality of substance abuse treatment. Our preliminary evidence suggests that the SAATSA, a novel patient survey that assesses patients' perceptions of the outcomes and quality of substance abuse treatment, is a psychometrically robust tool that can help fill this void.

Identifying perceived barriers to monitoring service quality among substance abuse treatment providers in South Africa.

BACKGROUND: A performance measurement system is planned for South African substance abuse treatment services. Provider-level barriers to implementing these systems have been identified in the United States, but little is known about the nature of these barriers in South Africa. This study explored the willingness of South African substance abuse treatment providers' to adopt a performance measurement system and perceived barriers to monitoring service quality that would need to be addressed during system development. METHODS: Three focus group discussions were held with treatment providers from two of the nine provinces in South Africa. These providers represented the diverse spread of substance abuse treatment services available in the country. The final sample comprised 21 representatives from 12 treatment facilities: eight treatment centres in the Western Cape and four in KwaZulu-Natal. Content analysis was used to extract core themes from these discussions. RESULTS: Participants identified barriers to the monitoring of service quality that included outdated modes of collecting data, personnel who were already burdened by paperwork, lack of time to collect data, and limited skills to analyse and interpret data. Participants recommended that developers engage with service providers in a participatory manner to ensure that service providers are invested in the proposed performance measurement system. CONCLUSION: Findings show that substance abuse treatment providers are willing to adopt a performance measurement system and highlight several barriers that need to be addressed during system development in order to enhance the likelihood that this system will be successfully implemented.

Tobacco use among African-American youth receiving behavioral healthcare services.

African-American youth with behavioral health problems may be particularly vulnerable to tobacco use and dependence; however, little is known about overall prevalence and factors associated with tobacco use in this population. The present study compared rates of tobacco use for African-Americans (aged 13-17) receiving behavioral healthcare services to state and national prevalence rates. In addition, we examined whether tobacco use prevalence was related to treatment characteristics and services rendered. Retrospective chart reviews were conducted at an urban, public behavioral healthcare agency for youth admitted in 2009. Tobacco use rates among African-Americans receiving behavioral healthcare services were similar to, and in some cases, higher than statewide and national prevalence rates. While tobacco users were more likely to be enrolled in a substance abuse program than in a mental health program, only 2 of 55 youth reporting tobacco use had received documented tobacco cessation treatment. Future work should focus on implementing tobacco cessation prevention and treatment for these youth.

Assessing the utility of consumer surveys for improving the quality of behavioral health care services.

The development and implementation of provider performance and consumer outcome measures for behavioral health care have been growing over the last decade, presumably because they are useful tools for improving service quality. However, the extent to which providers have successfully used performance measurement results has not been adequately determined. To this end, two methods were used to better understand the use of data obtained from an annual survey of behavioral health care consumers: a cross-sectional survey of executive directors, clinical program directors, and quality improvement directors and follow-up interviews with a subsample of survey respondents. Results revealed information about the use of consumer survey data, factors that facilitate and hinder the use of results, as well as respondents' opinions about consumer survey administration procedures. These findings provide valuable information for the application of performance measures and, ultimately, improving consumer outcomes.

Addiction epidemiology in adolescents receiving inpatient psychiatric treatment.

This study sought to characterize adolescent psychiatric inpatient populations from two sites and to determine correlates of substance use disorders (SUD). Screening procedures for SUD differ substantially between these sites. A retrospective review of adolescent inpatients (n=636) revealed that the populations were similar in gender, race and age. Rates of SUD at the site with a formalized SUD screening regimen were higher (39%) than those at the other site (16.5%). Similar correlates of SUD were observed across sites, including older age, legal involvement, sexual activity, childhood disruptive disorder, and tobacco use. These results suggest that SUD is a major issue in adolescent psychiatric patients. More rigorous screening for SUD and its correlates may facilitate earlier detection of substance use in this vulnerable population.