Refining Parent SMART: User feedback to optimize a multi-modal intervention.

INTRODUCTION: The continuing care period following residential substance use treatment is a time when adolescents are at especially high risk for relapse, yet few families engage in traditional office-based care. Parent SMART (Substance Misuse among Adolescents in Residential Treatment) is a multi-component continuing care intervention for parents that combines three digital health technologies - an "off the shelf" online parenting program, daily phone notifications, and an online parent networking forum - with support from a parent coach. The current study solicited both qualitative and quantitative user feedback about Parent SMART to ensure responsivity to user preferences, refinement, and continuous improvement of the intervention. METHODS: Exit interviews were conducted with 30 parents who received Parent SMART, which includes (1) a parent networking forum; (2) daily text messages reminders of skills, (3) an "off-the-shelf" online parenting program; and (4) in-person or telehealth parent coaching sessions. The study collected qualitative feedback using semi-structured interviews and obtained quantitative feedback via a series of ratings of each Parent SMART component on a 5-point Likert scale administered at each follow-up assessment. RESULTS: Quantitative feedback suggest that parents rated all four elements of Parent SMART as easy to use. Qualitative feedback revealed that parents valued several aspects of Parent SMART including the brevity and structure of the intervention elements, the reminders to use parenting skills, and the sense of social connectedness fostered by different components. Recommended refinements included a number of strategies to enhance personalization and ease of navigation. CONCLUSIONS: Parent feedback informed enhancements to the Parent SMART intervention prior to implementation in a larger, ongoing pragmatic effectiveness trial. The current study serves as a model for applying a staged person-centered approach and eliciting both quantitative and qualitative feedback to refine digital health technologies.

Pragmatic Implementation of a Music Intervention in Nursing Homes Before and During COVID-19.

OBJECTIVES: We conducted 2 trials of a music intervention for managing behaviors in nursing home (NH) residents with dementia, before (2019) and during (2021) the pandemic. In this report, we compare adherence fidelity across the trials using the Framework for Implementation Fidelity (FIF). DESIGN: Cross-sectional, descriptive implementation comparison. SETTING AND PARTICIPANTS: Fifty-four NHs randomized to receive the intervention (27 pre-COVID, 27 during COVID) METHODS: We compare the trials on the following FIF criteria: coverage (number of residents receiving the intervention); duration (minutes of music received per exposed day); frequency (percentage of residents with nursing staff use of music in the past week); and details of content (adherence to core components of the intervention). We report NH-level performance in each domain and compare characteristics of NHs in the bottom (low) and top (high) terciles of adherence. RESULTS: Across FIF domains, adherence fidelity was lower during COVID compared with pre-COVID: coverage, residents exposed (COVID: 7.5, SD 5.6; pre-COVID: 12.7, SD 3.6); duration, music minutes per exposed day (COVID: 2.5, SD 5.1; pre-COVID: 27.1, SD 23.9); frequency, percentage of residents with nursing use of intervention in the past week (COVID: 15.0, SD 31.5; pre-COVID 40.4, SD 25.6); and details of content, compliance with core components of the intervention (COVID: 8.3, SD 1.9; pre-COVID 9.6, SD 2.0). In both trials, high-adherence fidelity NHs had better nursing staff ratios, greater percentages of Medicare residents, and lower percentages of Black residents, compared with low-fidelity NHs. CONCLUSIONS AND IMPLICATIONS: Adherence fidelity was worse in the COVID vs pre-COVID trial, despite adaptations between trials intended to reduce staff burden and increase clinical targeting of the intervention. Results may point to the long-term effects of COVID on quality improvement capacity in NHs and/or a lack of available resources in most NHs to implement complex behavioral interventions without direct research support.

What Are the Right Tools for Studying Arts in Health Interventions?

The arts can touch places that are difficult to recognize and understand, capture in words, or measure by numbers-whether you're an artist, a patient, or an educator. This ineffability presents a dilemma for practitioners and researchers in arts in health when questions of legitimacy, efficacy, program implementation, and research funding are tied to outcomes-based research. Ethical tensions arise when traditional public health and clinical research methods are the wrong tools for capturing what's vital about the arts. This article argues that being a responsible arts in health researcher requires interrogating what counts as evidence, especially when the insistence on rigor risks oversimplifying and diminishing the power of the arts. It further argues for equity in arts in health research, including equity in investigative strategies that value both the arts and the research.

Pragmatic Trial of Personalized Music for Agitation and Antipsychotic Use in Nursing Home Residents With Dementia.

OBJECTIVE: To test the effect of a personalized music intervention on agitated behaviors and medication use among long-stay nursing home residents with dementia. DESIGN: Pragmatic, cluster-randomized controlled trial of a personalized music intervention. Staff in intervention facilities identified residents' early music preferences and offered music at early signs of agitation or when disruptive behaviors typically occur. Usual care in control facilities may include ambient or group music. SETTING AND PARTICIPANTS: The study was conducted between June 2019 and February 2020 at 54 nursing homes (27 intervention and 27 control) in 10 states owned by 4 corporations. METHODS: Four-month outcomes were measured for each resident. The primary outcome was frequency of agitated behaviors using the Cohen-Mansfield Agitation Inventory. Secondary outcomes included frequency of agitated behaviors reported in the Minimum Data Set and the proportion of residents using antipsychotic, antidepressant, or antianxiety medications. RESULTS: The study included 976 residents with dementia [483 treatment and 493 control; mean age = 80.3 years (SD 12.3), 69% female, 25% African American]. CMAI scores were not significantly different (treatment: 50.67, SE 1.94; control: 49.34, SE 1.68) [average marginal effect (AME) 1.33, SE 1.38, 95% CI -1.37 to 4.03]. Minimum Data Set-based behavior scores were also not significantly different (treatment: 0.35, SE 0.13; control: 0.46, SE 0.11) (AME -0.11, SE 0.10, 95% CI -0.30 to 0.08). Fewer residents in intervention facilities used antipsychotics in the past week compared with controls (treatment: 26.2, SE 1.4; control: 29.6, SE 1.3) (AME -3.61, SE 1.85, 95% CI -7.22 to 0.00), but neither this nor other measures of psychotropic drug use were statistically significant. CONCLUSIONS AND IMPLICATIONS: Personalized music was not significantly effective in reducing agitated behaviors or psychotropic drug use among long-stay residents with dementia. Barriers to full implementation included engaging frontline nursing staff and identifying resident's preferred music.

Measuring implementation fidelity in a cluster-randomized pragmatic trial: development and use of a quantitative multi-component approach.

BACKGROUND: In pragmatic trials, on-site partners, rather than researchers, lead intervention delivery, which may result in implementation variation. There is a need to quantitatively measure this variation. Applying the Framework for Implementation Fidelity (FIF), we develop an approach for measuring variability in site-level implementation fidelity. This approach is then applied to measure site-level fidelity in a cluster-randomized pragmatic trial of Music & MemorySM (M&M), a personalized music intervention targeting agitated behaviors in residents living with dementia, in US nursing homes (NHs). METHODS: Intervention NHs (N = 27) implemented M&M using a standardized manual, utilizing provided staff trainings and iPods for participating residents. Quantitative implementation data, including iPod metadata (i.e., song title, duration, number of plays), were collected during baseline, 4-month, and 8-month site visits. Three researchers developed four FIF adherence dimension scores. For Details of Content, we independently reviewed the implementation manual and reached consensus on six core M&M components. Coverage was the total number of residents exposed to the music at each NH. Frequency was the percent of participating residents in each NH exposed to M&M at least weekly. Duration was the median minutes of music received per resident day exposed. Data elements were scaled and summed to generate dimension-level NH scores, which were then summed to create a Composite adherence score. NHs were grouped by tercile (low-, medium-, high-fidelity). RESULTS: The 27 NHs differed in size, resident composition, and publicly reported quality rating. The Composite score demonstrated significant variation across NHs, ranging from 4.0 to 12.0 [8.0, standard deviation (SD) 2.1]. Scaled dimension scores were significantly correlated with the Composite score. However, dimension scores were not highly correlated with each other; for example, the correlation of the Details of Content score with Coverage was τb = 0.11 (p = 0.59) and with Duration was τb = - 0.05 (p = 0.78). The Composite score correlated with CMS quality star rating and presence of an Alzheimer's unit, suggesting face validity. CONCLUSIONS: Guided by the FIF, we developed and used an approach to quantitatively measure overall site-level fidelity in a multi-site pragmatic trial. Future pragmatic trials, particularly in the long-term care environment, may benefit from this approach. TRIAL REGISTRATION: Clinicaltrials.gov NCT03821844. Registered on 30 January 2019, https://clinicaltrials.gov/ct2/show/NCT03821844 .