Single-case intervention research design standards: Additional proposed upgrades and future directions.

Single-case intervention research design standards have evolved considerably over the past decade. These standards serve the dual role of assisting in single-case design (SCD) intervention research methodology and as guidelines for literature syntheses within a particular research domain. In a recent article (Kratochwill et al., 2021), we argued for a need to clarify key features of these standards. In this article we offer additional recommendations for SCD research and synthesis standards that have been either underdeveloped or missing in the conduct of research and in literature syntheses. Our recommendations are organized into three categories: expanding design standards, expanding evidence standards, and expanding the applications and consistency of SCDs. The recommendations we advance are for consideration for future standards, research design training, and they are especially important to guide the reporting of SCD intervention investigations as they enter the literature-synthesis phase of evidence-based practice initiatives.

Treatment Acceptability for Interventions Addressing Challenging Behavior Among Chinese Caregivers of Children with Autism Spectrum Disorder.

The present study evaluated treatment acceptability for behavioral interventions addressing challenging behaviors with Chinese caregivers of children with autism spectrum disorder. Factors influencing treatment acceptability (i.e., severity of challenging behavior and Chinese child-rearing values) were investigated. Caregivers of children aged 2-12 years (N = 216) participated in this survey study. Results suggest that caregivers found positive strategies including noncontingent reinforcement and positive reinforcement the most acceptable; punishment-based strategies were rated as the least acceptable. Furthermore, positive punishment was perceived as more acceptable for severe challenging behavior. Caregivers who endorsed training were more likely to find positive strategies acceptable, whereas those who endorsed shaming were more likely to rate punishment-based strategies as more acceptable. Implications for future research and culturally competent behavioral treatments in Chinese context are provided.

Recommendations for Diversifying Racial and Ethnic Representation in Autism Intervention Research: A Crossover Review of Recruitment and Retention Practices in Pediatric Mental Health.

Disparities in diagnosis and access to healthcare and therapeutic services are well-documented for children with autism spectrum disorder (ASD) from minoritized races and ethnicities, but there is little empirical research to guide the selection and implementation of interventions and practices that will effectively support racially/ethnically diverse children with ASD and their families. This cross-over systematic review summarizes parent-mediated intervention research of children with or at risk for mental health disorders to identify potentially effective recruitment and retention strategies for diverse participants in parent-mediated intervention research for children with autism. Electronic database keyword, lead author name searches in PyschNet, MEDLINE, and ancestral searches were conducted to identify 68 relevant articles that used experimental designs to evaluate the effects of parent-mediated interventions on children with or at risk for mental health disorders. Articles were coded for participant demographics; intervention setting and type, recruitment and retention strategies, cultural adaptation of intervention, and reported attrition. Findings are discussed and applied to practices in autism parent-mediated intervention research. Suggestions for future research and limitations are discussed.

Honoring Uncontrolled Events: Commentary on Slocum et al.

In this special section of Perspectives on Behavior Science, Slocum et al. (2022) provide a summary of the logic and protocol for the construction, implementation, and analysis of single-case multiple-baseline designs. A major contribution of this article is a reassessment of the nonconcurrent multiple baseline design as a credible approach to documenting experimental control. In this commentary we provide considerations for readers as they approach the Slocum et al. article and suggest that although the resurrection of nonconcurrent multiple-baseline designs to a higher status is warranted, researchers will find more control for threats to internal validity in concurrent multiple-baseline designs, and the concurrent format should remain the preferred option.

Parent-Implemented Behavior Interventions via Telehealth for Older Children and Adolescents.

Children and adolescents with intellectual and developmental disabilities (IDD) are more likely to engage in challenging and interfering behavior than their typically developing peers, which has been linked to many negative outcomes. The most effective interventions to address challenging and interfering behavior incorporate function-based assessments, which are used to develop individualized behavior interventions. Functional communication training (FCT) is an evidence-based practice to decrease challenging and interfering behavior that can be taught to parents using behavioral parent training (BPT); however, there are limited skilled professionals who can develop interventions and train parents. Telehealth can enable greater access to these professionals. This study used withdrawal designs to determine whether high parent treatment fidelity resulted in decreased challenging and interfering behavior and increased appropriate replacement behavior. Three participants (8-17 years) were included in the study, and their parents served as interventionists during mealtime, toothbrushing, and room cleaning. Data were analyzed using visual analysis. Each parent achieved high treatment fidelity with one session of BPT and bug-in-ear coaching. All participants had a decrease in challenging and interfering behavior and an increase in functional communication responses (FCRs) upon the introduction of the intervention with reliable reversals. All parents reported high social validity. Results and implications for practice and future research are discussed.

A single-case experimental design investigation of collaborative goal setting practices in hospital-based speech-language pathologists when provided supports to use motivational interviewing and goal attainment scaling.

The study investigated the impact of the electronic Goal Attainment Scaling (eGAS) process on medical speech-language pathologists' (SLPs) interviewing and goal setting. The process was trained via the eGAS app, designed to facilitate motivational interviewing and goal attainment scaling. The study utilized a single-case, nonconcurrent, multiple-baseline design replicated across three clinicians and their 27 respective clients. We observed client-clinician dyads engaged in setting rehabilitation goals pre and post eGAS training. The clients had neurogenic conditions and were being treated for cognitive, communication and/or swallowing challenges in an outpatient setting. Two measures were used to collect data on the clinician's interviewing and goal-setting behaviors: (1) Assessment of Client-Centeredness when Interviewing and Goal Setting (ACIG) scale, and (2) a task analysis, i.e., the Clinician Interview Behavior scale (CIB). Training with eGAS had a strong effect on clinicians' collaborative interviewing behaviors, an inconsistent effect on their ability to adhere to a three-phase interview structure, and a strong effect on their ability to generate valid goal attainment scales. This study provides preliminary support that the eGAS process provides a feasible framework for training hospital-based SLPs engaged in neurorehabilitation to use collaborative interviewing behaviors and produce valid person-centered rehabilitation goals.

Augmentative and Alternative Communication for Children with Intellectual and Developmental Disability: A Mega-Review of the Literature.

Establishing evidence- and research-based practices relies upon research synthesis of individual studies in reviews and meta analyses. Further summarizing scientific evidence about a specific topic by synthesizing reviews is an area of need to determine practices that have a strong evidence base and to identify areas of methodological weakness and gaps in the literature. A mega-review of literature reviews, systematic reviews, and meta-analyses on interventions using aided augmentative and alternative communication (AAC) interventions for children with intellectual and developmental disabilities from 2000 to mid-2020 was conducted. Participant and interventionist demographics, interventions, settings, outcomes, and recommendations of each review were reported and summarized. A MeaSurement Tool to Assess systematic Reviews Revised (AMSTAR 2; Shea et al., 2017) was used to examine the methodological rigor of 84 included reviews. Over the past 20 years, published reviews have increased slightly in methodological rigor but demonstrate a number of methodological weaknesses that detract from the strength of evidence for AAC interventions with this population. Suggestions for improving the methodological rigor of literature reviews and areas for future research specific to AAC interventions are discussed.

Sustaining Personal Activism: Behavior Analysts as Antiracist Accomplices.

One pervasive social issue that has received little attention within the behavior-analytic community is racism and the systemic oppression of Black, Indigenous, and non-Black people of color. The present article offers guidance and examples of how each of us as behavior analysts might build individualized self-management behavior change plans that support initiating and sustaining socially significant antiracism work as we move from allies to accomplices within our own sphere of influence. This article introduces the concept of self-managed antiracism behavior change plans that (a) operationally define antiracist action using measurable outcomes and strategies for data collection on specific antiracist and support actions, (b) provide choices to improve engagement and reduce barriers to adherence, and (c) use effective behavioral interventions to alter the availability of discriminative stimuli or reduce their influence, and increase the availability of reinforcers that are compatible with the goal of the behavior change plan for increasing antiracism behavior and dismantling structures perpetuating racial inequities.

Single-case design standards: An update and proposed upgrades.

In this paper, we provide a critique focused on the What Works Clearinghouse (WWC) Standards for Single-Case Research Design (Standards 4.1). Specifically, we (a) recommend the use of visual-analysis to verify a single-case intervention study's design standards and to examine the study's operational issues, (b) identify limitations of the design-comparable effect-size measure and discuss related statistical matters, (c) review the applicability and practicality of Standards 4.1 to single-case designs (SCDs), and (d) recommend inclusion of content pertaining to diversity, equity, and inclusion in future standards. Within the historical context of the WWC Pilot Standards for Single-Case Design (1.0), we suggest that Standards 4.1 may best serve as standards for meta-analyses of SCDs but will need to make clear distinctions among the various types of SCD studies that are included in any research synthesis. In this regard, we argue for transparency in SCD studies that meet design standards and those that do not meet design standards in any meta-analysis emanating from the WWC. The intent of these recommendations is to advance the science of SCD research both in research synthesis and in promoting evidence-based practices.

Examination of the Effectiveness and Acceptability of a Play-Based Sibling Intervention for Children with Autism: A Single-Case Research Design.

Complementary and reciprocal interactions are a defining feature of sibling relationships for young children. However, the social and communication difficulties of children with autism spectrum disorder (ASD) can make reciprocal play more difficult and play between siblings can be less rewarding. Sibling play can serve an important role in intervention and family cohesiveness, but there is no consistent method for involving siblings in intervention benefitting the sibling dyad. This study evaluated a novel treatment package including training siblings on play strategies to increase positive sibling play in combination with a sibling support group to offer social support for the neurotypical sibling (NT). The effects of the treatment package on NT sibling play and fidelity of implementation of naturalistic play strategies was examined using a concurrent multiple-baseline design across six dyads, five of whom completed the intervention. After behavior skills training, all NT siblings increased the number of strategies they used, and increased the frequency of initiations towards their sibling with ASD. In addition, the percentage of reciprocal play between siblings increased. Generalization probes and follow-up probes demonstrated above-baseline levels of performance across most dyads, indicating that the skills learned generalized across other toys and were maintained over time. Only three of the sibling support group sessions were completed due to the COVID-19 pandemic. Although the effectiveness of the sibling support group cannot be determined, social validity questionnaires suggest siblings and parents valued and liked the support group. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s43494-021-00043-5.

Coaching via Telehealth: Caregiver-Mediated Interventions for Young Children on the Waitlist for an Autism Diagnosis Using Single-Case Design.

Years can elapse between parental suspicion of a developmental delay and a diagnostic assessment, ultimately delaying access to medically necessary, autism-specific intervention. Using a single-case, concurrent multiple baseline design, autism spectrum disorder symptomology (i.e., higher-order restrictive and repetitive behaviors and interests; higher-order RRBIs) was targeted in toddlers (21-35 months) waiting for a diagnostic appointment. Caregivers were coached via telehealth to mediate early intervention to decrease interfering, inflexible higher-order RRBIs during play using four evidence-based applied behavior analytic strategies: modeling, prompting, differential reinforcement of appropriate behaviors, and response interruption and redirection. Six mother-child dyads were recruited from pediatrician offices and early intervention service districts in the United States. All families were considered under-served, under-resourced, or living in rural locations. A visual analysis of the data combined with Tau-U revealed a strong basic effect between the intervention package and parent strategy use and child flexible and inflexible behavior. Findings were consistent across participants with one exception demonstrating a moderate effect for flexible behaviors yet a strong effect for inflexible behaviors. Standardized mean difference was beyond zero for all participants. Implications for science and practice include support for early intervention of higher-order RRBIs for young children with and at risk for ASD.

Attrition, missing data, compliance, and related biases in randomized controlled trials of rehabilitation interventions: towards improving reporting and conduct.

INTRODUCTION: Attrition, missing data, compliance, and related biases can influence the magnitude of treatment effects in randomized controlled trials (RCTs). It is unclear which items should be considered when reporting and evaluating the influence of these biases in trial reports in the rehabilitation field. The aim was to describe which individual items considering attrition, missing data, compliance, and related biases are included in quality tools used in rehabilitation research. In addition, we aimed to determine whether the existing reporting guidelines, such as the CONSORT and its extensions include all relevant items related to these biases when reporting RCTs in the area of rehabilitation. EVIDENCE ACQUISITION: Comprehensive literature searches and a systematic approach to identify tools and items looking at attrition, missing data, compliance and related biases in rehabilitation were performed. We extracted individual items linked to these biases from all quality tools. We calculated the frequency of quality items used across tools and compared them to those found in the CONSORT statement and its extensions. A list of items to be potentially added to the CONSORT statement was generated. EVIDENCE SYNTHESIS: Three new tools to assess the conduct and reporting of trials in the rehabilitation field were found. From these tools, 28 items were used to evaluate the reporting as well as the conduct of trials considering attrition, missing data, compliance, and related biases in the rehabilitation field. However, our team found that some of these items lack specificity in the information required and therefore more research is needed to determine a core set of items used for reporting as well as assessing the risk of bias (RoB) of RCT in the rehabilitation field. CONCLUSIONS: Although many items have been described by existing tools and the CONSORT statement (and its extensions) that deal with attrition, missing data, compliance, and related biases, several gaps in reporting were identified. It is crucial that future research investigate a core set of items to be used in the field of rehabilitation to facilitate the reporting as well as the conduct of RCTs.

Influence of attrition, missing data, compliance, and related biases and analyses strategies on treatment effects in randomized controlled trials in rehabilitation: a methodological review.

INTRODUCTION: Attrition, missing data, compliance, and related biases are three interrelated concepts. Previous research has found that these biases can affect the treatment estimates of randomized trials (RCTs). The extent to which the effects of attrition, missing data, compliance and related biases influence effect size estimates in rehabilitation as well as the effect of analytic strategies to mitigate these biases is unknown. EVIDENCE ACQUISITION: To compile and synthetize the empirical evidence regarding the effects of attrition and compliance related biases on treatment effect estimates in rehabilitation RCTs. Electronic searches were conducted. Studies were included if they investigated the effects of attrition, missing data, compliance and related biases on treatment estimates. The seven studies meeting inclusion criteria were coded for type of biases and summarized using a narrative and/or quantitative approach when appropriate. EVIDENCE SYNTHESIS: Findings demonstrated that trials reporting higher levels of attrition (differences in ES: 0.18 [95%CI: 0.15, 0.22 ]), exclusion of participants from analyses (differences in ES: 0.13 [95% CI: -0.03, 0.29]), lack of good control of incomplete outcome data (differences in ES: 0.14 [95%CI: -0.02, 0.30]) and analysis by "as treated"(differences in ES:-0.39 [95%CI: -0.99, 0.2]) or "per protocol" (differences in ES:-0.46 [95%CI: -0.92, 0]) analyses were more likely to have higher effects than those that did not. CONCLUSIONS: These findings suggest that attrition, missing data, compliance, and related biases have an influence in treatment effect estimates in rehabilitation trials. Therefore, these results should be taken into consideration when designing, conducting and reporting trials in the rehabilitation field.

The Randomized Controlled Trials Rehabilitation Checklist: Methodology of Development of a Reporting Guideline Specific to Rehabilitation.

BACKGROUND: One of the goals of Cochrane Rehabilitation is to strengthen methodology relevant to evidence-based clinical practice. Toward this goal, several research activities have been performed in rehabilitation literature: a scoping review listed the methodological issues in research, a study showed the low clinical replicability of randomized controlled trials, two systematic reviews showed the relevant items in reporting guidelines, and a series of articles discussed main methodological issues as a result of the first Cochrane Rehabilitation Methodological Meeting (Paris 2018). The need to improve the quality of conduct and reporting of research studies in rehabilitation emerged as a relevant task. The aim of this article is to present the Randomized Controlled Trial Rehabilitation Checklists (RCTRACK) project to produce a specific reporting guideline in rehabilitation. METHODS: The project followed a combination of the CONsolidated Standards of Reporting Trials and EQUATOR Network methodologies. The project includes five phases. The first is kick-off, first consensus meeting and executive and advisory committee identification. The second is literature search and synthesis, where eight working groups will produce knowledge synthesis products (systematic or scoping reviews) to compile items relevant to reporting of randomized controlled trials in rehabilitation. The topics will be as follows: patient selection; blinding; treatment group; control group and co-interventions; attrition, follow-up, and protocol deviation; outcomes; statistical analysis and appropriate randomization; and research questions. The third is guidelines development, which means drafting of a document with the guidelines through a consensus meeting. The fourth is Delphi process consensus, a Delphi study involving all the rehabilitation research and methodological community. The fifth is final consensus meeting and publication. CONCLUSIONS: The RCTRACK will be an important contribution to the rehabilitation field and will impact several groups of rehabilitation stakeholders worldwide. The main goal is to improve the quality of the evidence produced in rehabilitation research. The RCTRACK also wants to improve the recognition and understanding of rehabilitation within Cochrane and the scientific and medical community at large.