A detailed examination of reporting procedural fidelity in the Journal of Applied Behavior Analysis.

Few reviews on procedural fidelity-the degree to which procedures are implemented as designed-provide details to gauge the quality of fidelity reporting in behavior-analytic research. This review focused on experiments in the Journal of Applied Behavior Analysis (2006-2021) with "integrity" or "fidelity" in the abstract or body. When fidelity data were collected, the coders characterized measurement details (e.g., description of calculation, report of single or multiple values, frequency of fidelity checks, checklist use). The researchers found increasing trends in describing the calculation(s), reporting multiple values, and stating the frequency of measurement. Few studies described using a checklist. Most studies reported fidelity as a percentage, with high obtained values (M = 97%). When not collecting fidelity data was stated as a limitation, authors were unlikely to provide a rationale for the omission. We discuss recommendations for reporting procedural fidelity to increase the quality of and transparency in behavior-analytic research.

Comparing Multiple Methods to Measure Procedural Fidelity of Discrete-trial Instruction.

Procedural fidelity is the extent to which an intervention is implemented as designed and is an important component of research and practice. There are multiple ways to measure procedural fidelity, and few studies have explored how procedural fidelity varies based on the method of measurement. The current study compared adherence to discrete-trial instruction protocols by behavior technicians with a child with autism when observers used different procedural-fidelity measures. We collected individual-component and individual-trial fidelity with an occurrence-nonoccurrence data sheet and compared these scores to global fidelity and all-or-nothing, 3-point Likert scale, and 5-point Likert scale measurement methods. The all-or-nothing method required all instances of a component or trial be implemented without error to be scored correct. The Likert scales used a rating system to score components and trials. At the component level, we found that the global, 3-point Likert, and 5-point Likert methods were likely to overestimate fidelity and mask component errors, and the all-or-nothing method was unlikely to mask errors. At the trial level, we found that the global and 5-point Likert methods approximated individual-trial fidelity, the 3-point Likert method overestimated fidelity, and the all-or-nothing method underestimated fidelity. The occurrence-nonoccurrence method required the most time to complete, and all-or-nothing by trial required the least. We discuss the implications of measuring procedural fidelity with different methods of measurement, including false positives and false negatives, and provide suggestions for practice and research. Supplementary Information: The online version contains supplementary material available at 10.1007/s43494-023-00094-w.

Trends in Reporting Procedural Integrity: A Comparison.

Procedural integrity refers to the extent to which an independent variable is implemented as described. Measuring procedural integrity is one important factor when considering internal and external validity of experiments. Experimental articles in behavior-analytic journals have rarely reported procedural-integrity data. The purpose of this study was to update previous reviews of whether articles published in the Journal of Applied Behavior Analysis reported procedural integrity, spanning a period from 1980 to 2020, and compare reporting in JABA to recent reviews of studies published in Behavior Analysis in Practice (2008-2019) and the Journal of Organizational Behavior Management (2000-2020). Procedural integrity continues to be underreported across all three journals, but an increasing trend in reporting procedural integrity is evident in the Journal of Applied Behavior Analysis and Behavior Analysis in Practice. In addition to our recommendations and implications for research and practice, we provide examples and resources to assist researchers and practitioners with recording and reporting integrity data.

The Use of Instructive Feedback to Promote Emergent Tact and Intraverbal Control: A Replication.

Instructive feedback (IF) involves incorporating additional acquisition targets into skill-acquisition programs. A recent study by Frampton and Shillingsburg (2020) found that IF led to emergent verbal operants with two elementary-aged children diagnosed with autism spectrum disorder (ASD). The current study replicated Frampton and Shillingsburg with two children with ASD. Therapists conducted sessions of mastered listener-by-name trials (e.g., "Show me otter," with pictures of otter, dog, and elephant) with IF statements for features of the target stimuli (e.g., "It lives in rivers.") embedded during the consequence portion of the trial. We evaluated the acquisition of secondary targets and emergent responses using a concurrent multiple baseline across sets design. We observed increased correct responding for secondary targets and emergent responses for all three sets of stimuli with one participant. The other participant emitted correct responses for secondary targets and emergent operants with the first set but not with the other two sets of stimuli. Results suggested that IF can lead to emergent verbal operants, but the extent of emergence may be idiosyncratic. Supplementary Information: The online version contains supplementary material available at 10.1007/s40616-022-00171-y.

Strengthening the procedural fidelity research-to-practice loop in animal behavior.

Procedural fidelity is the extent to which components of an intervention are implemented as designed. Procedural fidelity is measured as a dependent variable and manipulated as an independent variable. In research and practice, procedural-fidelity data should be collected, monitored, and reported. Procedural fidelity as an independent variable has been investigated in humans using parametric analyses, and the current article summarizes some of the research conducted on the effects of procedural-fidelity errors in behavior-reduction and skill-acquisition interventions. Connections were drawn to applied animal researchers and the work of animal behavior practitioners to produce implications for practice with human and animal clients and suggestions for future research. Further, there are multiple ways to measure procedural fidelity, and different conclusions can be drawn based on the measure and computation method. The current article describes procedural-fidelity measures that are most applicable to animal behavior researchers and professionals.

Comparing Matrix-Training Procedures with Children with Autism Spectrum Disorder.

Recombinative generalization is the production of responses in the presence of novel combinations of known components. For example, after learning "red triangle" and "blue square," recombinative generalization is observed when a child can tact "red square" and "blue triangle." Recombinative generalization can emerge from a history of matrix training, which involves carefully selecting and arranging stimuli and responses along at least two axes and training a subset of responses. With three children with autism spectrum disorder, we compared recombinative generalization of object-action or feature-object tacts when the component stimuli were trained before combination stimuli, trained along with combination stimuli, or untrained (i.e., combination only). For two participants, training the components along with some combinations led to the most untrained targets acquired without direct teaching. For the other participant, training the combinations only led to the greatest proportion of untrained targets acquired without direct teaching. We discuss stimulus control promoted by each teaching arrangement and suggestions for future research on recombinative generalization.

Replication of a skills assessment for auditory-visual conditional discrimination training.

Auditory-visual conditional discrimination training (e.g., receptive identification training, listener responses; AVCD) is ubiquitous in early intervention and special education programs. Nevertheless, some learners with Autism Spectrum Disorder (ASD) do not appear to benefit from this training despite use of empirically validated treatments. To prevent exposure to extended training that does not lead to learning, a skills assessment that measures skills related to AVCD training will be useful for educators and practitioners. The current study replicated the skills assessment developed and evaluated by Kodak et al. (2015) with 8 participants with ASD who received behavior analytic intervention that included at least 1 goal related to AVCD training. Two of the 8 participants mastered all skills included in the assessment except scanning. In addition, 5 participants' responding failed to reach mastery during subsequent exposure to AVCD training, which further demonstrated the predictive utility of the skills assessment.

Adapting Direct Services for Telehealth: A Practical Tutorial.

Due to the pandemic brought on by the novel coronavirus (COVID-19), consumers of applied behavior-analytic interventions may be experiencing disrupted access to services. In response to the need for services, behavior analysts and therapists may find themselves treading unchartered waters as they use telehealth to provide direct intervention to consumers. Direct service provision via telehealth extends beyond the bounds of existing telehealth research, which primarily focuses on caregiver training and consultation. In the transition to telehealth, behavior analysts can consider how to adapt an existing evidence base of behavior-analytic strategies from a face-to-face format to intervention via a teleconferencing platform (i.e., Zoom). In this tutorial, we provide practice recommendations, task analyses, and a curated list of Zoom walk-throughs to help behavior analysts construct conceptually systematic learning opportunities in their direct telehealth services. Leveraging teleconferencing features to provide behavior-analytic intervention directly to consumers could spur future research to support these need-inspired practices and guide telehealth applications during and beyond the current pandemic. Supplementary Information: The online version contains supplementary material available at 10.1007/s40617-020-00529-5.

When do errors in reinforcer delivery affect learning? A parametric analysis of treatment integrity.

Treatment integrity is the extent to which components of an intervention are implemented as intended (Gresham, 1989). Recent behavior-analytic literature has begun to evaluate the effects of reduced-treatment integrity on the efficacy and efficiency of skill-acquisition interventions. This study extended the current literature on the effects of errors of omission and commission of reinforcer delivery by replicating and extending Hirst and DiGennaro Reed (2015). Using a randomized-control group design, we compared undergraduate student participants' acquisition of conditional discriminations in a parametric analysis of different error values. A computer program erred in reinforcer delivery on 0%, 5%, 10%, 15%, 20%, 25% and 50% of trials. The purpose of the current study was to identify which levels of reduced integrity slowed or prevented acquisition. Our data replicated the findings of Hirst and DiGennaro Reed, and extended parametric analyses by identifying that errors in reinforcer delivery occurring on 15% or fewer trials (i.e., 85% integrity) were unlikely to prevent participants' responding from meeting the mastery criterion. These results could inform future research on how treatment-integrity errors change behavior-analytic procedures and the effects on skill acquisition for consumers of applied behavior analysis.

Replicating stimulus-presentation orders in discrimination training.

Children with autism spectrum disorder (ASD) are taught conditional discriminations often during early intervention. Auditory-visual conditional discrimination (AVCD) training requires the presentation of multiple antecedent stimuli, and the order of stimulus presentation varies in the literature. This series of studies replicated previous literature on stimulus-presentation order in AVCD training. In Experiment 1, we compared sample-first and comparisons-first arrangements in 8 comparisons with 4 participants with ASD. For 3 participants, both presentations were efficacious. For 1 participant, the sample-first order was more likely to be efficacious. In Experiment 2, we added a sample-first-with-repetition arrangement and conducted 6 comparisons with 5 participants with ASD. Across comparisons, all 3 presentations were efficacious. Considerations for teaching AVCD to children with ASD and suggestions for further evaluation and examination of efficacy and efficiency are discussed.

Autism Spectrum Disorder: Characteristics, Associated Behaviors, and Early Intervention.

Autism spectrum disorder (ASD) is characterized by deficits in social communication and interaction and the presence of restricted and repetitive patterns of behavior and interests. Currently, ASD affects 1 in 59 individuals and can be a costly disorder across one's lifetime. Because of the prevalence, costs, and range of behavioral needs, early intervention is vital to teach skills across a variety of domains and prevent the development or exacerbation of behavioral deficits and excesses. Interventions based on applied behavior analysis have the most empirical support; several strategies to teach social skills, communication, and adaptive skills are discussed.

A comparison of stimulus set size on tact training for children with autism spectrum disorder.

Previous studies on skill acquisition have taught targets in stimulus sets composed of different numbers of stimuli. Although the rationale for selection of a stimulus set size is not clear, the number of target stimuli trained within a set is a treatment decision for which there is limited empirical support. The current investigation compared the efficiency of tact training in 4 stimulus set sizes, each of which included 12 stimuli grouped into (a) 4 sets of 3 stimuli, (b) 3 sets of 4 stimuli, (c) 2 sets of 6 stimuli, and (d) 1 set of 12 stimuli. Results of all 4 participants with autism spectrum disorder show tact training with larger (i.e., 6 and 12) stimulus set sizes was more efficient than training with smaller (i.e., 3 and 4) stimulus set sizes.

Examination of the Effects of Auditory and Textual Stimuli on Response Accuracy and Latency during a Math Task and Tangram Puzzle.

Although Skinner (1957) provided a behavioral account of verbal thinking, additional research is needed to evaluate stimuli that may influence covert verbal behavior that occurs between the onset of a verbal stimulus and the emission of a response during an episode of verbal thinking. The present investigation examined the effects of auditory distractors and/or textual stimuli during arithmetic problems and tangram puzzles on the participants' response latency and accuracy. In addition, we measured and categorized occurrences of vocal verbal behavior during the response interval. In Experiments 1 and 2, the experimenter played auditory distractors during a proportion of arithmetic problems. In Experiment 2, the experimenter also presented a textual stimulus of the arithmetic problem. In Experiment 3, the experimenter played auditory distractors during a proportion of tangram puzzles. Results showed that auditory distractors led to longer response latencies and reduced accuracy in Experiment 1. The addition of the textual stimulus during trials in Experiment 2 improved accuracy and reduced differences in response latency when the auditory distractors were and were not present during the response interval. The auditory distractors during tangram puzzles in Experiment 3 produced no differential effects on accuracy or latency to respond.

Examination of efficacious, efficient, and socially valid error-correction procedures to teach sight words and prepositions to children with autism spectrum disorder.

Prior research shows that learners have idiosyncratic responses to error-correction procedures during instruction. Thus, assessments that identify error-correction strategies to include in instruction can aid practitioners in selecting individualized, efficacious, and efficient interventions. The current investigation conducted an assessment to compare 5 error-correction procedures that have been evaluated in the extant literature and are common in instructional practice for children with autism spectrum disorder (ASD). Results showed that the assessment identified efficacious and efficient error-correction procedures for all participants, and 1 procedure was efficient for 4 of the 5 participants. To examine the social validity of error-correction procedures, participants selected among efficacious and efficient interventions in a concurrent-chains assessment. We discuss the results in relation to prior research on error-correction procedures and current instructional practices for learners with ASD.