A detailed examination of reporting procedural fidelity in the Journal of Applied Behavior Analysis.

Few reviews on procedural fidelity-the degree to which procedures are implemented as designed-provide details to gauge the quality of fidelity reporting in behavior-analytic research. This review focused on experiments in the Journal of Applied Behavior Analysis (2006-2021) with "integrity" or "fidelity" in the abstract or body. When fidelity data were collected, the coders characterized measurement details (e.g., description of calculation, report of single or multiple values, frequency of fidelity checks, checklist use). The researchers found increasing trends in describing the calculation(s), reporting multiple values, and stating the frequency of measurement. Few studies described using a checklist. Most studies reported fidelity as a percentage, with high obtained values (M = 97%). When not collecting fidelity data was stated as a limitation, authors were unlikely to provide a rationale for the omission. We discuss recommendations for reporting procedural fidelity to increase the quality of and transparency in behavior-analytic research.

Trends in Reporting Procedural Integrity: A Comparison.

Procedural integrity refers to the extent to which an independent variable is implemented as described. Measuring procedural integrity is one important factor when considering internal and external validity of experiments. Experimental articles in behavior-analytic journals have rarely reported procedural-integrity data. The purpose of this study was to update previous reviews of whether articles published in the Journal of Applied Behavior Analysis reported procedural integrity, spanning a period from 1980 to 2020, and compare reporting in JABA to recent reviews of studies published in Behavior Analysis in Practice (2008-2019) and the Journal of Organizational Behavior Management (2000-2020). Procedural integrity continues to be underreported across all three journals, but an increasing trend in reporting procedural integrity is evident in the Journal of Applied Behavior Analysis and Behavior Analysis in Practice. In addition to our recommendations and implications for research and practice, we provide examples and resources to assist researchers and practitioners with recording and reporting integrity data.

On a persisting curious double standard in behavior analysis: Behavioral scholars' perspectives on procedural fidelity.

Procedural fidelity is the extent to which independent variables are implemented as designed. Despite 40 years of discussion about the importance of procedural fidelity for behavioral research, reporting of fidelity data remains an uncommon practice in behavior-analytic journals. Researchers have speculated about reasons for underreporting, but the perspectives of scholars about when reporting is warranted or necessary have not yet been explored. Thus, the purpose of this study was to evaluate possible reasons for infrequent reporting of fidelity data in behavior-analytic studies. To address this purpose, we conducted focus groups with scholars in applied behavior analysis. Five themes emerged regarding why procedural fidelity data are not typically reported. We provide a discussion about how these themes are interrelated and offer suggestions and recommendations to assist with the collection and reporting of fidelity data.

Nominally acceptable integrity failures negatively affect interventions involving intermittent reinforcement.

The finding that differential reinforcement of alternative behavior (DRA) is efficacious at 80% integrity when continuous reinforcement is programmed for alternative responding may have contributed to a perception that integrity at 80% or above is acceptable. However, research also suggests that other interventions (e.g., noncontingent reinforcement) may not remain effective at 80% integrity. The conditions under which 80% integrity is acceptable for common behavioral interventions remains unclear. Therefore, we conducted two human-operant studies to evaluate effects of 80% integrity for interventions with contingent or noncontingent intermittent reinforcement schedules. During Experiment 1, we compared noncontingent reinforcement (NCR) and DRA when implemented with 80% integrity. During Experiment 2, we compared 2 variations of DRA, which included either a ratio or interval schedule to reinforce alternative behavior. Results replicated previous research showing that DRA with a FR-1 schedule programmed for alternative responding resulted in consistent target response suppression, even when integrity was reduced to 80%. In contrast, neither NCR nor interval-based DRA were consistently effective when implemented at 80% integrity. These results demonstrate that 80% integrity is not a uniformly acceptable minimal level of integrity.

Connecting animal trainers and behavior analysts through loopy training.

The communities of behavior analysts and animal trainers remain relatively disconnected despite potentially beneficial links between behavioral principles and the practices of animal training. Describing existing links between research by behavior analysts and practices used by animal trainers may foster connections. In this paper, we describe an approach used by many clicker trainers, referred to as loopy training. Loopy training is a teaching process built around the concept of movement cycles. Interactions between the animal learner and the handler are refined into predictable, cyclical patterns that can be expanded into complex sequences. These sequences include cues, target responses, conditioned reinforcers, and consummatory responses. We link the foundations of loopy training to existing work in the experimental analysis of behavior, compare loopy training to other shaping approaches, and describe areas for future research. We conclude with a series of recommendations for further developing connections between behavior analysts and animal trainers, using loopy training as the foundation for our suggestions.

Comparing training methods to improve volunteer skills during therapeutic horseback riding: A randomized control trial.

Although in-vivo behavioral skills training (BST) is often effective, it may be too resource-intensive for organizations that rely on volunteers. Alternatives to in-vivo BST include video models or interactive computer training (ICT), but the utility of these procedures for training volunteers remains largely unknown. We used a randomized control trial to teach multiple skills to new volunteers at a therapeutic riding center. A total of 60 volunteers were assigned to one of three groups using block randomization. Depending on group assignment, volunteers received instructions and modeling through in-vivo interactions, a video model, or ICT. All volunteers completed in-vivo role plays with feedback. Skills were measured by unblinded observers during role plays. There were no statistically significant differences in accuracy of role-play performance between volunteers in the in-vivo BST and ICT groups, but both outperformed the video-model group. The ICT and video model required statistically significantly less time from a live instructor than did in-vivo training. Thus, although in-vivo BST remains best practice, ICT may be a viable alternative when training resources are limited.

Reporting of demographic variables in the Journal of Applied Behavior Analysis.

Describing demographic variables (e.g., ethnicity/race, socioeconomic status, gender/sex, age) of participants may be important for identifying relations between these variables and behavior-analytic procedures. Previous research found that demographic variables were underreported in behavior-analytic studies dealing with particular populations (e.g., children with Autism Spectrum Disorder), interventions (e.g., verbal behavior), or for a subset of demographic variables. We evaluated the extent to which studies recently published in the Journal of Applied Behavior Analysis included descriptions of demographic variables of participants. Demographic variables were often underreported, which may limit the broader dissemination of these behavior-analytic studies and the development of culturally responsive modifications to behavioral interventions.

Increased number of responses may account for reduced resurgence following serial training.

Abrupt discontinuation of functional communication training can cause resurgence of challenging behavior. Teaching multiple alternative responses in sequence (serial training) may reduce resurgence, relative to teaching a single alternative. However, previous evaluations of serial training included a different number of response options across comparison conditions. In Experiment 1, we varied both training type (single and serial) and number of response options, and replicated previous findings showing that more resurgence occurred following single training relative to serial training. In Experiment 2, we varied the training type while holding the number of alternative responses constant and obtained no consistent differences in resurgence. In Experiment 3, we varied the number of alternative responses while holding training type constant (i.e., single). More resurgence occurred in the condition with fewer response options, suggesting that the number of available alternative responses, and not explicit serial training of alternatives, was critical to outcomes.

Resurgence of previously taught academic responses.

Resurgence is often discussed in relation to the relapse of undesirable behavior. However, resurgence may also describe the recurrence of socially appropriate behavior, including academic responding. The recurrence of academic responses following periods of extinction may aid in the solution of novel problems. The aims of this study were to evaluate the resurgence of complex, desirable behavior related to college-level instruction and to explore problem form as an aspect of environmental context. Each participant was taught 2 response chains to solve quadratic equations across experimental phases, followed by a phase in which neither chain resulted in the correct solution (extinction). During Experiment 1, the equations presented during extinction resembled those presented during reinforcement of the alternative response. Of the 8 participants in Experiment 1, 4 attempted to use the first-taught chain to solve an equation in the extinction phase. During Experiment 2, the equations presented during extinction resembled those presented during reinforcement of the target response. Of the 8 participants in Experiment 2, 6 attempted to use the first-taught chain to solve an equation in the extinction phase. Results demonstrate the resurgence of academic responses and suggest that the form of the problem may constitute a context that affects resurgence.

Accumulated reinforcers increase academic responding and suppress problem behavior for students with Attention-Deficit Hyperactivity Disorder.

We compared rates of academic responses and problem behavior during mathematics with distributed and accumulated reinforcer arrangements for 3 students with Attention-Deficit Hyperactivity Disorder who engaged in chronic, severe problem behavior. All 3 students engaged in more academic responding and less problem behavior when reinforcers accumulated throughout the session, relative to conditions in which reinforcers were distributed throughout the session or withheld completely. We then conducted concurrent-chain analyses to evaluate student preference for the reinforcer arrangements. Two students preferred distributed reinforcers, even though this arrangement continued to produce problem behavior. One student preferred accumulated reinforcers. Our data replicate previous findings regarding the efficacy of accumulated-reinforcer arrangements, but suggest that students do not always prefer the most efficacious reinforcer arrangement.

Blue Light Covers Increase Stereotypy and Decrease On-Task Behavior for Students with Autism.

Some recommended strategies for individuals with autism spectrum disorder (ASD) are not empirically based. The purpose of the study was to evaluate effects of blue light covers on levels of stereotypy and on-task behavior. Four male children with ASD who engaged in repetitive behavior participated. Placing light covers over the classroom's fluorescent lights relative to normal classroom lighting did not improve on-task behavior or stereotypy.

Assessing the repeatability of resurgence in humans: Implications for the use of within-subject designs.

Resurgence refers to the recurrence of a previously reinforced response following the worsening of reinforcement conditions (e.g., extinction) for an alternative response. Because of the implications for treatment relapse, researchers have become particularly interested in mitigating resurgence of human behavior. Some studies have employed reversal designs and varied parameters across replications (e.g., ABCADC) to compare effects of second-phase variables. Although resurgence is generally repeatable within and between subjects, the extent to which similar levels of resurgence occur across replications is less clear. To assess the repeatability of resurgence, we conducted a secondary analysis of 62 human-operant data sets using ABCABC reversal designs from two laboratories in the United States. We found significant reductions in the magnitude of resurgence during the second exposure to extinction relative to the first exposure when all other phase variables were held constant. These results suggest that researchers should exercise caution when using within-subject, across-phase replications to compare resurgence between variable manipulations with human participants.

Effects of treatment-integrity failures on a response-cost procedure.

Effects of incorrect or partial implementation (poor treatment integrity) on response cost are largely unknown. We evaluated reduced treatment integrity during response cost on rates of 2 concurrently available responses. College students earned points by clicking on either a black circle or a red circle on a computer screen. Experiment 1 compared 2 types of treatment-integrity failures (omission and commission errors) across 2 levels of integrity (20% and 50%). Compared to 100% integrity conditions, omission errors did not suppress responding to the same extent, and commission errors reduced target responding but also decreased rates of alternative behavior. Experiment 2 compared the effects of 20% and 50% omission errors within subjects. Implementation at 50% integrity adequately suppressed responding, but treatment effects were lost at 20% integrity. There may be a critical level at which response cost must be implemented to suppress responding, which has important implications for application.

Evaluation of treatment integrity errors on mand acquisition.

Manding allows individuals to access reinforcers in their environment. Caregivers may not implement mand-training programs as designed, which could result in decreased mand proficiency. This study evaluated the effects of delivery of the incorrect item (Experiment 1) and response-independent item delivery (Experiment 2) across 4 levels of treatment integrity (0%, 40%, 70%, and 100%) on mand acquisition with individuals with developmental disabilities. During Experiment 1, 2 of the 3 participants acquired the mand fastest during 100% integrity. Delivery of the incorrect item was detrimental to acquisition, but effects were idiosyncratic. During Experiment 2, all participants acquired the mand trained with 100% integrity fastest, followed by the mand trained with 70% integrity. None of the participants acquired the mands trained with 40% and 0% integrity, suggesting that delivery of the item independent of responding was detrimental to acquisition. For mand training to be most effective, caregivers must implement mand training with high levels of integrity.

A comparison of error-correction procedures on skill acquisition during discrete-trial instruction.

Previous research supports the use of a variety of error-correction procedures to facilitate skill acquisition during discrete-trial instruction. We used an adapted alternating treatments design to compare the effects of 4 commonly used error-correction procedures on skill acquisition for 2 children with attention deficit hyperactivity disorder and 3 children with autism spectrum disorder. For all participants, multiple error-correction procedures were effective; however, 1 or 2 specific error-correction procedures led to more efficient skill acquisition for each individual. These results highlight the importance of evaluating the effectiveness and efficiency of error-correction procedures for individual learners during discrete-trial instruction. We discuss the use of discrete-trial instruction with different populations, implications for using multiple measures of procedural efficiency, and several areas for future research.

Effects of fixed-time reinforcement schedules on resurgence of problem behavior.

Resurgence of problem behavior following the discontinuation of differential reinforcement of alternative behavior (DRA) may be prevented by response-independent reinforcer delivery. In basic research, response-independent reinforcer delivery following DRA prevented resurgence of the initially reinforced response and maintained alternative responding (Lieving & Lattal, 2003, Experiment 3). We evaluated the generality of these results by assessing if fixed-time (FT) reinforcer delivery following DRA would prevent resurgence of problem behavior and maintain appropriate behavior with 4 children with disabilities. For all participants, extinction following DRA produced resurgence of previously reinforced problem behavior and reduced appropriate requests, but FT reinforcer delivery following DRA mitigated resurgence of problem behavior and maintained appropriate requests.

Methods for Assessing Social Validity of Behavioral Intervention Plans for Children with Attention Deficit Hyperactivity Disorder / Métodos para Evaluar la Validez Social de Planes de Intervención Conductual con Niños con Desorden por Déficit de Atención e Hiperactividad

Although behavioral interventions are powerful tools for parents and teachers, they are unlikely to result in lasting change if the intervention agents find them unacceptable. After developing effective behavior intervention plans for classroom use, we compared social validity of those interventions using three measures: concurrent-chains selections from the intervention consumer (students), verbal report of the intervention agent (teachers), and maintenance of the intervention over time. All three measures of social validity identified an intervention that was acceptable to the intervention consumer and intervention delivery agent. These findings are discussed in terms of applied implications for assessing social validity.

A pesar de que las intervenciones conductuales son herramientas poderosas para padres y maestros, es posible que no representen un cambio duradero si los agentes de la intervención consideran que no son aceptables. Después de desarrollar planes de intervención efectivos para ser utilizados en el aula, se comparó la validez social de dichas intervenciones usando tres medidas: elección de cadenas concurrentes por el consumidor de la intervención (estudiantes), reportes verbales del agente de la intervención (maestros) y mantenimiento de la intervención a lo largo del tiempo. Las tres medidas de validación social identificaron una intervención que era aceptable tanto para el consumidor como para el agente de la intervención. Los resultados se discuten en términos de las implicaciones aplicadas para evaluar la validez social.