Examining effects of training duration on humans' resurgence and variability using a novel touchscreen procedure.

Resurgence occurs when a previously reinforced and then extinguished target response increases due to reducing/eliminating an alternative source of reinforcement or punishing an alternative response. We evaluated whether duration of reinforcement history for a target response (1) affects the degree to which resurgence is observed in humans and (2) produces different gradients of response generalization around target responding during extinction testing. We arranged a novel touchscreen interface in which university students could swipe a 3D soccer ball to spin any direction. In Phase 1, the first direction swiped became the target and produced points exchangeable for money for 3 or 1 min across 2 groups. The first swipe was recorded but had no programmed consequence in a third group. In Phase 2, swipes 180-degrees from the target resulted in points for 3 min in all groups. Point deliveries ceased for 2 min to test for resurgence in Phase 3. Target responses resurged during testing to a relatively greater extent with longer Phase-1 training but gradients of response generalization did not differ among groups. These findings extend prior research on the role of training duration on resurgence. We discuss methodological and conceptual issues surrounding the assessment of response generalization in resurgence.

Predator videos and electric shock function as punishers for zebrafish (Danio rerio).

Zebrafish (Danio rerio) are a promising animal model for studying the effects of gene-environment interactions on behavior. Two experiments were conducted to assess punishment effects of presenting predator videos (Indian leaf fish; Nandus nandus) and electric shock on operant approach responses in zebrafish. In Experiment 1, the predator video and shock stimuli were presented upon a response maintained by a single variable-interval schedule of food reinforcement in different groups of fish. In Experiment 2, the predator video and shock stimuli were presented upon one of two response alternatives maintain by concurrently available variable-interval schedules of food reinforcement in different groups of fish. Responding decreased when the predator video and shock stimuli were presented relative to their absence in both experiments. Moreover, responding on an unpunished alternative did not reliably decrease in Experiment 2. These results indicate that the decrease in responding resulted from the punishment contingency rather than from elicited species-specific defense responses or conditioned avoidance. Thus, the predator video and electric shock functioned as punishers of operant behavior for zebrafish. Identifying punishers for this species could lead to research on how gene-environment interactions influence individual differences in sensitivity to punishment.

Response acquisition by zebrafish (Danio rerio) with delayed reinforcement.

Zebrafish (Danio rerio) is a common vertebrate animal model in biomedical research and is a promising species for studying how genes interact with environmental factors in determining behavior. The present study investigated how reinforcement parameters affect zebrafish behavior by assessing response acquisition with delayed reinforcement, which has been studied with other species (e.g., rats, pigeons, humans, etc.) but not with zebrafish. Twenty-four experimentally naïve subjects were exposed to a tandem fixed-ratio 1 differential-reinforcement-of-other-behavior x-s schedule of reinforcement, where x varied across subjects. There were six different delay-to-reinforcement durations and sets of four fish were assigned to each delay duration. All of the fish assigned to a 0-, 0.5-, or 1-s delay acquired responding. Two fish acquired responding with a 3-s delay and one fish appeared to have acquired it with a 6-s delay although the latter result was less clear. None acquired responding with a 12-s delay. These results suggest that zebrafish behavior is sensitive to delays to reinforcement and the time frame over which reinforcement is effective may be limited approximately to 6 s. This time frame is shorter than that found with other species. Practical and theoretical implications of the present finding are discussed.

Operant models of relapse in zebrafish (Danio rerio): Resurgence, renewal, and reinstatement.

Zebrafish are a widely used animal model in biomedical research, as an alternative to mammals, for having features such as a fully sequenced genome, high fecundity, and low-cost maintenance, but behavioral research with these fish remains scarce. The present study investigated whether zebrafish could be a new animal model for studies on the relapse of behavior (e.g., addiction and overeating) after the behavior has been extinguished. Specifically, we examined whether zebrafish would show three different types of relapse commonly studied with other species: resurgence, renewal, and reinstatement. For resurgence, a target response (i.e., approaching a sensor) was established by presenting a reinforcer (i.e., shrimp eggs) contingent upon the response in Phase 1; the target response was extinguished while introducing reinforcement for an alternative response in Phase 2; neither response produced the reinforcer in Phase 3. For renewal, a target response was established under Context A in Phase 1 and was extinguished under Context B in Phase 2; the fish were placed back in Context A in Phase 3, where extinction remained in effect. For reinstatement, a target response was established in Phase 1 and was extinguished in Phase 2; the reinforcer was presented independently of responding in Phase 3. Each type of relapse occurred in Phase 3. These results replicate and extend previous findings on relapse to a new species and suggest that zebrafish can be a useful animal model for studying the interactions of biological and environmental factors that lead to relapse.

Reversal learning and resurgence of operant behavior in zebrafish (Danio rerio).

Zebrafish are used extensively as vertebrate animal models in biomedical research for having such features as a fully sequenced genome and transparent embryo. Yet, operant-conditioning studies with this species are scarce. The present study investigated reversal learning and resurgence of operant behavior in zebrafish. A target response (approaching a sensor) was reinforced in Phase 1. In Phase 2, the target response was extinguished while reinforcing an alternative response (approaching a different sensor). In Phase 3, extinction was in effect for the target and alternative responses. Reversal learning was demonstrated when responding tracked contingency changes between Phases 1 and 2. Moreover, resurgence occurred in 10 of 13 fish in Phase 3: Target response rates increased transiently and exceeded rates of an unreinforced control response. The present study provides the first evidence with zebrafish supporting reversal learning between discrete operant responses and a laboratory model of relapse. These findings open the possibility to assessing genetic influences of operant behavior generally and in models of relapse (e.g., resurgence, renewal, reinstatement).