Propranolol attenuates the establishment of conditioned context aversions: differential effects compared to MK-801 in an animal model of anticipatory nausea and vomiting.

Cancer patients often experience anticipatory nausea and vomiting (ANV) due to Pavlovian conditioning. Both N-methyl-D-aspartate and beta-adrenergic receptors are known to mediate memory formation, but their role in the development of ANV remains unclear. This study used a conditioned context aversion (CCA) paradigm, an animal model for ANV, to assess whether administration of the beta-adrenergic receptor antagonist propranolol or the N-methyl-D-aspartate receptor antagonist MK-801 immediately after CCA training has an effect on the later expression of CCA in CD1 male mice. In experiment 1, three groups were injected with lithium chloride (LiCl) to induce aversion in a novel context, resulting in CCA. A control group was injected with sodium chloride (NaCl). Following conditioning, two of the LiCl-treated groups received different doses of MK-801 (0.05 or 0.2 mg/kg), while the remaining LiCl-treated and NaCl-treated groups received a second NaCl injection. In experiment 2, two groups were injected with LiCl, and one group was injected with NaCl. After conditioning, one of the LiCl-treated groups received a propranolol injection (10 mg/kg). The remaining LiCl-treated and NaCl-treated groups received NaCl injections. Water consumption was measured in all groups 72 h later within the conditioning context. Postconditioning administration of propranolol, but not MK-801, attenuated CCA, as revealed by similar levels of water consumption in animals that received LiCl and propranolol relative to NaCl-treated animals. These findings suggest that beta-adrenergic receptor activation is crucial for the development of CCA. Therefore, propranolol may represent a novel therapeutic approach for cancer patients at high risk of ANV.

The impact of emotional valence on generalization gradients.

Generalization enables individuals to respond to novel stimuli based on previous experiences. The degree to which organisms respond is determined by their physical resemblance to the original conditioned stimulus (CS+), with a stronger response elicited by more similar stimuli, resulting in similarity-based generalization gradients. Recent research showed that cognitive or conceptual dimensions also result in gradients similar to those observed with manipulations of physical dimensions. Such findings suggest that attributes beyond physical similarity play a role in shaping generalization gradients. However, despite its adaptive relevance for survival, there is no study exploring the effectiveness of affective dimensions in shaping generalization gradients. In two experiments (135 Spanish and 150 English participants, respectively), we used an online predictive learning task, in which different stimuli (words and Gabor patches) were paired with the presence - or absence - of a fictitious shock. After training, we assessed whether valence (i.e., hedonic experience) conveyed by words shape generalization gradients. In Experiment 1, the outcome expectancy decreased monotonically with variations in valence of Spanish words, mirroring the gradient obtained with the physical dimension (line orientation). In Experiment 2, conducted with English words, a similar gradient was observed when non-trained (i.e., generalization) words varied along the valence dimension, but not when words were of neutral valence. The consistency of these findings across two different languages strengthens the reliability and validity of the affective dimension as a determinant of generalization gradients. Furthermore, our data highlight the importance of considering the role of affective features in generalization responses, advancing the interplay between emotion, language, and learning.

The effects of goal-landmark distance on overshadowing: A replication in humans (Homo sapiens) of Goodyear and Kamil (2004).

Goodyear and Kamil (2004) assessed the ability of Clark's nutcrackers to find buried food based on a cross-shaped array of landmarks at different distances from the goal. Their findings suggested that proximal landmarks overshadowed learning about distal landmarks, and this was attenuated when assessing the effect of distal landmarks on learning about proximal landmarks. In this study, we aimed to replicate their findings in human spatial navigation by using a virtual environment. Three groups of participants were trained in an open environment featuring orientation cues, and they had to find a hidden goal with reference to four landmarks that were arranged in the shape of a cross and placed at different distances from the goal. Two of the four landmark distances were common across all three groups to allow a comparison of the extent of overshadowing under comparable conditions. Following training, all participants were tested with each of the four landmarks individually. Consistent with the results in birds, we observed better performance in the groups with more distal landmarks, suggesting that overshadowing was greater in the groups with closer landmarks and thus dependent on the spatial distance between the landmarks and the goal. Landmarks near the goal more effectively overshadowed landmarks far from the goal. A second experiment, in which landmarks and orientation cues were misaligned in order to prevent the use of a straightforward solution to the task, replicated the results. The results are discussed in terms of a modification of Pearce's configural model. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Further evidence for the role of temporal contiguity as a determinant of overshadowing.

Three experiments explored whether weakening temporal contiguity between auditory cues and an aversive outcome attenuated cue competition in an avoidance learning task with human participants. Overall, with strong temporal contiguity between auditory cues and the outcome during training (the offset of the predictive auditory signals concurred with the onset of the outcome), the target cue trained as part of a compound yielded less avoidance behaviour than the control cue trained alone, an instance of overshadowing. However, weakening temporal contiguity during training (inserting a 5-s trace) attenuated overshadowing, resulting in similar avoidance behaviour in response to the control and target cues. These results provide evidence that, as predicted by a recent modification of Pearce's configural theory, temporal contiguity is critical for determining cue competition.

Category relevance attenuates overshadowing in human predictive learning.

In situations in which multiple predictors anticipate the presence or absence of an outcome, cues compete to anticipate the outcome, resulting in a loss of associative strength compared to control conditions without additional cues. Critically, there are multiple factors modulating the magnitude and direction of such competition, although in some scenarios the effect of these factors remains unexplored. We sought to assess whether the relative salience of the elements in a compound of cues modulates the magnitude of the overshadowing effect in human predictive learning. Two separable categories (i.e., colors and symbols) were used in a predictive learning task. In Experiment 1, different groups of participants were granted with different time of exposure to a compound of cues belonging to different categories (color and symbol) to evaluate potential differences in the magnitude of overshadowing. Furthermore, we used posttest questionnaires to assess whether participants used either only one or both categories during training, and assessed if this impacted the magnitude of overshadowing. In general, overshadowing was not modulated by the time of exposition, except in the case of very short time of exposition with prominent learning about the most salient category. In Experiment 2, the relative salience of a category was biased via prior experience either with a biconditional discrimination or attending only the relevant category (either color or symbol). The previously relevant category was less prone to overshadowing, but not the alternative one. Results are discussed in light of attentional and configural theories of associative learning. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Genetic and environmental influences on one-trial conditioned context aversion in mice.

Anticipatory nausea (AN) is caused by an association between contextual cues and the experience of nausea (the side effects of chemotherapy or radiation treatment) and it develops predominantly in female patients undergoing chemotherapy. Preclinical studies in rodents show that the administration of an illness-inducing agent in the presence of novel contextual cues can cause conditioned context aversion (CCA) and this has been proposed to model AN. The literature also suggests that brief pre-exposure to a novel context prior to shock delivery is critical in the development of contextual fear conditioning in rodents (a phenomenon known as Immediate Shock Deficit), but this has not been assessed in CCA. The aim of present study was to develop a CCA paradigm to assess this in outbred (CD1) and inbred (C57BL/6J) mice and evaluate potential sex differences. The results revealed that a single conditioning trial in which a distinctive context was paired with LiCl-induced illness was sufficient to elicit a conditioned response in both female and male CD1 outbred mice, but not in C57BL/6J inbred mice. In addition, CCA was facilitated when animals had prior experience with the context. Finally, outbred female mice showed longer and more robust retention of CCA than male mice, which parallels clinical findings. The results indicate the importance of using CD1 outbred mice as an animal model of AN as well as examining sex differences in the CCA paradigm. Similar findings in humans encourage the future use of this novel CCA preclinical mouse model.

Conditioned place avoidance in the planaria Schmidtea mediterranea: A pre-clinical invertebrate model of anxiety-related disorders.

The objective of the present study was to develop a model of avoidance learning and its extinction in planarians (Schmidtea mediterranea). Based on previous experiments showing conditioned place preference, we developed a procedure to investigate conditioned place avoidance (CPA) using shock as an unconditioned stimulus (US) and an automated tracking system to record the animals' behaviour. In Experiment 1, we assessed the unconditioned properties of different shock intensities by measuring post shock activity. In two subsequent experiments we investigated CPA using different designs, surfaces as conditioned stimuli (CSs; rough and smooth), and different US intensities (5 V and 10 V). In general, we observed the successful development of CPA. However, CPA was stronger with higher shock intensities, and we found that, in our preparation, a rough surface is best at entering into an association with the shock than a smooth surface. Finally, we also observed extinction of CPA. The evidence of CPA and its extinction in flatworms validates the planaria as a pre-clinical model for the study of avoidance learning, a hallmark of anxiety disorders.

Contiguity and overshadowing interactions in the rapid-streaming procedure.

When multiple cues are associated with the same outcome, organisms tend to select between the cues, with one revealing greater behavioral control at the expense of the others (i.e., cue competition). However, non-human and human studies have not always observed this competition, creating a puzzling scenario in which the interaction between cues can result in competition, no interaction, or facilitation as a function of several learning parameters. In five experiments, we assessed whether temporal contiguity and overshadowing effects are reliably observed in the streamed-trial procedure, and whether there was an interaction between them. We anticipated that weakening temporal contiguity (ranging from 500 to 1,000 ms) should attenuate competition. Using within-subject designs, participants experienced independent series of rapid streams in which they had to learn the relationship between visual cues (presented either alone or with another cue) and an outcome, with the cue-outcome pairings being presented with either a delay or trace relationship. Across experiments, we observed overshadowing (Experiments 1, 2, 4, and 5) and temporal contiguity effects (Experiments 2, 3, and 4). Despite the frequent occurrence of both effects, we did not find that trace conditioning abolished competition between cues. Overall, these results suggest that the extent to which contiguity determines cue interactions depends on multiple variables, some of which we address in the General discussion.

Social overshadowing: Revisiting cue-competition in social interactions.

In a large variety of contexts, it is essential to use the available information to extract patterns and behave accordingly. When it comes to social interactions for instance, the information gathered about interaction partners across multiple encounters (e.g., trustworthiness) is crucial in guiding one's own behavior (e.g., approach the trustworthy and avoid the untrustworthy), a process akin to trial-by-trial learning. Building on associative learning and social cognition literatures, the present research adopts a domain-general approach to learning and explores whether the principles underlying associative learning also govern learning in social contexts. In particular, we examined whether overshadowing, a well-established cue-competition phenomenon, impacts learning of the cooperative behaviors of unfamiliar interaction partners. Across three experiments using an adaptation of the iterated Trust Game, we consistently observed a 'social overshadowing' effect, that is, a better learning about the cooperative tendencies of partners presented alone compared to those presented in a pair. This robust effect was not modulated by gender stereotypes or beliefs about the internal communication dynamics within a pair of partners. Drawing on these results, we argue that examining domain-general learning processes in social contexts is a useful approach to understanding human social cognition.

Temporal contiguity determines overshadowing and potentiation of human Action-Outcome performance.

Three experiments (n = 81, n = 81, n = 82, respectively) explored how temporal contiguity influences Action-Outcome learning, assessing whether an intervening signal competed, facilitated, or had no effect on performance and causal attribution in undergraduate participants. Across experiments, we observed competition and facilitation as a function of the temporal contiguity between Action and Outcome. When there was a strong temporal relationship between Action and Outcome, the signal competed with the action, hindering instrumental performance but not causal attribution (Experiments 1 and 3). However, with weak temporal contiguity, the same signal facilitated both instrumental performance and causal attribution (Experiments 1 and 2). Finally, the physical intensity of the signal determined the magnitude of competition. As anticipated by associative learning models, a more salient signal attenuated to a greater extent instrumental performance (Experiment 3). These results are discussed by reference to a recent adaptation of the configural theory of learning.

Signal detection analysis of contingency assessment: Associative interference and nonreinforcement impact cue-outcome contingency sensitivity, whereas cue density affects bias.

In a signal detection theory approach to associative learning, the perceived (i.e., subjective) contingency between a cue and an outcome is a random variable drawn from a Gaussian distribution. At the end of the sequence, participants report a positive cue-outcome contingency provided the subjective contingency is above some threshold. Some researchers have suggested that the mean of the subjective contingency distributions and the threshold are controlled by different variables. The present data provide empirical support for this claim. In three experiments, participants were exposed to rapid streams of trials at the end of which they had to indicate whether a target outcome O1 was more likely following a target cue X. Interfering treatments were incorporated in some streams to impend participants' ability to identify the objective X-O1 contingency: interference trials (X was paired with an irrelevant outcome O2), nonreinforced trials (X was presented alone), plus control trials (an irrelevant cue W was paired with O2). Overall, both interference and nonreinforced trials impaired participants' sensitivity to the contingencies as measured by signal detection theory's d', but they also enhanced detection of positive contingencies through a cue density effect, with nonreinforced trials being more susceptible to this effect than interference trials. These results are explicable if one assumes interference and nonreinforced trials impact the mean of the associative strength distribution, while the cue density influences the threshold. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Temporal and spatial contiguity are necessary for competition between events.

Over the last 50 years, cue competition phenomena have shaped theoretical developments in animal and human learning. However, recent failures to observe competition effects in standard conditioning procedures, as well as the lengthy and ongoing debate surrounding cue competition in the spatial learning literature, have cast doubts on the generality of these phenomena. In the present study, we manipulated temporal contiguity between simultaneously trained predictors and outcomes (Experiments 1-4), and spatial contiguity between landmarks and goals in spatial learning (Supplemental Experiments 1 and 2; Experiment 5). Across different parametric variations, we observed overshadowing when temporal and spatial contiguity were strong, but no overshadowing when contiguity was weak. Thus, across temporal and spatial domains, we observed that contiguity is necessary for competition to occur, and that competition between cues presented simultaneously during learning is absent when these cues were either spatially or temporally discontiguous from the outcome. Consequently, we advance a model in which the contiguity between events is accounted for and which explains these results and reconciles the previously contradictory findings observed in spatial learning. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Fear memory modulation by incentive down and up-shifts.

Research on retrieval-induced malleability of maladaptive emotional memories has been mostly focused on the effect of drugs and extinction (i.e. post-retrieval extinction). Only a few studies addressed post-retrieval appetitive-aversive interactions. Due to the relevance that the understanding of the interactions between memory content and appetitive or aversive states under retrieval circumstances has for translational research, here we explored the relation between fear (i.e. contextual fear conditioning) and sucrose concentration down (32-4%) or up-shifts (4-32%). These have been reported as methods to induce aversive or appetitive internal states, respectively. We observed that fear expression is differentially susceptible to incentive contrast manipulations depending on the memory stage: acquisition, mere retrieval or retrieval-induced memory malleability. After fear acquisition, freezing behavior and incentive shift direction followed an inverse relation, that is: up-shift decreased fear responding and down-shift increased it. However, freezing behavior remained unaltered when incentive contrast was absent, regardless of the sucrose concentration employed (4-4% and 32-32%). When incentive shifts occurred after mere-retrieval, both negative and positive incentive shifts resulted in increased freezing behavior. Strikingly, this effect was unrelated to the nature of the incentive contrast (either positive or negative), occurring only when animals had no previous experience with the shifted solution. On the other hand, when fear retrieval led to memory malleability, up-shifts in sucrose concentration dampened freezing behavior as much as unshifted controls, whilst down-shift left freezing unaltered. Freezing facilitation was finally achieved after retrieval-induced memory malleability only after prior sampling of the down-shifted solution (i.e. 4% SUC). These results reveal a complex pattern of interactions between memory retrieval and incentive shift-induced internal states.

Predictive and motivational factors influencing anticipatory contrast: A comparison of contextual and gustatory predictors in food restricted and free-fed rats.

In anticipation of palatable food, rats can learn to restrict consumption of a less rewarding food type resulting in an increased consumption of the preferred food when it is made available. This construct is known as anticipatory negative contrast (ANC) and can help elucidate the processes that underlie binge-like behavior as well as self-control in rodent motivation models. In the current investigation we aimed to shed light on the ability of distinct predictors of a preferred food choice to generate contrast effects and the motivational processes that underlie this behavior. Using a novel set of rewarding solutions, we directly compared contextual and gustatory ANC predictors in both food restricted and free-fed Sprague-Dawley rats. Our results indicate that, despite being food restricted, rats are selective in their eating behavior and show strong contextually-driven ANC similar to free-fed animals. These differences mirrored changes in palatability for the less preferred solution across the different sessions as measured by lick microstructure analysis. In contrast to previous research, predictive cues in both food restricted and free-fed rats were sufficient for ANC to develop although flavor-driven ANC did not relate to a corresponding change in lick patterning. These differences in the lick microstructure between context- and flavor-driven ANC indicate that the motivational processes underlying ANC generated by the two predictor types are distinct. Moreover, an increase in premature port entries to the unavailable sipper - a second measure of ANC - in all groups reveals a direct influence of response competition on ANC development.

Nicotine chronic tolerance development and withdrawal in the planaria (Schmidtea mediterranea).

Chronic nicotine exposure reduces sensitivity to the effects of nicotine, which then results in behavioural changes and tolerance development. In the planaria, a valuable first-stage preclinical model for addictive behaviour, acute nicotine administration has been shown to steadily alter the motility of the animals, a result that has been interpreted as evidence of tolerance and withdrawal effects; however, chronic exposure - typically regarded as a condition for the development of tolerance - and the role of the contextual cues have not been systematically assessed. The present study assessed the acute and chronic effects of nicotine on the motility of planarians (Schmidtea mediterranea). The animals in the experimental groups received long chronic exposure to nicotine (ten daily 30 min exposures); a control group was exposed to water in the same context but in the absence of the drug. The motility of the animals was closely monitored on every exposure. Following this phase, all the animals were subject to three different tests: in the presence of the exposure context (without the drug, Test 1); in the presence of nicotine in the exposure context (Test 2); and in the presence of the drug in a novel context (Test 3). Exposure to nicotine consistently reduced motility; the motility in the presence of nicotine increased with repeated exposures to the drug, an instance of tolerance development. Tolerance development was dependent on nicotinic receptor activation, because it was blocked by the co-administration of mecamylamine. However, this tolerance was found to be independent of the contextual cues where the effects of the drug had been experienced. The results are discussed by reference to the existent theories of tolerance development to drugs.

Heat shock disrupts expression of excitatory and extinction memories in planaria: Interaction with amount of exposure.

In planarians, as seen in rodents, natural reinforcers (sucrose) and drugs of abuse support Conditioned Place Preference (CPP), which is a form of Pavlovian learning to examine the rewarding effects of natural reinforcers and drugs of abuse. Using this preparation, we have previously observed acquisition, extinction and reinstatement of sucrose CPP. In the present experiments, we used planaria to investigate the amnestic effects of Heat Shock (HS, a known stressor in planaria) following different amounts of CPP extinction sessions. Experiment 1 showed that planarians developed a CPP response to a sucrose-paired surface. Heat shock, when given in conjunction with exposure to the sucrose-paired surface, produced amnesia as assessed by a subsequent sucrose reinstatement test. We interpreted that the amnesic effect of HS was due to HS affecting the dominant excitatory memory at the time of HS exposure. Thus, we hypothesized that after extensive extinction training (10 exposures), HS would lead to recovery from extinction (when the new inhibitory memory is dominant at the time of HS exposure). Experiment 2 explored this possibility and showed that given HS following 10 extinction sessions had no amnestic effect on the excitatory CPP response. In Experiment 3, we hypothesized that 16 extinction sessions would produce a stronger (and hence dominant) extinction inhibitory trace, which then would be vulnerable to HS. We observed that HS impaired the expression of the extinction memory following 16 exposures. These results reveal different effects of HS on CPP memories depending on the amount of extinction, and are fully consistent with the literature using rodents and humans. In addition, they suggest that planaria is a promising pre-clinical model to assess fundamental memory processes.

Short- and long-term habituation of photonegative and exploratory responses in the flatworm planaria (Dugesia).

Two experiments address the habituation of photonegative and exploratory responses in the flatworm planaria (Dugesia). Planarians possess a well-documented photonegative response; Experiment 1 showed that repeated exposures to a bright light source with short inter trial intervals (ITIs) within 1 experimental session gradually weakens the unconditioned photonegative response. In addition, it was found that presentation of an unexpected arousal-increasing stimulus (dropped water or a shock) temporarily re-establishes the photonegative response. Experiment 2 addressed the development of long-term habituation; we recorded the locomotor activity of the animals exposed to an inescapable bright light. Experiments 2A and 2B showed that planarians develop long-term habituation but only when they were trained in relatively novel contexts; when they were trained in familiar contexts (in surfaces similar to the ones in the home) the development of habituation was severely impaired. The results are discussed by reference to the theory of short- and long-term habituation put forward by Allan R. Wagner (Wagner, 1976), highlighting the impact that this theory has had in the research of invertebrate learning. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Delayed rewards facilitate habit formation.

The transition from goal-directed to habitual forms of instrumental behavior is determined by variables such as the amount of training, schedules of reinforcement, the availability of choices, and exposure to drugs of abuse. Less is known about the control of goal-directed behavior when reinforcement is delayed rather than immediate. In these experiments, we investigated in rats the role of response-outcome contiguity on the control of goal-directed action, assessed through satiety-specific outcome devaluation tests. In Experiment 1 using a within-subjects design we observed goal-directed behavior after 6 days of FR1 training when the outcome was presented immediately following the lever press, but not when it was delayed for 20 s, revealing habit formation with delayed outcomes. Experiment 2 revealed that the habitual control observed with 20-s delays of reinforcement can be prevented if, immediately before each instrumental training session, the rats were exposed to the experimental context in the absence of both the lever and reinforcement. In summary, these experiments suggest that response-outcome contiguity plays an important role in the control of goal-directed actions and habits. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Human instrumental performance in ratio and interval contingencies: A challenge for associative theory.

Associative learning theories regard the probability of reinforcement as the critical factor determining responding. However, the role of this factor in instrumental conditioning is not completely clear. In fact, free-operant experiments show that participants respond at a higher rate on variable ratio than on variable interval schedules even though the reinforcement probability is matched between the schedules. This difference has been attributed to the differential reinforcement of long inter-response times (IRTs) by interval schedules, which acts to slow responding. In the present study, we used a novel experimental design to investigate human responding under random ratio (RR) and regulated probability interval (RPI) schedules, a type of interval schedule that sets a reinforcement probability independently of the IRT duration. Participants responded on each type of schedule before a final choice test in which they distributed responding between two schedules similar to those experienced during training. Although response rates did not differ during training, the participants responded at a lower rate on the RPI schedule than on the matched RR schedule during the choice test. This preference cannot be attributed to a higher probability of reinforcement for long IRTs and questions the idea that similar associative processes underlie classical and instrumental conditioning.

Excitatory second-order conditioning using a backward first-order conditioned stimulus: A challenge for prediction error reduction.

Prével and colleagues reported excitatory learning with a backward conditioned stimulus (CS) in a conditioned reinforcement preparation. Their results add to existing evidence of backward CSs sometimes being excitatory and were viewed as challenging the view that learning is driven by prediction error reduction, which assumes that only predictive (i.e., forward) relationships are learned. The results instead were consistent with the assumptions of both Miller's Temporal Coding Hypothesis and Wagner's Sometimes Opponent Processes (SOP) model. The present experiment extended the conditioned reinforcement preparation developed by Prével et al. to a backward second-order conditioning preparation, with the aim of discriminating between these two accounts. We tested whether a second-order CS can serve as an effective conditioned reinforcer, even when the first-order CS with which it was paired is a backward CS that elicits no responding. Evidence of conditioned reinforcement was found, despite no conditioned response (CR) being elicited by the first-order backward CS. The evidence of second-order conditioning in the absence of excitatory conditioning to the first-order CS is interpreted as a challenge to SOP. In contrast, the present results are consistent with the Temporal Coding Hypothesis and constitute a conceptual replication in humans of previous reports of excitatory second-order conditioning in rodents with a backward CS. The proposal is made that learning is driven by "discrepancy" with prior experience as opposed to " prediction error."