Infralimbic activity during REM sleep facilitates fear extinction memory.

Rapid eye movement (REM) sleep is known to facilitate fear extinction and play a protective role against fearful memories.1,2 Consequently, disruption of REM sleep after a traumatic event may increase the risk for developing PTSD.3,4 However, the underlying mechanisms by which REM sleep promotes extinction of aversive memories remain largely unknown. The infralimbic cortex (IL) is a key brain structure for the consolidation of extinction memory.5 Using calcium imaging, we found in mice that most IL pyramidal neurons are intensively activated during REM sleep. Optogenetically suppressing the IL specifically during REM sleep within a 4-h window after auditory-cued fear conditioning impaired extinction memory consolidation. In contrast, REM-specific IL inhibition after extinction learning did not affect the extinction memory. Whole-cell patch-clamp recordings demonstrated that inactivating IL neurons during REM sleep depresses their excitability. Together, our findings suggest that REM sleep after fear conditioning facilitates fear extinction by enhancing IL excitability and highlight the importance of REM sleep in the aftermath of traumatic events for protecting against traumatic memories.

The basal forebrain to lateral habenula circuitry mediates social behavioral maladaptation.

Elucidating the neural basis of fear allows for more effective treatments for maladaptive fear often observed in psychiatric disorders. Although the basal forebrain (BF) has an essential role in fear learning, its function in fear expression and the underlying neuronal and circuit substrates are much less understood. Here we report that BF glutamatergic neurons are robustly activated by social stimulus following social fear conditioning in male mice. And cell-type-specific inhibition of those excitatory neurons largely reduces social fear expression. At the circuit level, BF glutamatergic neurons make functional contacts with the lateral habenula (LHb) neurons and these connections are potentiated in conditioned mice. Moreover, optogenetic inhibition of BF-LHb glutamatergic pathway significantly reduces social fear responses. These data unravel an important function of the BF in fear expression via its glutamatergic projection onto the LHb, and suggest that selective targeting BF-LHb excitatory circuitry could alleviate maladaptive fear in relevant disorders.

The Effects of Fingolimod (FTY720) on Leukocyte Subset Circulation cannot be Behaviourally Conditioned in Rats.

Suppression of immune functions can be elicited by behavioural conditioning using drugs such as cyclosporin A or rapamycin. Nevertheless, little is known about the underlying mechanisms and generalisability of this phenomenon. Against this background, the present study investigated whether the pharmacological properties of fingolimod (FTY720), an immunosuppressive drug widely applied to treat multiple sclerosis, can be conditioned in rats by means of taste-immune associative learning. For this purpose, a conditioned taste avoidance paradigm was used, pairing the presentation of a novel sweet drinking solution (saccharin or sucrose) as conditioned stimulus (CS) with therapeutically effective doses of FTY720 as unconditioned stimulus (US). Subsequent re-exposure to the CS at a later time point revealed that conditioning with FTY720 induced a mild conditioned taste avoidance only when saccharin was employed as CS. However, on an immunological level, neither re-exposure with saccharin nor sucrose altered blood immune cell subsets or splenic cytokine production. Despite the fact that intraperitonally administered FTY720 could be detected in brain regions known to mediate neuro-immune interactions, the present findings show that the physiological action of FTY720 is not inducible by mere taste-immune associative learning. Whether conditioning generalises across all small-molecule drugs with immunosuppressive properties still needs to be investigated with modified paradigms probably using distinct sensory CS. Moreover, these findings emphasize the need to further investigate the underlying mechanisms of conditioned immunomodulation to assess the generalisability and usability of associative learning protocols as supportive therapies in clinical contexts.

The effect of social anxiety on threat acquisition and extinction: a systematic review and meta-analysis.

Although exposure-based therapy has been found to be effective at alleviating symptoms of social anxiety disorder, it often does not lead to full remission, and relapse after treatment is common. Exposure therapy is based on theoretical principles of extinction of conditioned fear responses. However, there are inconsistencies in findings across experiments that have investigated the effect of social anxiety on threat conditioning and extinction processes. This systematic review and meta-analysis aimed to examine whether elevated levels of social anxiety are associated with abnormalities in threat conditioning and extinction processes. A second aim was to examine the sensitivity of various study designs and characteristics to detect social anxiety-related differences in threat conditioning and extinction. A systematic search was conducted, which identified twenty-three experiments for inclusion in the review. The findings did not demonstrate compelling evidence that high levels of social anxiety are associated with atypical threat conditioning or extinction. Further, when systematically examining the data, there was no convincing support that the use of a particular psychophysiological measure, subjective rating, or experimental parameter yields more consistent associations between social anxiety and conditioning processes during threat acquisition or extinction. Meta-analyses demonstrated that during threat extinction, the use of anxiety ratings as a dependent variable, socially relevant unconditioned stimuli, and a higher reinforcement schedule produced more detectable effects of social anxiety on compromised extinction processes compared to any other dependent variable (subjective or physiological) or experimental parameter. Overall, the results of this study suggest that social anxiety is not reliably related to deficits in conditioning and extinction processes in the context of laboratory-based Pavlovian conditioning paradigms.

Spaced conditioned stimulus presentation facilitates the extinction of strong fear memory in mice.

Inducing fear memory extinction by re-presenting a conditioned stimulus (CS) is the foundation of exposure therapy for post-traumatic stress disorder (PTSD). Investigating differences in the ability of different CS presentation patterns to induce extinction learning is crucial for improving this type of therapy. Using a trace fear conditioning paradigm in mice, we demonstrate that spaced presentation of the CS facilitated the extinction of a strong fear memory to a greater extent than continuous CS presentation. These results lay the groundwork for developing more effective exposure therapy techniques for PTSD.

Functional diversity of dopamine axons in prefrontal cortex during classical conditioning.

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Appetitive conditioning with pornographic stimuli elicits stronger activation in reward regions than monetary and gaming-related stimuli.

Appetitive conditioning plays an important role in the development and maintenance of pornography-use and gaming disorders. It is assumed that primary and secondary reinforcers are involved in these processes. Despite the common use of pornography and gaming in the general population appetitive conditioning processes in this context are still not well studied. This study aims to compare appetitive conditioning processes using primary (pornographic) and secondary (monetary and gaming-related) rewards as unconditioned stimuli (UCS) in the general population. Additionally, it investigates the conditioning processes with gaming-related stimuli as this type of UCS was not used in previous studies. Thirty-one subjects participated in a differential conditioning procedure in which four geometric symbols were paired with either pornographic, monetary, or gaming-related rewards or with nothing to become conditioned stimuli (CS + porn, CS + game, CS + money, and CS-) in an functional magnetic resonance imaging study. We observed elevated arousal and valence ratings as well as skin conductance responses for each CS+ condition compared to the CS-. On the neural level, we found activations during the presentation of the CS + porn in the bilateral nucleus accumbens, right medial orbitofrontal cortex, and the right ventral anterior cingulate cortex compared to the CS-, but no significant activations during CS + money and CS + game compared to the CS-. These results indicate that different processes emerge depending on whether primary and secondary rewards are presented separately or together in the same experimental paradigm. Additionally, monetary and gaming-related stimuli seem to have a lower appetitive value than pornographic rewards.

Effects of sleep deprivation on food-related Pavlovian-instrumental transfer: a randomized crossover experiment.

Recent research suggests that insufficient sleep elevates the risk of obesity. Although the mechanisms underlying the relationship between insufficient sleep and obesity are not fully understood, preliminary evidence suggests that insufficient sleep may intensify habitual control of behavior, leading to greater cue-elicited food-seeking behavior that is insensitive to satiation. The present study tested this hypothesis using a within-individual, randomized, crossover experiment. Ninety-six adults underwent a one-night normal sleep duration (NSD) condition and a one-night total sleep deprivation (TSD) condition. They also completed the Pavlovian-instrumental transfer paradigm in which their instrumental responses for food in the presence and absence of conditioned cues were recorded. The sleep × cue × satiation interaction was significant, indicating that the enhancing effect of conditioned cues on food-seeking responses significantly differed across sleep × satiation conditions. However, this effect was observed in NSD but not TSD, and it disappeared after satiation. This finding contradicted the hypothesis but aligned with previous literature on the effect of sleep disruption on appetitive conditioning in animals-sleep disruption following learning impaired the expression of appetitive behavior. The present finding is the first evidence for the role of sleep in Pavlovian-instrumental transfer effects. Future research is needed to further disentangle how sleep influences motivational mechanisms underlying eating.

Mesoscale simulations predict the role of synergistic cerebellar plasticity during classical eyeblink conditioning.

According to the motor learning theory by Albus and Ito, synaptic depression at the parallel fibre to Purkinje cells synapse (pf-PC) is the main substrate responsible for learning sensorimotor contingencies under climbing fibre control. However, recent experimental evidence challenges this relatively monopolistic view of cerebellar learning. Bidirectional plasticity appears crucial for learning, in which different microzones can undergo opposite changes of synaptic strength (e.g. downbound microzones-more likely depression, upbound microzones-more likely potentiation), and multiple forms of plasticity have been identified, distributed over different cerebellar circuit synapses. Here, we have simulated classical eyeblink conditioning (CEBC) using an advanced spiking cerebellar model embedding downbound and upbound modules that are subject to multiple plasticity rules. Simulations indicate that synaptic plasticity regulates the cascade of precise spiking patterns spreading throughout the cerebellar cortex and cerebellar nuclei. CEBC was supported by plasticity at the pf-PC synapses as well as at the synapses of the molecular layer interneurons (MLIs), but only the combined switch-off of both sites of plasticity compromised learning significantly. By differentially engaging climbing fibre information and related forms of synaptic plasticity, both microzones contributed to generate a well-timed conditioned response, but it was the downbound module that played the major role in this process. The outcomes of our simulations closely align with the behavioural and electrophysiological phenotypes of mutant mice suffering from cell-specific mutations that affect processing of their PC and/or MLI synapses. Our data highlight that a synergy of bidirectional plasticity rules distributed across the cerebellum can facilitate finetuning of adaptive associative behaviours at a high spatiotemporal resolution.

Distinct Hippocampal Oscillation Dynamics in Trace Eyeblink Conditioning Task for Retrieval and Consolidation of Associations.

Trace eyeblink conditioning (TEBC) has been widely used to study associative learning in both animals and humans. In this paradigm, conditioned responses (CRs) to conditioned stimuli (CS) serve as a measure for retrieving learned associations between the CS and the unconditioned stimuli (US) within a trial. Memory consolidation, that is, learning over time, can be quantified as an increase in the proportion of CRs across training sessions. However, how hippocampal oscillations differentiate between successful memory retrieval within a session and consolidation across TEBC training sessions remains unknown. To address this question, we recorded local field potentials (LFPs) from the rat dorsal hippocampus during TEBC and investigated hippocampal oscillation dynamics associated with these two functions. We show that transient broadband responses to the CS were correlated with memory consolidation, as indexed by an increase in CRs across TEBC sessions. In contrast, induced alpha (8-10 Hz) and beta (16-20 Hz) band responses were correlated with the successful retrieval of the CS-US association within a session, as indexed by the difference in trials with and without CR.

Bayesian reinforcement learning: A basic overview.

We and other animals learn because there is some aspect of the world about which we are uncertain. This uncertainty arises from initial ignorance, and from changes in the world that we do not perfectly know; the uncertainty often becomes evident when our predictions about the world are found to be erroneous. The Rescorla-Wagner learning rule, which specifies one way that prediction errors can occasion learning, has been hugely influential as a characterization of Pavlovian conditioning and, through its equivalence to the delta rule in engineering, in a much wider class of learning problems. Here, we review the embedding of the Rescorla-Wagner rule in a Bayesian context that is precise about the link between uncertainty and learning, and thereby discuss extensions to such suggestions as the Kalman filter, structure learning, and beyond, that collectively encompass a wider range of uncertainties and accommodate a wider assortment of phenomena in conditioning.

Central amygdala contributes to stimulus facilitation and pre-stimulus vigilance during cerebellar learning.

Our previous studies found that the central amygdala (CeA) modulates cerebellum-dependent eyeblink conditioning (EBC) using muscimol inactivation. We also found that CeA inactivation decreases cerebellar neuronal activity during the conditional stimulus (CS) from the start of training. Based on these findings, we hypothesized that the CeA facilitates CS input to the cerebellum. The current study tested the CS facilitation hypothesis using optogenetic inhibition with archaerhodopsin (Arch) and excitation with channelrhodopsin (ChR2) of the CeA during EBC in male rats. Optogenetic manipulations were administered during the 400 ms tone CS or during a 400 ms pre-CS period. As predicted by the CS facilitation hypothesis CeA inhibition during the CS impaired EBC and CeA excitation during the CS facilitated EBC. Unexpectedly, CeA inhibition just prior to the CS also impaired EBC, while CeA excitation during the pre-CS pathway did not facilitate EBC. The results suggest that the CeA contributes to CS facilitation and vigilance during the pre-CS period. These putative functions of the CeA may be mediated through separate output pathways from the CeA to the cerebellum.

Role of amygdala astrocytes in different phases of contextual fear memory.

Growing evidence indicates a critical role of astrocytes in learning and memory. However, little is known about the role of basolateral amygdala complex (BLA-C) astrocytes in contextual fear conditioning (CFC), a paradigm relevant to understand and generate treatments for fear- and anxiety-related disorders. To get insights on the involvement of BLA-C astrocytes in fear memory, fluorocitrate (FLC), a reversible astroglial metabolic inhibitor, was applied at critical moments of the memory processing in order to target the acquisition, consolidation, retrieval and reconsolidation process of the fear memory. Adult Wistar male rats were bilaterally cannulated in BLA-C. Ten days later they were infused with different doses of FLC (0.5 or 1 nmol/0.5 µl) or saline before or after CFC and before or after retrieval. FLC impaired fear memory expression when administered before and shortly after CFC, but not one hour later. Infusion of FLC prior and after retrieval did not affect the memory. Our findings suggest that BLA-C astrocytes are critically involved in the acquisition/early consolidation of fear memory but not in the retrieval and reconsolidation. Furthermore, the extinction process was presumably not affected (considering that peri-retrieval administration could also affect this process).

How to solve novel problems: the role of associative learning in problem-solving performance in wild great tits Parus major.

Although problem-solving tasks are frequently used to assess innovative ability, the extent to which problem-solving performance reflects variation in cognitive skills has been rarely formally investigated. Using wild breeding great tits facing a new non-food motivated problem-solving task, we investigated the role of associative learning in finding the solution, compared to multiple other non-cognitive factors. We first examined the role of accuracy (the proportion of contacts made with the opening part of a string-pulling task), neophobia, exploration, activity, age, sex, body condition and participation time on the ability to solve the task. To highlight the effect of associative learning, we then compared accuracy between solvers and non-solvers, before and after the first cue to the solution (i.e., the first time they pulled the string opening the door). We finally compared accuracy over consecutive entrances for solvers. Using 884 observations from 788 great tits tested from 2010 to 2015, we showed that, prior to initial successful entrance, solvers were more accurate and more explorative than non-solvers, and that females were more likely to solve the task than males. The accuracy of solvers, but not of non-solvers, increased significantly after they had the opportunity to associate string pulling with the movement of the door, giving them a first cue to the task solution. The accuracy of solvers also increased over successive entrances. Our results demonstrate that variations in problem-solving performance primarily reflect inherent individual differences in associative learning, and are also to a lesser extent shaped by sex and exploratory behaviour.

A translational and multidisciplinary approach to studying the Garcia effect, a higher form of learning with deep evolutionary roots.

Animals, including humans, learn and remember to avoid a novel food when its ingestion is followed, hours later, by sickness - a phenomenon initially identified during World War II as a potential means of pest control. In the 1960s, John Garcia (for whom the effect is now named) demonstrated that this form of conditioned taste aversion had broader implications, showing that it is a rapid but long-lasting taste-specific food aversion with a fundamental role in the evolution of behaviour. From the mid-1970s onward, the principles of the Garcia effect were translated to humans, showing its role in different clinical conditions (e.g. side-effects linked to chemotherapy). However, in the last two decades, the number of studies on the Garcia effect has undergone a considerable decline. Since its discovery in rodents, this form of learning was thought to be exclusive to mammals; however, we recently provided the first demonstration that a Garcia effect can be formed in an invertebrate model organism, the pond snail Lymnaea stagnalis. Thus, in this Commentary, after reviewing the experiments that led to the first characterization of the Garcia effect in rodents, we describe the recent evidence for the Garcia effect in L. stagnalis, which may pave the way for future studies in other invertebrates and mammals. This article aims to inspire future translational and ecological studies that characterize the conserved mechanisms underlying this form of learning with deep evolutionary roots, which can be used to address a range of different biological questions.

Autoshaped impulsivity: Some explorations with a neural network model.

This study evaluated the effect of delay and magnitude of reinforcement in Pavlovian contingencies, extending the understanding of the phenomenon of autoshaped impulsivity as described in Alcalá's thesis (2017) and Burgos and García-Leal (2015). The effects of adding a trace interval were analyzed on the maintained responses of impulsive choice, seen as the preference of a small and immediate reinforcer over a larger and delayed one, and the role of the contextual unit, as well as the inhibitory units according to the Diffuse Discrepancy Model. In the Simulation, the model with inhibitory units was used, trained in two signals with different delays and reinforcement magnitudes, and subsequently presented concurrently in choice tasks without reinforcement nor learning, using an ABA within-subject design. In general, the DD model successfully simulated the phenomenon of autoshaped impulsivity, consistent with studies from Alcalá's thesis (2017), Burgos and García-Leal (2015), and Picker and Poling (1982). It also predicted the elimination of this effect (autoshaped impulsivity) after introducing a trace interval. The observed results and their implications are discussed, as well as possible future studies with animals and humans.

Cue duration and trial spacing effects in contingency assessment in the streaming procedure with humans.

According to the cycle/trial (C/T) rule, the rate of associative learning is a function of the ratio between the overall rate of U.S. presentation (C) and its rate in the presence of the conditioned stimulus (CS; [T]). This rule is well supported in studies with nonhumans. The present study was conducted to test whether it also applies to human contingency learning. In Experiment 1, participants were exposed to rapid streams of trials. Sensitivity to the cue-outcome contingency varied with both intertrial interval (ITI, which captures C) and cue duration, but the C/T rule was not respected, notably because the effect of ITI was much larger than the effect of cue duration. Experiment 2 showed that mere suppression of verbal strategies did not alter the magnitude of the ITI effect. Experiment 3 replicated Experiment 1 but with cue duration and ITI varied between 1,000 and 3,000 ms instead of between 100 and 1,000 ms. Performance was insensitive to both cue duration and ITI. This was not the consequence of Experiment 3 only varying the cue duration to ITI ratio by a factor of 3; in Experiment 4 where the cue duration was 100 ms, a 300-ms ITI was sufficient to observe an ITI effect. The lack of an ITI effect with a 1,000-ms cue and an ITI varying between 1,000 and 3,000 ms was replicated in Experiment 5. These results are discussed in light of how processes underlying associative learning might break down when events occur very rapidly. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

An analysis of reinstatement after extinction of a conditioned taste aversion.

Taste aversion learning has sometimes been considered a specialized form of learning. In several other conditioning preparations, after a conditioned stimulus (CS) is conditioned and extinguished, reexposure to the unconditioned stimulus (US) by itself can reinstate the extinguished conditioned response. Reinstatement has been widely studied in fear and appetitive Pavlovian conditioning, as well as operant conditioning, but its status in taste aversion learning is more controversial. Six taste-aversion experiments with rats therefore sought to discover conditions that might encourage it there. The results often yielded little to no evidence of reinstatement, and we also found no evidence of concurrent recovery, a related phenomenon in which responding to a CS that has been conditioned and extinguished is restored if a second CS is separately conditioned. However, a key result was that reinstatement occurred when the conditioning procedure involved multiple closely spaced conditioning trials that could have allowed the animal to learn that a US presentation signaled or set the occasion for another trial with a US. Such a mechanism is precluded in many taste aversion experiments because they often use very few conditioning trials. Overall, the results suggest that taste aversion learning is experimentally unique, though not necessarily biologically or evolutionarily unique. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Conditioning and pseudoconditioning differently change intrinsic excitability of inhibitory interneurons in the neocortex.

Many studies indicate a broad role of various classes of GABAergic interneurons in the processes related to learning. However, little is known about how the learning process affects intrinsic excitability of specific classes of interneurons in the neocortex. To determine this, we employed a simple model of conditional learning in mice where vibrissae stimulation was used as a conditioned stimulus and a tail shock as an unconditioned one. In vitro whole-cell patch-clamp recordings showed an increase in intrinsic excitability of low-threshold spiking somatostatin-expressing interneurons (SST-INs) in layer 4 (L4) of the somatosensory (barrel) cortex after the conditioning paradigm. In contrast, pseudoconditioning reduced intrinsic excitability of SST-LTS, parvalbumin-expressing interneurons (PV-INs), and vasoactive intestinal polypeptide-expressing interneurons (VIP-INs) with accommodating pattern in L4 of the barrel cortex. In general, increased intrinsic excitability was accompanied by narrowing of action potentials (APs), whereas decreased intrinsic excitability coincided with AP broadening. Altogether, these results show that both conditioning and pseudoconditioning lead to plastic changes in intrinsic excitability of GABAergic interneurons in a cell-specific manner. In this way, changes in intrinsic excitability can be perceived as a common mechanism of learning-induced plasticity in the GABAergic system.

Changes in responses of the amygdala and hippocampus during fear conditioning are associated with persecutory beliefs.

The persecutory delusion is the most common symptom of psychosis, yet its underlying neurobiological mechanisms are poorly understood. Prior studies have suggested that abnormalities in medial temporal lobe-dependent associative learning may contribute to this symptom. In the current study, this hypothesis was tested in a non-clinical sample of young adults without histories of psychiatric treatment (n = 64), who underwent classical Pavlovian fear conditioning while fMRI data were collected. During the fear conditioning procedure, participants viewed images of faces which were paired (the CS+) or not paired (the CS-) with an aversive stimulus (a mild electrical shock). Fear conditioning-related neural responses were measured in two medial temporal lobe regions, the amygdala and hippocampus, and in other closely connected brain regions of the salience and default networks. The participants without persecutory beliefs (n = 43) showed greater responses to the CS- compared to the CS+ in the right amygdala and hippocampus, while the participants with persecutory beliefs (n = 21) failed to exhibit this response. These between-group differences were not accounted for by symptoms of depression, anxiety or a psychosis risk syndrome. However, the severity of subclinical psychotic symptoms overall was correlated with the level of this aberrant response in the amygdala (p = .013) and hippocampus (p = .033). Thus, these findings provide evidence for a disruption of medial temporal lobe-dependent associative learning in young people with subclinical psychotic symptoms, specifically persecutory thinking.