Rat 50 kHz Trill Calls Are Tied to the Expectation of Social Interaction.

Rats emit a variety of calls in the 40-80 kHz range (50 kHz calls). While these calls are generally associated with positive affect, it is unclear whether certain calls might be used selectively in certain contexts. To examine this, we looked at ultrasonic calls in 30-40 day old male rats during the expectation of either play or food, both of which are reinforcing. Behavior and vocalizations were recorded while rats were in a test chamber awaiting the arrival of a play partner or food over seven days of testing. Control groups were included for the non-specific effects of food deprivation and social isolation. Play reward led to an increase in 50 kHz vocalizations, generally, with specific increases in trill and "trill with jump" calls not seen in other groups. Expectation of food reward did not lead to a significant increase in vocalizations of any type, perhaps due to the young age of our study group. Further, rats that were food deprived for the food expectation study showed markedly lower calls overall and had a different profile of call types compared to rats that were socially isolated. Taken together, the results suggest that trill-associated calls may be used selectively when rats are socially isolated and/or expecting a social encounter.

Reliable induction of sleep spindles with intracranial electrical pulse stimulation.

Neocortical sleep spindles have been shown to occur more frequently following a memory task, suggesting that a method to increase spindle activity could improve memory processing. Stimulation of the neocortex can elicit a slow oscillation (SO) and a spindle, but the feasibility of this method to boost SO and spindles over time has not been tested. In rats with implanted neocortical electrodes, stimulation during slow wave sleep significantly increased SO and spindle rates compared to control rest periods before and after the stimulation session. Coordination between hippocampal sharp-wave ripples and spindles also increased. These effects were reproducible across five consecutive days of testing, demonstrating the viability of this method to increase SO and spindles.

A naturalistic method to test depression: Anticipation of play.

The Wistar-Kyoto (WKY) rat was developed as a control for the spontaneous hypertensive rat but has subsequently also been used as a genetic animal model of depression due to its hyper-responsiveness to stress. We used anticipation of social reward (i.e., a play partner) to assess behavioural and vocal differences between the WKY and normal Wistar (WI) rats in the juvenile period. We found marked differences between groups; the WKY rats, were less active, vocalized less, and used significantly fewer types of 50-kHz calls in comparison to their WI counterparts. The animals were re-tested in adulthood and the same differences existed in overall activity, types of vocalizations and the behavioural vocal profiles used by the two groups of animals. These findings provide a robust baseline for an animal model of depression using a social paradigm. This paradigm may be useful to evaluate the efficacy of pharmaceutical interventions as potential treatments of depression in WKY rats.

Amphetamine reduces reward encoding and stabilizes neural dynamics in rat anterior cingulate cortex.

Psychostimulants such as d-amphetamine (AMPH) often have behavioral effects that appear paradoxical within the framework of optimal choice theory. AMPH typically increases task engagement and the effort animals exert for reward, despite decreasing reward valuation. We investigated neural correlates of this phenomenon in the anterior cingulate cortex (ACC), a brain structure implicated in signaling cost-benefit utility. AMPH decreased signaling of reward, but not effort, in the ACC of freely-moving rats. Ensembles of simultaneously recorded neurons generated task-specific trajectories of neural activity encoding past, present, and future events. Low-dose AMPH contracted these trajectories and reduced their variance, whereas high-dose AMPH expanded both. We propose that under low-dose AMPH, increased network stability balances moderately increased excitability, which promotes accelerated unfolding of a neural 'script' for task execution, despite reduced reward valuation. Noise from excessive excitability at high doses overcomes stability enhancement to drive frequent deviation from the script, impairing task execution.

Memory reactivation in rat medial prefrontal cortex occurs in a subtype of cortical UP state during slow-wave sleep.

Interaction between hippocampal sharp-wave ripples (SWRs) and UP states, possibly by coordinated reactivation of memory traces, is conjectured to play an important role in memory consolidation. Recently, it was reported that SWRs were differentiated into multiple subtypes. However, whether cortical UP states can also be classified into subtypes is not known. Here, we analysed neural ensemble activity from the medial prefrontal cortex from rats trained to run a spatial sequence-memory task. Application of the hidden Markov model (HMM) with three states to epochs of UP-DOWN oscillations identified DOWN states and two subtypes of UP state (UP-1 and UP-2). The two UP subtypes were distinguished by differences in duration, with UP-1 having a longer duration than UP-2, as well as differences in the speed of population vector (PV) decorrelation, with UP-1 decorrelating more slowly than UP-2. Reactivation of recent memory sequences predominantly occurred in UP-2. Short-duration reactivating UP states were dominated by UP-2 whereas long-duration ones exhibit transitions from UP-1 to UP-2. Thus, recent memory reactivation, if it occurred within long-duration UP states, typically was preceded by a period of slow PV evolution not related to recent experience, and which we speculate may be related to previously encoded information. If that is the case, then the transition from UP-1 to UP-2 subtypes may help gradual integration of recent experience with pre-existing cortical memories by interleaving the two in the same UP state. This article is part of the Theo Murphy meeting issue 'Memory reactivation: replaying events past, present and future'.

Unsupervised Detection of Cell-Assembly Sequences by Similarity-Based Clustering.

Neurons which fire in a fixed temporal pattern (i.e., "cell assemblies") are hypothesized to be a fundamental unit of neural information processing. Several methods are available for the detection of cell assemblies without a time structure. However, the systematic detection of cell assemblies with time structure has been challenging, especially in large datasets, due to the lack of efficient methods for handling the time structure. Here, we show a method to detect a variety of cell-assembly activity patterns, recurring in noisy neural population activities at multiple timescales. The key innovation is the use of a computer science method to comparing strings ("edit similarity"), to group spikes into assemblies. We validated the method using artificial data and experimental data, which were previously recorded from the hippocampus of male Long-Evans rats and the prefrontal cortex of male Brown Norway/Fisher hybrid rats. From the hippocampus, we could simultaneously extract place-cell sequences occurring on different timescales during navigation and awake replay. From the prefrontal cortex, we could discover multiple spike sequences of neurons encoding different segments of a goal-directed task. Unlike conventional event-driven statistical approaches, our method detects cell assemblies without creating event-locked averages. Thus, the method offers a novel analytical tool for deciphering the neural code during arbitrary behavioral and mental processes.

Can Slot-Machine Reward Schedules Induce Gambling Addiction in Rats?

Similar to drugs of abuse, random-ratio reward schedules are highly motivating and, in humans, are thought to foster gambling addiction. Animal gambling models, however, have not yet demonstrated the compulsivity so characteristic of drug addiction. Three criteria have been used to evaluate addiction-like behavior in drug models: (1) response inhibition when reward is not available, (2) persistence under a progressive ratio schedule, in which the response-to-reward ratio is stretched, and (3) persistence in spite of punishment. We tested whether prolonged exposure (6 weeks) to a gambling-like reward schedule would induce addiction-like symptoms in rats. In two studies, separate groups were trained to respond to either random- or fixed-ratio schedules for food reward. We found that rats trained on random-ratio schedules showed higher response rates and dramatically shorter pauses after rewards. Tests of addiction-like behavior, however, were largely negative. Response rates were not different during cued no-reward periods nor when reward was coupled with punishment. We also found no group differences when food was devalued nor in reinstatement of reward-seeking after a 1-week delay. The sole exception to this pattern was that rats in the second experiment showed greater persistence on a progressive ratio test. After experiment two, subjects were also orally administered pramipexole, which caused increased perseveration during progressive ratio testing, especially in the random ratio group. While, it is possible that longer training or more appetitive rewards might have led to addiction-like behavior, our results, on the surface, suggest that random-ratio schedules are motivating but not addictive.

Rat anterior cingulate cortex recalls features of remote reward locations after disfavoured reinforcements.

The anterior cingulate cortex (ACC) encodes information supporting mnemonic and cognitive processes. We show here that a rat's position can be decoded with high spatiotemporal resolution from ACC activity. ACC neurons encoded the current state of the animal and task, except for brief excursions that sometimes occurred at target feeders. During excursions, the decoded position became more similar to a remote target feeder than the rat's physical position. Excursions recruited activation of neurons encoding choice and reward, and the likelihood of excursions at a feeder was inversely correlated with feeder preference. These data suggest that the excursion phenomenon was related to evaluating real or fictive choice outcomes, particularly after disfavoured reinforcements. We propose that the multiplexing of position with choice-related information forms a mental model isomorphic with the task space, which can be mentally navigated via excursions to recall multimodal information about the utility of remote locations.

Avoiding escalation from play to aggression in adult male rats: The role of ultrasonic calls.

Play fighting is most commonly associated with juvenile animals, but in some species, including rats, it can continue into adulthood. Post-pubertal engagement in play fighting is often rougher and has an increased chance of escalation to aggression, making the use of play signals to regulate the encounter more critical. During play, both juvenile and adult rats emit many 50-kHz calls and some of these may function as play facilitating signals. In the present study, unfamiliar adult male rats were introduced in a neutral enclosure and their social interactions were recorded. While all pairs escalated their playful encounters to become rougher, only the pairs in which one member was devocalized escalated to serious biting. A Monte Carlo shuffling technique was used for the analysis of the correlations between the overt playful and aggressive actions performed and the types and frequencies of various 50-kHz calls that were emitted. The analysis revealed that lower frequency (20-30kHz) calls with a flat component maybe particularly critical for de-escalating encounters and so allowing play to continue. Moreover, coordinating calls reciprocally, with either the same call mimicked in close, temporal association or with complementary calls emitted by participants as they engage in complementary actions (e.g., attacking the nape, being attacked on the nape), appeared to be ways with which calls could be potentially used to avoid escalation to aggression and so sustain playful interactions.

Specific 50-kHz vocalizations are tightly linked to particular types of behavior in juvenile rats anticipating play.

Rat ultrasonic vocalizations have been suggested to be either a byproduct of physical movement or, in the case of 50-kHz calls, a means to communicate positive affect. Yet there are up to 14 distinct types of 50-kHz calls, raising issues for both explanations. To discriminate between these theories and address the purpose for the numerous 50-kHz call types, we studied single juvenile rats that were waiting to play with a partner, a situation associated with a high number of 50-kHz calls. We used a Monte-Carlo shuffling procedure to identify vocalization-behavior correlations that were statistically different from chance. We found that certain call types ("split", "composite" and "multi-step") were strongly associated with running and jumping while other call types (those involving "trills") were more common during slower movements. Further, non-locomotor states such as resting and rearing were strongly predictive of a lack of vocalizations. We also found that the various sub-types of USVs can be clustered into 3-4 categories based on similarities in the way they are used. We did not find a one-to-one relationship between any movements and specific vocalizations, casting doubt on the motion byproduct theory. On the other hand, the use of specific calls during specific behaviors is problematic for the affect communication hypothesis. Based on our results, we suggest that ultrasonic calls may serve to coordinate moment-to-moment social interactions.

Are 50-khz calls used as play signals in the playful interactions of rats? III. The effects of devocalization on play with unfamiliar partners as juveniles and as adults.

When playing, rats emit 50-kHz calls which may function as play signals. A previous study using devocalized rats provides support for the hypothesis that 50-kHz function to promote and maintain playful interactions (Kisko et al., 2015). However, in that study, all pairs were cage mates and familiar with each other's playful tendencies that could have attenuated the role of play signals. The present study uses unfamiliar pairs to eliminate any chance for such attenuation. Four hypotheses about how 50-kHz calls could act as play signals were tested, that (1) they maintain the playful mood of the partner, (2) they are used to locate partners, (3) they attract play partners and (4) they reduce the risk of playful encounters from escalating to serious fights. Predictions arising from the first three hypotheses, tested in juveniles, were not supported, suggesting that, for juveniles, 50-kHz calls are not facilitating playful interactions as play signals. The fourth hypothesis, however, was supported in adults, but not in juveniles, in that unfamiliar adult males were more likely to escalate playful encounters into serious fights when one partner was devocalized. These findings suggest that vocalizations at most have a minor role in juvenile play but serve a more central role in modulating adult interactions between strangers, allowing for the tactical mitigation of the risk of aggression.

Are 50-kHz calls used as play signals in the playful interactions of rats? II. Evidence from the effects of devocalization.

During playful interactions, juvenile rats emit many 50-kHz ultrasonic vocalizations, which are associated with a positive affective state. In addition, these calls may also serve a communicative role - as play signals that promote playful contact. Consistent with this hypothesis, a previous study found that vocalizations are more frequent prior to playful contact than after contact is terminated. The present study uses devocalized rats to test three predictions arising from the play signals hypothesis. First, if vocalizations are used to facilitate contact, then in pairs of rats in which one is devocalized, the higher frequency of pre-contact calling should only be present when the intact rat is initiating the approach. Second, when both partners in a playing pair are devocalized, the frequency of play should be reduced and the typical pattern of playful wrestling disrupted. Finally, when given a choice to play with a vocal and a non-vocal partner, rats should prefer to play with the one able to vocalize. The second prediction was supported in that the frequency of playful interactions as well as some typical patterns of play was disrupted. Even though the data for the other two predictions did not produce the expected findings, they support the conclusion that, in rats, 50-kHz calls are likely to function to maintain a playful mood and for them to signal to one another during play fighting.

Lesions of dorsal striatum eliminate lose-switch responding but not mixed-response strategies in rats.

We used focal brain lesions in rats to examine how dorsomedial (DMS) and dorsolateral (DLS) regions of the striatum differently contribute to response adaptation driven by the delivery or omission of rewards. Rats performed a binary choice task under two modes: one in which responses were rewarded on half of the trials regardless of choice; and another 'competitive' one in which only unpredictable choices were rewarded. In both modes, control animals were more likely to use a predictable lose-switch strategy than animals with lesions of either DMS or DLS. Animals with lesions of DMS presumably relied more on DLS for behavioural control, and generated repetitive responses in the first mode. These animals then shifted to a random response strategy in the competitive mode, thereby performing better than controls or animals with DLS lesions. Analysis using computational models of reinforcement learning indicated that animals with striatal lesions, particularly of the DLS, had blunted reward sensitivity and less stochasticity in the choice mechanism. These results provide further evidence that the rodent DLS is involved in rapid response adaptation that is more sophisticated than that embodied by the classic notion of habit formation driven by gradual stimulus-response learning.

Not all effort is equal: the role of the anterior cingulate cortex in different forms of effort-reward decisions.

The rat anterior cingulate cortex (ACC) mediates effort-based decision making when the task requires the physical effort of climbing a ramp. Normal rats will readily climb a barrier leading to high reward whereas rats with ACC lesions will opt instead for an easily obtained small reward. The present study explored whether the role of ACC in cost-benefit decisions extends beyond climbing by testing its role in ramp climbing as well as two novel cost-benefit decision tasks, one involving the physical effort of lifting weights and the other the emotional cost of overcoming fear (i.e., "courage"). As expected, rats with extensive ACC lesions tested on a ramp-climbing task were less likely to choose a high-reward/high-effort arm than sham controls. However, during the first few trials, lesioned rats were as likely as controls to initially turn into the high-reward arm (HRA) but far less likely to actually climb the barrier, suggesting that the role of the ACC is not in deciding which course of action to pursue, but rather in maintaining a course of action in the face of countervailing forces. In the effort-reward decision task involving weight lifting, some lesion animals behaved like controls while others avoided the HRA. However, the results were not statistically significant and a follow-up study using incremental increasing effort failed to show any difference between lesion and control groups. The results suggest that the ACC is not needed for effort-reward decisions involving weight lifting but may affect motor abilities. Finally, a courage task explored the willingness of rats to overcome the fear of crossing an open, exposed arm to obtain a high reward. Both sham and ACC-lesioned animals exhibited equal tendencies to enter the open arm. However, whereas sham animals gradually improved on the task, ACC-lesioned rats did not. Taken together, the results suggest that the role of the ACC in effort-reward decisions may be limited to certain tasks.

The role of medial prefrontal cortex in memory and decision making.

Some have claimed that the medial prefrontal cortex (mPFC) mediates decision making. Others suggest mPFC is selectively involved in the retrieval of remote long-term memory. Yet others suggests mPFC supports memory and consolidation on time scales ranging from seconds to days. How can all these roles be reconciled? We propose that the function of the mPFC is to learn associations between context, locations, events, and corresponding adaptive responses, particularly emotional responses. Thus, the ubiquitous involvement of mPFC in both memory and decision making may be due to the fact that almost all such tasks entail the ability to recall the best action or emotional response to specific events in a particular place and time. An interaction between multiple memory systems may explain the changing importance of mPFC to different types of memories over time. In particular, mPFC likely relies on the hippocampus to support rapid learning and memory consolidation.

Stored-trace reactivation in rat prefrontal cortex is correlated with down-to-up state fluctuation density.

Spontaneous reactivation of previously stored patterns of neural activity occurs in hippocampus and neocortex during non-rapid eye movement (NREM) sleep. Notable features of the neocortical local field potential during NREM sleep are high-amplitude, low-frequency thalamocortical oscillations including K-complexes, low-voltage spindles, and high-voltage spindles. Using combined neuronal ensemble and local field potential recordings, we show that prefrontal stored-trace reactivation is correlated with the density of down-to-up state transitions of the population of simultaneously recorded cells, as well as K-complexes and low-voltage spindles in the local field potential. This result strengthens the connection between reactivation and learning, as these same NREM sleep features have been correlated with memory. Although memory trace reactivation is correlated with low-voltage spindles, it is not correlated with high-voltage spindles, indicating that despite their similar frequency characteristics, these two oscillations serve different functions.

Fast-forward playback of recent memory sequences in prefrontal cortex during sleep.

As previously shown in the hippocampus and other brain areas, patterns of firing-rate correlations between neurons in the rat medial prefrontal cortex during a repetitive sequence task were preserved during subsequent sleep, suggesting that waking patterns are reactivated. We found that, during sleep, reactivation of spatiotemporal patterns was coherent across the network and compressed in time by a factor of 6 to 7. Thus, when behavioral constraints are removed, the brain's intrinsic processing speed may be much faster than it is in real time. Given recent evidence implicating the medial prefrontal cortex in retrieval of long-term memories, the observed replay may play a role in the process of memory consolidation.

Apparent encoding of sequential context in rat medial prefrontal cortex is accounted for by behavioral variability.

Simple sequences can be represented via asymmetrically linked neural assemblies, provided that the elements of the sequence are unique. When elements repeat, however (e.g., A-B-C-B-A), the same element belongs to two separate "sequential contexts," and a more complex encoding mechanism is required. To enable correct sequence performance, some neural structure must provide a disambiguating signal that differentiates the two sequential contexts (i.e., B as an element of "A-B" as opposed to "C-B"). The disambiguating signal may derive from a form of working memory, or, in some cases, a simple timing mechanism may suffice. To investigate the possible role of medial prefrontal cortex in complex sequence encoding, rats were trained on a spatial sequence containing two adjacent repeated segments (e.g., A-B-C-D-B-C-E). The double-repeat procedure minimized behavioral differences in the second leg (C) of the repeat subsequence that arise in the first leg (B) because of differences in the entry point (e.g., A-B vs D-B). Far more cells were context sensitive along the first leg than along the second (36 vs 9%), and most of the differences were accounted for by systematic variations in the rat's trajectory, which were much larger along the first leg. There is thus little evidence for sequential context-discriminative activity in the medial prefrontal cortex that cannot plausibly be accounted for by context-dependent behavior. The finding that the rodent medial prefrontal cortex is highly sensitive to sensory-behavioral variables raises doubts about previous experiments that purport to show working memory-related activity in this region.