Risk-Based Decision Making: A Systematic Scoping Review of Animal Models and a Pilot Study on the Effects of Sleep Deprivation in Rats.

Animals, including humans, frequently make decisions involving risk or uncertainty. Different strategies in these decisions can be advantageous depending the circumstances. Short sleep duration seems to be associated with more risky decisions in humans. Animal models for risk-based decision making can increase mechanistic understanding, but very little data is available concerning the effects of sleep. We combined primary- and meta-research to explore the relationship between sleep and risk-based decision making in animals. Our first objective was to create an overview of the available animal models for risky decision making. We performed a systematic scoping review. Our searches in Pubmed and Psychinfo retrieved 712 references, of which 235 were included. Animal models for risk-based decision making have been described for rodents, non-human primates, birds, pigs and honey-bees. We discuss task designs and model validity. Our second objective was to apply this knowledge and perform a pilot study on the effect of sleep deprivation. We trained and tested male Wistar rats on a probability discounting task; a "safe" lever always resulted in 1 reward, a "risky" lever resulted in 4 or no rewards. Rats adapted their preferences to variations in reward probabilities (p < 0.001), but 12 h of sleep deprivation during the light phase did not clearly alter risk preference (p = 0.21).

Sleep and Microdialysis: An Experiment and a Systematic Review of Histamine and Several Amino Acids.

Sleep seems essential to proper functioning of the prefrontal cortex (PFC). The role of different neurotransmitters has been studied, mainly the catecholamines and serotonin. Less attention has been paid to the amino acid transmitters and histamine. Here, we focus on the activity of these molecules in the PFC during sleep and sleep deprivation (SD). We determined extracellular concentrations of histamine and 8 amino acids in the medial PFC before, during and after SD. Additionally, we systematically reviewed the literature on studies reporting microdialysis measurements relating to sleep throughout the brain. In our experiment, median concentrations of glutamate were higher during SD than during baseline (p = 0.013) and higher during the dark-active than during the resting phase (p = 0.003). Glutamine was higher during post-SD recovery than during baseline (p = 0.010). For other compounds, no differences were observed between light and dark circadian phase, and between sleep deprivation, recovery and baseline. We retrieved 13 papers reporting on one or more of the molecules of interest during naturally occurring sleep, 2 during sleep deprivation and 2 during both. Only two studies targeted PFC. Histamine was low during sleep, but high during sleep deprivation and wakefulness, irrespective of brain area. Glu (k = 11) and GABA (k = 8) concentrations in different brain areas were reported to peak during sleep or wakefulness or to lack state-dependency. Aspartate, glycine, asparagine and taurine were less often studied (1-2 times), but peaked exclusively during sleep. Sleep deprivation increased glutamate and GABA exclusively in the cortex. Further studies are needed for drawing solid conclusions.

Brain Microdialysate Monoamines in Relation to Circadian Rhythms, Sleep, and Sleep Deprivation - a Systematic Review, Network Meta-analysis, and New Primary Data.

Disruption of the monoaminergic system, e.g. by sleep deprivation (SD), seems to promote certain diseases. Assessment of monoamine levels over the circadian cycle, during different sleep stages and during SD is instrumental to understand the molecular dynamics during and after SD. To provide a complete overview of all available evidence, we performed a systematic review. A comprehensive search was performed for microdialysis and certain monoamines (dopamine, serotonin, noradrenaline, adrenaline), certain monoamine metabolites (3,4-dihydroxyphenylacetic acid (DOPAC), 5-hydroxyindoleacetic acid (5-HIAA)) and a precursor (5-hydroxytryptophan (5-HTP)) in PubMed and EMBASE. After screening of the search results by two independent reviewers, 94 publications were included. All results were tabulated and described qualitatively. Network-meta analyses (NMAs) were performed to compare noradrenaline and serotonin concentrations between sleep stages. We further present experimental monoamine data from the medial prefrontal cortical (mPFC). Monoamine levels varied with brain region and circadian cycle. During sleep, monoamine levels generally decreased compared to wake. These qualitative observations were supported by the NMAs: noradrenaline and serotonin levels decreased from wakefulness to slow wave sleep and decreased further during Rapid Eye Movement sleep. In contrast, monoamine levels generally increased during SD, and sometimes remained high even during subsequent recovery. Decreases during or after SD were only reported for serotonin. In our experiment, SD did not affect any of the mPFC monoamine levels. Concluding, monoamine levels vary over the light-dark cycle and between sleep stages. SD modifies the patterns, with effects sometimes lasting beyond the SD period.

Intracerebral Adenosine During Sleep Deprivation: A Meta-Analysis and New Experimental Data.

The neuroregulator adenosine is involved in sleep-wake control. Basal forebrain (BF) adenosine levels increase during sleep deprivation. Only a few studies have addressed the effect of sleep deprivation on extracellular adenosine concentrations in other brain regions. In this paper, we describe a microdialysis experiment as well as a meta-analysis of published data. The 64 h microdialysis experiment determined the extracellular adenosine and adenosine monophosphate (AMP) concentrations in the medial prefrontal cortex of rats before, during and after 12 h of sleep deprivation by forced locomotion. The meta-analysis comprised published sleep deprivation animal experiments measuring adenosine by means of microdialysis. In the animal experiment, the overall median adenosine concentration was 0.36 nM and ranged from 0.004 nM to 27 nM. No significant differences were observed between the five conditions: 12 h of wash-out, baseline light phase, baseline dark phase, 12 h of sleep deprivation and 12 h of subsequent recovery. The overall median AMP concentration was 0.10 nM and ranged from 0.001 nM to 7.56 nM. Median AMP concentration increased during sleep deprivation (T = 47; p = 0.047) but normalised during subsequent recovery. The meta-analysis indicates that BF dialysate adenosine concentrations increase with 74.7% (95% CI: 54.1-95.3%) over baseline during sleep deprivation. Cortex dialysate adenosine concentrations during sleep deprivation were so far only reported by 2 publications. The increase in adenosine during sleep deprivation might be specific to the BF. At this stage, the evidence for adenosine levels in other brain regions is based on single experiments and insufficient for generalised conclusions. Further experiments are currently still warranted.

Instrumental learning: an animal model for sleep dependent memory enhancement.

The relationship between learning and sleep is multifaceted; learning influences subsequent sleep characteristics, which may in turn influence subsequent memory. Studies in humans indicate that sleep may not only prevent degradation of acquired memories, but even enhance performance without further practice. In a rodent instrumental learning task, individual differences occur in how fast rats learn to associate lever pressing with food reward. Rats habitually sleep between learning sessions, and may differ in this respect. The current study assessed if the instrumental leaning paradigm could serve as a model to study sleep-dependent memory enhancement. Male Wistar rats performed 2 sessions of instrumental learning per day for 1-3 days. Electroencephalography was recorded both before and after the sessions. Sleep deprivation (3 h) was applied between the first and second session in a subgroup of rats. Measurements comprised the number of lever presses in each session, slow wave sleep (SWS) duration, Rapid Eye Movement Sleep (REMS) duration and sleep spindles. Baseline sleep parameters were similar for fast and slow learning rats. Task-exposure increased REMS-duration. The increase in REMS-duration was observed specifically after sessions in which learning occurred, but not after a later session. Sleep deprivation during the 3h period between the initial two sessions interfered with performance enhancement, but did not prevent this in all rats. Our considered movement control protocol induced partial sleep deprivation and also interfered with performance enhancement. The classic instrumental learning task provides a practical model for animal studies on sleep-dependent memory enhancement.

Switch-task performance in rats is disturbed by 12 h of sleep deprivation but not by 12 h of sleep fragmentation.

STUDY OBJECTIVES: Task-switching is an executive function involving the prefrontal cortex. Switching temporarily attenuates the speed and/or accuracy of performance, phenomena referred to as switch costs. In accordance with the idea that prefrontal function is particularly sensitive to sleep loss, switch-costs increase during prolonged waking in humans. It has been difficult to investigate the underlying neurobiological mechanisms because of the lack of a suitable animal model. Here, we introduce the first switch-task for rats and report the effects of sleep deprivation and inactivation of the medial prefrontal cortex. DESIGN: Rats were trained to repeatedly switch between 2 stimulus-response associations, indicated by the presentation of a visual or an auditory stimulus. These stimulus-response associations were offered in blocks, and performance was compared for the first and fifth trials of each block. Performance was tested after exposure to 12 h of total sleep deprivation, sleep fragmentation, and their respective movement control conditions. Finally, it was tested after pharmacological inactivation of the medial prefrontal cortex. SETTINGS: Controlled laboratory settings. PARTICIPANTS: 15 male Wistar rats. MEASUREMENTS & RESULTS: Both accuracy and latency showed switch-costs at baseline. Twelve hours of total sleep deprivation, but not sleep fragmentation, impaired accuracy selectively on the switch-trials. Inactivation of the medial prefrontal cortex by local neuronal inactivation resulted in an overall decrease in accuracy. CONCLUSIONS: We developed and validated a switch-task that is sensitive to sleep deprivation. This introduces the possibility for in-depth investigations on the neurobiological mechanisms underlying executive impairments after sleep disturbance in a rat model.

Spatial reversal learning is robust to total sleep deprivation.

Sleep deprivation affects cognitive functions that depend on the prefrontal cortex (PFC) such as cognitive flexibility, and the consolidation of newly learned information. The identification of cognitive processes that are either robustly sensitive or robustly insensitive to the same experimental sleep deprivation procedure, will allow us to better focus on the specific effects of sleep on cognition, and increase understanding of the mechanisms involved. In the present study we investigate whether sleep deprivation differentially affects the two separate cognitive processes of acquisition and consolidation of a spatial reversal task. After training on a spatial discrimination between two levers in a Skinner box, male Wistar rats were exposed to a reversal of the previously learned stimulus-response contingency. We first evaluated the effect of sleep deprivation on the acquisition of reversal learning. Performance on reversal learning after 12h of sleep deprivation (n=12) was compared to performance after control conditions (n=12). The second experiment evaluated the effect of sleep deprivation on the consolidation of reversal learning; the first session of reversal learning was followed by 3h of nap prevention (n=8) or undisturbed control conditions (n=8). The experiments had sufficient statistical power (0.90 and 0.81, respectively) to detect differences with medium effect sizes. Neither the acquisition, nor the consolidation, of reversal learning was affected by acute sleep deprivation. Together with previous findings, these results help to further delineate the role of sleep in cognitive processing.

A new automated method for rat sleep deprivation with minimal confounding effects on corticosterone and locomotor activity.

The function of sleep in physiology, behaviour and cognition has become a primary focus of neuroscience. Its study inevitably includes experimental sleep deprivation designs. However, concerns exist regarding confounds like stress, increased locomotor activity levels, and decreased motivation to perform operant tasks induced by the methods employed. We here propose a novel procedure for sleep deprivation in rats and evaluate how it affects sleep, corticosterone concentration profiles, locomotor activity levels, and motivation to perform an operant task. Before, during and after 12h of total sleep deprivation by means of gradually increasing the rotation variability and the speed of a novel automated, two-compartment sleep deprivation device, sleep-wake states were assessed by electroencephalography (n=21), brain extracellular corticosterone concentrations using microdialysis (n=11), locomotor activity by infrared measurements (n=8), and operant performance using a fixed-interval-fixed-ratio task (n=16). Sleep was effectively prevented during the procedure; rats on average slept less than 1% of the time (0.8±0.2%, mean±standard error). Brain corticosterone concentrations were mildly increased during the procedure, but did not exceed normal peak concentrations. Locomotor activity was not only increased during the procedure, but also did not exceed the peak levels found during undisturbed wakefulness. Food restriction to 12 g/rat/day prevented sleep deprivation from reducing the motivation to perform an operant task. This novel procedure can be applied to sleep deprive rats in a highly effective way, while keeping corticosterone and locomotor activity within the normal range.

Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat.

The orbitofrontal cortex (OFC) has been implicated in decision-making under uncertainty, but it is unknown how information about the probability or uncertainty of future reward is coded by single orbitofrontal neurons and ensembles. We recorded neuronal ensembles in rat OFC during an olfactory discrimination task in which different odor stimuli predicted different reward probabilities. Single-unit firing patterns correlated to the expected reward probability primarily within an immobile waiting period before reward delivery but also when the rat executed movements toward the reward site. During these pre-reward periods, a subset of OFC neurons was sensitive to differences in probability but only very rarely discriminated on the basis of reward uncertainty. In the reward period, neurons responded during presentation or omission of reward or during both types of outcome. At the population level, neurons were characterized by a wide divergence in firing-rate variability attributable to expected probability. A population analysis using template matching as reconstruction method indicated that OFC generates a distributed representation of reward probability with a weak dependence on neuronal group size. The analysis furthermore confirmed that predictive information coded by OFC populations was quantitatively related to reward probability, but not to uncertainty.

Preferential reactivation of motivationally relevant information in the ventral striatum.

Spontaneous "off-line" reactivation of neuronal activity patterns may contribute to the consolidation of memory traces. The ventral striatum exhibits reactivation and has been implicated in the processing of motivational information. It is unknown, however, whether reactivating neuronal ensembles specifically recapitulate information relating to rewards that were encountered during wakefulness. We demonstrate a prolonged reactivation in rat ventral striatum during quiet wakefulness and slow-wave but not rapid eye movement sleep. Reactivation of reward-related information processed in this structure was particularly prominent, and this was primarily attributable to spike trains temporally linked to reward sites. It was accounted for by small, strongly correlated subgroups in recorded cell assemblies and can thus be characterized as a sparse phenomenon. Our results indicate that reactivated memory traces may not only comprise feature- and context-specific information but also contain a value component.

Medial prefrontal serotonin in the rat is involved in goal-directed behaviour when affect guides decision making.

RATIONALE: Across species, serotonin (5-HT) depletion in the prefrontal cortex (PFC) has been shown to cause impaired performance on tests of cognitive flexibility and the processing of affective information (e.g. information with an 'emotional' content). While recent work has explored the specific role of the orbital PFC herein, the role of the medial PFC remains unclear. OBJECTIVES: The aim of our current experiments was to study the role of medial PFC 5-HT in both the processing of affective information and reversal learning across stimulus modalities. MATERIALS AND METHODS: To this end, we selectively destroyed 5-HT terminals in the medial PFC of male Wistar rats by means of local infusion of the toxin 5,7-dihydroxytryptamine. Both control and lesioned animals were tested in two reversal learning paradigms with either spatial or odour cues and an affective switch from non-preferred to preferred food rewards. RESULTS: Our results indicate that a pellet switch during reversal learning impaired performance in control animals but not in lesioned animals, independent of the stimulus modality. CONCLUSION: These results indicate that lesioned animals are not guided in their behaviour by the affective value of the reward like intact animals and thus that medial prefrontal 5-HT is needed for affective processing in goal-directed behaviour.

Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task.

The orbitofrontal cortex (OBFc) has been suggested to code the motivational value of environmental stimuli and to use this information for the flexible guidance of goal-directed behavior. To examine whether information regarding reward prediction is quantitatively represented in the rat OBFc, neural activity was recorded during an olfactory discrimination "go"/"no-go" task in which five different odor stimuli were predictive for various amounts of reward or an aversive reinforcer. Neural correlates related to both actual and expected reward magnitude were observed. Responses related to reward expectation occurred during the execution of the behavioral response toward the reward site and within a waiting period prior to reinforcement delivery. About one-half of these neurons demonstrated differential firing toward the different reward sizes. These data provide new and strong evidence that reward expectancy, regardless of reward magnitude, is coded by neurons of the rat OBFc, and are indicative for representation of quantitative information concerning expected reward. Moreover, neural correlates of reward expectancy appear to be distributed across both motor and nonmotor phases of the task.

A split microdrive for simultaneous multi-electrode recordings from two brain areas in awake small animals.

Complex cognitive operations such as memory formation and decision-making are thought to be mediated not by single, isolated brain structures but by multiple, connected brain areas. To facilitate studies on the neural communication between connected brain structures, we developed a multi-electrode microdrive for chronically recording ensembles of neurons in two different brain areas simultaneously. The "split drive" contains 14 independently movable microdrivers that were designed to hold tetrodes and to permit day-to-day adjustment of dorsoventral position in the brain. The limited weight of the drive allowed rats to adjust well to the headstage after recovering from surgery and permitted stable recording sessions across at least several weeks. In addition to describing the design and assembly of the split drive, we also discuss some important individual parts of microdrives used for tetrode recordings in general. Furthermore, the split drive was applied to two widely separated and connected brain structures, the hippocampus and ventral striatum. From these two areas, stable ensemble recordings were conducted in rats performing a reward-searching task on a triangular track, yielding group sizes of about 15 and 25 units in the dorsal hippocampus and ventral striatum, respectively.

Dopamine and noradrenaline efflux in the medial prefrontal cortex during serial reversals and extinction of instrumental goal-directed behavior.

The prefrontal cortex (PFC) of the rat supports cognitive flexibility, the ability to spontaneously adapt goal-directed behavior in response to radically changing situational demands. We have shown previously that transient inactivation of the rat medial PFC (mPFC) impairs initial reversal learning in a spatial 2-lever discrimination task. Given the importance of dopamine (DA) for PFC function, we studied DA (and noradrenaline [NA]) efflux in the mPFC during reversal learning. We observed a higher and more extended increase in DA efflux in rats performing the first reversal compared with controls performing the previously acquired discrimination. The results of an additional experiment suggest that such a difference between the reversal- and control-induced DA increases was absent during a third reversal. During the extinction session, DA efflux did not increase from basal levels. Increases in NA efflux were less than in DA and did not differ between control and any condition. We conclude that prefrontal DA activity is increased during execution of instrumental discrimination tasks and that this increase is amplified during the acquisition of a first, but not of later reversals. These data corroborate our previous findings and indicate that DA is critically involved in this form of cognitive flexibility.

The NMDA-receptor antagonist MK-801 selectively disrupts reversal learning in rats.

We tested the hypothesis that inhibition of NMDA-receptors in rats would lead to a selective impairment of reversal learning in a serial reversal task in the Skinner box. Low doses of MK-801 (0.025 and 0.05 mg/kg) did not affect acquisition of the two-lever discrimination, but impaired performance during the first reversal more than during the third reversal. Similar effects were observed during the series of extinction sessions. The high dose (0.1 mg/kg) completely inhibited reversal and extinction learning, as the rats perseverated in pressing the previously rewarded lever(s). We conclude that NMDA receptor blockade leads to a selective impairment in cognitive flexibility, and shows some similarity to transient inactivation of the medial prefrontal cortex in this respect.