Effects of working memory load and CS-US intervals on delay eyeblink conditioning.

Eyeblink conditioning is used in many species to study motor learning and make inferences about cerebellar function. However, the discrepancies in performance between humans and other species combined with evidence that volition and awareness can modulate learning suggest that eyeblink conditioning is not merely a passive form of learning that relies on only the cerebellum. Here we explored two ways to reduce the influence of volition and awareness on eyeblink conditioning: (1) using a short interstimulus interval, and (2) having participants do working memory tasks during the conditioning. Our results show that participants trained with short interstimulus intervals (150 ms and 250 ms) produce very few conditioned responses after 100 trials. Participants trained with a longer interstimulus interval (500 ms) who simultaneously did working memory tasks produced fewer conditioned responses than participants who watched a movie during the training. Our results suggest that having participants perform working memory tasks during eyeblink conditioning can be a viable strategy for studying cerebellar learning that is absent of influences from awareness and volition. This could enhance the comparability of the results obtained in human studies with those in animal models.

Quantitative properties of the creation and activation of a cell-intrinsic duration-encoding engram.

The engram encoding the interval between the conditional stimulus (CS) and the unconditional stimulus (US) in eyeblink conditioning resides within a small population of cerebellar Purkinje cells. CSs activate this engram to produce a pause in the spontaneous firing rate of the cell, which times the CS-conditional blink. We developed a Bayesian algorithm that finds pause onsets and offsets in the records from individual CS-alone trials. We find that the pause consists of a single unusually long interspike interval. Its onset and offset latencies and their trial-to-trial variability are proportional to the CS-US interval. The coefficient of variation (CoV = σ/µ) are comparable to the CoVs for the conditional eye blink. The average trial-to-trial correlation between the onset latencies and the offset latencies is close to 0, implying that the onsets and offsets are mediated by two stochastically independent readings of the engram. The onset of the pause is step-like; there is no decline in firing rate between the onset of the CS and the onset of the pause. A single presynaptic spike volley suffices to trigger the reading of the engram; and the pause parameters are unaffected by subsequent volleys. The Fano factors for trial-to-trial variations in the distribution of interspike intervals within the intertrial intervals indicate pronounced non-stationarity in the endogenous spontaneous spiking rate, on which the CS-triggered firing pause supervenes. These properties of the spontaneous firing and of the engram read out may prove useful in finding the cell-intrinsic, molecular-level structure that encodes the CS-US interval.

Absence of Parallel Fibre to Purkinje Cell LTD During Eyeblink Conditioning.

Long-term depression (LTD) of parallel fibre/Purkinje cell synapses has been the favoured explanation for cerebellar motor learning such as classical eyeblink conditioning. Previous evidence against this interpretation has been contested. Here we wanted to test whether a classical conditioning protocol causes LTD. We applied a conditioning protocol, using a train of electrical pulses to the parallel fibres as the conditional stimulus. In order to rule out indirect effects caused by antidromic granule cell activation or output from Purkinje cells that might produce changes in Purkinje cell responsiveness, we focused the analysis on the first pulse in the conditional stimulus, that is, before any indirect effects would have time to occur. Purkinje cells learned to respond with a firing pause to the conditional stimulus. Yet, there was no depression of parallel fibre excitation after training.

Learning and Timing of Voluntary Blink Responses Match Eyeblink Conditioning.

Can humans produce well-timed blink responses to a neutral stimulus voluntarily, without receiving any blink-eliciting, unconditional, stimulus? And if they can, to what degree does classical eyeblink conditioning depend on volition? Here we show that voluntary blink responses learned in two paradigms that did not involve any unconditional blink-eliciting stimuli, display timing that is as good, or better than, the timing of blink responses learned in a standard eyeblink conditioning paradigm. The exceptional timing accuracy likely stems from the fact that, in contrast to previous studies, we challenged our participants to blink in a timed manner, and not merely to blink so as to avoid the corneal air puff. These results reveal a remarkable level of voluntary control over a simple movement, and they challenge the view that learning during eyeblink conditioning is necessarily automatic and involuntary.

Learned response sequences in cerebellar Purkinje cells.

Associative learning in the cerebellum has previously focused on single movements. In eyeblink conditioning, for instance, a subject learns to blink at the right time in response to a conditional stimulus (CS), such as a tone that is repeatedly followed by an unconditional corneal stimulus (US). During conditioning, the CS and US are transmitted by mossy/parallel fibers and climbing fibers to cerebellar Purkinje cells that acquire a precisely timed pause response that drives the overt blink response. The timing of this conditional Purkinje cell response is determined by the CS-US interval and is independent of temporal patterns in the input signal. In addition to single movements, the cerebellum is also believed to be important for learning complex motor programs that require multiple precisely timed muscle contractions, such as, for example, playing the piano. In the present work, we studied Purkinje cells in decerebrate ferrets that were conditioned using electrical stimulation of mossy fiber and climbing fiber afferents as CS and US, while alternating between short and long interstimulus intervals. We found that Purkinje cells can learn double pause responses, separated by an intermediate excitation, where each pause corresponds to one interstimulus interval. The results show that individual cells can not only learn to time a single response but that they also learn an accurately timed sequential response pattern.

Are Purkinje Cell Pauses Drivers of Classically Conditioned Blink Responses?

Several lines of evidence show that classical or Pavlovian conditioning of blink responses depends on the cerebellum. Recordings from cerebellar Purkinje cells that control the eyelid and the conditioned blink show that during training with a conditioning protocol, a Purkinje cell develops a pause response to the conditional stimulus. This conditioned cellular response has many of the properties that characterise the overt blink. The present paper argues that the learned Purkinje cell pause response is the memory trace and main driver of the overt conditioned blink and that it explains many well-known behavioural phenomena.

Purkinje cell activity during classical conditioning with different conditional stimuli explains central tenet of Rescorla­Wagner model [corrected].

A central tenet of Rescorla and Wagner's model of associative learning is that the reinforcement value of a paired trial diminishes as the associative strength between the presented stimuli increases. Despite its fundamental importance to behavioral sciences, the neural mechanisms underlying the model have not been fully explored. Here, we present findings that, taken together, can explain why a stronger association leads to a reduced reinforcement value, within the context of eyeblink conditioning. Specifically, we show that learned pause responses in Purkinje cells, which trigger adaptively timed conditioned eyeblinks, suppress the unconditional stimulus (US) signal in a graded manner. Furthermore, by examining how Purkinje cells respond to two distinct conditional stimuli and to a compound stimulus, we provide evidence that could potentially help explain the somewhat counterintuitive overexpectation phenomenon, which was derived from the Rescorla-Wagner model.

Memory trace and timing mechanism localized to cerebellar Purkinje cells.

The standard view of the mechanisms underlying learning is that they involve strengthening or weakening synaptic connections. Learned response timing is thought to combine such plasticity with temporally patterned inputs to the neuron. We show here that a cerebellar Purkinje cell in a ferret can learn to respond to a specific input with a temporal pattern of activity consisting of temporally specific increases and decreases in firing over hundreds of milliseconds without a temporally patterned input. Training Purkinje cells with direct stimulation of immediate afferents, the parallel fibers, and pharmacological blocking of interneurons shows that the timing mechanism is intrinsic to the cell itself. Purkinje cells can learn to respond not only with increased or decreased firing but also with an adaptively timed activity pattern.

Changes in complex spike activity during classical conditioning.

The cerebellar cortex is necessary for adaptively timed conditioned responses (CRs) in eyeblink conditioning. During conditioning, Purkinje cells acquire pause responses or "Purkinje cell CRs" to the conditioned stimuli (CS), resulting in disinhibition of the cerebellar nuclei (CN), allowing them to activate motor nuclei that control eyeblinks. This disinhibition also causes inhibition of the inferior olive (IO), via the nucleo-olivary pathway (N-O). Activation of the IO, which relays the unconditional stimulus (US) to the cortex, elicits characteristic complex spikes in Purkinje cells. Although Purkinje cell activity, as well as stimulation of the CN, is known to influence IO activity, much remains to be learned about the way that learned changes in simple spike firing affects the IO. In the present study, we analyzed changes in simple and complex spike firing, in extracellular Purkinje cell records, from the C3 zone, in decerebrate ferrets undergoing training in a conditioning paradigm. In agreement with the N-O feedback hypothesis, acquisition resulted in a gradual decrease in complex spike activity during the conditioned stimulus, with a delay that is consistent with the long N-O latency. Also supporting the feedback hypothesis, training with a short interstimulus interval (ISI), which does not lead to acquisition of a Purkinje cell CR, did not cause a suppression of complex spike activity. In contrast, observations that extinction did not lead to a recovery in complex spike activity and the irregular patterns of simple and complex spike activity after the conditioned stimulus are less conclusive.

Bidirectional plasticity of Purkinje cells matches temporal features of learning.

Many forms of learning require temporally ordered stimuli. In Pavlovian eyeblink conditioning, a conditioned stimulus (CS) must precede the unconditioned stimulus (US) by at least about 100 ms for learning to occur. Conditioned responses are learned and generated by the cerebellum. Recordings from the cerebellar cortex during conditioning have revealed CS-triggered pauses in the firing of Purkinje cells that likely drive the conditioned blinks. The predominant view of the learning mechanism in conditioning is that long-term depression (LTD) at parallel fiber (PF)-Purkinje cell synapses underlies the Purkinje cell pauses. This raises a serious conceptual challenge because LTD is most effectively induced at short CS-US intervals, which do not support acquisition of eyeblinks. To resolve this discrepancy, we recorded Purkinje cells during conditioning with short or long CS-US intervals. Decerebrated ferrets trained with CS-US intervals ≥150 ms reliably developed Purkinje cell pauses, but training with an interval of 50 ms unexpectedly induced increases in CS-evoked spiking. This bidirectional modulation of Purkinje cell activity offers a basis for the requirement of a minimum CS-US interval for conditioning, but we argue that it cannot be fully explained by LTD, even when previous in vitro studies of stimulus-timing-dependent LTD are taken into account.

Number of spikes in climbing fibers determines the direction of cerebellar learning.

Cerebellar learning requires context information from mossy fibers and a teaching signal through the climbing fibers from the inferior olive. Although the inferior olive fires in bursts, virtually all studies have used a teaching signal consisting of a single pulse. Following a number of failed attempts to induce cerebellar learning in decerebrate ferrets with a nonburst signal, we tested the effect of varying the number of pulses in the climbing fiber teaching signal. The results show that training with a single pulse in a conditioning paradigm in vivo does not result in learning, but rather causes extinction of a previously learned response.

Parallel fiber and climbing fiber responses in rat cerebellar cortical neurons in vivo.

Over the last few years we have seen a rapidly increasing interest in the functions of the inhibitory interneurons of the cerebellar cortex. However, we still have very limited knowledge about their physiological properties in vivo. The present study provides the first description of their spontaneous firing properties and their responses to synaptic inputs under non-anesthetized conditions in the decerebrated rat in vivo. We describe the spike responses of molecular layer interneurons (MLI) in the hemispheric crus1/crus2 region and compare them with those of Purkinje cells (PCs) and Golgi cells (GCs), both with respect to spontaneous activity and responses evoked by direct electrical stimulation of parallel fibers (PFs) and climbing fibers (CFs). In agreement with previous findings in the cat, we found that the CF responses in the interneurons consisted of relatively long lasting excitatory modulations of the spike firing. In contrast, activation of PFs induced rapid but short-lasting excitatory spike responses in all types of neurons. We also explored PF input plasticity in the short-term (10 min) using combinations of PF and CF stimulation. With regard to in vivo recordings from cerebellar cortical neurons in the rat, the data presented here provide the first demonstration that PF input to PC can be potentiated using PF burst stimulation and they suggest that PF burst stimulation combined with CF input may lead to potentiation of PF inputs in MLIs. We conclude that the basic responsive properties of the cerebellar cortical neurons in the rat in vivo are similar to those observed in the cat and also that it is likely that similar mechanisms of PF input plasticity apply.

Classical conditioning of motor responses: what is the learning mechanism?

According to a widely held assumption, the main mechanism underlying motor learning in the cerebellum, such as eyeblink conditioning, is long-term depression (LTD) of parallel fibre to Purkinje cell synapses. Here we review some recent physiological evidence from Purkinje cell recordings during conditioning with implications for models of conditioning. We argue that these data pose four major challenges to the LTD hypothesis of conditioning. (i) LTD cannot account for the pause in Purkinje cell firing that is believed to drive the conditioned blink. (ii) The temporal conditions conducive to LTD do not match those for eyeblink conditioning. (iii) LTD cannot readily account for the adaptive timing of the conditioned response. (iv) The data suggest that parallel fibre to Purkinje cell synapses are not depressed after learning a Purkinje cell CR. Models based on metabotropic glutamate receptors are also discussed and found to be incompatible with the recording data.

Time course of classically conditioned Purkinje cell response is determined by initial part of conditioned stimulus.

Classical conditioning of a motor response such as eyeblink is associated with the development of a pause in cerebellar Purkinje cell firing that is an important driver of the overt response. This conditioned Purkinje cell response is adaptively timed and has a specific temporal profile that probably explains the time course of the overt behavior. It is generally assumed that the temporal properties of the conditioned Purkinje cell response are determined by the temporal pattern of the parallel fiber impulses generated by the conditioned stimulus at the time of the conditioned response. We show here in the decerebrate ferret preparation that a very brief conditioned stimulus, consisting of only one or two impulses in the mossy fibers, can be sufficient to elicit a full conditioned Purkinje cell response with normal time course. The finding suggests that parallel fiber input to the Purkinje cell influences the firing rate several hundred milliseconds later. It poses a serious challenge to the standard view of the role of parallel fiber impulses in response timing.

Learning stimulus intervals--adaptive timing of conditioned purkinje cell responses.

Classical conditioning of motor responses, such as the eyeblink response, is an experimental model of associative learning and of adaptive timing of movements. A conditioned blink will have its maximum amplitude near the expected onset of the unconditioned blink-eliciting stimulus and it adapts to changes in the interval between the conditioned and unconditioned stimuli. Previous studies have shown that an eyeblink conditioning protocol can make cerebellar Purkinje cells learn to pause in response to the conditioned stimulus. According to the cerebellar cortical conditioning model, this conditioned Purkinje cell response drives the overt blink. If so, the model predicts that the temporal properties of the Purkinje cell response reflect the overt behaviour. To test this prediction, in vivo recordings of Purkinje cell activity were performed in decerebrate ferrets during conditioning, using direct stimulation of cerebellar mossy and climbing fibre afferents as conditioned and unconditioned stimuli. The results show that Purkinje cells not only develop a change in responsiveness to the conditioned stimulus. They also learn a particular temporal response profile where the timing, not only of onset and maximum but also of offset, is determined by the temporal interval between the conditioned and unconditioned stimuli.

Effect of conditioned stimulus parameters on timing of conditioned Purkinje cell responses.

Pavlovian eyeblink conditioning is a useful experimental model for studying adaptive timing, an important aspect of skilled movements. The conditioned response (CR) is precisely timed to occur just before the onset of the expected unconditioned stimulus (US). The timing can be changed immediately, however, by varying parameters of the conditioned stimulus (CS). It has previously been shown that increasing the intensity of a peripheral CS or the frequency of a CS consisting of a train of stimuli to the mossy fibers shortens the latency of the CR. The adaptive timing of behavioral CRs probably reflects the timing of an underlying learned inhibitory response in cerebellar Purkinje cells. It is not known how the latency of this Purkinje cell CR is controlled. We have recorded form Purkinje cells in conditioned decerebrate ferrets while increasing the intensity of a peripheral CS or the frequency of a mossy fiber CS. We observe changes in the timing of the Purkinje cell CR that match the behavioral effects. The results are consistent with the effect of CS parameters on behavioral CR latency being caused by corresponding changes in Purkinje cell CRs. They suggest that synaptic temporal summation may be one of several mechanisms underlying adaptive timing of movements.

Simple and complex spike firing patterns in Purkinje cells during classical conditioning.

Classical blink conditioning is known to depend critically on the cerebellum and the relevant circuitry is gradually being unravelled. Several lines of evidence support the theory that the conditioned stimulus is transmitted by mossy fibers to the cerebellar cortex whereas the unconditioned stimulus is transmitted by climbing fibers. This view has been dramatically confirmed by recent Purkinje cell recordings during training with a classical conditioning paradigm. We have tracked the activity of single Purkinje cells with microelectrodes for several hours in decerebrate ferrets during learning, extinction, and relearning. Paired peripheral forelimb and periocular stimulation, as well as paired direct stimulation of cerebellar afferent pathways (mossy and climbing fibers) causes acquisition of a pause response in Purkinje cell simple spike firing. This conditioned Purkinje cell response has temporal properties that match those of the behavioral response. Its latency varies with the interstimulus interval and it responds to manipulations of the conditioned stimulus in the same way that the blink does. Complex spike firing largely mirrors the simple spike behavior. We have previously suggested that cerebellar learning is subject to a negative feedback control via the inhibitory nucleo-olivary pathway. As the Purkinje cell learns to respond to the conditioned stimulus with a suppression of simple spikes, disinhibition of anterior interpositus neurons would be expected to cause inhibition of the inferior olive. Observations of complex spike firing in the Purkinje cells during conditioning and extinction confirm this prediction. Before training, complex spikes are unaffected or facilitated by the conditioned stimulus, but as the simple spike pause response develops, spontaneous and stimulus-evoked complex spikes are also strongly suppressed by the conditioned stimulus. After extinction of the simple spike pause response, the complex spikes reappear.

Extinction of conditioned blink responses by cerebello-olivary pathway stimulation.

Learning of classically conditioned eyeblink responses depends on mechanisms within the cerebellum. It has been suggested that climbing fibres from the inferior olive transmit the unconditioned stimulus signal to the cerebellum. We have previously shown that the pathway from the deep cerebellar nuclei to the inferior olive inhibits olivary activity. It is known that repeated presentation of the conditioned stimulus on its own leads to extinction of the conditioned response. If the unconditioned stimulus signal is transmitted to the cerebellum via the inferior olive - climbing fibre system then stimulation of the nucleo-olivary pathway just before the unconditioned stimulus in a trained animal should lead to extinction. The results from this investigation confirm this.

Acquisition, extinction, and reacquisition of a cerebellar cortical memory trace.

Associative learning in the cerebellum underlies motor memories and probably also cognitive associations. Pavlovian eyeblink conditioning, a widely used experimental model of such learning, depends on the cerebellum, but the memory locus within the cerebellum as well as the underlying mechanisms have remained controversial. To date, crucial information on how cerebellar Purkinje cells change their activity during learning has been ambiguous and contradictory, and there is no information at all about how they behave during extinction and reacquisition. We have now tracked the activity of single Purkinje cells with microelectrodes for up to 16 h in decerebrate ferrets during learning, extinction, and relearning. We demonstrate that paired peripheral forelimb and periocular stimulation, as well as paired direct stimulation of cerebellar afferent pathways (mossy and climbing fibers) consistently causes a gradual acquisition of an inhibitory response in Purkinje cell simple spike firing. This conditioned cell response has several properties that matches known features of the behavioral conditioned response. The response latency varies with the interstimulus interval, and the response maximum is adaptively timed to precede the unconditioned stimulus. Across training trials, it matches behavioral extinction to unpaired stimulation and also the substantial savings that occur when paired stimulation is reinstated. These data suggest that many of the basic behavioral phenomena in eyeblink conditioning can be explained at the level of the single Purkinje cell.