Rejuvenating silicon probes for acute neurophysiology.

Neurophysiological recording with a new probe often yields better signal quality than with a used probe. Why does the signal quality degrade after only a few experiments? Here, we considered silicon probes in which the contacts are densely packed, and each contact is coated with a conductive polymer that increases its surface area. We tested 12 Cambridge Neurotech silicon probes during 61 recording sessions from the brain of 3 marmosets. Out of the box, each probe arrived with an electrodeposited polymer coating on 64 gold contacts, and an impedance of around 50k Ohms. With repeated use, the impedance increased and there was a corresponding decrease in the number of well-isolated neurons. Imaging of the probes suggested that the reduction in signal quality was due to a gradual loss of the polymer coating. To rejuvenate the probes, we first stripped the contacts, completely removing their polymer coating, and then recoated them in a solution of 10 mM EDOT monomer with 11 mM PSS using a current density of about 3mA/cm2 for 30 seconds. This recoating process not only returned probe impedance to around 50k Ohms, but it also yielded significantly improved signal quality during neurophysiological recordings. Thus, insertion into the brain promoted loss of the polymer that coated the contacts of the silicon probes. This led to degradation of signal quality, but recoating rejuvenated the probes.

The olivary input to the cerebellum dissociates sensory events from movement plans.

Neurons in the inferior olive are thought to anatomically organize the Purkinje cells (P-cells) of the cerebellum into computational modules, but what is computed by each module? Here, we designed a saccade task in marmosets that dissociated sensory events from motor events and then recorded the complex and simple spikes of hundreds of P-cells. We found that when a visual target was presented at a random location, the olive reported the direction of that sensory event to one group of P-cells, but not to a second group. However, just before movement onset, it reported the direction of the planned movement to both groups, even if that movement was not toward the target. At the end of the movement if the subject experienced an error but chose to withhold the corrective movement, only the first group received information about the sensory prediction error. We organized the P-cells based on the information content of their olivary input and found that in the group that received sensory information, the simple spikes were suppressed during fixation, then produced a burst before saccade onset in a direction consistent with assisting the movement. In the second group, the simple spikes were not suppressed during fixation but burst near saccade deceleration in a direction consistent with stopping the movement. Thus, the olive differentiated the P-cells based on whether they would receive sensory or motor information, and this defined their contributions to control of movements as well as holding still.

Slowing of Movements in Healthy Aging as a Rational Economic Response to an Elevated Effort Landscape.

Why do we move slower as we grow older? The reward circuits of the brain, which tend to invigorate movements, decline with aging, raising the possibility that reduced vigor is due to the diminishing value that our brain assigns to movements. However, as we grow older, it also becomes more effortful to make movements. Is age-related slowing principally a consequence of increased effort costs from the muscles, or reduced valuation of reward by the brain? Here, we first quantified the cost of reaching via metabolic energy expenditure in human participants (male and female), and found that older adults consumed more energy than the young at a given speed. Thus, movements are objectively more costly for older adults. Next, we observed that when reward increased, older adults, like the young, responded by initiating their movements earlier. Yet, unlike the young, they were unwilling to increase their movement speed. Was their reluctance to reach quicker for rewards due to the increased effort costs, or because they ascribed less value to the movement? Motivated by a mathematical model, we next made the young experience a component of aging by making their movements more effortful. Now the young responded to reward by reacting faster but chose not to increase their movement speed. This suggests that slower movements in older adults are partly driven by an adaptive response to an elevated effort landscape. Moving slower may be a rational economic response the brain is making to mitigate the elevated effort costs that accompany aging.

Effects of reward and effort history on decision making and movement vigor during foraging.

During foraging, animals explore a site and harvest reward and then abandon that site and travel to the next opportunity. One aspect of this behavior involves decision making, and the other involves movement control. These two aspects of behavior may be linked via an underlying desire to maximize a single normative utility: the sum of all rewards acquired, minus all efforts expended, divided by time. According to this theory, the history of rewards, and not just its immediate availability, should dictate how long one should stay and harvest reward and how vigorously one should travel to the next opportunity. We tested this theory in a series of experiments in which humans used their hand to harvest tokens at a reward patch and then used their arm to reach toward another patch. After a history of high rewards, the subjects not only shortened their harvest duration but also moved more vigorously toward the next reward opportunity. In contrast, after a history of high effort they lengthened their harvest duration but reduced their movement vigor, reaching more slowly to the next reward site. Thus, a history of high reward or low effort biased decisions by promoting early abandonment of the reward site and biased movements by promoting vigor.NEW & NOTEWORTHY Much of life is spent foraging. Whereas previous work has focused on the decision regarding time spent harvesting from a reward patch, here we test the idea that both decision making and movement control are tuned to optimize the net rate of reward in an environment. Our results show that movement patterns reflect not just immediate expectations but also past experiences in the environment, providing fundamental insight into the factors governing volitional control of arm movements.

Effort cost of harvest affects decisions and movement vigor of marmosets during foraging.

Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor.

Complex spikes perturb movements and reveal the sensorimotor map of Purkinje cells.

Computations that are performed by the cerebellar cortex are transmitted via simple spikes of Purkinje cells (P-cells) to downstream structures, but because P-cells are many synapses away from muscles, we do not know the relationship between modulation of simple spikes and control of behavior. Here, we recorded the spiking activities of hundreds of P-cells in the oculomotor vermis of marmosets during saccadic eye movements and found that following the presentation of a visual stimulus, the olivary input to a P-cell coarsely described the direction and amplitude of the visual stimulus as well as the upcoming movement. Occasionally, the complex spike occurred just before saccade onset, suppressing the P-cell's simple spikes and disrupting its output during that saccade. Remarkably, this brief suppression of simple spikes altered the saccade's trajectory by pulling the eyes toward the part of the visual space that was preferentially encoded by the olivary input to that P-cell. Thus, there is an alignment between the sensory space encoded by the complex spikes and the behavior conveyed by the simple spikes: a reduction in simple spikes is a signal to bias the ongoing movement toward the part of the sensory space preferentially encoded by the olivary input to that P-cell.

Effort cost of reaching prompts vigor reduction in older adults.

As people age, they move slower. Is age-related reduction in vigor a reflection of a reduced valuation of reward by the brain, or a consequence of increased effort costs by the muscles? Here, we quantified cost of movements objectively via the metabolic energy that young and old participants consumed during reaching and found that in order reach at a given speed, older adults expended more energy than the young. We next quantified how reward modulated movements in the same populations and found that like the young, older adults responded to increased reward by initiating their movements earlier. Yet, their movements were less sensitive to increased reward, resulting in little or no modulation of reach speed. Lastly, we quantified the effect of increased effort on how reward modulated movements in young adults. Like the effects of aging, when faced with increased effort the young adults responded to reward primarily by reacting faster, with little change in movement speed. Therefore, reaching required greater energetic expenditure in the elderly, suggesting that the slower movements and reactions exhibited in aging are partly driven by an adaptive response to an elevation in the energetic landscape of effort. That is, moving slower appears to be a rational economic consequence of aging. Significance statement: Healthy aging coincides with a reduction in speed, or vigor, of walking, reaching, and eye movements. Here we focused on disentangling two opposing sources of aging-related movement slowing: reduced reward sensitivity due to loss of dopaminergic tone, or increased energy expenditure movements related to mitochondrial or muscular inefficiencies. Through a series of three experiments and construction of a computational model, here we demonstrate that transient changes in reaction time and movement speed together offer a quantifiable metric to differentiate between reward- and effort-based alterations in movement vigor. Further, we suggest that objective increases in the metabolic cost of moving, not reductions in reward valuation, are driving much of the movement slowing occurring alongside healthy aging.

Impact of unilateral and bilateral impairments on bimanual force production following stroke.

Large bilateral asymmetry and task deficits are typically observed during bimanual actions of stroke survivors. Do these abnormalities originate from unilateral impairments affecting their more-impaired limb, such as weakness and abnormal synergy, or from bilateral impairments such as incoordination of two limbs? To answer this question, 23 subjects including 10 chronic stroke survivors and 13 neurologically intact subjects participated in an experiment where they produced bimanual forces at different hand locations. The force magnitude and directional deviation of the more-impaired arm were measured for unilateral impairments and bimanual coordination across locations for bilateral impairments. Force asymmetry and task error were used to define task performance. Significant unilateral impairments were observed in subjects with stroke; the maximal force capacity of their more-impaired arm was significantly lower than that of their less-impaired arm, with a higher degree of force deviation. However, its force contribution during submaximal tasks was greater than its relative force capacity. Significant bilateral impairments were also observed, as stroke survivors modulated two forces to a larger degree across hand locations but in a less coordinated manner than control subjects did. But only unilateral, not bilateral, impairments explained a significant amount of between-subject variability in force asymmetry across subjects with stroke. Task error, in contrast, was correlated with neither unilateral nor bilateral impairments. Our results suggest that unilateral impairments of the more-impaired arm of stroke survivors mainly contribute to its reduced recruitment, but that the degree of its participation in bimanual task may be greater than their capacity as they attempt to achieve symmetry.NEW & NOTEWORTHY We studied how unilateral and bilateral impairments in stroke survivors affect their bimanual task performance. Unilateral impairments of the more-impaired limb, both weakness and loss of directional control, mainly contribute to bimanual asymmetry, but stroke survivors generally produce higher force with their more-impaired limb than their relative capacity. Bilateral force coordination was significantly impaired in stroke survivors, but its degree of impairment was not related to their unilateral impairments.

Complex spikes perturb movements, revealing the sensorimotor map of Purkinje cells.

The cerebellar cortex performs computations that are critical for control of our actions, and then transmits that information via simple spikes of Purkinje cells (P-cells) to downstream structures. However, because P-cells are many synapses away from muscles, we do not know how their output affects behavior. Furthermore, we do not know the level of abstraction, i.e., the coordinate system of the P-cell's output. Here, we recorded spiking activities of hundreds of P-cells in the oculomotor vermis of marmosets during saccadic eye movements and found that following the presentation of a visual stimulus, the olivary input to a P-cell encoded a probabilistic signal that coarsely described both the direction and the amplitude of that stimulus. When this input was present, the resulting complex spike briefly suppressed the P-cell's simple spikes, disrupting the P-cell's output during that saccade. Remarkably, this brief suppression altered the saccade's trajectory by pulling the eyes toward the part of the visual space that was preferentially encoded by the olivary input to that P-cell. Thus, analysis of behavior in the milliseconds following a complex spike unmasked how the P-cell's output influenced behavior: the preferred location in the coordinates of the visual system as conveyed probabilistically from the inferior olive to a P-cell defined the action in the coordinates of the motor system for which that P-cell's simple spikes directed behavior.

Choice of Arm Use in Stroke Survivors is Largely Driven by the Energetic Cost of the Movement.

BACKGROUND: The decision of which arm to use to achieve a goal depends on energetic costs and performance abilities of each arm. Following a stroke, there is a reduction in the use of the more-impaired arm. Is it because the energetic costs of the more-impaired arm are increased, or because its use dictates a lower chance of success? OBJECTIVE: We sought to elucidate the impact of energetic cost and task success on the arm choice of stroke survivors. METHODS: Thirteen chronic stroke survivors and thirteen neurologically-intact subjects participated in an experiment where they reached towards visual targets in a virtual-reality environment. Energetic cost of reaching with their less-used arm (nondominant/more-impaired) was adjusted by amplifying the range of motion, while task accuracy requirement was independently modulated by changing target size. RESULTS: Reducing the energic cost of reaching increased the use of the less-used arms in both groups, but by a greater amount in the stroke survivors. In contrast, lowering task accuracy requirement altered arm choice similarly in the two groups. The time spent in decision-making (reaction time) reflected different impacts of energetic cost and task success on the arm choice of the two groups. Conversely, velocity changes were similar between the groups. CONCLUSIONS: The impact of energetic cost on arm choice of stroke survivors is greater than neurologically-intact subjects. Thus, the reduction in the use of the impaired arm following stroke may be primarily due to a subjective increase in the effort it takes to use that arm.

Effort cost of harvest affects decisions and movement vigor of marmosets during foraging.

Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor. Significance statement: Our results suggest that as the brainstem neuromodulatory circuits that control pupil size respond to effort costs, they alter computations in the brain regions that control decisions, encouraging work and delaying gratification, and the brain regions that control movements, reducing vigor and suppressing energy expenditure. This coordinated response suggests that decisions and actions are part of a single control policy that aims to maximize a variable relevant to fitness: the capture rate.

A software tool for at-home measurement of sensorimotor adaptation.

Sensorimotor adaptation is traditionally studied in well-controlled laboratory settings with specialized equipment. However, recent public health concerns such as the COVID-19 pandemic, as well as a desire to recruit a more diverse study population, have led the motor control community to consider at-home study designs. At-home motor control experiments are still rare because of the requirement to write software that can be easily used by anyone on any platform. To this end, we developed software that runs locally on a personal computer. The software provides audiovisual instructions and measures the ability of the subject to control the cursor in the context of visuomotor perturbations. We tested the software on a group of at-home participants and asked whether the adaptation principles inferred from in-lab measurements were reproducible in the at-home setting. For example, we manipulated the perturbations to test whether there were changes in adaptation rates (savings and interference), whether adaptation was associated with multiple timescales of memory (spontaneous recovery), and whether we could selectively suppress subconscious learning (delayed feedback, perturbation variability) or explicit strategies (limited reaction time). We found remarkable similarity between in-lab and at-home behaviors across these experimental conditions. Thus, we developed a software tool that can be used by research teams with little or no programming experience to study mechanisms of adaptation in an at-home setting.

Defending against cerebellar disease.

A hedge fund billionaire's children are suffering from cerebellar disease. He invited a group of neuroscientists to plan a search for therapies. What resulted is the outline of an implantable neural emulator that might electronically replace the damaged part of the brain.

Saccade vigor reflects the rise of decision variables during deliberation.

During deliberation, as we quietly consider our options, the neural activities representing the decision variables that reflect the goodness of each option rise in various regions of the cerebral cortex.1,2,3,4,5,6,7 If the options are depicted visually, we make saccades, focusing gaze on each option. Do the kinematics of these saccades reflect the state of the decision variables? To test this idea, we engaged human participants in a decision-making task in which they considered two effortful options that required walking across various distances and inclines. As they deliberated, they made saccades between the symbolic representations of their options. These deliberation period saccades had no bearing on the effort they would later expend, yet saccade velocities increased gradually and differentially: the rate of rise was faster for saccades toward the option that they later indicated as their choice. Indeed, the rate of rise encoded the difference in the subjective value of the two options. Importantly, the participants did not reveal their choice at the conclusion of deliberation, but rather waited during a delay period, and finally expressed their choice by making another saccade. Remarkably, vigor for this saccade dropped to baseline and no longer encoded subjective value. Thus, saccade vigor appeared to provide a real-time window to the otherwise hidden process of option evaluation during deliberation.

Synchronous spiking of cerebellar Purkinje cells during control of movements.

SignificanceThe information that one region of the brain transmits to another is usually viewed through the lens of firing rates. However, if the output neurons could vary the timing of their spikes, then, through synchronization, they would spotlight information that may be critical for control of behavior. Here we report that, in the cerebellum, Purkinje cell populations that share a preference for error convey, to the nucleus, when to decelerate the movement, by reducing their firing rates and temporally synchronizing the remaining spikes.

Competition between parallel sensorimotor learning systems.

Sensorimotor learning is supported by at least two parallel systems: a strategic process that benefits from explicit knowledge and an implicit process that adapts subconsciously. How do these systems interact? Does one system's contributions suppress the other, or do they operate independently? Here, we illustrate that during reaching, implicit and explicit systems both learn from visual target errors. This shared error leads to competition such that an increase in the explicit system's response siphons away resources that are needed for implicit adaptation, thus reducing its learning. As a result, steady-state implicit learning can vary across experimental conditions, due to changes in strategy. Furthermore, strategies can mask changes in implicit learning properties, such as its error sensitivity. These ideas, however, become more complex in conditions where subjects adapt using multiple visual landmarks, a situation which introduces learning from sensory prediction errors in addition to target errors. These two types of implicit errors can oppose each other, leading to another type of competition. Thus, during sensorimotor adaptation, implicit and explicit learning systems compete for a common resource: error.

Movement control, decision-making, and the building of Roman roads to link them.

In science, as in life, one can only hope to both inform others, and be informed by them. The commentaries associated with our book Vigor have highlighted the many ways in which the theory that we proposed can be improved. For example, there are a myriad of factors that need to be considered in a fully encompassing objective function. The neural mechanisms underlying the links between movement and decision-making have yet to be unraveled. The implications of a two-way interaction between movement and decisions at both the individual and social levels remain to be understood. The commentaries outline future questions, and encouragingly highlight the diversity of science communities that may be linked via the concept of vigor.

The cost of correcting for error during sensorimotor adaptation.

Learning from error is often a slow process. In machine learning, the learning rate depends on a loss function that specifies a cost for error. Here, we hypothesized that during motor learning, error carries an implicit cost for the brain because the act of correcting for error consumes time and energy. Thus, if this implicit cost could be increased, it may robustly alter how the brain learns from error. To vary the implicit cost of error, we designed a task that combined saccade adaptation with motion discrimination: movement errors resulted in corrective saccades, but those corrections took time away from acquiring information in the discrimination task. We then modulated error cost using coherence of the discrimination task and found that when error cost was large, pupil diameter increased and the brain learned more from error. However, when error cost was small, the pupil constricted and the brain learned less from the same error. Thus, during sensorimotor adaptation, the act of correcting for error carries an implicit cost for the brain. Modulating this cost affects how much the brain learns from error.

P-sort: an open-source software for cerebellar neurophysiology.

Analysis of electrophysiological data from Purkinje cells (P-cells) of the cerebellum presents unique challenges to spike sorting. Complex spikes have waveforms that vary significantly from one event to the next, raising the problem of misidentification. Even when complex spikes are detected correctly, the simple spikes may belong to a different P-cell, raising the danger of misattribution. To address these identification and attribution problems, we wrote an open-source, semiautomated software called P-sort, and then tested it by analyzing data from P-cells recorded in three species: marmosets, macaques, and mice. Like other sorting software, P-sort relies on nonlinear dimensionality reduction to cluster spikes. However, it also uses the statistical relationship between simple and complex spikes to merge disparate clusters and split a single cluster. In comparison with expert manual curation, occasionally P-sort identified significantly more complex spikes, as well as prevented misattribution of clusters. Three existing automatic sorters performed less well, particularly for identification of complex spikes. To improve the development of analysis tools for the cerebellum, we provide labeled data for 313 recording sessions, as well as statistical characteristics of waveforms and firing patterns of P-cells in three species.NEW & NOTEWORTHY Algorithms that perform spike sorting depend on waveforms to cluster spikes. However, a cerebellar Purkinje-cell produces two types of spikes; simple and complex spikes. A complex spike coincides with the suppression of generating simple spikes. Here, we recorded neurophysiological data from three species and developed a spike analysis software named P-sort that relies on this statistical property to improve both the detection and the attribution of simple and complex spikes in the cerebellum.

Adaptive control of movement deceleration during saccades.

As you read this text, your eyes make saccades that guide your fovea from one word to the next. Accuracy of these movements require the brain to monitor and learn from visual errors. A current model suggests that learning is supported by two different adaptive processes, one fast (high error sensitivity, low retention), and the other slow (low error sensitivity, high retention). Here, we searched for signatures of these hypothesized processes and found that following experience of a visual error, there was an adaptive change in the motor commands of the subsequent saccade. Surprisingly, this adaptation was not uniformly expressed throughout the movement. Rather, after experience of a single error, the adaptive response in the subsequent trial was limited to the deceleration period. After repeated exposure to the same error, the acceleration period commands also adapted, and exhibited resistance to forgetting during set-breaks. In contrast, the deceleration period commands adapted more rapidly, but suffered from poor retention during these same breaks. State-space models suggested that acceleration and deceleration periods were supported by a shared adaptive state which re-aimed the saccade, as well as two separate processes which resembled a two-state model: one that learned slowly and contributed primarily via acceleration period commands, and another that learned rapidly but contributed primarily via deceleration period commands.