Computational mechanism underlying switching of motor actions.

Surviving in a constantly changing environment requires not only the ability to select actions, but also the flexibility to stop and switch actions when necessary. Extensive research has been devoted to understanding how the brain switches actions, yet the computations underlying switching and how it relates to selecting and stopping processes remain elusive. A central question is whether switching is an extension of the stopping process or involves different mechanisms. To address this question, we modeled action regulation tasks with a neurocomputational theory and evaluated its predictions on individuals performing reaches in a dynamic environment. Our findings suggest that, unlike stopping, switching does not necessitate a proactive pause mechanism to delay movement onset. However, switching engages a pause mechanism after movement onset, if the new target location is unknown prior to switch signal. These findings offer a new understanding of the action-switching computations, opening new avenues for future neurophysiological investigations.

Task-based functional neuroimaging in infants: a systematic review.

Background: Infancy is characterized by rapid neurological transformations leading to consolidation of lifelong function capabilities. Studying the infant brain is crucial for understanding how these mechanisms develop during this sensitive period. We review the neuroimaging modalities used with infants in stimulus-induced activity paradigms specifically, for the unique opportunity the latter provide for assessment of brain function. Methods: Conducted a systematic review of literature published between 1977-2021, via a comprehensive search of four major databases. Standardized appraisal tools and inclusion/exclusion criteria were set according to the PRISMA guidelines. Results: Two-hundred and thirteen papers met the criteria of the review process. The results show clear evidence of overall cumulative growth in the number of infant functional neuroimaging studies, with electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) to be the most utilized and fastest growing modalities with behaving infants. However, there is a high level of exclusion rates associated with technical limitations, leading to limited motor control studies (about 6%) in this population. Conclusion: Although the use of functional neuroimaging modalities with infants increases, there are impediments to effective adoption of existing technologies with this population. Developing new imaging modalities and experimental designs to monitor brain activity in awake and behaving infants is vital.

A neurocomputational theory of action regulation predicts motor behavior in neurotypical individuals and patients with Parkinson's disease.

Surviving in an uncertain environment requires not only the ability to select the best action, but also the flexibility to withhold inappropriate actions when the environmental conditions change. Although selecting and withholding actions have been extensively studied in both human and animals, there is still lack of consensus on the mechanism underlying these action regulation functions, and more importantly, how they inter-relate. A critical gap impeding progress is the lack of a computational theory that will integrate the mechanisms of action regulation into a unified framework. The current study aims to advance our understanding by developing a neurodynamical computational theory that models the mechanism of action regulation that involves suppressing responses, and predicts how disruption of this mechanism can lead to motor deficits in Parkinson's disease (PD) patients. We tested the model predictions in neurotypical individuals and PD patients in three behavioral tasks that involve free action selection between two opposed directions, action selection in the presence of conflicting information and abandoning an ongoing action when a stop signal is presented. Our results and theory suggest an integrated mechanism of action regulation that affects both action initiation and inhibition. When this mechanism is disrupted, motor behavior is affected, leading to longer reaction times and higher error rates in action inhibition.

Action planning and control under uncertainty emerge through a desirability-driven competition between parallel encoding motor plans.

Living in an uncertain world, nearly all of our decisions are made with some degree of uncertainty about the consequences of actions selected. Although a significant progress has been made in understanding how the sensorimotor system incorporates uncertainty into the decision-making process, the preponderance of studies focus on tasks in which selection and action are two separate processes. First people select among alternative options and then initiate an action to implement the choice. However, we often make decisions during ongoing actions in which the value and availability of the alternatives can change with time and previous actions. The current study aims to decipher how the brain deals with uncertainty in decisions that evolve while acting. To address this question, we trained individuals to perform rapid reaching movements towards two potential targets, where the true target location was revealed only after the movement initiation. We found that reaction time and initial approach direction are correlated, where initial movements towards intermediate locations have longer reaction times than movements that aim directly to the target locations. Interestingly, the association between reaction time and approach direction was independent of the target probability. By modeling the task within a recently proposed neurodynamical framework, we showed that action planning and control under uncertainty emerge through a desirability-driven competition between motor plans that are encoded in parallel.

Single-trial decoding of movement intentions using functional ultrasound neuroimaging.

New technologies are key to understanding the dynamic activity of neural circuits and systems in the brain. Here, we show that a minimally invasive approach based on ultrasound can be used to detect the neural correlates of movement planning, including directions and effectors. While non-human primates (NHPs) performed memory-guided movements, we used functional ultrasound (fUS) neuroimaging to record changes in cerebral blood volume with 100 µm resolution. We recorded from outside the dura above the posterior parietal cortex, a brain area important for spatial perception, multisensory integration, and movement planning. We then used fUS signals from the delay period before movement to decode the animals' intended direction and effector. Single-trial decoding is a prerequisite to brain-machine interfaces, a key application that could benefit from this technology. These results are a critical step in the development of neuro-recording and brain interface tools that are less invasive, high resolution, and scalable.

Intrinsic Variable Learning for Brain-Machine Interface Control by Human Anterior Intraparietal Cortex.

Although animal studies provided significant insights in understanding the neural basis of learning and adaptation, they often cannot dissociate between different learning mechanisms due to the lack of verbal communication. To overcome this limitation, we examined the mechanisms of learning and its limits in a human intracortical brain-machine interface (BMI) paradigm. A tetraplegic participant controlled a 2D computer cursor by modulating single-neuron activity in the anterior intraparietal area (AIP). By perturbing the neuron-to-movement mapping, the participant learned to modulate the activity of the recorded neurons to solve the perturbations by adopting a target re-aiming strategy. However, when no cognitive strategies were adequate to produce correct responses, AIP failed to adapt to perturbations. These findings suggest that learning is constrained by the pre-existing neuronal structure, although it is possible that AIP needs more training time to learn to generate novel activity patterns when cognitive re-adaptation fails to solve the perturbations.

Lateral intraparietal area (LIP) is largely effector-specific in free-choice decisions.

Despite many years of intense research, there is no strong consensus about the role of the lateral intraparietal area (LIP) in decision making. One view of LIP function is that it guides spatial attention, providing a "saliency map" of the external world. If this were the case, it would contribute to target selection regardless of which action would be performed to implement the choice. On the other hand, LIP inactivation has been shown to influence spatial selection and oculomotor metrics in free-choice decisions, which are made using eye movements, arguing that it contributes to saccade decisions. To dissociate between a more general attention role and a more effector specific saccade role, we reversibly inactivated LIP while non-human primates freely selected between two targets, presented in the two hemifields, with either saccades or reaches. Unilateral LIP inactivation induced a strong choice bias to ipsilesional targets when decisions were made with saccades. Interestingly, the inactivation also caused a reduction of contralesional choices when decisions were made with reaches, albeit the effect was less pronounced. These findings suggest that LIP is part of a network for making oculomotor decisions and is largely effector-specific in free-choice decisions.

Extinction as a deficit of the decision-making circuitry in the posterior parietal cortex.

Extinction is a common neurologic deficit that often occurs as one of a constellation of symptoms seen with lesions of the posterior parietal cortex (PPC). Although extinction has typically been considered a deficit in the allocation of attention, new findings, particularly from nonhuman primate studies, point to one potential and important source of extinction as damage to decision-making circuits for actions within the PPC. This new understanding provides clues to potential therapies for extinction. Also the finding that the PPC is important for action decisions and action planning has led to new neuroprosthetic applications using PPC recordings as control signals to assist paralyzed patients.

Dynamic Integration of Value Information into a Common Probability Currency as a Theory for Flexible Decision Making.

Decisions involve two fundamental problems, selecting goals and generating actions to pursue those goals. While simple decisions involve choosing a goal and pursuing it, humans evolved to survive in hostile dynamic environments where goal availability and value can change with time and previous actions, entangling goal decisions with action selection. Recent studies suggest the brain generates concurrent action-plans for competing goals, using online information to bias the competition until a single goal is pursued. This creates a challenging problem of integrating information across diverse types, including both the dynamic value of the goal and the costs of action. We model the computations underlying dynamic decision-making with disparate value types, using the probability of getting the highest pay-off with the least effort as a common currency that supports goal competition. This framework predicts many aspects of decision behavior that have eluded a common explanation.

Neural mechanisms underlying the exploration of small city maps using magnetoencephalography.

The neural mechanisms underlying spatial cognition in the context of exploring realistic city maps are unknown. We conducted a novel brain imaging study to address the question of whether and how features of special importance for map exploration are encoded in the brain to make a spatial decision. Subjects explored by eyes small city maps exemplifying five different street network types in order to locate a hypothetical City Hall, while neural activity was recorded continuously by 248 magnetoencephalography (MEG) sensors at high temporal resolution. Monitoring subjects' eye positions, we locally characterized the maps by computing three spatial parameters of the areas that were explored. We computed the number of street intersections, the total street length, and the regularity index in the circular areas of 6 degrees of visual angle radius centered on instantaneous eye positions. We tested the hypothesis that neural activity during exploration is associated with the spatial parameters and modulated by street network type. All time series were rendered stationary and nonautocorrelated by applying an autoregressive integrated moving average model and taking the residuals. We then assessed the associations between the prewhitened time-varying MEG time series from 248 sensors and the prewhitened spatial parameters time series, for each street network type, using multiple linear regression analyses. In accord with our hypothesis, ongoing neural activity was strongly associated with the spatial parameters through localized and distributed networks, and neural processing of these parameters depended on the type of street network. Overall, processing of the spatial parameters seems to predominantly involve right frontal and prefrontal areas, but not for all street network layouts. These results are in line with findings from a series of previous studies showing that frontal and prefrontal areas are involved in the processing of spatial information and decision making. Modulation of neural processing of the spatial parameters by street network type suggests that some street network layouts may contain other types of spatial information that subjects use to explore maps and make spatial decisions.

Inactivation of Parietal Reach Region Affects Reaching But Not Saccade Choices in Internally Guided Decisions.

The posterior parietal cortex (PPC) has traditionally been considered important for awareness, spatial perception, and attention. However, recent findings provide evidence that the PPC also encodes information important for making decisions. These findings have initiated a running argument of whether the PPC is critically involved in decision making. To examine this issue, we reversibly inactivated the parietal reach region (PRR), the area of the PPC that is specialized for reaching movements, while two monkeys performed a memory-guided reaching or saccade task. The task included choices between two equally rewarded targets presented simultaneously in opposite visual fields. Free-choice trials were interleaved with instructed trials, in which a single cue presented in the peripheral visual field defined the reach and saccade target unequivocally. We found that PRR inactivation led to a strong reduction of contralesional choices, but only for reaches. On the other hand, saccade choices were not affected by PRR inactivation. Importantly, reaching and saccade movements to single instructed targets remained largely intact. These results cannot be explained as an effector-nonspecific deficit in spatial attention or awareness, since the temporary "lesion" had an impact only on reach choices. Hence, the PPR is a part of a network for reach decisions and not just reach planning. SIGNIFICANCE STATEMENT: There has been an ongoing debate on whether the posterior parietal cortex (PPC) represents only spatial awareness, perception, and attention or whether it is also involved in decision making for actions. In this study we explore whether the parietal reach region (PRR), the region of the PPC that is specialized for reaches, is involved in the decision process. We inactivated the PRR while two monkeys performed reach and saccade choices between two targets presented simultaneously in both hemifields. We found that inactivation affected only the reach choices, while leaving saccade choices intact. These results cannot be explained as a deficit in attention, since the temporary lesion affected only the reach choices. Thus, PRR is a part of a network for making reach decisions.

Cognitive mechanisms underlying instructed choice exploration of small city maps.

We investigated the cognitive mechanisms underlying the exploration and decision-making in realistic and novel environments. Twelve human subjects were shown small circular U.S. city maps with two locations highlighted on the circumference, as possible choices for a post office ("targets"). At the beginning of a trial, subjects fixated a spot at the center of the map and ultimately chose one of the two locations. A space syntax analysis of the map paths (from the center to each target) revealed that the chosen location was associated with the less convoluted path, as if subjects navigated mentally the paths in an "ant's way," i.e., by staying within street boundaries, and ultimately choosing the target that could be reached from the center in the shortest way, and the fewest turns and intersections. The subjects' strategy for map exploration and decision making was investigated by monitoring eye position during the task. This revealed a restricted exploration of the map delimited by the location of the two alternative options and the center of the map. Specifically, subjects explored the areas around the two target options by repeatedly looking at them before deciding which one to choose, presumably implementing an evaluation and decision-making process. The ultimate selection of a specific target was significantly associated with the time spent exploring the area around that target. Finally, an analysis of the sequence of eye fixations revealed that subjects tended to look systematically toward the target ultimately chosen even from the beginning of the trial. This finding indicates an early cognitive selection bias for the ensuing decision process.

The effect of apolipoprotein E4 on synchronous neural interactions in brain cultures.

In a previous study, we assessed the synchronous neural interactions (SNI) in a developing neural network in brain cultures on multielectrode arrays (Christopoulos et al. in J Neural Eng 9:046008, 2012). Here, we report on the effects of apolipoprotein E4 (apoE4) on these neural interactions. We carried out six experiments (five using rodent brain cultures and one using neuroblastoma cultures) in which we recorded local field potentials (LFP) from 59 sites for several days in vitro under the following conditions. In one experiment, we added to the culture media triglyceride (TG)-rich lipoproteins from a human subject with the apoE4/4 genotype, whereas in the other experiments, we added recombinant human apoE4. We found that SNI in the apoE4-treated cultures had higher coefficient of SNI variation, as compared to control cultures. These findings further document the role of SNI as a fundamental aspect of the dynamic organization of neural networks (Langheim et al. in Proc Natl Acad Sci USA 103:455-459, 2006. doi: 10.1073/pnas.0509623102 ; Georgopoulos et al. in J Neural Eng 4:349-355, 2007) and extend the effect of apoE4 on SNI (Leuthold et al. in Exp Brain Res 226:525-536, 2013) across different brain species (human, rodents), apoE source (TG-rich lipoproteins, recombinant), neural signals (MEG, LFP), and brain network (intact brain, developing brain in vitro). To our knowledge, this is the first study of the effects of apoE4 on neural network function in vitro.

A biologically plausible computational theory for value integration and action selection in decisions with competing alternatives.

Decision making is a vital component of human and animal behavior that involves selecting between alternative options and generating actions to implement the choices. Although decisions can be as simple as choosing a goal and then pursuing it, humans and animals usually have to make decisions in dynamic environments where the value and the availability of an option change unpredictably with time and previous actions. A predator chasing multiple prey exemplifies how goals can dynamically change and compete during ongoing actions. Classical psychological theories posit that decision making takes place within frontal areas and is a separate process from perception and action. However, recent findings argue for additional mechanisms and suggest the decisions between actions often emerge through a continuous competition within the same brain regions that plan and guide action execution. According to these findings, the sensorimotor system generates concurrent action-plans for competing goals and uses online information to bias the competition until a single goal is pursued. This information is diverse, relating to both the dynamic value of the goal and the cost of acting, creating a challenging problem in integrating information across these diverse variables in real time. We introduce a computational framework for dynamically integrating value information from disparate sources in decision tasks with competing actions. We evaluated the framework in a series of oculomotor and reaching decision tasks and found that it captures many features of choice/motor behavior, as well as its neural underpinnings that previously have eluded a common explanation.

Spatiotemporal neural interactions underlying continuous drawing movements as revealed by magnetoencephalography.

Continuous and sequential movements are controlled by widely distributed brain regions. A series of studies have contributed to understanding the functional role of these regions in a variety of visuomotor tasks. However, little is known about the neural interactions underpinning continuous movements. In the current study, we examine the spatiotemporal neural interactions underlying continuous drawing movements and the association of them with behavioral components. We conducted an experiment in which subjects copied a pentagon continuously for ~45 s using an XY joystick, while neuromagnetic fluxes were recorded from their head using a 248-sensor whole-head magnetoencephalography (MEG) device. Each sensor time series was rendered stationary and non-autocorrelated by applying an autoregressive integrated moving average model and taking the residuals. We used the directional variability of the movement as a behavioral measure of the controls generated. The main objective of this study was to assess the relation between neural interactions and the variability of movement direction. That is, we divided the continuous recordings into consecutive periods (i.e., time-bins) of 51 steps duration and computed the pairwise cross-correlations between the prewhitened time series in each time-bin. The circular standard deviation of the movement direction within each time-bin provides an estimate of the directional variability of the 51-ms trajectory segment. We looked at the association between neural interactions and variability of movement direction, separately for each pair of sensors, by running a cross-correlation analysis between the strength of the MEG pairwise cross-correlations and the circular standard deviations. We identified two types of neuronal networks: in one, the neural interactions are correlated with the directional variability of the movement at negative time-lags (feedforward), and in the other, the neural interactions are correlated with the directional variability of the movement at positive time-lags (feedback). Sensors associated mostly with feedforward processes are distributed in the left hemisphere and the right occipital-temporal junction, whereas sensors related to feedback processes are distributed in the right hemisphere and the left cerebellar hemisphere. These results are in line with findings from a series of previous studies showing that specific brain regions are involved in feedforward and feedback control processes to plan, perform, and correct movements. Additionally, we looked at whether changes in movement direction modulate the neural interactions. Interestingly, we found a preponderance of sensors associated with changes in movement direction over the right hemisphere-ipsilateral to the moving hand. These sensors exhibit stronger coupling with the rest of the sensors for trajectory segments with high rather than low directional movement variability. We interpret these results as evidence that ipsilateral cortical regions are recruited for continuous movements when the curvature of the trajectory increases. To the best of our knowledge, this is the first study that shows how neural interactions are associated with a behavioral control parameter in continuous and sequential movements.

An optimal feedback control framework for grasping objects with position uncertainty.

As we move, the relative location between our hands and objects changes in uncertain ways due to noisy motor commands and imprecise and ambiguous sensory information. The impressive capabilities humans display for interacting and manipulating objects with position uncertainty suggest that our brain maintains representations of location uncertainty and builds compensation for uncertainty into its motor control strategies. Our previous work demonstrated that specific control strategies are used to compensate for location uncertainty. However, it is an open question whether compensation for position uncertainty in grasping is consistent with the stochastic optimal feedback control, mainly due to the difficulty of modeling natural tasks within this framework. In this study, we develop a stochastic optimal feedback control model to evaluate the optimality of human grasping strategies. We investigate the properties of the model through a series of simulation experiments and show that it explains key aspects of previously observed compensation strategies. It also provides a basis for individual differences in terms of differential control costs-the controller compensates only to the extent that performance benefits in terms of making stable grasps outweigh the additional control costs of compensation. These results suggest that stochastic optimal feedback control can be used to understand uncertainty compensation in complex natural tasks like grasping.

Grasping objects with environmentally induced position uncertainty.

Due to noisy motor commands and imprecise and ambiguous sensory information, there is often substantial uncertainty about the relative location between our body and objects in the environment. Little is known about how well people manage and compensate for this uncertainty in purposive movement tasks like grasping. Grasping objects requires reach trajectories to generate object-fingers contacts that permit stable lifting. For objects with position uncertainty, some trajectories are more efficient than others in terms of the probability of producing stable grasps. We hypothesize that people attempt to generate efficient grasp trajectories that produce stable grasps at first contact without requiring post-contact adjustments. We tested this hypothesis by comparing human uncertainty compensation in grasping objects against optimal predictions. Participants grasped and lifted a cylindrical object with position uncertainty, introduced by moving the cylinder with a robotic arm over a sequence of 5 positions sampled from a strongly oriented 2D Gaussian distribution. Preceding each reach, vision of the object was removed for the remainder of the trial and the cylinder was moved one additional time. In accord with optimal predictions, we found that people compensate by aligning the approach direction with covariance angle to maintain grasp efficiency. This compensation results in higher probability to achieve stable grasps at first contact than non-compensation strategies in grasping objects with directional position uncertainty, and the results provide the first demonstration that humans compensate for uncertainty in a complex purposive task.