Punishment Leads to Greater Sensorimotor Learning But Less Movement Variability Compared to Reward.

When a musician practices a new song, hitting a correct note sounds pleasant while striking an incorrect note sounds unpleasant. Such reward and punishment feedback has been shown to differentially influence the ability to learn a new motor skill. Recent work has suggested that punishment leads to greater movement variability, which causes greater exploration and faster learning. To further test this idea, we collected 102 participants over two experiments. Unlike previous work, in Experiment 1 we found that punishment did not lead to faster learning compared to reward (n = 68), but did lead to a greater extent of learning. Surprisingly, we also found evidence to suggest that punishment led to less movement variability, which was related to the extent of learning. We then designed a second experiment that did not involve adaptation, allowing us to further isolate the influence of punishment feedback on movement variability. In Experiment 2, we again found that punishment led to significantly less movement variability compared to reward (n = 34). Collectively our results suggest that punishment feedback leads to less movement variability. Future work should investigate whether punishment feedback leads to a greater knowledge of movement variability and or increases the sensitivity of updating motor actions.

Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds.

From a baby's babbling to a songbird practising a new tune, exploration is critical to motor learning. A hallmark of exploration is the emergence of random walk behaviour along solution manifolds, where successive motor actions are not independent but rather become serially dependent. Such exploratory random walk behaviour is ubiquitous across species' neural firing, gait patterns and reaching behaviour. The past work has suggested that exploratory random walk behaviour arises from an accumulation of movement variability and a lack of error-based corrections. Here, we test a fundamentally different idea-that reinforcement-based processes regulate random walk behaviour to promote continual motor exploration to maximize success. Across three human reaching experiments, we manipulated the size of both the visually displayed target and an unseen reward zone, as well as the probability of reinforcement feedback. Our empirical and modelling results parsimoniously support the notion that exploratory random walk behaviour emerges by utilizing knowledge of movement variability to update intended reach aim towards recently reinforced motor actions. This mechanism leads to active and continuous exploration of the solution manifold, currently thought by prominent theories to arise passively. The ability to continually explore muscle, joint and task redundant solution manifolds is beneficial while acting in uncertain environments, during motor development or when recovering from a neurological disorder to discover and learn new motor actions.

Visual accuracy dominates over haptic speed for state estimation of a partner during collaborative sensorimotor interactions.

We routinely have physical interactions with others, whether it be handing someone a glass of water or jointly moving a heavy object together. These sensorimotor interactions between humans typically rely on visual feedback and haptic feedback. Recent single-participant studies have highlighted that the unique noise and time delays of each sense must be considered to estimate the state, such as the position and velocity, of one's own movement. However, we know little about how visual feedback and haptic feedback are used to estimate the state of another person. Here, we tested how humans utilize visual feedback and haptic feedback to estimate the state of their partner during a collaborative sensorimotor task. Across two experiments, we show that visual feedback dominated haptic feedback during collaboration. Specifically, we found that visual feedback led to comparatively lower task-relevant movement variability, smoother collaborative movements, and faster trial completion times. We also developed an optimal feedback controller that considered the noise and time delays of both visual feedback and haptic feedback to estimate the state of a partner. This model was able to capture both lower task-relevant movement variability and smoother collaborative movements. Taken together, our empirical and modeling results support the idea that visual accuracy is more important than haptic speed to perform state estimation of a partner during collaboration.NEW & NOTEWORTHY Physical collaboration between two or more individuals involves both visual and haptic feedback. Here, we investigated how visual and haptic feedback is used to estimate the movements of a partner during a collaboration task. Our experimental and computational modeling results parsimoniously support the notion that greater visual accuracy is more important than faster yet noisier haptic feedback when estimating the state of a partner.

The sensorimotor system modulates muscular co-contraction relative to visuomotor feedback responses to regulate movement variability.

The naturally occurring variability in our movements often poses a significant challenge when attempting to produce precise and accurate actions, which is readily evident when playing a game of darts. Two differing, yet potentially complementary, control strategies that the sensorimotor system may use to regulate movement variability are impedance control and feedback control. Greater muscular co-contraction leads to greater impedance that acts to stabilize the hand, while visuomotor feedback responses can be used to rapidly correct for unexpected deviations when reaching toward a target. Here, we examined the independent roles and potential interplay of impedance control and visuomotor feedback control when regulating movement variability. Participants were instructed to perform a precise reaching task by moving a cursor through a narrow visual channel. We manipulated cursor feedback by visually amplifying movement variability and/or delaying the visual feedback of the cursor. We found that participants decreased movement variability by increasing muscular co-contraction, aligned with an impedance control strategy. Participants displayed visuomotor feedback responses during the task but, unexpectedly, there was no modulation between conditions. However, we did find a relationship between muscular co-contraction and visuomotor feedback responses, suggesting that participants modulated impedance control relative to feedback control. Taken together, our results highlight that the sensorimotor system modulates muscular co-contraction, relative to visuomotor feedback responses, to regulate movement variability and produce accurate actions.NEW & NOTEWORTHY The sensorimotor system has the constant challenge of dealing with the naturally occurring variability in our movements. Here, we investigated the potential roles of muscular co-contraction and visuomotor feedback responses to regulate movement variability. When we visually amplified movements, we found that the sensorimotor system primarily uses muscular co-contraction to regulate movement variability. Interestingly, we found that muscular co-contraction was modulated relative to inherent visuomotor feedback responses, suggesting an interplay between impedance and feedback control.

Accuracy and effort costs together lead to temporal asynchrony of multiple motor commands.

The timing of motor commands is critical for task performance. A well-known example is rapidly raising the arm while standing upright. Here, reaction forces from the arm movement to the body are countered by leg and trunk muscle activity starting before any sensory feedback from the perturbation and often before the onset of arm muscle activity. Despite decades of research on the patterns, modifiability, and neural basis of these "anticipatory postural adjustments," it remains unclear why asynchronous motor commands occur. Simple accuracy considerations appear unlikely since temporally advanced motor commands displace the body from its initial position. Effort is a credible and overlooked factor that has successfully explained coordination patterns of many behaviors including gait and reaching. We provide the first use of optimal control to address this question. Feedforward commands were applied to a body mass mechanically linked to a rapidly moving limb mass. We determined the feedforward actions with the lowest cost according to an explicit criterion, accuracy alone versus accuracy + effort. Accuracy costs alone led to synchronous activation of the body and limb controllers. Adding effort to the cost resulted in body commands preceding limb commands. This sequence takes advantage of the body's momentum in one direction to counter the limb's reaction force in the opposite direction, allowing a lower peak command and lower integral. With a combined accuracy + effort cost, temporal advancement was further impacted by various task goals and plant dynamics, replicating previous findings and suggesting further studies using optimal control principles.NEW & NOTEWORTHY An important goal in the fields of sensorimotor neuroscience and biomechanics is to explain the timing of different muscles during behavior. Here, we propose that energy and accuracy considerations underlie the asynchronous onset of postural and arm muscles during rapid movement. Our novel model-based framework replicates a broad range of observations across varying task demands and plant dynamics and offers a new perspective to study motor timing.

Humans utilize sensory evidence of others' intended action to make online decisions.

We often acquire sensory information from another person's actions to make decisions on how to move, such as when walking through a crowded hallway. Past interactive decision-making research has focused on cognitive tasks that did not allow for sensory information exchange between humans prior to a decision. Here, we test the idea that humans accumulate sensory evidence of another person's intended action to decide their own movement. In a competitive sensorimotor task, we show that humans exploit time to accumulate sensory evidence of another's intended action and utilize this information to decide how to move. We captured this continuous interactive decision-making behaviour with a drift-diffusion model. Surprisingly, aligned with a 'paralysis-by-analysis' phenomenon, we found that humans often waited too long to accumulate sensory evidence and failed to make a decision. Understanding how humans engage in interactive and online decision-making has broad implications that spans sociology, athletics, interactive technology, and economics.

Knee muscle co-contractions are greater in old compared to young adults during walking and stair use.

BACKGROUND: Muscle co-contraction is an accepted clinical measure to quantify the effects of aging on neuromuscular control and movement efficiency. However, evidence of increased muscle co-contraction in old compared to young adults remains inconclusive. RESEARCH QUESTION: Are there differences in lower-limb agonist/antagonist muscle co-contractions in young and old adults, and males and females, during walking and stair use? METHODS: In a retrospective study, we analyzed data from 20 healthy young and 19 healthy old adults during walking, stair ascent, and stair descent at self-selected speeds, including marker trajectories, ground reaction force, and electromyography activity. We calculated muscle co-contraction at the knee (vastus lateralis vs. biceps femoris) and ankle (tibialis anterior vs. medial gastrocnemius) using the ratio of the common area under a muscle pairs' filtered and normalized electromyography curves to the sum of the areas under each muscle in that pair. RESULTS: Old compared to young adults displayed 18%-22% greater knee muscle co-contractions during the entire cycle of stair use activities. We found greater (17%-29%) knee muscle co-contractions in old compared to young adults during the swing phase of walking and stair use. We found no difference in ankle muscle co-contractions between the two age groups during all three activities. We found no difference in muscle co-contraction between males and females at the knee and ankle joints for all three activities. SIGNIFICANCE: Based on our findings, we recommend clinical evaluation to quantify the effects of aging through muscle co-contraction to include the knee joint during dynamic activities like walking and stair use, and independent evaluation of the stance and swing phases.