Developmental Changes of Muscle Synergies in an Infant's Walking.

Primitive stepping is one of the primitive reflexes in newborns in response to external stimuli. It is known that primitive stepping disappears about two months after birth, but its role and the relationship with voluntary gait acquired later are still unknown. In this study, we extracted muscle synergies, spatiotemporal coordination patterns of muscle activities, from EMG measured in one infant during growth (4-18 weeks of age) using non-negative matrix factorization (NMF). We found that a synergy changed before and after the disappearance of the primitive stepping, and others maintained the recruited muscles but changed the onset timing of the activations.

Behavioral and neuro-cognitive bases for emergence of norms and socially shared realities via dynamic interaction.

In the digital era, new socially shared realities and norms emerge rapidly, whether they are beneficial or harmful to our societies. Although these are emerging properties from dynamic interaction, most research has centered on static situations where isolated individuals face extant norms. We investigated how perceptual norms emerge endogenously as shared realities through interaction, using behavioral and fMRI experiments coupled with computational modeling. Social interactions fostered convergence of perceptual responses among people, not only overtly but also at the covert psychophysical level that generates overt responses. Reciprocity played a critical role in increasing the stability (reliability) of the psychophysical function within each individual, modulated by neural activity in the mentalizing network during interaction. These results imply that bilateral influence promotes mutual cognitive anchoring of individual views, producing shared generative models at the collective level that enable endogenous agreement on totally new targets-one of the key functions of social norms.

Characterizing Strategic Contributions of Physical Therapy to Natural Standing Motion in the Muscle Synergy Space.

Understanding the contributions of therapist skill during intervention is essential for improving existing rehabilitation methodologies. This study aims to characterize therapist intervention on an important activity of daily living, the sit-to-stand motion. Using the concept of muscle synergy, we quantify and compare naturally-occurring standing strategies with those induced by a physical therapist. In this paper, we show that natural standing strategies are not shared among healthy subjects. However, each subject retains their own set of strategies. Moreover, the results suggest that a therapist does not introduce new strategies during therapy, but rather modulates the existing strategies of the individuals. Using such a low-dimensional representation of standing behavior allows for development of low-cost tools for wider distribution.

Analysis of effective sit-to-stand therapy using kinematic synergies.

Understanding effective sit-to-stand (STS) movement is essential for improving rehabilitation strategies and developing services for the rapidly increasing number of elderly people. This study aims at identifying effective STS therapy by analyzing the kinematic synergies of movements induced by therapists of different skill-levels. Three synergies were found to share the same temporal pattern in both joint angles and center-of-mass spaces across all therapists. Effective strategy used by a skilled therapist and strategy flaws of less-experienced therapists were revealed through comparison of spatial patterns.

Modeling dynamic high-DOF finger postures from surface EMG using nonlinear synergies in latent space representation.

Accurate proportional myoelectric control of the hand is important in replicating dexterous manipulation in robot prostheses and orthoses. However, this is still difficult to achieve due to the complex and high degree-of-freedom (DOF) nature present in the governing musculoskeletal system. To address this problem, we suggest using a low dimensional encoding based on nonlinear synergies to represent both the high-DOF finger joint kinematics and the coordination of muscle activities taken from surface electromyographic (EMG) signals. Generating smooth multi-finger movements using EMG inputs is then done by using a shared Gaussian Process latent variable model that learns a dynamical model between both the kinematic and EMG data represented in a shared latent space. The experimental results show that the method is able to synthesize continuous movements of a full five-finger hand model, with total dimensions as large as 69 (although highly redundant and correlated). Finally, by comparing the estimation performances when the number of EMG latent dimensions are varied, we show that these synergistic features can capture the variance, shared and specific to the observed kinematics.

Continuous and simultaneous estimation of finger kinematics using inputs from an EMG-to-muscle activation model.

BACKGROUND: Surface electromyography (EMG) signals are often used in many robot and rehabilitation applications because these reflect motor intentions of users very well. However, very few studies have focused on the accurate and proportional control of the human hand using EMG signals. Many have focused on discrete gesture classification and some have encountered inherent problems such as electro-mechanical delays (EMD). Here, we present a new method for estimating simultaneous and multiple finger kinematics from multi-channel surface EMG signals. METHOD: In this study, surface EMG signals from the forearm and finger kinematic data were extracted from ten able-bodied subjects while they were tasked to do individual and simultaneous multiple finger flexion and extension movements in free space. Instead of using traditional time-domain features of EMG, an EMG-to-Muscle Activation model that parameterizes EMD was used and shown to give better estimation performance. A fast feed forward artificial neural network (ANN) and a nonparametric Gaussian Process (GP) regressor were both used and evaluated to estimate complex finger kinematics, with the latter rarely used in the other related literature. RESULTS: The estimation accuracies, in terms of mean correlation coefficient, were 0.85 ± 0.07, 0.78 ± 0.06 and 0.73 ± 0.04 for the metacarpophalangeal (MCP), proximal interphalangeal (PIP) and the distal interphalangeal (DIP) finger joint DOFs, respectively. The mean root-mean-square error in each individual DOF ranged from 5 to 15%. We show that estimation improved using the proposed muscle activation inputs compared to other features, and that using GP regression gave better estimation results when using fewer training samples. CONCLUSION: The proposed method provides a viable means of capturing the general trend of finger movements and shows a good way of estimating finger joint kinematics using a muscle activation model that parameterizes EMD. The results from this study demonstrates a potential control strategy based on EMG that can be applied for simultaneous and continuous control of multiple DOF(s) devices such as robotic hand/finger prostheses or exoskeletons.

Assist-as-needed robotic trainer based on reinforcement learning and its application to dart-throwing.

This paper proposes a novel robotic trainer for motor skill learning. It is user-adaptive inspired by the assist-as-needed principle well known in the field of physical therapy. Most previous studies in the field of the robotic assistance of motor skill learning have used predetermined desired trajectories, and it has not been examined intensively whether these trajectories were optimal for each user. Furthermore, the guidance hypothesis states that humans tend to rely too much on external assistive feedback, resulting in interference with the internal feedback necessary for motor skill learning. A few studies have proposed a system that adjusts its assistive strength according to the user's performance in order to prevent the user from relying too much on the robotic assistance. There are, however, problems in these studies, in that a physical model of the user's motor system is required, which is inherently difficult to construct. In this paper, we propose a framework for a robotic trainer that is user-adaptive and that neither requires a specific desired trajectory nor a physical model of the user's motor system, and we achieve this using model-free reinforcement learning. We chose dart-throwing as an example motor-learning task as it is one of the simplest throwing tasks, and its performance can easily be and quantitatively measured. Training experiments with novices, aiming at maximizing the score with the darts and minimizing the physical robotic assistance, demonstrate the feasibility and plausibility of the proposed framework.

Estimation of continuous multi-DOF finger joint kinematics from surface EMG using a multi-output Gaussian Process.

Surface electromyographic (EMG) signals have often been used in estimating upper and lower limb dynamics and kinematics for the purpose of controlling robotic devices such as robot prosthesis and finger exoskeletons. However, in estimating multiple and a high number of degrees-of-freedom (DOF) kinematics from EMG, output DOFs are usually estimated independently. In this study, we estimate finger joint kinematics from EMG signals using a multi-output convolved Gaussian Process (Multi-output Full GP) that considers dependencies between outputs. We show that estimation of finger joints from muscle activation inputs can be improved by using a regression model that considers inherent coupling or correlation within the hand and finger joints. We also provide a comparison of estimation performance between different regression methods, such as Artificial Neural Networks (ANN) which is used by many of the related studies. We show that using a multi-output GP gives improved estimation compared to multi-output ANN and even dedicated or independent regression models.

Control of an optimal finger exoskeleton based on continuous joint angle estimation from EMG signals.

Patients suffering from loss of hand functions caused by stroke and other spinal cord injuries have driven a surge in the development of wearable assistive devices in recent years. In this paper, we present a system made up of a low-profile, optimally designed finger exoskeleton continuously controlled by a user's surface electromyographic (sEMG) signals. The mechanical design is based on an optimal four-bar linkage that can model the finger's irregular trajectory due to the finger's varying lengths and changing instantaneous center. The desired joint angle positions are given by the predictive output of an artificial neural network with an EMG-to-Muscle Activation model that parameterizes electromechanical delay (EMD). After confirming good prediction accuracy of multiple finger joint angles we evaluated an index finger exoskeleton by obtaining a subject's EMG signals from the left forearm and using the signal to actuate a finger on the right hand with the exoskeleton. Our results show that our sEMG-based control strategy worked well in controlling the exoskeleton, obtaining the intended positions of the device, and that the subject felt the appropriate motion support from the device.

Continuous estimation of finger joint angles using muscle activation inputs from surface EMG signals.

Prediction of dynamic hand finger movements has many clinical and engineering applications in the control of human interface devices such as those used in virtual reality control, robot prosthesis and rehabilitation aids. Surface electromyography (sEMG) signals have often been used in the mentioned applications because these reflect the motor intention of users very well. In this study, we present a method to estimate the finger joint angles of a hand from sEMG signals that considers electromechanical delay (EMD), which is inherent when EMG signals are captured alongside motion data. We use the muscle activation obtained from the sEMG signals as input to a neural network. In this muscle activation model, the EMD is parameterized and automatically obtained through optimization. With this method, we can predict the finger joint angles with sEMG signals in both periodic and nonperiodic free movements of the flexion and extension movement of the fingers. Our results show correlation as high as 0.92 between the actual and predicted metacarpophalangeal (MCP) joint angles for periodic finger flexion movements, and as high as 0.85 for nonperiodic movements, which are more dynamic and natural.

Throwing darts utilizes the interaction torque of the elbow joint.

Acquiring the skillful movements of experts is a difficult task in many fields. If we find quantitative indices of skillful movement, we can develop an adaptive training system using the indices. We focused on throwing darts in our previous study. It was found that optimization criteria of sum of squared joint torque changes over time was negatively correlated with subject's scores, suggesting that the experts optimally controlled the shoulder elevations and rotation around the elbow joint in terms of dynamics. In this study, we investigate the relationship between the skill level of subjects and their utilization joint torque components such as the muscular torque, interaction torque and gravity torque. It is shown found that the sum of squared joint torque components of the subjects correlates with their scores, suggesting that the subjects who can take higher scores utilize the interaction torque of the elbow joint without shoulder displacement.

Comparison of experts and non-experts in throwing darts based on optimization criteria.

Acquiring skillful movements of experts is a difficult task in many fields. Since non-experts often fail to find out how to improve their skill, it is desirable to find quantitative indices of skillful movements that clarify the difference between experts and non-experts. If we find quantitative indices, we can develop an adaptive training system using the indices. In this study, we quantitatively compare dart-throwing movements between experts and non-experts based on their scores, motions, and EMG signals. First, we show that the variance of upper-limb motion trajectories of the experts is significantly smaller than that of the non-experts. Then, we show that the displacement and the variance of the shoulder of the experts are also significantly smaller than those of the non-experts. The final result is the highlight of this study. We investigated their upper-limb motions from the viewpoint of trajectory optimization. In this study, we focus on two popular optimization criteria, i.e., sum of squared jerk over a trajectory and sum of squared joint-torque change over a trajectory. We present that the sum of squared joint torques of the subjects was negatively correlated with their scores (p < 0.05), whereas the other criteria were not.