A CW-CNN regression model-based real-time system for virtual hand control.

For upper limb amputees, wearing a myoelectric prosthetic hand is the only way for them to continue normal life. Even until now, the proposal of a high-precision and natural performance real-time control system based on surface electromyography (sEMG) signals is still challenging. Researchers have proposed many strategies for motion classification or regression prediction tasks based on sEMG signals. However, most of them have been limited to offline analysis only. There are even few papers on real-time control based on deep learning models, almost all of which are about motion classification. Rare studies tried to use deep learning-based regression models in real-time control systems for multi-joint angle estimation via sEMG signals. This paper proposed a CW-CNN regression model-based real-time control system for virtual hand control. We designed an Adaptive Kalman Filter to smooth the joint angles output before sending them as control commands to control a virtual hand. Eight healthy participants were invited, and three sessions experiments were conducted on two different days for all of them. During the real-time experiment, we analyzed the joint angles estimation accuracy and computational latency. Moreover, target achievement control (TAC) test was applied to emphasize motion regression in real-time. The experimental results show that the proposed control system has high precision for 3-DOFs motion regression in simultaneously, and the system remains stable and low computational latency. In the future, the proposed real-time control system can be applied to actual prosthetic hand.

Constructing Brain Connectivity Model Using Causal Network Reconstruction Approach.

Studying brain function is a challenging task. In the past, we could only study brain anatomical structures post-mortem, or infer brain functions from clinical data of patients with a brain injury. Nowadays technology, such as functional magnetic resonance imaging (fMRI), enable non-invasive brain activity observation. Several approaches have been proposed to interpret brain activity data. The brain connectivity model is a graphical tool that represents the interaction between brain regions, during certain states. It depicts how a brain region cause changes to other parts of the brain, which can be implied as information flow. This model can be used to help interpret how the brain works. There are several mathematical frameworks that can be used to infer the connectivity model from brain activity signals. Granger causality is one such approach and is one of the first that has been applied to brain activity data. However, due to the concept of the framework, such as the use of pairwise correlation, combined with the limitation of brain activity data such as low temporal resolution in case of fMRI signal, makes the interpretation of the connectivity difficult. We therefore propose the application of the Tigramite causal discovery framework on fMRI data. The Tigramite framework uses measures such as causal effect to analyze causal relations in the system. This enables the framework to identify both direct and indirect pathways or connectivities. In this paper, we applied the framework to the Human Connectome Project motor task-fMRI dataset. We then present the results and discuss how the framework improves interpretability of the connectivity model. We hope that this framework will help us understand more complex brain functions such as memory, consciousness, or the resting-state of the brain, in the future.

Generation of diverse insect-like gait patterns using networks of coupled Rössler systems.

The generation of walking patterns is central to bio-inspired robotics and has been attained using methods encompassing diverse numerical as well as analog implementations. Here, we demonstrate the possibility of synthesizing viable gaits using a paradigmatic low-dimensional non-linear entity, namely, the Rössler system, as a dynamical unit. Through a minimalistic network wherein each instance is univocally associated with one leg, it is possible to readily reproduce the canonical gaits as well as generate new ones via changing the coupling scheme and the associated delays. Varying levels of irregularity can be introduced by rendering individual systems or the entire network chaotic. Moreover, through tailored mapping of the state variables to physical angles, adequate leg trajectories can be accessed directly from the coupled systems. The functionality of the resulting generator was confirmed in laboratory experiments by means of an instrumented six-legged ant-like robot. Owing to their simple form, the 18 coupled equations could be rapidly integrated on a bare-metal microcontroller, leading to the demonstration of real-time robot control navigating an arena using a brain-machine interface.

Behavioral and physiological correlates of kinetically tracking a chaotic target.

Humans can innately track a moving target by anticipating its future position from a brief history of observations. While ballistic trajectories can be readily extrapolated, many natural and artificial systems are governed by more general nonlinear dynamics and, therefore, can produce highly irregular motion. Yet, relatively little is known regarding the behavioral and physiological underpinnings of prediction and tracking in the presence of chaos. Here, we investigated in lab settings whether participants could manually follow the orbit of a paradigmatic chaotic system, the Rössler equations, on the (x,y) plane under different settings of a control parameter, which determined the prominence of transients in the target position. Tracking accuracy was negatively related to the level of unpredictability and folding. Nevertheless, while participants initially reacted to the transients, they gradually learned to anticipate it. This was accompanied by a decrease in muscular co-contraction, alongside enhanced activity in the theta and beta EEG bands for the highest levels of chaoticity. Furthermore, greater phase synchronization of breathing was observed. Taken together, these findings point to the possible ability of the nervous system to implicitly learn topological regularities even in the context of highly irregular motion, reflecting in multiple observables at the physiological level.

Utilizing sensory prediction errors for movement intention decoding: A new methodology.

We propose a new methodology for decoding movement intentions of humans. This methodology is motivated by the well-documented ability of the brain to predict sensory outcomes of self-generated and imagined actions using so-called forward models. We propose to subliminally stimulate the sensory modality corresponding to a user's intended movement, and decode a user's movement intention from his electroencephalography (EEG), by decoding for prediction errors-whether the sensory prediction corresponding to a user's intended movement matches the subliminal sensory stimulation we induce. We tested our proposal in a binary wheelchair turning task in which users thought of turning their wheelchair either left or right. We stimulated their vestibular system subliminally, toward either the left or the right direction, using a galvanic vestibular stimulator and show that the decoding for prediction errors from the EEG can radically improve movement intention decoding performance. We observed an 87.2% median single-trial decoding accuracy across tested participants, with zero user training, within 96 ms of the stimulation, and with no additional cognitive load on the users because the stimulation was subliminal.

Real-Time Control of a Video Game Using Eye Movements and Two Temporal EEG Sensors.

EEG-controlled gaming applications range widely from strictly medical to completely nonmedical applications. Games can provide not only entertainment but also strong motivation for practicing, thereby achieving better control with rehabilitation system. In this paper we present real-time control of video game with eye movements for asynchronous and noninvasive communication system using two temporal EEG sensors. We used wavelets to detect the instance of eye movement and time-series characteristics to distinguish between six classes of eye movement. A control interface was developed to test the proposed algorithm in real-time experiments with opened and closed eyes. Using visual feedback, a mean classification accuracy of 77.3% was obtained for control with six commands. And a mean classification accuracy of 80.2% was obtained using auditory feedback for control with five commands. The algorithm was then applied for controlling direction and speed of character movement in two-dimensional video game. Results showed that the proposed algorithm had an efficient response speed and timing with a bit rate of 30 bits/min, demonstrating its efficacy and robustness in real-time control.